ZipRecruiter

Log In

2

Remote Ai Infrastructure Engineer Jobs (NOW HIRING)

OVA.Work

AI Infrastructure Engineer

$110K - $144K/yr

Work is seeking an AI Infrastructure Engineer to design, implement, and manage the infrastructure that powers AI and machine learning workloads. The role involves building scalable and secure ...

Utilidata

AI Infrastructure Engineer

Ann Arbor, MI · Remote

$170K - $210K/yr

The AI Infrastructure Engineer is responsible for designing, building, and owning the end-to-end ... fully remote candidates, with periodic travel expected for company retreats and key on-site ...

vCluster Labs

AI Infrastructure Engineer

New York, NY · Remote

$150K - $200K/yr

As an AI Infrastructure Engineer, your role will include: * Lead Technical Deployments: Drive end ... and we have a remote-first work culture. We are the leading platform for operating GPU ...

Percepta

AI Infrastructure Engineer

$110K - $144K/yr

They are seeking an AI Infrastructure Engineer to own the infrastructure and operational reliability that powers their AI systems, focusing on defining infrastructure patterns and building ...

Berkeley Research Group

AI Lab Infrastructure Engineer

$110K - $144K/yr

About the Role As an AI Infrastructure Engineer, you will architect and build the virtual access ... Build scalable remote processing capabilities supporting 100,000+ documents per day * Create ...

Biohub

Staff AI Infrastructure Engineer

Redwood City, CA · On-site +1

$131K - $172K/yr

Achieving that requires training frontier-scale AI biology models, and that demands reliable, high-performance compute infrastructure. This is production engineering work at a frontier AI lab, with ...

Workato

Senior Infrastructure Engineer (Core Infra, US)

OR · On-site +1

$180K - $240K/yr

... and AI into a single, governed platform. A leader in Enterprise MCP and trusted by 50% of the ... Quartz ranked us the #1 best company for remote workers We are hiring a Senior Infrastructure ...

next page

Showing results 1-20

All JobsAi Infrastructure Engineer JobsRemote Ai Infrastructure Engineer Jobs

Remote Ai Infrastructure Engineer information

See salary details

$46.5K

$127.1K

$182K

How much do remote ai infrastructure engineer jobs pay per year?

As of Jul 20, 2026, the average yearly pay for remote ai infrastructure engineer in the United States is $127,066.00, according to ZipRecruiter salary data. Most workers in this role earn between $107,500.00 and $141,000.00 per year, depending on experience, location, and employer.

What are the key skills and qualifications needed to thrive as a Remote AI Infrastructure Engineer, and why are they important?

To thrive as a Remote AI Infrastructure Engineer, you need expertise in cloud computing, distributed systems, and software engineering, often supported by a degree in computer science or a related field. Familiarity with tools like Kubernetes, Docker, Terraform, and cloud platforms such as AWS, Azure, or GCP is typically required, along with knowledge of CI/CD pipelines and AI/ML frameworks. Strong problem-solving skills, self-motivation, and effective remote communication are essential soft skills for success in this role. These skills ensure robust, scalable AI infrastructure that supports rapid innovation and seamless collaboration across distributed teams.

What is a Remote AI Infrastructure Engineer?

A Remote AI Infrastructure Engineer is a professional who designs, builds, and maintains the systems and tools necessary to support artificial intelligence (AI) projects, all while working remotely. Their responsibilities often include developing and optimizing cloud or on-premise infrastructure, ensuring scalability, managing data pipelines, and supporting machine learning workflows. They work closely with data scientists and software engineers to ensure AI models can be efficiently trained, deployed, and monitored in production environments. The remote aspect allows them to perform these tasks from anywhere, using collaboration tools and cloud platforms.

What are some common challenges faced by Remote AI Infrastructure Engineers, and how can they be addressed?

Remote AI Infrastructure Engineers often encounter challenges such as managing distributed systems, ensuring robust data pipelines, and maintaining high system reliability across different time zones. Collaboration with cross-functional teams can require clear communication and effective use of remote tools. To address these challenges, it's important to establish strong documentation practices, schedule regular check-ins, and utilize automated monitoring and deployment solutions. Staying proactive and adaptable helps ensure seamless infrastructure performance and team alignment.
More about Remote Ai Infrastructure Engineer jobs
What cities are hiring for Remote Ai Infrastructure Engineer jobs? Cities with the most Remote Ai Infrastructure Engineer job openings:
What are the most commonly searched types of Ai Infrastructure Engineer jobs? The most popular types of Ai Infrastructure Engineer jobs are:
What states have the most Remote Ai Infrastructure Engineer jobs? States with the most job openings for Remote Ai Infrastructure Engineer jobs include:
What job categories do people searching Remote Ai Infrastructure Engineer jobs look for? The top searched job categories for Remote Ai Infrastructure Engineer jobs are:
Remote Ai Infrastructure Engineer jobs near you
Infographic showing various Remote Ai Infrastructure Engineer job openings in the United States as of July 2026, with employment types broken down into 75% Full Time, 22% Part Time, and 3% Contract. Highlights an 66% Physical, 3% Hybrid, and 31% Remote job distribution, with an average salary of $127,066 per year, or $61.1 per hour.

AI Infrastructure Engineer

OVA.Work

Remote

$110K - $144K/yr

Full-time

Posted 14 days ago

Job description

Job Summary:
OVA.Work is seeking an AI Infrastructure Engineer to design, implement, and manage the infrastructure that powers AI and machine learning workloads. The role involves building scalable and secure environments for model training and deployment while optimizing resources and collaborating with cross-functional teams.
Responsibilities:
• Design, deploy, and maintain AI infrastructure across cloud and on-premises environments.
• Build and manage GPU-enabled compute clusters for machine learning training and inference.
• Implement scalable infrastructure for distributed AI workloads.
• Deploy and manage Kubernetes clusters for containerized AI applications.
• Automate infrastructure provisioning using Infrastructure as Code (IaC).
• Develop and maintain CI/CD pipelines for AI infrastructure and services.
• Optimize compute, storage, networking, and GPU utilization to improve performance and reduce costs.
• Monitor infrastructure health, availability, capacity, and performance using observability tools.
• Implement security best practices, identity management, secrets management, and compliance controls.
• Support AI model deployment platforms and inference infrastructure.
• Troubleshoot infrastructure, networking, and performance issues affecting AI workloads.
• Collaborate with AI engineers, ML engineers, data engineers, and cloud teams to improve platform reliability and scalability.
• Evaluate and implement emerging infrastructure technologies for AI workloads.
Qualifications:
Required:
• Bachelor's or Master's degree in Computer Science, Information Technology, Engineering, or a related field.
• 4+ years of experience in Infrastructure Engineering, Cloud Engineering, Platform Engineering, or DevOps.
• Strong experience with Linux system administration.
• Proficiency in Python, Bash, or Go for infrastructure automation.
• Hands-on experience with Docker and Kubernetes.
• Experience with one or more cloud platforms: AWS, Microsoft Azure, or Google Cloud Platform.
• Experience with Infrastructure as Code tools such as Terraform or Pulumi.
• Strong understanding of networking, storage, load balancing, and security.
• Experience with CI/CD tools such as GitHub Actions, GitLab CI, or Jenkins.
• Knowledge of monitoring and logging tools such as Prometheus, Grafana, ELK Stack, or OpenTelemetry.
Preferred:
• Experience managing NVIDIA GPU infrastructure and CUDA environments.
• Experience with distributed computing frameworks such as Ray, Apache Spark, or Slurm.
• Experience with AI model serving frameworks such as NVIDIA Triton Inference Server, KServe, or Ray Serve.
• Familiarity with MLOps tools such as MLflow, Kubeflow, or Airflow.
• Experience with vector databases and Generative AI infrastructure.
• Knowledge of storage technologies for AI workloads, including object storage and distributed file systems.
• Experience with high-performance computing (HPC) environments.
• Familiarity with infrastructure security, compliance, and governance standards.
• Experience supporting Large Language Models (LLMs) and Generative AI platforms.
• Experience with Retrieval-Augmented Generation (RAG) infrastructure.
• Knowledge of AI infrastructure cost optimization strategies.
• Experience with multi-cloud or hybrid-cloud deployments.
• Cloud, Kubernetes, or Linux certifications.
Company:
OVA is the most advanced Automated, Intelligent, intuitive On-boarding platform for Staffing Firms of all sizes. Founded in 2018, the company is headquartered in Alpharetta, USA, with a team of 51-200 employees. The company is currently Growth Stage.

Apply