1

Ai Infrastructure Engineer Jobs in California (NOW HIRING)

AI Infrastructure Engineer

Sunnyvale, CA · On-site

$125K - $164K/yr

The AI Infrastructure Engineer role involves ensuring the reliability and scalability of the AI model serving stack, while developing core engineering infrastructure to connect models to product ...

About the Role We are looking for an AI Infrastructure Engineer to own the entire software stack of our GPU clusters - from kernel tuning and GPU drivers up through schedulers, containers, and ML ...

New

Senior AI Infrastructure Engineer

Santa Clara, CA · On-site

$127K - $173K/yr

About the role We are seeking a Senior AI Infrastructure Engineer to design, build, and scale the high-performance AI platform powering our autonomous driving models. While researchers focus on ...

Senior AI Infrastructure Engineer

Santa Clara, CA · On-site

$127K - $173K/yr

About the role We are seeking a Senior AI Infrastructure Engineer to design, build, and scale the high-performance AI platform powering our autonomous driving models. While researchers focus on ...

AI Infrastructure Engineer

Fremont, CA · On-site

$126K - $165K/yr

Development and deployment of AI infrastructure workloads on-prem (GPU scheduling, model serving ... infra engineering Benefits * Medical Insurance * Dental Insurance * Vision Insurance * 401(k)

AI Infrastructure Engineer

Fremont, CA · On-site

$126K - $165K/yr

Development and deployment of AI infrastructure workloads on-prem (GPU scheduling, model serving ... infra engineering Benefits * Medical Insurance * Dental Insurance * Vision Insurance * 401(k)

AI Infrastructure Engineer

Fremont, CA · On-site

$117K - $154K/yr

Development and deployment of AI infrastructure workloads on-prem (GPU scheduling, model serving ... infra engineering Benefits * Medical Insurance * Dental Insurance * Vision Insurance * 401(k)

AI Infrastructure Engineer

San Francisco, CA · On-site

$126K - $166K/yr

Spellbrush, the world's leading generative AI studio behind niji・journey , is looking for an AI Infrastructure Engineer to join us in building out end-to-end ML infrastructure to run our models on ...

AI Infrastructure Engineer

San Francisco, CA · On-site

$126K - $166K/yr

Spellbrush, the world's leading generative AI studio behind niji・journey , is looking for an AI Infrastructure Engineer to join us in building out end-to-end ML infrastructure to run our models on ...

About the Position We are looking for a senior AI Inference Infrastructure Software Engineer with strong hands-on experience building, optimizing, and deploying high-performance, scalable inference ...

We are looking for a performance-obsessed AI Infrastructure Engineer to push LLM inference to its absolute limits on Intel's next-generation GPU architectures. In this role, you will dive deep into ...

New

We are looking for a performance-obsessed AI Infrastructure Engineer to push LLM inference to its absolute limits on Intel's next-generation GPU architectures. In this role, you will dive deep into ...

New

AI Infrastructure Engineer

San Jose, CA · On-site

$126K - $165K/yr

About the Position We are looking for a senior AI Inference Infrastructure Software Engineer with strong hands-on experience building, optimizing, and deploying high-performance, scalable inference ...

AI Infrastructure Engineer

San Jose, CA · On-site

$126K - $165K/yr

About the Position We are looking for a senior AI Inference Infrastructure Software Engineer with strong hands-on experience building, optimizing, and deploying high-performance, scalable inference ...

Achieving that requires training frontier-scale AI biology models, and that demands reliable, high-performance compute infrastructure. This is production engineering work at a frontier AI lab, with ...

Staff AI Infrastructure Engineer

Redwood City, CA · On-site +1

$131K - $172K/yr

Achieving that requires training frontier-scale AI biology models, and that demands reliable, high-performance compute infrastructure. This is production engineering work at a frontier AI lab, with ...

next page

Showing results 1-20

Ai Infrastructure Engineer information

See California salary details

$45.9K

$125.4K

$179.6K

How much do ai infrastructure engineer jobs pay per year?

As of Aug 9, 2026, the average yearly pay for ai infrastructure engineer in California is $125,402.00, according to ZipRecruiter salary data. Most workers in this role earn between $106,100.00 and $139,200.00 per year, depending on experience, location, and employer.

How much do AI infrastructure engineers make?

AI infrastructure engineers typically earn between $100,000 and $150,000 annually, depending on experience, location, and company size. Senior roles or those with specialized skills in cloud platforms and hardware may earn higher salaries, often exceeding $180,000.

What does a typical day look like for an AI infrastructure engineer?

A typical day for an AI Infrastructure Engineer often involves designing and maintaining the underlying systems that support machine learning and AI workloads, such as setting up scalable cloud environments, automating workflows with CI/CD pipelines, and troubleshooting performance bottlenecks. You might collaborate closely with data scientists and software engineers to ensure seamless integration between AI models and production infrastructure. Daily activities can include writing and reviewing infrastructure-as-code, monitoring system health, and responding to incidents or scaling requests as needed. This role offers a dynamic mix of hands-on technical work, problem-solving, and teamwork, providing opportunities to refine your skills and contribute meaningfully to cutting-edge AI projects.

What are the key skills and qualifications needed to thrive as an AI infrastructure engineer?

To thrive as an AI Infrastructure Engineer, a strong background in computer science, cloud computing, and distributed systems is typically required, often supported by a degree in a related field. Familiarity with tools like Kubernetes, Docker, TensorFlow, and cloud platforms (AWS, Azure, or GCP), along with certifications in cloud technologies or DevOps, is highly valuable. Strong problem-solving abilities, collaboration, and effective communication skills are essential to excel within multidisciplinary engineering teams. These competencies ensure the reliable deployment, scaling, and optimization of AI workloads in dynamic production environments.

What does an AI infrastructure engineer do?

An AI Infrastructure Engineer designs, builds, and maintains the computing systems that support AI and machine learning workloads. They manage cloud services, optimize hardware and software performance, and ensure scalability for AI models. Their work involves configuring GPUs, CPUs, storage, and networking, as well as automating workflows with DevOps and MLOps tools. They collaborate with data scientists and engineers to streamline AI development and deployment. Their goal is to create reliable, efficient, and scalable AI infrastructure.

What are the most commonly searched types of Ai Infrastructure Engineer jobs in California? The most popular types of Ai Infrastructure Engineer jobs in California are:
What job categories do people searching Ai Infrastructure Engineer jobs in California look for? The top searched job categories for Ai Infrastructure Engineer jobs in California are:
What cities in California are hiring for Ai Infrastructure Engineer jobs? Cities in California with the most Ai Infrastructure Engineer job openings:
Infographic showing various Ai Infrastructure Engineer job openings in California as of August 2026, with employment types broken down into 50% Full Time, and 50% Contract. Highlights an 100% In-person job distribution, with an average salary of $125,402 per year, or $60.3 per hour.

AI Infrastructure Engineer / MLOps

Eitacies Inc

San Francisco, CA • On-site

$50 - $60/hr

Full-time

Retirement

Re-posted 4 days ago


Job description

Benefits:
  • 401(k)

AI Infrastructure Engineer / MLOps
San Francisco Bay Area, CA (100% Onsite)
EITACIES is looking for an experienced AI Infrastructure Engineer to support large scale AI and machine learning platforms running in cloud native environments.
Responsibilities
  • Design, deploy, and support scalable AI/ML infrastructure platforms
  • Manage Kubernetes environments running in AWS EKS
  • Build and maintain infrastructure automation using Python and Ansible
  • Support MLOps workflows including model deployment, monitoring, and operationalization
  • Troubleshoot complex Linux-based production environments
  • Partner with engineering teams to improve platform reliability, scalability, and performance
  • Implement observability, monitoring, and operational best practices across AI systems
  • Support modern AI architectures and agent-based workflows
Required Skills
  • 10+ years of Linux systems administration and engineering experience
  • 10+ years of Python development and automation experience
  • 5+ years of Kubernetes administration and operations
  • 5+ years of AWS cloud experience, including AWS EKS
  • 5+ years of infrastructure automation using Ansible
  • Experience supporting production-scale distributed systems
  • Strong troubleshooting and performance optimization skills
  • Experience working in enterprise environments
Preferred Skills
  • Experience with MLOps platforms and machine learning infrastructure
  • Exposure to Agentic AI architectures and AI orchestration frameworks
  • Experience supporting LLM-based applications and AI workloads
  • Knowledge of infrastructure-as-code and DevOps best practices
  • Experience with monitoring, logging, and observability platforms