ZipRecruiter

Log In

1

Ai Infrastructure Engineer Jobs in California (NOW HIRING)

Palona AI

AI Infrastructure Engineer

Los Altos, CA

$127K - $167K/yr

We are looking for an Infrastructure Engineer who combines cloud and reliability depth with strong software engineering judgment. You will build and operate the platform beneath Palona's AI products ...

Palona AI

AI Infrastructure Engineer

New York, NY Ā· On-site

$117K - $154K/yr

We are looking for an Infrastructure Engineer who combines cloud and reliability depth with strong software engineering judgment. You will build and operate the platform beneath Palona's AI products ...

Palona AI

AI Infrastructure Engineer

Los Altos, CA Ā· On-site

$127K - $167K/yr

We are looking for an Infrastructure Engineer who combines cloud and reliability depth with strong software engineering judgment. You will build and operate the platform beneath Palona's AI products ...

New

MeshyAI

AI Infrastructure Engineer

Sunnyvale, CA Ā· On-site

$125K - $164K/yr

The AI Infrastructure Engineer role involves ensuring the reliability and scalability of the AI model serving stack, while developing core engineering infrastructure to connect models to product ...

Meshy LLC

AI Infrastructure Engineer

Sunnyvale, CA Ā· On-site

$126K - $165K/yr

The function owns the reliability, scalability, and operability of Meshy\'s AI model serving stack, along with core engineering infrastructure. The team operates a conventional production ...

Gatik AI

Senior AI Infrastructure Engineer

Santa Clara, CA

$127K - $173K/yr

About the role We are seeking a Senior AI Infrastructure Engineer to design, build, and scale the high-performance AI platform powering our autonomous driving models. While researchers focus on ...

Gatik AI

Senior AI Infrastructure Engineer

Santa Clara, CA Ā· On-site

$127K - $173K/yr

About the role We are seeking a Senior AI Infrastructure Engineer to design, build, and scale the high-performance AI platform powering our autonomous driving models. While researchers focus on ...

AMAX

AI Infrastructure Engineer

Fremont, CA Ā· On-site

$126K - $165K/yr

Development and deployment of AI infrastructure workloads on-prem (GPU scheduling, model serving ... infra engineering Benefits * Medical Insurance * Dental Insurance * Vision Insurance * 401(k)

AMAX

AI Infrastructure Engineer

Fremont, CA Ā· On-site

$126K - $165K/yr

Development and deployment of AI infrastructure workloads on-prem (GPU scheduling, model serving ... infra engineering Benefits * Medical Insurance * Dental Insurance * Vision Insurance * 401(k)

AMAX

AI Infrastructure Engineer

Fremont, CA

$117K - $154K/yr

Development and deployment of AI infrastructure workloads on-prem (GPU scheduling, model serving ... infra engineering Benefits * Medical Insurance * Dental Insurance * Vision Insurance * 401(k)

Spellbrush

AI Infrastructure Engineer

San Francisco, CA Ā· On-site

$126K - $166K/yr

Spellbrush, the world's leading generative AI studio behind niji惻journey , is looking for an AI Infrastructure Engineer to join us in building out end-to-end ML infrastructure to run our models on ...

NIO USA, INC

AI Infrastructure Engineer

San Jose, CA

$192K - $249K/yr

About the Position We are looking for a senior AI Inference Infrastructure Software Engineer with strong hands-on experience building, optimizing, and deploying high-performance, scalable inference ...

Spellbrush

AI Infrastructure Engineer

San Francisco, CA Ā· On-site

$126K - $166K/yr

Spellbrush, the world's leading generative AI studio behind niji惻journey , is looking for an AI Infrastructure Engineer to join us in building out end-to-end ML infrastructure to run our models on ...

Intel

AI Infrastructure Engineer

Santa Clara, CA

$170K - $315K/yr

We are looking for a performance-obsessed AI Infrastructure Engineer to push LLM inference to its absolute limits on Intel's next-generation GPU architectures. In this role, you will dive deep into ...

NIO

AI Infrastructure Engineer

San Jose, CA Ā· On-site

$126K - $165K/yr

About the Position We are looking for a senior AI Inference Infrastructure Software Engineer with strong hands-on experience building, optimizing, and deploying high-performance, scalable inference ...

Intel

AI Infrastructure Engineer

Folsom, CA

$170K - $315K/yr

We are looking for a performance-obsessed AI Infrastructure Engineer to push LLM inference to its absolute limits on Intel's next-generation GPU architectures. In this role, you will dive deep into ...

NIO

AI Infrastructure Engineer

San Jose, CA Ā· On-site

$126K - $165K/yr

About the Position We are looking for a senior AI Inference Infrastructure Software Engineer with strong hands-on experience building, optimizing, and deploying high-performance, scalable inference ...

Biohub

Staff AI Infrastructure Engineer

Redwood City, CA

$241K - $331K/yr

Achieving that requires training frontier-scale AI biology models, and that demands reliable, high-performance compute infrastructure. This is production engineering work at a frontier AI lab, with ...

next page

Showing results 1-20

All JobsAi Infrastructure Engineer JobsAi Infrastructure Engineer Jobs in California

Ai Infrastructure Engineer information

See California salary details

$45.9K

$125.4K

$179.6K

How much do ai infrastructure engineer jobs pay per year?

As of Aug 15, 2026, the average yearly pay for ai infrastructure engineer in California is $125,402.00, according to ZipRecruiter salary data. Most workers in this role earn between $106,100.00 and $139,200.00 per year, depending on experience, location, and employer.

How much do AI infrastructure engineers make?

AI infrastructure engineers typically earn between $100,000 and $150,000 annually, depending on experience, location, and company size. Senior roles or those with specialized skills in cloud platforms and hardware may earn higher salaries, often exceeding $180,000.

What does a typical day look like for an AI infrastructure engineer?

A typical day for an AI Infrastructure Engineer often involves designing and maintaining the underlying systems that support machine learning and AI workloads, such as setting up scalable cloud environments, automating workflows with CI/CD pipelines, and troubleshooting performance bottlenecks. You might collaborate closely with data scientists and software engineers to ensure seamless integration between AI models and production infrastructure. Daily activities can include writing and reviewing infrastructure-as-code, monitoring system health, and responding to incidents or scaling requests as needed. This role offers a dynamic mix of hands-on technical work, problem-solving, and teamwork, providing opportunities to refine your skills and contribute meaningfully to cutting-edge AI projects.

What are the key skills and qualifications needed to thrive as an AI infrastructure engineer?

To thrive as an AI Infrastructure Engineer, a strong background in computer science, cloud computing, and distributed systems is typically required, often supported by a degree in a related field. Familiarity with tools like Kubernetes, Docker, TensorFlow, and cloud platforms (AWS, Azure, or GCP), along with certifications in cloud technologies or DevOps, is highly valuable. Strong problem-solving abilities, collaboration, and effective communication skills are essential to excel within multidisciplinary engineering teams. These competencies ensure the reliable deployment, scaling, and optimization of AI workloads in dynamic production environments.

What does an AI infrastructure engineer do?

An AI Infrastructure Engineer designs, builds, and maintains the computing systems that support AI and machine learning workloads. They manage cloud services, optimize hardware and software performance, and ensure scalability for AI models. Their work involves configuring GPUs, CPUs, storage, and networking, as well as automating workflows with DevOps and MLOps tools. They collaborate with data scientists and engineers to streamline AI development and deployment. Their goal is to create reliable, efficient, and scalable AI infrastructure.

What are the most commonly searched types of Ai Infrastructure Engineer jobs in California?

The most popular types of Ai Infrastructure Engineer jobs in California are:

What are popular job titles related to Ai Infrastructure Engineer jobs in California?

For Ai Infrastructure Engineer jobs in California, the most frequently searched job titles are:

What job categories do people searching Ai Infrastructure Engineer jobs in California look for?

The top searched job categories for Ai Infrastructure Engineer jobs in California are:

What cities in California are hiring for Ai Infrastructure Engineer jobs?

Cities in California with the most Ai Infrastructure Engineer job openings:

Ai Infrastructure Engineer jobs near you
Infographic showing various Ai Infrastructure Engineer job openings in California as of August 2026, with employment types broken down into 76% Full Time, 19% Part Time, 2% Temporary, and 3% Contract. Highlights an 67% Physical, 4% Hybrid, and 29% Remote job distribution, with an average salary of $125,402 per year, or $60.3 per hour.

AI Infrastructure Engineer

Palona AI

Los Altos, CA

$127K - $167K/yr

Full-time

Medical, Dental, Vision, Retirement, PTO

Posted 4 days ago

Job description

Palona's AI agents operate continuously in production, handle real-time guest interactions, integrate with restaurant systems, and face sharp traffic peaks. Infrastructure is therefore part of the product: latency, reliability, deployment safety, observability, security, and cost directly shape the guest and operator experience.

We are looking for an Infrastructure Engineer who combines cloud and reliability depth with strong software engineering judgment. You will build and operate the platform beneath Palona's AI products, improve how engineers ship, and turn production signals into durable system improvements. This is not a ticket-driven IT or operations role. You will write production code, design systems, automate repetitive work, and own outcomes across the full service lifecycle.

Our current environment includes Python services, Docker, AWS and selected Azure services, ECS and Lambda workloads, API Gateway, load balancers, relational data systems, OpenTofu/Terraform, Datadog, and CI/CD automation. We value the ability to learn and make sound tradeoffs more than exact tool-for-tool matching.

What you will own:
  • Design, build, and evolve secure, scalable cloud infrastructure for real-time AI services and customer-facing applications.
  • Improve service reliability through clear SLOs, actionable observability, capacity planning, failure testing, and pragmatic incident prevention.
  • Build deployment and release systems that make production changes fast, repeatable, auditable, and safe.
  • Own infrastructure as code, environment consistency, and reusable platform patterns across development, staging, and production.
  • Partner with product and AI engineers on architecture, performance, data flows, and operational readiness for new capabilities.
  • Diagnose complex distributed-system failures across application, network, database, model-provider, and third-party integration boundaries.
  • Reduce infrastructure and model-serving cost without compromising customer experience or engineering velocity.
  • Strengthen secrets management, access controls, backup and recovery, vulnerability management, and other practical security foundations.
  • Build internal tooling and paved paths that let engineers ship and operate services with less manual work.
  • Participate in incident response and turn incidents into better systems, automation, documentation, and engineering judgment.

Requirements

  • 3+ years industrial experience in relevant technical domain.
  • Strong software engineering fundamentals and experience building or operating production distributed systems.
  • Hands-on experience with a major cloud platform; AWS experience is especially relevant.
  • Experience with containers, infrastructure as code, CI/CD, monitoring, alerting, and production debugging.
  • Ability to write reliable automation and services in Python or another modern programming language.
  • Sound judgment around availability, latency, scalability, security, and cost tradeoffs.
  • A track record of taking ambiguous operational problems from diagnosis through durable resolution.
  • Clear communication during architecture reviews, launches, and incidents.
  • AI-native working habits and curiosity about the operational behavior of LLM- and agent-powered systems.

Benefits

  • Competitive Salary and Stock Option Plan.
  • Medical, dental, vision, retirement, leave, and disability benefits as applicable.
  • Family Leave
  • Short Term & Long Term Disability
  • Paid time off and company holidays.
  • Learning and development support.

Apply