ZipRecruiter

Log In

1

Ai Infrastructure Engineer Jobs in California (NOW HIRING)

Palona AI

AI Infrastructure Engineer

Los Altos, CA · On-site

$150 - $230/hr

We are looking for an Infrastructure Engineer who combines cloud and reliability depth with strong software engineering judgment. You will build and operate the platform beneath Palona's AI products ...

Palona AI

AI Infrastructure Engineer

Los Altos, CA · On-site

$127K - $167K/yr

We are looking for an Infrastructure Engineer who combines cloud and reliability depth with strong software engineering judgment. You will build and operate the platform beneath Palona's AI products ...

Barrow Wise Consulting

AI Infrastructure Engineer

Norco, CA · On-site +1

$115K - $151K/yr

The AI Infrastructure Engineer will support Barrow Wise and perform the following duties: * Assess legacy infrastructure, identify modernization gaps, and design the next-generation AI + Data Mesh ...

New

Palona AI

AI Infrastructure Engineer

Los Altos, CA · On-site

$127K - $167K/yr

We are looking for an Infrastructure Engineer who combines cloud and reliability depth with strong software engineering judgment. You will build and operate the platform beneath Palona's AI products ...

MeshyAI

AI Infrastructure Engineer

Sunnyvale, CA · On-site

$125K - $164K/yr

The AI Infrastructure Engineer role involves ensuring the reliability and scalability of the AI model serving stack, while developing core engineering infrastructure to connect models to product ...

Socket.dev

AI Infrastructure Engineer

Los Altos, CA · On-site

$110 - $170/hr

We are looking for an Infrastructure Engineer who combines cloud and reliability depth with strong software engineering judgment. You will build and operate the platform beneath Palona's AI products ...

Spellbrush

AI Infrastructure Engineer

San Francisco, CA · On-site

$126K - $166K/yr

Spellbrush is the world's leading generative AI studio behind niji・journey, and they are seeking an AI Infrastructure Engineer to build out end-to-end ML infrastructure. The role involves designing ...

Gatik AI

Senior AI Infrastructure Engineer

Santa Clara, CA · On-site

$127K - $173K/yr

About the role We are seeking a Senior AI Infrastructure Engineer to design, build, and scale the high-performance AI platform powering our autonomous driving models. While researchers focus on ...

Gatik AI

Senior AI Infrastructure Engineer

Santa Clara, CA · On-site

$127K - $173K/yr

About the role We are seeking a Senior AI Infrastructure Engineer to design, build, and scale the high-performance AI platform powering our autonomous driving models. While researchers focus on ...

AMAX

AI Infrastructure Engineer

Fremont, CA · On-site

$126K - $165K/yr

Development and deployment of AI infrastructure workloads on-prem (GPU scheduling, model serving ... infra engineering Benefits * Medical Insurance * Dental Insurance * Vision Insurance * 401(k)

Amax

AI Infrastructure Engineer

Fremont, CA · On-site

$140 - $190/hr

Development and deployment of AI infrastructure workloads on‑prem (GPU scheduling, model serving ... infra engineering * Medical Insurance * Dental Insurance * Vision Insurance * 401(k) * Flexible ...

AMAX

AI Infrastructure Engineer

Fremont, CA · On-site

$126K - $165K/yr

Development and deployment of AI infrastructure workloads on-prem (GPU scheduling, model serving ... infra engineering Benefits * Medical Insurance * Dental Insurance * Vision Insurance * 401(k)

Visa Hunt

AI Infrastructure Engineer

San Francisco, CA · On-site

$180 - $240/hr

Spellbrush, the world's leading generative AI studio behind niji・journey, is looking for an AI Infrastructure Engineer to join us in building out end-to-end ML infrastructure to run our models on ...

AMAX

AI Infrastructure Engineer

Fremont, CA

$117K - $154K/yr

Development and deployment of AI infrastructure workloads on-prem (GPU scheduling, model serving ... infra engineering Benefits * Medical Insurance * Dental Insurance * Vision Insurance * 401(k)

NIO USA, INC

AI Infrastructure Engineer

San Jose, CA

$192K - $249K/yr

About the Position We are looking for a senior AI Inference Infrastructure Software Engineer with strong hands-on experience building, optimizing, and deploying high-performance, scalable inference ...

Intel

AI Infrastructure Engineer

Santa Clara, CA

$170K - $315K/yr

We are looking for a performance-obsessed AI Infrastructure Engineer to push LLM inference to its absolute limits on Intel's next-generation GPU architectures. In this role, you will dive deep into ...

Spellbrush

AI Infrastructure Engineer

San Francisco, CA · On-site

$126K - $166K/yr

Spellbrush, the world's leading generative AI studio behind niji・journey , is looking for an AI Infrastructure Engineer to join us in building out end-to-end ML infrastructure to run our models on ...

next page

Showing results 1-20

All JobsAi Infrastructure Engineer JobsAi Infrastructure Engineer Jobs in California

Ai Infrastructure Engineer information

See California salary details

$45.9K

$125.4K

$179.6K

How much do ai infrastructure engineer jobs pay per year?

As of Aug 23, 2026, the average yearly pay for ai infrastructure engineer in California is $125,402.00, according to ZipRecruiter salary data. Most workers in this role earn between $106,100.00 and $139,200.00 per year, depending on experience, location, and employer.

What does an AI infrastructure engineer do?

An AI Infrastructure Engineer designs, builds, and maintains the computing systems that support AI and machine learning workloads. They manage cloud services, optimize hardware and software performance, and ensure scalability for AI models. Their work involves configuring GPUs, CPUs, storage, and networking, as well as automating workflows with DevOps and MLOps tools. They collaborate with data scientists and engineers to streamline AI development and deployment. Their goal is to create reliable, efficient, and scalable AI infrastructure.

What are the key skills and qualifications needed to thrive as an AI infrastructure engineer?

To thrive as an AI Infrastructure Engineer, a strong background in computer science, cloud computing, and distributed systems is typically required, often supported by a degree in a related field. Familiarity with tools like Kubernetes, Docker, TensorFlow, and cloud platforms (AWS, Azure, or GCP), along with certifications in cloud technologies or DevOps, is highly valuable. Strong problem-solving abilities, collaboration, and effective communication skills are essential to excel within multidisciplinary engineering teams. These competencies ensure the reliable deployment, scaling, and optimization of AI workloads in dynamic production environments.

What does a typical day look like for an AI infrastructure engineer?

A typical day for an AI Infrastructure Engineer often involves designing and maintaining the underlying systems that support machine learning and AI workloads, such as setting up scalable cloud environments, automating workflows with CI/CD pipelines, and troubleshooting performance bottlenecks. You might collaborate closely with data scientists and software engineers to ensure seamless integration between AI models and production infrastructure. Daily activities can include writing and reviewing infrastructure-as-code, monitoring system health, and responding to incidents or scaling requests as needed. This role offers a dynamic mix of hands-on technical work, problem-solving, and teamwork, providing opportunities to refine your skills and contribute meaningfully to cutting-edge AI projects.

How much do AI infrastructure engineers make?

AI infrastructure engineers typically earn between $100,000 and $150,000 annually, depending on experience, location, and company size. Senior roles or those with specialized skills in cloud platforms and hardware may earn higher salaries, often exceeding $180,000. Compensation can also include bonuses and stock options in tech companies.

What are the most commonly searched types of Ai Infrastructure Engineer jobs in California?

The most popular types of Ai Infrastructure Engineer jobs in California are:

What are popular job titles related to Ai Infrastructure Engineer jobs in California?

For Ai Infrastructure Engineer jobs in California, the most frequently searched job titles are:

What job categories do people searching Ai Infrastructure Engineer jobs in California look for?

The top searched job categories for Ai Infrastructure Engineer jobs in California are:

What cities in California are hiring for Ai Infrastructure Engineer jobs?

Cities in California with the most Ai Infrastructure Engineer job openings:

Ai Infrastructure Engineer jobs near you
Infographic showing various Ai Infrastructure Engineer job openings in California as of August 2026, with employment types broken down into 100% Full Time. Highlights an 74% In-person, and 26% Remote job distribution, with an average salary of $125,402 per year, or $60.3 per hour.

AI Infrastructure Engineer

Barrow Wise Consulting

Norco, CA • On-site

$90K - $180K/yr

Full-time

Posted 4 days ago

Job description

Enjoy problem-solving, need a venue to display your creativity, and emerging technologies pique your interest; if so, Barrow Wise Consulting, LLC is for you. As a multi-disciplined leader, you understand the gifts that set you apart from everyone else. Demonstrate innovative solutions to our clients. Join Barrow Wise Consulting, LLC today.
Responsibilities:
The AI Infrastructure Engineer will support Barrow Wise and perform the following duties:
  • Assess legacy infrastructure, identify modernization gaps, and design the next-generation AI + Data Mesh infrastructure + Zero Trust 2.0 for federal mission environments.
  • Blend AI platform engineering, secure distributed data architecture, and classified-environment deployment engineering.
  • Evaluate current systems, design modernization roadmaps, and build secure, scalable AI infrastructure capable of supporting agentic AI, RAG pipelines, autonomous workflows, and distributed data governance.
  • Identify gaps in scalability, observability, compliance, and AI readiness.
  • Design and implement scalable AI infrastructure for model inference, RAG, vector databases, agentic AI, and high-performance GPU workloads.
  • Build deterministic, well-tested deployment tooling for air-gapped, on-prem, and classified environments.
  • Produce modernization roadmaps aligned with federal cybersecurity and zero-trust requirements.
  • Collaborate with stakeholders to understand the gaps and required improvements in the various enclaves
  • Performs other duties as assigned

An Ideal Candidate has:
  • US Citizenship and Secret Clearance
  • Master's Degree or PhD in Engineering, Computer Science, Mathematics, or a related field
  • 8 years of systems engineering and AI infrastructure development expertise

Barrow Wise Consulting, LLC offers an ethical, challenging, diverse, and rewarding experience. Join us and become part of an enthusiastic, responsible team that delivers innovative solutions to our clients. We provide competitive compensation packages, attractive benefits, and great careers. Barrow Wise is an equal opportunity, drug-free employer committed to diversity in the workplace. Minority/Female/Disabled/Protected Veteran/LBGT.
Our employees stand behind Barrow Wise's core values of integrity, quality, innovation, and diversity. We are confident that Barrow Wise's core values, business model, and team focus create positive career paths for our employees. Barrow Wise will continue to lead the industry in delivering new solutions to clients and persevere until the client is overjoyed.

Apply