ZipRecruiter

Log In

1

Ai Infrastructure Engineer Jobs in California (NOW HIRING)

Together AI

AI Infrastructure Engineer

San Francisco, CA · On-site

$190K - $270K/yr

As an AI Infrastructure Engineer at Together, you are responsible for keeping all user-facing services and production systems running smoothly. You are a blend of a pragmatic operator and a software ...

Together AI

AI Infrastructure Engineer

San Francisco, CA

$190K - $270K/yr

As an AI Infrastructure Engineer at Together, you are responsible for keeping all user-facing services and production systems running smoothly. You are a blend of a pragmatic operator and a software ...

Together AI

AI Infrastructure Engineer

San Francisco, CA · On-site

$126K - $166K/yr

As an AI Infrastructure Engineer, you will be responsible for maintaining user-facing services and production systems, implementing best practices for availability and scalability, and building ...

MeshyAI

AI Infrastructure Engineer

Sunnyvale, CA · On-site

$125K - $164K/yr

The AI Infrastructure Engineer role involves ensuring the reliability and scalability of the AI model serving stack, while developing core engineering infrastructure to connect models to product ...

Meshy LLC

AI Infrastructure Engineer

Sunnyvale, CA

$126K - $165K/yr

The function owns the reliability, scalability, and operability of Meshy\'s AI model serving stack, along with core engineering infrastructure. The team operates a conventional production ...

Gatik AI

Senior AI Infrastructure Engineer

Santa Clara, CA · On-site

$127K - $173K/yr

About the role We are seeking a Senior AI Infrastructure Engineer to design, build, and scale the high-performance AI platform powering our autonomous driving models. While researchers focus on ...

Gatik AI

Senior AI Infrastructure Engineer

Santa Clara, CA · On-site

$127K - $173K/yr

About the role We are seeking a Senior AI Infrastructure Engineer to design, build, and scale the high-performance AI platform powering our autonomous driving models. While researchers focus on ...

AMAX

AI Infrastructure Engineer

Fremont, CA · On-site

$126K - $165K/yr

Development and deployment of AI infrastructure workloads on-prem (GPU scheduling, model serving ... infra engineering Benefits * Medical Insurance * Dental Insurance * Vision Insurance * 401(k)

AMAX

AI Infrastructure Engineer

Fremont, CA · On-site

$126K - $165K/yr

Development and deployment of AI infrastructure workloads on-prem (GPU scheduling, model serving ... infra engineering Benefits * Medical Insurance * Dental Insurance * Vision Insurance * 401(k)

AMAX

AI Infrastructure Engineer

Fremont, CA

$117K - $154K/yr

Development and deployment of AI infrastructure workloads on-prem (GPU scheduling, model serving ... infra engineering Benefits * Medical Insurance * Dental Insurance * Vision Insurance * 401(k)

Spellbrush

AI Infrastructure Engineer

San Francisco, CA · On-site

$126K - $166K/yr

Spellbrush, the world's leading generative AI studio behind niji・journey , is looking for an AI Infrastructure Engineer to join us in building out end-to-end ML infrastructure to run our models on ...

Spellbrush

AI Infrastructure Engineer

San Francisco, CA · On-site

$126K - $166K/yr

Spellbrush, the world's leading generative AI studio behind niji・journey , is looking for an AI Infrastructure Engineer to join us in building out end-to-end ML infrastructure to run our models on ...

NIO USA, INC

AI Infrastructure Engineer

San Jose, CA

$192K - $249K/yr

About the Position We are looking for a senior AI Inference Infrastructure Software Engineer with strong hands-on experience building, optimizing, and deploying high-performance, scalable inference ...

NIO

AI Infrastructure Engineer

San Jose, CA · On-site

$126K - $165K/yr

About the Position We are looking for a senior AI Inference Infrastructure Software Engineer with strong hands-on experience building, optimizing, and deploying high-performance, scalable inference ...

NIO

AI Infrastructure Engineer

San Jose, CA · On-site

$126K - $165K/yr

About the Position We are looking for a senior AI Inference Infrastructure Software Engineer with strong hands-on experience building, optimizing, and deploying high-performance, scalable inference ...

Biohub

Staff AI Infrastructure Engineer

Redwood City, CA

$241K - $331K/yr

Achieving that requires training frontier-scale AI biology models, and that demands reliable, high-performance compute infrastructure. This is production engineering work at a frontier AI lab, with ...

Biohub

Staff AI Infrastructure Engineer

Redwood City, CA · On-site +1

$131K - $172K/yr

Achieving that requires training frontier-scale AI biology models, and that demands reliable, high-performance compute infrastructure. This is production engineering work at a frontier AI lab, with ...

next page

Showing results 1-20

All JobsAi Infrastructure Engineer JobsAi Infrastructure Engineer Jobs in California

Ai Infrastructure Engineer information

See California salary details

$45.9K

$125.4K

$179.6K

How much do ai infrastructure engineer jobs pay per year?

As of Aug 2, 2026, the average yearly pay for ai infrastructure engineer in California is $125,402.00, according to ZipRecruiter salary data. Most workers in this role earn between $106,100.00 and $139,200.00 per year, depending on experience, location, and employer.

How much do AI infra engineers make?

AI infrastructure engineers typically earn between $100,000 and $150,000 annually, with salaries increasing based on experience, skills in cloud platforms, and knowledge of machine learning frameworks. Senior roles or those with specialized expertise can earn over $180,000 per year.

What does a typical day look like for an AI Infrastructure Engineer?

A typical day for an AI Infrastructure Engineer often involves designing and maintaining the underlying systems that support machine learning and AI workloads, such as setting up scalable cloud environments, automating workflows with CI/CD pipelines, and troubleshooting performance bottlenecks. You might collaborate closely with data scientists and software engineers to ensure seamless integration between AI models and production infrastructure. Daily activities can include writing and reviewing infrastructure-as-code, monitoring system health, and responding to incidents or scaling requests as needed. This role offers a dynamic mix of hands-on technical work, problem-solving, and teamwork, providing opportunities to refine your skills and contribute meaningfully to cutting-edge AI projects.

What is a $900000 AI job?

A $900,000 AI job typically refers to a high-level position in artificial intelligence, such as senior AI engineer, research scientist, or AI director, often offering top-tier compensation due to expertise, experience, and the strategic importance of AI projects. These roles usually require advanced skills in machine learning, deep learning, and data infrastructure, along with significant industry experience and sometimes advanced degrees or certifications.

What are the key skills and qualifications needed to thrive in the Ai Infrastructure Engineer position, and why are they important?

To thrive as an AI Infrastructure Engineer, a strong background in computer science, cloud computing, and distributed systems is typically required, often supported by a degree in a related field. Familiarity with tools like Kubernetes, Docker, TensorFlow, and cloud platforms (AWS, Azure, or GCP), along with certifications in cloud technologies or DevOps, is highly valuable. Strong problem-solving abilities, collaboration, and effective communication skills are essential to excel within multidisciplinary engineering teams. These competencies ensure the reliable deployment, scaling, and optimization of AI workloads in dynamic production environments.

What does an AI Infrastructure Engineer do?

An AI Infrastructure Engineer designs, builds, and maintains the computing systems that support AI and machine learning workloads. They manage cloud services, optimize hardware and software performance, and ensure scalability for AI models. Their work involves configuring GPUs, CPUs, storage, and networking, as well as automating workflows with DevOps and MLOps tools. They collaborate with data scientists and engineers to streamline AI development and deployment. Their goal is to create reliable, efficient, and scalable AI infrastructure.

What do AI infrastructure engineers do?

AI infrastructure engineers design, build, and maintain the hardware and software systems that support artificial intelligence models and applications. They work with cloud platforms, high-performance computing, and data storage solutions, often using tools like Kubernetes and Docker, to ensure scalable and efficient AI operations.

What engineers make $500,000?

Senior AI Infrastructure Engineers, cloud architects, and machine learning engineers with extensive experience and advanced skills in AI systems, cloud platforms, and distributed computing can reach or exceed $500,000 in total compensation, especially in high-demand industries or companies. Achieving this level often requires specialized certifications, leadership roles, and a strong track record of impactful projects.
What are the most commonly searched types of Ai Infrastructure Engineer jobs in California? The most popular types of Ai Infrastructure Engineer jobs in California are:
What are popular job titles related to Ai Infrastructure Engineer jobs in California? For Ai Infrastructure Engineer jobs in California, the most frequently searched job titles are:
What job categories do people searching Ai Infrastructure Engineer jobs in California look for? The top searched job categories for Ai Infrastructure Engineer jobs in California are:
What cities in California are hiring for Ai Infrastructure Engineer jobs? Cities in California with the most Ai Infrastructure Engineer job openings:
Ai Infrastructure Engineer jobs near you
Infographic showing various Ai Infrastructure Engineer job openings in California as of July 2026, with employment types broken down into 75% Full Time, 22% Part Time, and 3% Contract. Highlights an 71% Physical, 3% Hybrid, and 26% Remote job distribution, with an average salary of $125,402 per year, or $60.3 per hour.

AI Infrastructure Engineer

Together AI

San Francisco, CA • On-site

$190K - $270K/yr

Full-time

Medical

Re-posted 5 days ago

Job description

As an AI Infrastructure Engineer at Together, you are responsible for keeping all user-facing services and production systems running smoothly. You are a blend of a pragmatic operator and a software engineer that applies sound engineering principles, operational discipline, and mature automation to our operating environments and codebase.
You specialize in systems (operating systems, storage subsystems, networking), while implementing best practices for availability, reliability and scalability, with varied interests in algorithms and distributed systems.
Responsibilities
  • Participate in on-call rotation (Pagerduty) to respond to production incidents
  • Build and run our infrastructure with Ansible, Terraform, and Kubernetes to enable scaling to a massive number of concurrent users
  • Build monitoring systems to ensure the highest quality service for our customers
  • Design and implement operational processes (such as deployments and upgrades)
  • Debug production issues across all services and levels of the stack
  • Identify improvements for the product architecture from the reliability, performance and availability perspectives
  • Plan the growth of Together AI's infrastructure

Requirements
  • 5+ years of professional AI Infra or related experience
  • Bachelor's degree in Computer Science or a related field or equivalent work experience
  • Knowledge of Ansible (roles, playbooks), Terraform, and Kubernetes
  • Proficiency in programming/scripting languages
  • Direct experience in monitoring and observability practices
  • Knowledge of cloud services
  • Ability to thrive in a collaborative environment involving different stakeholders and subject matter experts

About Together AI
Together AI is a research-driven artificial intelligence company. We believe open and transparent AI systems will drive innovation and create the best outcomes for society, and together we are on a mission to significantly lower the cost of modern AI systems by co-designing software, hardware, algorithms, and models. We have contributed to leading open-source research, models, and datasets to advance the frontier of AI, and our team has been behind technological advancement such as FlashAttention, Hyena, FlexGen, and RedPajama. We invite you to join a passionate group of researchers and engineers in our journey in building the next generation AI infrastructure.
Compensation
We offer competitive compensation, startup equity, health insurance and other competitive benefits. The US base salary range for this full-time position is: $190,000 - $270,000 + equity + benefits. Our salary ranges are determined by location, level and role. Individual compensation will be determined by experience, skills, and job-related knowledge.
Equal Opportunity
Together AI is an Equal Opportunity Employer and is proud to offer equal employment opportunity to everyone regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, citizenship, marital status, disability, gender identity, veteran status, and more.

Apply