1

Associate Ai Infrastructure Engineer Jobs in California

As an AI Infrastructure Engineer at Together, you are responsible for keeping all user-facing services and production systems running smoothly. You are a blend of a pragmatic operator and a software ...

AI Infrastructure Engineer

San Francisco, CA · On-site

$126K - $166K/yr

As an AI Infrastructure Engineer, you will be responsible for maintaining user-facing services and production systems, implementing best practices for availability and scalability, and building ...

As an AI Infrastructure Engineer at Together, you are responsible for keeping all user-facing services and production systems running smoothly. You are a blend of a pragmatic operator and a software ...

AI Infrastructure Engineer

Sunnyvale, CA · On-site

$125K - $164K/yr

The AI Infrastructure Engineer role involves ensuring the reliability and scalability of the AI model serving stack, while developing core engineering infrastructure to connect models to product ...

Senior AI Infrastructure Engineer

Santa Clara, CA · On-site

$127K - $173K/yr

About the role We are seeking a Senior AI Infrastructure Engineer to design, build, and scale the high-performance AI platform powering our autonomous driving models. While researchers focus on ...

About the role We are seeking a Senior AI Infrastructure Engineer to design, build, and scale the high-performance AI platform powering our autonomous driving models. While researchers focus on ...

AI Infrastructure Engineer

Fremont, CA · On-site

$126K - $165K/yr

Development and deployment of AI infrastructure workloads on-prem (GPU scheduling, model serving ... infra engineering Benefits * Medical Insurance * Dental Insurance * Vision Insurance * 401(k)

AI Infrastructure Engineer

Fremont, CA · On-site

$126K - $165K/yr

Development and deployment of AI infrastructure workloads on-prem (GPU scheduling, model serving ... infra engineering Benefits * Medical Insurance * Dental Insurance * Vision Insurance * 401(k)

AI Infrastructure Engineer

Fremont, CA

$117K - $154K/yr

Development and deployment of AI infrastructure workloads on-prem (GPU scheduling, model serving ... infra engineering Benefits * Medical Insurance * Dental Insurance * Vision Insurance * 401(k)

AI Infrastructure Engineer

San Francisco, CA · On-site

$126K - $166K/yr

Spellbrush, the world's leading generative AI studio behind niji・journey , is looking for an AI Infrastructure Engineer to join us in building out end-to-end ML infrastructure to run our models on ...

AI Infrastructure Engineer

San Francisco, CA · On-site

$126K - $166K/yr

Spellbrush, the world's leading generative AI studio behind niji・journey , is looking for an AI Infrastructure Engineer to join us in building out end-to-end ML infrastructure to run our models on ...

AI Infrastructure Engineer

San Jose, CA · On-site

$192K - $249K/yr

About the Position We are looking for a senior AI Inference Infrastructure Software Engineer with strong hands-on experience building, optimizing, and deploying high-performance, scalable inference ...

AI Infrastructure Engineer

San Jose, CA

$126K - $165K/yr

About the Position We are looking for a senior AI Inference Infrastructure Software Engineer with strong hands-on experience building, optimizing, and deploying high-performance, scalable inference ...

Achieving that requires training frontier-scale AI biology models, and that demands reliable, high-performance compute infrastructure. This is production engineering work at a frontier AI lab, with ...

Staff AI Infrastructure Engineer

Redwood City, CA · On-site +1

$131K - $172K/yr

Achieving that requires training frontier-scale AI biology models, and that demands reliable, high-performance compute infrastructure. This is production engineering work at a frontier AI lab, with ...

next page

Showing results 1-20

Associate Ai Infrastructure Engineer information

What engineer makes $500,000 a year?

Senior AI infrastructure engineers or machine learning engineers with extensive experience, specialized skills, and advanced certifications can earn salaries approaching or exceeding $500,000 annually, especially in high-demand industries or companies. These roles often require expertise in cloud platforms, distributed systems, and deep learning frameworks, along with leadership responsibilities and a strong track record of impactful projects.

How much do AI infrastructure engineers make?

AI infrastructure engineers typically earn between $90,000 and $150,000 annually, depending on experience, location, and company size. Senior roles or those with specialized skills in cloud platforms and machine learning tools can command higher salaries.

What is the difference between Associate Ai Infrastructure Engineer vs Data Engineer?

AspectAssociate Ai Infrastructure EngineerData Engineer
Required CredentialsBachelor's in CS, Engineering, or related field; familiarity with cloud platformsBachelor's in CS, Data Science, or related; strong programming skills
Work EnvironmentAI/ML teams, cloud environments, infrastructure setupData pipelines, database management, data processing systems
Employer & Industry UsageTech companies, AI startups, cloud service providersTech firms, finance, healthcare, data-driven industries

Associate Ai Infrastructure Engineers focus on building and maintaining AI infrastructure, while Data Engineers develop and manage data pipelines and databases. Both roles require technical skills and often collaborate, but their core responsibilities differ in infrastructure versus data processing.

What is a $900000 AI job?

A $900,000 AI job typically refers to high-level positions in artificial intelligence, such as senior AI engineers, research directors, or chief AI officers, often requiring advanced skills in machine learning, deep learning, and data infrastructure. These roles usually involve leadership responsibilities, extensive experience, and may include stock options or bonuses that contribute to the total compensation. Such salaries are rare and generally found in large tech companies or specialized AI firms.

What does an associate AI engineer do?

An associate AI engineer supports the development and deployment of artificial intelligence models and systems. They assist with data preprocessing, model training, testing, and optimization, often using tools like Python, TensorFlow, or PyTorch. This entry-level role typically requires foundational knowledge of machine learning concepts and programming skills.
What are the most commonly searched types of Ai Infrastructure Engineer jobs in California? The most popular types of Ai Infrastructure Engineer jobs in California are:
What are popular job titles related to Associate Ai Infrastructure Engineer jobs in California? For Associate Ai Infrastructure Engineer jobs in California, the most frequently searched job titles are:
What cities in California are hiring for Associate Ai Infrastructure Engineer jobs? Cities in California with the most Associate Ai Infrastructure Engineer job openings:
Infographic showing various Associate Ai Infrastructure Engineer job openings in California as of July 2026, with employment types broken down into 68% Full Time, 22% Part Time, and 10% Contract. Highlights an 59% Physical, 3% Hybrid, and 38% Remote job distribution.
AI Infrastructure Engineer

AI Infrastructure Engineer

Together AI

San Francisco, CA

$190K - $270K/yr

Other

Medical

Posted 29 days ago


Job description

As an AI Infrastructure Engineer at Together, you are responsible for keeping all user-facing services and production systems running smoothly. You are a blend of a pragmatic operator and a software engineer that applies sound engineering principles, operational discipline, and mature automation to our operating environments and codebase.

You specialize in systems (operating systems, storage subsystems, networking), while implementing best practices for availability, reliability and scalability, with varied interests in algorithms and distributed systems.

Responsibilities

  • Participate in on-call rotation (Pagerduty) to respond to production incidents
  • Build and run our infrastructure with Ansible, Terraform, and Kubernetes to enable scaling to a massive number of concurrent users
  • Build monitoring systems to ensure the highest quality service for our customers
  • Design and implement operational processes (such as deployments and upgrades)
  • Debug production issues across all services and levels of the stack
  • Identify improvements for the product architecture from the reliability, performance and availability perspectives
  • Plan the growth of Together AI's infrastructure

Requirements

  • 5+ years of professional AI Infra or related experience
  • Bachelor's degree in Computer Science or a related field or equivalent work experience
  • Knowledge of Ansible (roles, playbooks), Terraform, and Kubernetes
  • Proficiency in programming/scripting languages
  • Direct experience in monitoring and observability practices
  • Knowledge of cloud services
  • Ability to thrive in a collaborative environment involving different stakeholders and subject matter experts

About Together AI

Together AI is a research-driven artificial intelligence company. We believe open and transparent AI systems will drive innovation and create the best outcomes for society, and together we are on a mission to significantly lower the cost of modern AI systems by co-designing software, hardware, algorithms, and models. We have contributed to leading open-source research, models, and datasets to advance the frontier of AI, and our team has been behind technological advancement such as FlashAttention, Hyena, FlexGen, and RedPajama. We invite you to join a passionate group of researchers and engineers in our journey in building the next generation AI infrastructure.

Compensation

We offer competitive compensation, startup equity, health insurance and other competitive benefits. The US base salary range for this full-time position is: $190,000 - $270,000 + equity + benefits. Our salary ranges are determined by location, level and role. Individual compensation will be determined by experience, skills, and job-related knowledge.

Equal Opportunity

Together AI is an Equal Opportunity Employer and is proud to offer equal employment opportunity to everyone regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, citizenship, marital status, disability, gender identity, veteran status, and more.