ZipRecruiter

Log In

1

Associate Ai Infrastructure Engineer Jobs (NOW HIRING)

Together AI

AI Infrastructure Engineer

San Francisco, CA · On-site

$126K - $166K/yr

As an AI Infrastructure Engineer, you will be responsible for maintaining user-facing services and production systems, implementing best practices for availability and scalability, and building ...

BNY

AI Infrastructure Engineer

Lake Mary, FL · Hybrid

$94K - $123K/yr

AI Infrastructure Engineer At BNY, our culture allows us to run our company better and enables employees' growth and success. As a leading global financial services company at the heart of the global ...

Seekr

Staff AI Infrastructure Engineer

Austin, TX

$106K - $139K/yr

As a Staff AI Infrastructure Engineer, you will design, build, and operate the platforms that enable large-scale training, serving, evaluation, and deployment of foundation models and autonomous AI ...

Analogdevices

Senior AI Infrastructure Engineer

Wilmington, MA · Hybrid

$118K - $161K/yr

Senior AI Infrastructure Engineer, Developer Experience Analog Devices, Inc. (NASDAQ: ADI) is a global semiconductor leader that bridges the physical and digital worlds to enable breakthroughs at the ...

BNY

AI Infrastructure Engineer

Lake Mary, FL · On-site

$94K - $123K/yr

They are seeking an AI Infrastructure Engineer to support enterprise-grade NVIDIA AI infrastructure, automate operations, and maintain AI training and inference pipelines. Responsibilities : • Be ...

Seekr

Staff AI Infrastructure Engineer

Austin, TX · On-site

$106K - $139K/yr

As a Staff AI Infrastructure Engineer, you will design, build, and operate the platforms that enable large-scale training, serving, evaluation, and deployment of foundation models and autonomous AI ...

Seekr

Senior AI Infrastructure Engineer

Austin, TX

$107K - $146K/yr

As a Senior AI Infrastructure Engineer, you will design, build, and operate the platforms that enable large-scale training, serving, evaluation, and deployment of foundation models and autonomous AI ...

MeshyAI

AI Infrastructure Engineer

Sunnyvale, CA · On-site

$125K - $164K/yr

The AI Infrastructure Engineer role involves ensuring the reliability and scalability of the AI model serving stack, while developing core engineering infrastructure to connect models to product ...

Autonomous Solutions

AI Infrastructure Engineer IV

Lehi, UT · On-site

$100K - $132K/yr

As an AI Infrastructure Engineer IV , you will play a critical role in designing, building, and maintaining the systems that power our AI and machine learning capabilities. You will ensure our ...

BNY

AI Infrastructure Engineer

Lake Mary, FL · Hybrid

$94K - $123K/yr

AI Infrastructure Engineer At BNY, our culture allows us to run our company better and enables employees' growth and success. As a leading global financial services company at the heart of the global ...

Utilidata

AI Infrastructure Engineer

Ann Arbor, MI · Remote

$170K - $210K/yr

The AI Infrastructure Engineer is responsible for designing, building, and owning the end-to-end infrastructure that serves Utilidata's AI and ML models across edge deployments, cloud environments ...

Autonomous Solutions

AI Infrastructure Engineer IV

Lehi, UT · On-site

$100K - $132K/yr

As an AI Infrastructure Engineer IV , you will play a critical role in designing, building, and maintaining the systems that power our AI and machine learning capabilities. You will ensure our ...

next page

Showing results 1-20

All JobsAssociate Ai Infrastructure Engineer Jobs

Associate Ai Infrastructure Engineer information

See salary details

$41.5K

$82.6K

$132K

How much do associate ai infrastructure engineer jobs pay per year?

As of Aug 6, 2026, the average yearly pay for associate ai infrastructure engineer in the United States is $82,636.00, according to ZipRecruiter salary data. Most workers in this role earn between $65,500.00 and $95,000.00 per year, depending on experience, location, and employer.

What is the difference between Associate Ai Infrastructure Engineer vs Data Engineer?

AspectAssociate Ai Infrastructure EngineerData Engineer
Required CredentialsBachelor's in CS, Engineering, or related field; familiarity with cloud platformsBachelor's in CS, Data Science, or related; strong programming skills
Work EnvironmentAI/ML teams, cloud environments, infrastructure setupData pipelines, database management, data processing systems
Employer & Industry UsageTech companies, AI startups, cloud service providersTech firms, finance, healthcare, data-driven industries

Associate Ai Infrastructure Engineers focus on building and maintaining AI infrastructure, while Data Engineers develop and manage data pipelines and databases. Both roles require technical skills and often collaborate, but their core responsibilities differ in infrastructure versus data processing.

More about Associate Ai Infrastructure Engineer jobs
What cities are hiring for Associate Ai Infrastructure Engineer jobs? Cities with the most Associate Ai Infrastructure Engineer job openings:
What are the most commonly searched types of Ai Infrastructure Engineer jobs? The most popular types of Ai Infrastructure Engineer jobs are:
What states have the most Associate Ai Infrastructure Engineer jobs? States with the most job openings for Associate Ai Infrastructure Engineer jobs include:
What job categories do people searching Associate Ai Infrastructure Engineer jobs look for? The top searched job categories for Associate Ai Infrastructure Engineer jobs are:
Associate Ai Infrastructure Engineer jobs near you
Infographic showing various Associate Ai Infrastructure Engineer job openings in the United States as of August 2026, with employment types broken down into 1% As Needed, 68% Full Time, 28% Part Time, 1% Temporary, and 2% Contract. Highlights an 97% Physical, 1% Hybrid, and 2% Remote job distribution, with an average salary of $82,636 per year, or $39.7 per hour.

AI Infrastructure Systems Engineer

Together AI

San Francisco, CA • On-site

$190K - $270K/yr

Full-time

Medical

Re-posted 23 days ago

Job description

Build the infrastructure powering the next generation of AI.
At Together AI, you'll build and operate one of the world's largest GPU fleets used for frontier model training and inference. This isn't a traditional infrastructure role-we're looking for engineers who love building systems, automating everything, and solving problems at massive scale.
You'll Thrive Here If You:
  • Love building systems that replace repetitive operational work.
  • Think of infrastructure as a software engineering problem.
  • Enjoy solving hard problems with no existing playbook.
  • Care deeply about performance, reliability, and scale.
  • Want to build technology that powers frontier AI models.

Our mission is simple: build AI infrastructure that largely runs itself-where intelligent systems deploy, monitor, diagnose, optimize, and heal GPU fleets at massive scale. Every system you build will directly improve the speed, efficiency, and reliability of one of the world's most advanced AI compute platforms.
If you enjoy writing software more than clicking dashboards, obsess over eliminating manual work, and want to build infrastructure that manages tens of thousands of GPUs autonomously, we'd love to talk.
Responsibilities
  • Design and build fleet automation systems that provision, validate, deploy, upgrade, repair, and retire GPU clusters with minimal human intervention.
  • Build AI Infrastructure Agents that automate deployment, root-cause failures, incident triage, and autonomous remediation.
  • Develop Fleet Intelligence platforms that continuously monitor hardware health, firmware, networking, storage, thermals, and workload performance to predict failures before they impact customers.
  • Build software that maximizes GPU availability, utilization, performance, and reliability across thousands of accelerators.
  • Create automated validation systems for GPUs, InfiniBand/RoCE fabrics, NVLink/NVSwitch, storage, and distributed AI workloads.
  • Build internal platforms and developer tools that allow infrastructure to be managed through software-not manual operations.
  • Continuously improve deployment velocity, reliability, and operational efficiency through automation.
  • Partner closely with hardware, networking, platform, and AI teams to push the limits of AI infrastructure.
Requirements
  • 3+ years building distributed systems, infrastructure platforms, or large-scale backend software.
  • Strong software engineering skills in Python, Go, or Rust.
  • Experience building platforms, automation systems, or developer infrastructure.
  • Experience with Linux, Kubernetes, Terraform, Ansible, or similar infrastructure technologies.
  • Strong systems thinking with the ability to understand problems across hardware and software.
  • A passion for solving complex infrastructure challenges through software.
  • An automation-first mindset-if a task is repeated, your instinct is to build a system to eliminate it.
Bonus Experience
  • GPU infrastructure, CUDA, NCCL, NVLink/NVSwitch
  • InfiniBand or RoCE networking
  • Bare-metal provisioning and lifecycle management
  • Large-scale AI training or inference clusters
  • Hardware health monitoring and predictive failure detection
  • Distributed storage systems
  • AI agents and autonomous infrastructure operations
About Together AI
Together AI is a research-driven artificial intelligence company. We believe open and transparent AI systems will drive innovation and create the best outcomes for society, and together we are on a mission to significantly lower the cost of modern AI systems by co-designing software, hardware, algorithms, and models. We have contributed to leading open-source research, models, and datasets to advance the frontier of AI, and our team has been behind technological advancement such as FlashAttention, Hyena, FlexGen, and RedPajama. We invite you to join a passionate group of researchers and engineers in our journey in building the next generation AI infrastructure.
Compensation
We offer competitive compensation, startup equity, health insurance and other competitive benefits. The US base salary range for this full-time position is: $190,000 - $270,000 + equity + benefits. Our salary ranges are determined by location, level and role. Individual compensation will be determined by experience, skills, and job-related knowledge.
Equal Opportunity
Together AI is an Equal Opportunity Employer and is proud to offer equal employment opportunity to everyone regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, citizenship, marital status, disability, gender identity, veteran status, and more.

Apply