ZipRecruiter

Log In

1

Ai Infrastructure Jobs (NOW HIRING)

Together AI

AI Infrastructure Engineer

San Francisco, CA

$190K - $270K/yr

As an AI Infrastructure Engineer at Together, you are responsible for keeping all user-facing services and production systems running smoothly. You are a blend of a pragmatic operator and a software ...

Together AI

AI Infrastructure Engineer

San Francisco, CA · On-site

$190K - $270K/yr

As an AI Infrastructure Engineer at Together, you are responsible for keeping all user-facing services and production systems running smoothly. You are a blend of a pragmatic operator and a software ...

AI Foundry

AI Infrastructure Engineer

Seattle, WA

$200K - $325K/yr

We are hiring multiple AI Infrastructure Engineers across data center infrastructure teams. Exact level, scope, and team placement may vary based on experience and business needs. AI Foundry is an AI ...

AI Foundry

AI Infrastructure Engineer

Seattle, WA · On-site

$122.30K - $160.50K/yr

They are seeking AI Infrastructure Engineers to help build and operate large-scale GPU infrastructure for training and inference workloads, focusing on hands-on systems work across various technical ...

STN Incorporated

AI Infrastructure Engineer

Pleasanton, CA · Remote

$145K - $195K/yr

We provide end-to-end services spanning cloud consulting, AI infrastructure, and enterprise security, enabling secure, scalable, and future-ready transformation. As trusted advisors, we align IT ...

TechNix LLC

AI Infrastructure Engineer

Olympia, WA · Hybrid

$114.30K - $149.90K/yr

Position: AI Infrastructure Engineer Duration: 6months (with Extension) Location: Washington (Hybrid) Position Summary The AI Infrastructure Engineer designs and manages the computing, storage ...

New

Utilidata

AI Infrastructure Engineer

Ann Arbor, MI · Remote

$170K - $210K/yr

The AI Infrastructure Engineer is responsible for designing, building, and owning the end-to-end infrastructure that serves Utilidata's AI and ML models across edge deployments, cloud environments ...

Bright Vision Technologies

AI Infrastructure Engineer

$110K - $144.30K/yr

We are seeking an AI Infrastructure Engineer to design, build, and operate the platform layer that powers large-scale AI training and inference workloads, focusing on GPU clusters and distributed ...

Bright Vision Technologies

AI Infrastructure Engineer

$110K - $144.30K/yr

We are seeking an AI Infrastructure Engineer to design, build, and operate the platform layer that powers large-scale AI training and inference workloads. Responsibilities : • Design and operate ...

Utilidata

AI Infrastructure Engineer

Ann Arbor, MI · On-site +1

$170K - $210K/yr

The AI Infrastructure Engineer is responsible for designing, building, and owning the end-to-end infrastructure that serves Utilidata's AI and ML models across edge deployments, cloud environments ...

Gatik AI

Senior AI Infrastructure Engineer

Mountain View, CA · On-site

$128K - $174K/yr

About the role We are seeking a Senior AI Infrastructure Engineer to design, build, and scale the high-performance AI platform powering our autonomous driving models. While researchers focus on ...

BNY

AI Infrastructure Engineer

Lake Mary, FL · Hybrid

$94K - $123.30K/yr

AI Infrastructure Engineer At BNY, our culture allows us to run our company better and enables employees' growth and success. As a leading global financial services company at the heart of the global ...

BNY

AI Infrastructure Engineer

Lake Mary, FL · Hybrid

$94K - $123.30K/yr

AI Infrastructure Engineer At BNY, our culture allows us to run our company better and enables employees' growth and success. As a leading global financial services company at the heart of the global ...

Gatik AI

Senior AI Infrastructure Engineer

Mountain View, CA · On-site

$128K - $174K/yr

About the role We are seeking a Senior AI Infrastructure Engineer to design, build, and scale the high-performance AI platform powering our autonomous driving models. While researchers focus on ...

Analogdevices

Senior AI Infrastructure Engineer

Wilmington, MA · Hybrid

$118.60K - $161.30K/yr

Senior AI Infrastructure Engineer, Developer Experience Analog Devices, Inc. (NASDAQ: ADI) is a global semiconductor leader that bridges the physical and digital worlds to enable breakthroughs at the ...

next page

Showing results 1-20

People also search for

All JobsAi Infrastructure Jobs

Ai Infrastructure information

See salary details

$28

$59

$87

How much do ai infrastructure jobs pay per hour?

As of May 29, 2026, the average hourly pay for ai infrastructure in the United States is $59.18, according to ZipRecruiter salary data. Most workers in this role earn between $48.08 and $68.99 per hour, depending on experience, location, and employer.

What are the key skills and qualifications needed to thrive in AI Infrastructure, and why are they important?

To thrive in AI Infrastructure, you need expertise in software engineering, distributed systems, cloud platforms, and a solid understanding of machine learning workflows, often supported by degrees in computer science or related fields. Familiarity with tools like Kubernetes, Docker, Terraform, and cloud services (AWS, GCP, Azure), as well as experience with CI/CD pipelines and monitoring systems, is essential. Strong problem-solving abilities, effective communication, and adaptability help professionals excel in cross-functional teams and rapidly evolving environments. These skills and qualities are crucial for building scalable, reliable systems that power AI applications and support organizational innovation.

What are common challenges faced by professionals working in AI Infrastructure roles, and how can they be addressed?

Professionals in AI Infrastructure roles often encounter challenges related to scalability, system reliability, and integration with existing IT environments. Managing rapidly growing datasets and ensuring seamless deployment of machine learning models can be complex, requiring robust automation and monitoring tools. Collaboration with data scientists, software engineers, and DevOps teams is critical to ensure infrastructure meets the evolving needs of AI projects. Staying updated with the latest cloud technologies and best practices can help address these challenges and drive successful AI implementations.

What is AI Infrastructure?

AI infrastructure refers to the combination of hardware, software, and cloud-based solutions that support the development, deployment, and scaling of artificial intelligence applications. It includes components such as GPUs, CPUs, storage systems, networking, data management tools, and machine learning frameworks. The goal of AI infrastructure is to provide the computational power and resources needed to train, test, and run AI models efficiently, whether on-premises or in the cloud. Organizations invest in robust AI infrastructure to accelerate innovation, manage large datasets, and ensure the reliability of their AI systems.

What is the difference between Ai Infrastructure vs Data Engineer?

AspectAi InfrastructureData Engineer
Required CredentialsBachelor's in CS, Engineering, or related; knowledge of cloud platforms and AI toolsBachelor's in CS, Data Science, or related; programming and database skills
Work EnvironmentCloud environments, AI model deployment, infrastructure setupData pipelines, database management, data processing
Employer & Industry UsageTech companies, AI startups, cloud providersTech firms, finance, healthcare, e-commerce

Ai Infrastructure professionals focus on building and maintaining the hardware and software systems that support AI models, while Data Engineers develop and manage data pipelines and databases. Both roles require technical skills and often collaborate but serve different core functions within AI and data ecosystems.

More about Ai Infrastructure jobs
What cities are hiring for Ai Infrastructure jobs? Cities with the most Ai Infrastructure job openings:
What states have the most Ai Infrastructure jobs? States with the most job openings for Ai Infrastructure jobs include:
What job categories do people searching Ai Infrastructure jobs look for? The top searched job categories for Ai Infrastructure jobs are:
Ai Infrastructure jobs near you
Infographic showing various Ai Infrastructure job openings in the United States as of May 2026, with employment types broken down into 93% Full Time, 3% Part Time, and 4% Contract. Highlights an 86% Physical, 5% Hybrid, and 9% Remote job distribution, with an average salary of $123,103 per year, or $59.2 per hour.

AI Infrastructure Engineer

Together AI

San Francisco, CA

$190K - $270K/yr

Other

Medical

Posted 16 hours ago

Job description

As an AI Infrastructure Engineer at Together, you are responsible for keeping all user-facing services and production systems running smoothly. You are a blend of a pragmatic operator and a software engineer that applies sound engineering principles, operational discipline, and mature automation to our operating environments and codebase.

You specialize in systems (operating systems, storage subsystems, networking), while implementing best practices for availability, reliability and scalability, with varied interests in algorithms and distributed systems.

Responsibilities

  • Participate in on-call rotation (Pagerduty) to respond to production incidents
  • Build and run our infrastructure with Ansible, Terraform, and Kubernetes to enable scaling to a massive number of concurrent users
  • Build monitoring systems to ensure the highest quality service for our customers
  • Design and implement operational processes (such as deployments and upgrades)
  • Debug production issues across all services and levels of the stack
  • Identify improvements for the product architecture from the reliability, performance and availability perspectives
  • Plan the growth of Together AI's infrastructure

Requirements

  • 5+ years of professional AI Infra or related experience
  • Bachelor's degree in Computer Science or a related field or equivalent work experience
  • Knowledge of Ansible (roles, playbooks), Terraform, and Kubernetes
  • Proficiency in programming/scripting languages
  • Direct experience in monitoring and observability practices
  • Knowledge of cloud services
  • Ability to thrive in a collaborative environment involving different stakeholders and subject matter experts

About Together AI

Together AI is a research-driven artificial intelligence company. We believe open and transparent AI systems will drive innovation and create the best outcomes for society, and together we are on a mission to significantly lower the cost of modern AI systems by co-designing software, hardware, algorithms, and models. We have contributed to leading open-source research, models, and datasets to advance the frontier of AI, and our team has been behind technological advancement such as FlashAttention, Hyena, FlexGen, and RedPajama. We invite you to join a passionate group of researchers and engineers in our journey in building the next generation AI infrastructure.

Compensation

We offer competitive compensation, startup equity, health insurance and other competitive benefits. The US base salary range for this full-time position is: $190,000 - $270,000 + equity + benefits. Our salary ranges are determined by location, level and role. Individual compensation will be determined by experience, skills, and job-related knowledge.

Equal Opportunity

Together AI is an Equal Opportunity Employer and is proud to offer equal employment opportunity to everyone regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, citizenship, marital status, disability, gender identity, veteran status, and more.

Apply