ZipRecruiter

Log In

1

Ai Infrastructure Job Jobs (NOW HIRING)

Together AI

AI Infrastructure Engineer

San Francisco, CA · On-site

$190K - $270K/yr

As an AI Infrastructure Engineer at Together, you are responsible for keeping all user-facing services and production systems running smoothly. You are a blend of a pragmatic operator and a software ...

Together AI

AI Infrastructure Engineer

San Francisco, CA · On-site

$190K - $270K/yr

As an AI Infrastructure Engineer at Together, you are responsible for keeping all user-facing services and production systems running smoothly. You are a blend of a pragmatic operator and a software ...

AI Foundry

AI Infrastructure Engineer

Seattle, WA

$200K - $325K/yr

We are hiring multiple AI Infrastructure Engineers across data center infrastructure teams. Exact level, scope, and team placement may vary based on experience and business needs. AI Foundry is an AI ...

Utilidata

AI Infrastructure Engineer

Ann Arbor, MI · On-site +1

$170K - $210K/yr

The AI Infrastructure Engineer is responsible for designing, building, and owning the end-to-end infrastructure that serves Utilidata\'s AI and ML models across edge deployments, cloud environments ...

Utilidata

AI Infrastructure Engineer

Ann Arbor, MI · On-site +1

$170K - $210K/yr

The AI Infrastructure Engineer is responsible for designing, building, and owning the end-to-end infrastructure that serves Utilidata's AI and ML models across edge deployments, cloud environments ...

Fireworks AI

Software Engineer, AI Infrastructure

New York, NY · On-site

$189K - $224K/yr

As a Software Engineer on our AI Infrastructure team, you will help design the core systems that power Fireworks AI's generative AI platform. You will help build infrastructure and tools that ensure ...

Gatik AI

Senior AI Infrastructure Engineer

Mountain View, CA · On-site

$128K - $174K/yr

About the role We are seeking a Senior AI Infrastructure Engineer to design, build, and scale the high-performance AI platform powering our autonomous driving models. While researchers focus on ...

BNY Mellon

AI Infrastructure Engineer

Lake Mary, FL · On-site

$94K - $123K/yr

AI Infrastructure Engineer At BNY, our culture allows us to run our company better and enables employees' growth and success. As a leading global financial services company at the heart of the global ...

BNY

AI Infrastructure Engineer

Lake Mary, FL · Hybrid

$94K - $123K/yr

AI Infrastructure Engineer At BNY, our culture allows us to run our company better and enables employees' growth and success. As a leading global financial services company at the heart of the global ...

BNY

AI Infrastructure Engineer

Lake Mary, FL · Hybrid

$94K - $123K/yr

AI Infrastructure Engineer At BNY, our culture allows us to run our company better and enables employees' growth and success. As a leading global financial services company at the heart of the global ...

BNY Mellon

AI Infrastructure Engineer

Lake Mary, FL · On-site

$94K - $123K/yr

AI Infrastructure Engineer At BNY, our culture allows us to run our company better and enables employees' growth and success. As a leading global financial services company at the heart of the global ...

next page

Showing results 1-20

All JobsAi Infrastructure Job Jobs

Ai Infrastructure Job information

See salary details

$28

$59

$87

How much do ai infrastructure job jobs pay per hour?

As of Jun 20, 2026, the average hourly pay for ai infrastructure job in the United States is $59.18, according to ZipRecruiter salary data. Most workers in this role earn between $48.08 and $68.99 per hour, depending on experience, location, and employer.

What are some common challenges faced by professionals working in AI infrastructure roles?

Professionals in AI infrastructure roles often encounter challenges such as ensuring scalability and reliability of systems to handle large volumes of data and compute-intensive workloads. Managing the integration of diverse tools and frameworks, optimizing hardware and cloud resources, and maintaining security and compliance are also critical aspects. Additionally, effective collaboration with data scientists, software engineers, and DevOps teams is essential to streamline AI model deployment and monitoring. Staying current with rapidly evolving technologies is key to overcoming these challenges.

What is an AI Infrastructure job?

An AI Infrastructure job involves designing, building, and maintaining the foundational systems and tools required to support artificial intelligence and machine learning workloads. These professionals work on scalable computing environments, manage large datasets, and ensure high-performance computing resources are available for AI development and deployment. Their responsibilities often include optimizing hardware (like GPUs and TPUs), developing cloud-based solutions, and establishing reliable pipelines for data and model management. AI Infrastructure specialists collaborate with data scientists, ML engineers, and IT teams to deliver robust, efficient, and secure platforms that power AI applications.

What are the key skills and qualifications needed to thrive in an AI Infrastructure role, and why are they important?

To excel in an AI Infrastructure role, you need a strong background in computer science, cloud computing, and distributed systems, often supported by a relevant degree and experience with large-scale data environments. Proficiency with tools like Kubernetes, Docker, TensorFlow, PyTorch, and cloud platforms such as AWS, Azure, or Google Cloud is essential, along with familiarity with CI/CD pipelines and automation frameworks. Strong problem-solving, collaboration, and communication skills help drive innovation and facilitate cross-functional teamwork. These abilities ensure the robust, scalable, and efficient deployment of AI solutions that meet organizational needs.

What is the difference between Ai Infrastructure Job vs Data Engineer?

AspectAi Infrastructure JobData Engineer
Required CredentialsBachelor's in CS, Engineering, or related; knowledge of AI frameworksBachelor's in CS, Data Science, or related; programming skills in SQL, Python
Work EnvironmentData centers, cloud platforms, AI labsData pipelines, cloud environments, database systems
Industry UsageAI development, machine learning deploymentData processing, analytics, data pipeline creation

Ai Infrastructure Jobs focus on building and maintaining the hardware and software systems that support AI applications, including cloud and data center infrastructure. Data Engineers primarily develop and manage data pipelines and storage solutions to enable data analysis and machine learning. While both roles require technical skills and work in tech environments, Ai Infrastructure Jobs are more hardware and system-focused, whereas Data Engineers concentrate on data flow and management.

More about Ai Infrastructure Job jobs
What cities are hiring for Ai Infrastructure Job jobs? Cities with the most Ai Infrastructure Job job openings:
What states have the most Ai Infrastructure Job jobs? States with the most job openings for Ai Infrastructure Job jobs include:
What job categories do people searching Ai Infrastructure Job jobs look for? The top searched job categories for Ai Infrastructure Job jobs are:
Ai Infrastructure Job jobs near you
Infographic showing various Ai Infrastructure Job job openings in the United States as of June 2026, with employment types broken down into 64% Full Time, 27% Part Time, and 9% Temporary. Highlights an 66% Physical, 4% Hybrid, and 30% Remote job distribution, with an average salary of $123,103 per year, or $59.2 per hour.

AI Infrastructure Engineer

Together AI

San Francisco, CA • On-site

$190K - $270K/yr

Other

Medical

Posted 23 days ago

Job description

As an AI Infrastructure Engineer at Together, you are responsible for keeping all user-facing services and production systems running smoothly. You are a blend of a pragmatic operator and a software engineer that applies sound engineering principles, operational discipline, and mature automation to our operating environments and codebase.

You specialize in systems (operating systems, storage subsystems, networking), while implementing best practices for availability, reliability and scalability, with varied interests in algorithms and distributed systems.

Responsibilities

  • Participate in on-call rotation (Pagerduty) to respond to production incidents
  • Build and run our infrastructure with Ansible, Terraform, and Kubernetes to enable scaling to a massive number of concurrent users
  • Build monitoring systems to ensure the highest quality service for our customers
  • Design and implement operational processes (such as deployments and upgrades)
  • Debug production issues across all services and levels of the stack
  • Identify improvements for the product architecture from the reliability, performance and availability perspectives
  • Plan the growth of Together AI's infrastructure

Requirements

  • 5+ years of professional AI Infra or related experience
  • Bachelor's degree in Computer Science or a related field or equivalent work experience
  • Knowledge of Ansible (roles, playbooks), Terraform, and Kubernetes
  • Proficiency in programming/scripting languages
  • Direct experience in monitoring and observability practices
  • Knowledge of cloud services
  • Ability to thrive in a collaborative environment involving different stakeholders and subject matter experts

About Together AI

Together AI is a research-driven artificial intelligence company. We believe open and transparent AI systems will drive innovation and create the best outcomes for society, and together we are on a mission to significantly lower the cost of modern AI systems by co-designing software, hardware, algorithms, and models. We have contributed to leading open-source research, models, and datasets to advance the frontier of AI, and our team has been behind technological advancement such as FlashAttention, Hyena, FlexGen, and RedPajama. We invite you to join a passionate group of researchers and engineers in our journey in building the next generation AI infrastructure.

Compensation

We offer competitive compensation, startup equity, health insurance and other competitive benefits. The US base salary range for this full-time position is: $190,000 - $270,000 + equity + benefits. Our salary ranges are determined by location, level and role. Individual compensation will be determined by experience, skills, and job-related knowledge.

Equal Opportunity

Together AI is an Equal Opportunity Employer and is proud to offer equal employment opportunity to everyone regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, citizenship, marital status, disability, gender identity, veteran status, and more.

Apply