ZipRecruiter

Log In

1

Ai Infrastructure Job Jobs (NOW HIRING)

Together AI

AI Infrastructure Engineer

San Francisco, CA

$190K - $270K/yr

As an AI Infrastructure Engineer at Together, you are responsible for keeping all user-facing services and production systems running smoothly. You are a blend of a pragmatic operator and a software ...

Together AI

AI Infrastructure Engineer

San Francisco, CA · On-site

$190K - $270K/yr

As an AI Infrastructure Engineer at Together, you are responsible for keeping all user-facing services and production systems running smoothly. You are a blend of a pragmatic operator and a software ...

Together AI

AI Infrastructure Engineer

San Francisco, CA · On-site

$126K - $166K/yr

As an AI Infrastructure Engineer, you will be responsible for maintaining user-facing services and production systems, implementing best practices for availability and scalability, and building ...

The LaSalle Group

AI Infrastructure Director

Chicago, IL · On-site

$300K/yr

They are hiring an AI Infrastructure Director to architect, lead, and scale that platform. This is a single-point-of-accountability role at the intersection of cloud infrastructure, AI platform ...

The Josef Group

AI Infrastructure Engineer

Chantilly, VA

$110K - $144K/yr

AI Infrastructure Engineer Top Secret or TS/SCI is required to start $200K to $250K Chantilly, VA What You'll Do * Deploy and optimize self-hosted LLM inference servers (vLLM, Ollama, and similar)

BNY

AI Infrastructure Engineer

Lake Mary, FL · On-site

$94K - $123K/yr

They are seeking an AI Infrastructure Engineer to support enterprise-grade NVIDIA AI infrastructure, automate operations, and maintain AI training and inference pipelines. Responsibilities : • Be ...

Reveille Technologies

AI Infrastructure Engineer

Austin, TX · On-site

$106K - $139K/yr

AI Infrastructure Engineer (Forward Deployed AI Engineer) Location : Austin, TX / Fort Mill, SC Required Skills * Strong Python development * Infrastructure engineering * Cloud platforms (AWS ...

Bigbear.ai

Software Engineer (AI Infrastructure)

Columbia, MD · On-site

$170K - $201K/yr

Overview BigBear.ai is seeking a S oftware Engineer to support our AI infrastructure team. In this role, you'll help build and maintain the platform that provides the foundation for the customer's AI ...

BigBear.ai

Software Engineer (AI Infrastructure)

Columbia, MD · On-site

$170K - $201K/yr

Overview BigBear.ai is seeking a S oftware Engineer to support our AI infrastructure team. In this role, you'll help build and maintain the platform that provides the foundation for the customer's AI ...

Utilidata

AI Infrastructure Engineer

Ann Arbor, MI · Remote

$170K - $210K/yr

The AI Infrastructure Engineer is responsible for designing, building, and owning the end-to-end infrastructure that serves Utilidata's AI and ML models across edge deployments, cloud environments ...

Seekr

Staff AI Infrastructure Engineer

Austin, TX

$106K - $139K/yr

As a Staff AI Infrastructure Engineer, you will design, build, and operate the platforms that enable large-scale training, serving, evaluation, and deployment of foundation models and autonomous AI ...

next page

Showing results 1-20

All JobsAi Infrastructure Job Jobs

Ai Infrastructure Job information

See salary details

$28

$59

$87

How much do ai infrastructure job jobs pay per hour?

As of Aug 1, 2026, the average hourly pay for ai infrastructure job in the United States is $59.18, according to ZipRecruiter salary data. Most workers in this role earn between $48.08 and $68.99 per hour, depending on experience, location, and employer.

What are some common challenges faced by professionals working in AI infrastructure roles?

Professionals in AI infrastructure roles often encounter challenges such as ensuring scalability and reliability of systems to handle large volumes of data and compute-intensive workloads. Managing the integration of diverse tools and frameworks, optimizing hardware and cloud resources, and maintaining security and compliance are also critical aspects. Additionally, effective collaboration with data scientists, software engineers, and DevOps teams is essential to streamline AI model deployment and monitoring. Staying current with rapidly evolving technologies is key to overcoming these challenges.

What is an AI Infrastructure job?

An AI Infrastructure job involves designing, building, and maintaining the foundational systems and tools required to support artificial intelligence and machine learning workloads. These professionals work on scalable computing environments, manage large datasets, and ensure high-performance computing resources are available for AI development and deployment. Their responsibilities often include optimizing hardware (like GPUs and TPUs), developing cloud-based solutions, and establishing reliable pipelines for data and model management. AI Infrastructure specialists collaborate with data scientists, ML engineers, and IT teams to deliver robust, efficient, and secure platforms that power AI applications.

What are the key skills and qualifications needed to thrive in an AI Infrastructure role, and why are they important?

To excel in an AI Infrastructure role, you need a strong background in computer science, cloud computing, and distributed systems, often supported by a relevant degree and experience with large-scale data environments. Proficiency with tools like Kubernetes, Docker, TensorFlow, PyTorch, and cloud platforms such as AWS, Azure, or Google Cloud is essential, along with familiarity with CI/CD pipelines and automation frameworks. Strong problem-solving, collaboration, and communication skills help drive innovation and facilitate cross-functional teamwork. These abilities ensure the robust, scalable, and efficient deployment of AI solutions that meet organizational needs.

What is the difference between Ai Infrastructure Job vs Data Engineer?

AspectAi Infrastructure JobData Engineer
Required CredentialsBachelor's in CS, Engineering, or related; knowledge of AI frameworksBachelor's in CS, Data Science, or related; programming skills in SQL, Python
Work EnvironmentData centers, cloud platforms, AI labsData pipelines, cloud environments, database systems
Industry UsageAI development, machine learning deploymentData processing, analytics, data pipeline creation

Ai Infrastructure Jobs focus on building and maintaining the hardware and software systems that support AI applications, including cloud and data center infrastructure. Data Engineers primarily develop and manage data pipelines and storage solutions to enable data analysis and machine learning. While both roles require technical skills and work in tech environments, Ai Infrastructure Jobs are more hardware and system-focused, whereas Data Engineers concentrate on data flow and management.

More about Ai Infrastructure Job jobs
What cities are hiring for Ai Infrastructure Job jobs? Cities with the most Ai Infrastructure Job job openings:
What states have the most Ai Infrastructure Job jobs? States with the most job openings for Ai Infrastructure Job jobs include:
What job categories do people searching Ai Infrastructure Job jobs look for? The top searched job categories for Ai Infrastructure Job jobs are:
Ai Infrastructure Job jobs near you
Infographic showing various Ai Infrastructure Job job openings in the United States as of July 2026, with employment types broken down into 73% Full Time, 24% Part Time, and 3% Contract. Highlights an 65% Physical, 3% Hybrid, and 32% Remote job distribution, with an average salary of $123,103 per year, or $59.2 per hour.

AI Infrastructure Engineer

Together AI

San Francisco, CA

$190K - $270K/yr

Other

Medical

Re-posted 4 days ago

Job description

As an AI Infrastructure Engineer at Together, you are responsible for keeping all user-facing services and production systems running smoothly. You are a blend of a pragmatic operator and a software engineer that applies sound engineering principles, operational discipline, and mature automation to our operating environments and codebase.

You specialize in systems (operating systems, storage subsystems, networking), while implementing best practices for availability, reliability and scalability, with varied interests in algorithms and distributed systems.

Responsibilities

  • Participate in on-call rotation (Pagerduty) to respond to production incidents
  • Build and run our infrastructure with Ansible, Terraform, and Kubernetes to enable scaling to a massive number of concurrent users
  • Build monitoring systems to ensure the highest quality service for our customers
  • Design and implement operational processes (such as deployments and upgrades)
  • Debug production issues across all services and levels of the stack
  • Identify improvements for the product architecture from the reliability, performance and availability perspectives
  • Plan the growth of Together AI's infrastructure

Requirements

  • 5+ years of professional AI Infra or related experience
  • Bachelor's degree in Computer Science or a related field or equivalent work experience
  • Knowledge of Ansible (roles, playbooks), Terraform, and Kubernetes
  • Proficiency in programming/scripting languages
  • Direct experience in monitoring and observability practices
  • Knowledge of cloud services
  • Ability to thrive in a collaborative environment involving different stakeholders and subject matter experts

About Together AI

Together AI is a research-driven artificial intelligence company. We believe open and transparent AI systems will drive innovation and create the best outcomes for society, and together we are on a mission to significantly lower the cost of modern AI systems by co-designing software, hardware, algorithms, and models. We have contributed to leading open-source research, models, and datasets to advance the frontier of AI, and our team has been behind technological advancement such as FlashAttention, Hyena, FlexGen, and RedPajama. We invite you to join a passionate group of researchers and engineers in our journey in building the next generation AI infrastructure.

Compensation

We offer competitive compensation, startup equity, health insurance and other competitive benefits. The US base salary range for this full-time position is: $190,000 - $270,000 + equity + benefits. Our salary ranges are determined by location, level and role. Individual compensation will be determined by experience, skills, and job-related knowledge.

Equal Opportunity

Together AI is an Equal Opportunity Employer and is proud to offer equal employment opportunity to everyone regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, citizenship, marital status, disability, gender identity, veteran status, and more.

Apply