ZipRecruiter

Log In

1

Ai Infra Jobs (NOW HIRING)

Nastech Global

AI Infra SRE Engineer

San Jose, CA · Remote

$58.25 - $77.50/hr

Position: AI Infra SRE Engineer - DGX Location: Remote Duration: Fulltime Must-have * NVIDIA (DGX) or equivalent high-performance-compute (HPC) clusters (e.g. Cray, HPE, IBM) * Cisco UCS C885A

Sarah Smith Fund

Software Engineer, AI Infra

Palo Alto, CA · On-site

$140 - $180/hr

Background in building infra for multi‑tenant SaaS, enterprise AI/ML platforms, or operational automation at scale * Previous startup experience or experience leading high‑impact projects through ...

Hewlett Packard Enterprise Development LP

$120 - $180/hr

Senior Engineer - NPAT Content Services AI Infra. This role has been designed as 'Hybrid' with a requirement that you will work on average 2 days per week from an HPE office. Who We Are: Hewlett ...

Pika

Software Engineer, AI Infra

Palo Alto, CA · On-site

$250K - $350K/yr

Background in building infra for multi-tenant SaaS, enterprise AI/ML platforms, or operational automation at scale * Previous startup experience or experience leading high-impact projects through ...

Serotonin

AI Infra Engineer

New York, NY · On-site

Build multi-step AI agents that automate research, synthesis, monitoring, and reporting. Not single-call LLM wrappers, but orchestrated systems with memory, defined tools, and structured output ...

Serotonin

AI Infra Engineer

Chicago, IL · On-site

Build multi-step AI agents that automate research, synthesis, monitoring, and reporting. Not single-call LLM wrappers, but orchestrated systems with memory, defined tools, and structured output ...

Serotonin

AI Infra Engineer

Los Angeles, CA · On-site

Build multi-step AI agents that automate research, synthesis, monitoring, and reporting. Not single-call LLM wrappers, but orchestrated systems with memory, defined tools, and structured output ...

Serotonin

AI Infra Engineer

San Francisco, CA · On-site

Build multi-step AI agents that automate research, synthesis, monitoring, and reporting. Not single-call LLM wrappers, but orchestrated systems with memory, defined tools, and structured output ...

Amperos Health, Inc

AI Research Engineer

New York, NY · On-site

$200K - $300K/yr

About the role As an AI Engineer on our research team, you'll work on our hardest research and AI infra problems. You'll both help prototype new products and also work on turning prototypes into a ...

Coupang

Sr. Director, AI Infrastructure

Seattle, WA · On-site

$184 - $376/hr

AI Infra Development and Operations * Oversee the design, implementation, and maintenance of the core orchestration platforms for large‑scale AI model training (e.g., distributed training ...

next page

Showing results 1-20

All JobsTechnology JobsAi Infra Jobs

Ai Infra information

See salary details

$43K

$88.7K

$139.5K

How much do ai infra jobs pay per year?

As of Sep 2, 2026, the average yearly pay for ai infra in the United States is $88,722.00, according to ZipRecruiter salary data. Most workers in this role earn between $70,000.00 and $101,000.00 per year, depending on experience, location, and employer.

What are AI infrastructure jobs?

AI infrastructure jobs involve designing, deploying, and maintaining the hardware and software systems that support artificial intelligence applications. These roles often require knowledge of cloud platforms, networking, data storage, and machine learning frameworks, and may include positions such as AI infrastructure engineer or systems architect.

Which AI Infra job is highly paid?

In AI infrastructure, roles such as AI Infrastructure Engineer and Machine Learning Infrastructure Engineer tend to be highly paid due to their specialized skills in deploying and maintaining large-scale AI systems, often requiring expertise in cloud platforms, distributed systems, and automation tools. Senior positions or those with advanced certifications typically command higher salaries in this field.
More about Ai Infra jobs

What cities are hiring for Ai Infra jobs?

Cities with the most Ai Infra job openings:

What states have the most Ai Infra jobs?

States with the most job openings for Ai Infra jobs include:

What job categories do people searching Ai Infra jobs look for?

The top searched job categories for Ai Infra jobs are:

Ai Infra jobs near you
Infographic showing various Ai Infra job openings in the United States as of August 2026, with employment types broken down into 76% Full Time, 21% Part Time, and 3% Contract. Highlights an 64% Physical, 4% Hybrid, and 32% Remote job distribution, with an average salary of $88,722 per year, or $42.7 per hour.

AI Infra SRE Engineer

Nastech Global

San Jose, CA • Remote

$58.25 - $77.50/hr

Full-time

Re-posted 28 days ago

Job description

Position: AI Infra SRE Engineer – DGX

Location: Remote

Duration: Fulltime

Must-have

  • NVIDIA (DGX) or equivalent high-performance-compute (HPC) clusters (e.g. Cray, HPE, IBM)
  • Cisco UCS C885A
  • Docker

Good to have

  • DevOps Automation
  • CI/CD systems (e.g., GitLab, GitHub Actions, Jenkins)
  • Terraform, Ansible, Jenkins
  • Python
  • GoLang, C/C++
  • Enterprise Grade Kubernetes cluster (RedHat OpenShift – preferred) and/or Google Anthos
  • Software development lifecycle includes design, development, testing, packaging, and deployment using Golang

Roles & Responsibilities

  • Technical knowledge of high-performance compute, NVIDIA DGX/GPUs and/or Cisco Unified Compute System.
  • Handle availability, latency, scalability and efficiency of NVIDIA and Cisco UCS infrastructure
  • by instilling engineering reliability into the development life cycle with a focus on fault tolerant approaches.
  • Drive capacity planning, performance analysis, instrumentation, and other non-functional systems requirements.
  • Automate operational capabilities using Python, Ansible, Terraform, Go etc.
  • Deliver automation through CI/CD pipeline and chatbot etc.
  • Implement metrics driven processes to ensure service quality targets are met.