1

Ai Infra Jobs (NOW HIRING)

AI Infra SRE Engineer

San Jose, CA · Remote

$58.25 - $77.50/hr

Position: AI Infra SRE Engineer - DGX Location: Remote Duration: Fulltime Must-have * NVIDIA (DGX) or equivalent high-performance-compute (HPC) clusters (e.g. Cray, HPE, IBM) * Cisco UCS C885A

Build multi-step AI agents that automate research, synthesis, monitoring, and reporting. Not single-call LLM wrappers, but orchestrated systems with memory, defined tools, and structured output ...

Software Engineer, AI Infra

Palo Alto, CA · On-site

$250K - $350K/yr

Background in building infra for multi-tenant SaaS, enterprise AI/ML platforms, or operational automation at scale * Previous startup experience or experience leading high-impact projects through ...

Build multi-step AI agents that automate research, synthesis, monitoring, and reporting. Not single-call LLM wrappers, but orchestrated systems with memory, defined tools, and structured output ...

Build multi-step AI agents that automate research, synthesis, monitoring, and reporting. Not single-call LLM wrappers, but orchestrated systems with memory, defined tools, and structured output ...

AI Infra Engineer

Chicago, IL · Remote

$90K - $150K/yr

Build multi-step AI agents that automate research, synthesis, monitoring, and reporting. Not single-call LLM wrappers, but orchestrated systems with memory, defined tools, and structured output ...

AI Infra Engineer

San Francisco, CA · Remote

$90K - $150K/yr

Build multi-step AI agents that automate research, synthesis, monitoring, and reporting. Not single-call LLM wrappers, but orchestrated systems with memory, defined tools, and structured output ...

Build multi-step AI agents that automate research, synthesis, monitoring, and reporting. Not single-call LLM wrappers, but orchestrated systems with memory, defined tools, and structured output ...

AI Infra Engineer

Los Angeles, CA · Remote

$90K - $150K/yr

Build multi-step AI agents that automate research, synthesis, monitoring, and reporting. Not single-call LLM wrappers, but orchestrated systems with memory, defined tools, and structured output ...

AI Infrastructure Engineer

San Francisco, CA · On-site

$126K - $166K/yr

Required : • 5+ years of professional AI Infra or related experience • Bachelor's degree in Computer Science or a related field or equivalent work experience • Knowledge of Ansible (roles ...

This is the AI-native specialist seat: the leader must be deep in agents, LLM orchestration, and the infra that makes them reliable at scale, and must build the platform org and its quality bar. A ...

AI Research Engineer

New York, NY · On-site

$200K - $300K/yr

About the role As an AI Engineer on our research team, you'll work on our hardest research and AI infra problems. You'll both help prototype new products and also work on turning prototypes into a ...

Technical Recruiting at Krea We're a small team and we want to hire exceptional people across infra, backend, AI research, and product. You'll work directly with the founders to find those people and ...

Plan the growth of Together AI's infrastructure Requirements * 5+ years of professional AI Infra or related experience * Bachelor's degree in Computer Science or a related field or equivalent work ...

Why This Role Matters AI infra today is fragmented, opaque, and largely built for researchers-not product teams. The company is changing that. As the first GTM hire , you will define the categories ...

next page

Showing results 1-20

Ai Infra information

See salary details

$43K

$88.7K

$139.5K

How much do ai infra jobs pay per year?

As of Jul 22, 2026, the average yearly pay for ai infra in the United States is $88,722.00, according to ZipRecruiter salary data. Most workers in this role earn between $70,000.00 and $101,000.00 per year, depending on experience, location, and employer.
More about Ai Infra jobs
What cities are hiring for Ai Infra jobs? Cities with the most Ai Infra job openings:
What states have the most Ai Infra jobs? States with the most job openings for Ai Infra jobs include:
Infographic showing various Ai Infra job openings in the United States as of July 2026, with employment types broken down into 89% Full Time, and 11% Contract. Highlights an 89% In-person, and 11% Remote job distribution, with an average salary of $88,722 per year, or $42.7 per hour.

AI Infra SRE Engineer

Nastech Global

San Jose, CA • Remote

$58.25 - $77.50/hr

Full-time

Re-posted 16 days ago


Job description

Position: AI Infra SRE Engineer – DGX

Location: Remote

Duration: Fulltime

Must-have

  • NVIDIA (DGX) or equivalent high-performance-compute (HPC) clusters (e.g. Cray, HPE, IBM)
  • Cisco UCS C885A
  • Docker

Good to have

  • DevOps Automation
  • CI/CD systems (e.g., GitLab, GitHub Actions, Jenkins)
  • Terraform, Ansible, Jenkins
  • Python
  • GoLang, C/C++
  • Enterprise Grade Kubernetes cluster (RedHat OpenShift – preferred) and/or Google Anthos
  • Software development lifecycle includes design, development, testing, packaging, and deployment using Golang

Roles & Responsibilities

  • Technical knowledge of high-performance compute, NVIDIA DGX/GPUs and/or Cisco Unified Compute System.
  • Handle availability, latency, scalability and efficiency of NVIDIA and Cisco UCS infrastructure
  • by instilling engineering reliability into the development life cycle with a focus on fault tolerant approaches.
  • Drive capacity planning, performance analysis, instrumentation, and other non-functional systems requirements.
  • Automate operational capabilities using Python, Ansible, Terraform, Go etc.
  • Deliver automation through CI/CD pipeline and chatbot etc.
  • Implement metrics driven processes to ensure service quality targets are met.