1

Ai Infrastructure Engineer Jobs (NOW HIRING)

We are hiring multiple AI Infrastructure Engineers across data center infrastructure teams. Exact level, scope, and team placement may vary based on experience and business needs. AI Foundry is an AI ...

AI Infrastructure Engineer

San Francisco, CA · On-site

$190K - $270K/yr

As an AI Infrastructure Engineer at Together, you are responsible for keeping all user-facing services and production systems running smoothly. You are a blend of a pragmatic operator and a software ...

AI Infrastructure Engineer

San Francisco, CA · On-site

$190K - $270K/yr

As an AI Infrastructure Engineer at Together, you are responsible for keeping all user-facing services and production systems running smoothly. You are a blend of a pragmatic operator and a software ...

AI Infrastructure Engineer

Katy, TX · Remote

$98K - $129K/yr

AI Infrastructure Engineer Job Title: AI Infrastructure Engineer Location: 100% Remote (Continental United States) Position Type: In-house Bright Vision Technologies SOW engagement (no third-party ...

AI Infrastructure Engineer

San Jose, CA · Hybrid

$126K - $165K/yr

AI Infrastructure Engineer (Nutanix AI Platform) Location: San Jose, CA (Hybrid/Onsite Preferred) Duration: 12 months+ Contract Experience: 10+ Years Rate: Negotiable Position Overview We are seeking ...

AI Infrastructure Engineer

Katy, TX · Remote

$98K - $129K/yr

AI Infrastructure Engineer Job Title: AI Infrastructure Engineer Location: 100% Remote (Continental United States) Position Type: In-house Bright Vision Technologies SOW engagement (no third-party ...

AI Infrastructure Engineer

Seattle, WA · On-site

$122K - $160K/yr

They are seeking AI Infrastructure Engineers to help build and operate large-scale GPU infrastructure for training and inference workloads, focusing on hands-on systems work across various technical ...

AI Infrastructure Engineer

Pleasanton, CA · Remote

$145K - $195K/yr

Overview The AI Infrastructure Engineer will be responsible for designing, deploying, and maintaining robust infrastructure systems tailored for AI and machine learning operations. This role focuses ...

Senior AI Infrastructure Engineer

Wilmington, MA · Hybrid

$118K - $161K/yr

Senior AI Infrastructure Engineer, Developer Experience Analog Devices, Inc. (NASDAQ: ADI) is a global semiconductor leader that bridges the physical and digital worlds to enable breakthroughs at the ...

Senior AI Infrastructure Engineer

Wilmington, MA · On-site

$118K - $161K/yr

Senior AI Infrastructure Engineer, Developer Experience Analog Devices, Inc. (NASDAQ: ADI) is a global semiconductor leader that bridges the physical and digital worlds to enable breakthroughs at the ...

AI Infrastructure Engineer

Ann Arbor, MI · Remote

$170K - $210K/yr

The AI Infrastructure Engineer is responsible for designing, building, and owning the end-to-end infrastructure that serves Utilidata's AI and ML models across edge deployments, cloud environments ...

AI Infrastructure Engineer

Ann Arbor, MI · On-site +1

$170K - $210K/yr

The AI Infrastructure Engineer is responsible for designing, building, and owning the end-to-end infrastructure that serves Utilidata\'s AI and ML models across edge deployments, cloud environments ...

AI Infrastructure Engineer IV

Lehi, UT · On-site

$100K - $132K/yr

As an AI Infrastructure Engineer IV , you will play a critical role in designing, building, and maintaining the systems that power our AI and machine learning capabilities. You will ensure our ...

AI Infrastructure Engineer

Sunnyvale, CA · On-site

$125K - $164K/yr

The AI Infrastructure Engineer role involves ensuring the reliability and scalability of the AI model serving stack, while developing core engineering infrastructure to connect models to product ...

AI Infrastructure Engineer

Ann Arbor, MI · On-site +1

$170K - $210K/yr

The AI Infrastructure Engineer is responsible for designing, building, and owning the end-to-end infrastructure that serves Utilidata's AI and ML models across edge deployments, cloud environments ...

AI Infrastructure Engineer IV

Mendon, UT · On-site

$93K - $122K/yr

As an AI Infrastructure Engineer IV , you will play a critical role in designing, building, and maintaining the systems that power our AI and machine learning capabilities. You will ensure our ...

AI Infrastructure Engineer IV

Lehi, UT · On-site

$100K - $132K/yr

As an AI Infrastructure Engineer IV , you will play a critical role in designing, building, and maintaining the systems that power our AI and machine learning capabilities. You will ensure our ...

next page

Showing results 1-20

Ai Infrastructure Engineer information

See salary details

$46.5K

$127.1K

$182K

How much do ai infrastructure engineer jobs pay per year?

As of Jun 6, 2026, the average yearly pay for ai infrastructure engineer in the United States is $127,066.00, according to ZipRecruiter salary data. Most workers in this role earn between $107,500.00 and $141,000.00 per year, depending on experience, location, and employer.

What does a typical day look like for an AI Infrastructure Engineer?

A typical day for an AI Infrastructure Engineer often involves designing and maintaining the underlying systems that support machine learning and AI workloads, such as setting up scalable cloud environments, automating workflows with CI/CD pipelines, and troubleshooting performance bottlenecks. You might collaborate closely with data scientists and software engineers to ensure seamless integration between AI models and production infrastructure. Daily activities can include writing and reviewing infrastructure-as-code, monitoring system health, and responding to incidents or scaling requests as needed. This role offers a dynamic mix of hands-on technical work, problem-solving, and teamwork, providing opportunities to refine your skills and contribute meaningfully to cutting-edge AI projects.

What are the key skills and qualifications needed to thrive in the Ai Infrastructure Engineer position, and why are they important?

To thrive as an AI Infrastructure Engineer, a strong background in computer science, cloud computing, and distributed systems is typically required, often supported by a degree in a related field. Familiarity with tools like Kubernetes, Docker, TensorFlow, and cloud platforms (AWS, Azure, or GCP), along with certifications in cloud technologies or DevOps, is highly valuable. Strong problem-solving abilities, collaboration, and effective communication skills are essential to excel within multidisciplinary engineering teams. These competencies ensure the reliable deployment, scaling, and optimization of AI workloads in dynamic production environments.

What does an AI Infrastructure Engineer do?

An AI Infrastructure Engineer designs, builds, and maintains the computing systems that support AI and machine learning workloads. They manage cloud services, optimize hardware and software performance, and ensure scalability for AI models. Their work involves configuring GPUs, CPUs, storage, and networking, as well as automating workflows with DevOps and MLOps tools. They collaborate with data scientists and engineers to streamline AI development and deployment. Their goal is to create reliable, efficient, and scalable AI infrastructure.

What cities are hiring for Ai Infrastructure Engineer jobs? Cities with the most Ai Infrastructure Engineer job openings:
What are the most commonly searched types of Ai Infrastructure Engineer jobs? The most popular types of Ai Infrastructure Engineer jobs are:
What states have the most Ai Infrastructure Engineer jobs? States with the most job openings for Ai Infrastructure Engineer jobs include:
What job categories do people searching Ai Infrastructure Engineer jobs look for? The top searched job categories for Ai Infrastructure Engineer jobs are:
Infographic showing various Ai Infrastructure Engineer job openings in the United States as of May 2026, with employment types broken down into 95% Full Time, 1% Part Time, and 4% Contract. Highlights an 85% Physical, 5% Hybrid, and 10% Remote job distribution, with an average salary of $127,066 per year, or $61.1 per hour.

AI Infrastructure Engineer

AI Foundry

Seattle, WA

$200K - $325K/yr

Full-time

Medical, Dental, Retirement

Posted 17 days ago


Job description

Compensation: $200K - $325K+

Travel Requirement: International travel required to India 8+ times per year

Multiple Openings: We are hiring multiple AI Infrastructure Engineers across data center infrastructure teams. Exact level, scope, and team placement may vary based on experience and business needs.

AI Foundry is an AI building and consulting business working with some of the largest companies in the world. AI Foundry is partnered with a major global company operating across finance, consumer, and retail verticals, leading their AI efforts from the ground up.

The team is seeking builders who want to be part of something massive: designing and building multi-agent AI systems that will reshape how hundreds of millions of people interact with financial services, retail, insurance, and consumer products.

AI Foundry is looking for AI Infrastructure Engineers to help build and operate large-scale GPU infrastructure for training and inference workloads. This is hands-on systems work across Linux, networking, storage, orchestration, observability, and automation in a data center environment.

If you want to build the infrastructure foundation for serious AI workloads rather than operate a small lab cluster, we want to hear from you.

What You'll Do
  • Build, configure, and operate GPU cluster infrastructure for training and inference workloads.
  • Work across Linux systems, high-performance networking, storage, orchestration, monitoring, and automation.
  • Support provisioning, configuration management, job scheduling, workload management, and lifecycle operations.
  • Implement observability, alerting, incident response, and operational runbooks for infrastructure health.
  • Partner with hardware, facilities, vendors, and engineering teams to resolve performance, reliability, and capacity issues.
  • Automate repetitive operational tasks and improve the reliability of cluster operations.
  • Help evaluate hardware, networking, storage, and platform components for AI workloads.
  • Document systems clearly so global teams can operate and troubleshoot consistently.
  • Travel to India 8+ times per year to work directly with infrastructure and client teams.
Who You Are
  • You have strong Linux systems engineering experience and enjoy hands-on infrastructure work.
  • You understand GPU infrastructure or are deeply motivated to build expertise in NVIDIA systems, CUDA, NCCL, and distributed AI workloads.
  • You have experience with networking, storage, Kubernetes, Slurm, observability, automation, or related infrastructure tooling.
  • You can troubleshoot complex systems methodically and communicate what you are seeing.
  • You care about reliability, operational clarity, and repeatable systems.
  • You are comfortable working with incomplete information and learning quickly.
  • You can collaborate with infrastructure, facilities, vendor, and engineering teams across time zones.
  • You write useful documentation and runbooks.
  • You are energized by building greenfield infrastructure at serious scale.
  • You use AI and modern tools to improve how you build, debug, document, and operate systems.
How We Work

We are looking for people who use AI to raise the speed, quality, and ambition of the work while staying grounded in customers, teammates, and measurable outcomes.

  • We are hands-on with AI and technical tools, and we make ideas tangible through prototypes, clear artifacts, and working systems.
  • We move quickly, share work early, and keep refining until the product experience feels useful, polished, and memorable.
  • We focus on the hardest problems and the outcomes that matter, with the judgment to change course when the evidence points somewhere better.
  • We communicate clearly enough that teammates, leaders, and AI-assisted workflows can act on our thinking across time zones.
  • We collaborate with openness and respect, build on other people's ideas, and treat shared ownership as part of doing excellent work.
  • We speak up directly and constructively when something looks wrong, then commit fully once a decision is made.
Benefits & More
  • Medical and Dental benefits
  • 401K
  • Opportunity to shape AI strategy for 500M+ users