1

Senior Ai Infrastructure Engineer Jobs (NOW HIRING)

AI Infrastructure Engineer

New York, NY · On-site

$215K - $350K/yr

We are seeking an AI Infrastructure Engineer to build, operate, and continuously enhance the Linux and GPU-based infrastructure that powers our AI platforms and performance testing environments. This ...

We are seeking an AI Infrastructure Engineer to build, operate, and continuously enhance the Linux and GPU-based infrastructure that powers our AI platforms and performance testing environments. This ...

AI Infrastructure Engineer

New York, NY · On-site

$215K - $350K/yr

We are seeking an AI Infrastructure Engineer to build, operate, and continuously enhance the Linux and GPU-based infrastructure that powers our AI platforms and performance testing environments. This ...

Senior AI Infrastructure Engineer

$111K - $151K/yr

RADIOLOGY PARTNERS OVERVIEW Radiology Partners, through its owned and affiliated practices, is a leading radiology practice in the U.S., serving hospitals and other healthcare facilities across the ...

Staff AI Infrastructure Engineer

Austin, TX

$106K - $139K/yr

As a Staff AI Infrastructure Engineer, you will design, build, and operate the platforms that enable large-scale training, serving, evaluation, and deployment of foundation models and autonomous AI ...

Staff AI Infrastructure Engineer

Austin, TX · On-site

$106K - $139K/yr

As a Staff AI Infrastructure Engineer, you will design, build, and operate the platforms that enable large-scale training, serving, evaluation, and deployment of foundation models and autonomous AI ...

AI Infrastructure Engineer L3

Santa Clara, CA · On-site

$125K - $164K/yr

AI Infrastructure Engineer L3 Location: Santa Clara, CA Experience: 10 plus Years Employment Type: Full-Time About HCLTech HCLTech is a global technology company with over 220,000 professionals ...

AI Infrastructure Engineer

New York, NY · On-site

$117K - $154K/yr

YOUR ROLE AND IMPACT As an AI-Enabled Infrastructure and Systems Engineer, you will combine deep infrastructure expertise with modern software engineering practices to design, build, and operate the ...

AI Infrastructure Engineer

Ann Arbor, MI · Remote

$170K - $210K/yr

The AI Infrastructure Engineer is responsible for designing, building, and owning the end-to-end infrastructure that serves Utilidata's AI and ML models across edge deployments, cloud environments ...

Showing results 21-40

Senior Ai Infrastructure Engineer information

See salary details

$22.5K

$127K

$175.5K

How much do senior ai infrastructure engineer jobs pay per year?

As of Sep 4, 2026, the average yearly pay for senior ai infrastructure engineer in the United States is $126,969.00, according to ZipRecruiter salary data. Most workers in this role earn between $108,500.00 and $147,500.00 per year, depending on experience, location, and employer.

What does a senior AI infrastructure engineer do?

A Senior AI Infrastructure Engineer is responsible for designing, building, and maintaining the large-scale computing systems that support artificial intelligence (AI) and machine learning (ML) workloads. They work on optimizing data pipelines, managing cloud or on-premise infrastructure, ensuring scalability, and enabling efficient training and deployment of AI models. These professionals collaborate closely with data scientists, software engineers, and IT teams to create robust, high-performance environments that support the rapid development and deployment of AI solutions.

What are the key skills and qualifications needed to thrive as a senior AI infrastructure engineer?

To thrive as a Senior AI Infrastructure Engineer, you need deep expertise in computer science, cloud computing, distributed systems, and AI/ML frameworks, often supported by a relevant degree and significant experience. Proficiency with tools such as Kubernetes, Docker, TensorFlow, PyTorch, and cloud platforms like AWS or Azure—as well as experience with CI/CD pipelines—is typically required. Strong problem-solving abilities, collaboration, and effective communication are standout soft skills for this role. These competencies are crucial for designing scalable, reliable AI infrastructure that supports complex machine learning workflows and organizational goals.

What are some typical challenges faced by senior AI infrastructure engineers when scaling AI systems for production?

Senior AI Infrastructure Engineers often encounter challenges related to managing large-scale data pipelines, ensuring low-latency model serving, and maintaining system reliability as user demand grows. Balancing resource allocation for compute-intensive workloads, optimizing infrastructure costs, and implementing robust monitoring are common hurdles. Collaboration with data scientists, DevOps, and product teams is crucial to streamline deployment cycles and rapidly address issues as they arise. Mastery of distributed systems and cloud platforms often distinguishes top performers in this role.
More about Senior Ai Infrastructure Engineer jobs

What cities are hiring for Senior Ai Infrastructure Engineer jobs?

Cities with the most Senior Ai Infrastructure Engineer job openings:

What are the most commonly searched types of Ai Infrastructure Engineer jobs?

The most popular types of Ai Infrastructure Engineer jobs are:

What states have the most Senior Ai Infrastructure Engineer jobs?

States with the most job openings for Senior Ai Infrastructure Engineer jobs include:

Infographic showing various Senior Ai Infrastructure Engineer job openings in the United States as of August 2026, with employment types broken down into 76% Full Time, 20% Part Time, and 4% Contract. Highlights an 66% Physical, 4% Hybrid, and 30% Remote job distribution, with an average salary of $126,969 per year, or $61 per hour.

Senior AI infrastructure engineer - EDA Infrastructure

Nvidia

OR • On-site, Remote

$108K - $147K/yr

Full-time

Posted 2 days ago

New


Nvidia rating

9.6

Company rating: 9.6 out of 10

Based on 18 frontline employees who took The Breakroom Quiz

6th of 247 rated software companies


Job description

AI Infrastructure Engineers at NVIDIA build the systems, tooling, and data infrastructure that enable operation of our GPU cloud services. We are enabling engineering teams to innovate while proactively identifying, tracking, and mitigating risks across the entire technical task. This role is ideal for engineers who thrive at the intersection of product, infrastructure, and software engineering and who want to build automated, intelligence-driven systems that protect NVIDIA's most critical AI platforms.

What you'll be doing: Telemetry Build and operate scalable telemetry pipelines for metrics, logs, traces, and events across on-premise, CSP, and NCP clusters. Establish common instrumentation, collection, storage, and access patterns so teams can generate and consume telemetry consistently. Deliver dashboards, alerting, and analysis capabilities that improve service visibility, detection, and troubleshooting.

Operational Excellence Standardize and automate incident, maintenance, service on-call, and support on-call workflows across HWInf. Integrate operational data and lifecycle signals to improve ownership, escalation, communication, and post-incident learning. Build reporting and AI-assisted tooling that reduces manual toil and improves operational responsiveness.

Cataloging and Inventory Build and maintain physical hardware and software catalogs as trusted sources of truth for infrastructure inventory, service ownership, dependencies, and documentation. Create consistent data models and integration pipelines that connect clusters, hardware, services, teams, and operational workflows. Provide self-service discovery capabilities so engineers can quickly identify what they operate, who owns it, and how to support it.

What we need to see: BS degree in Computer Science, Computer Engineering, or a related technical field, or equivalent experience. 8+ years of experience in infrastructure security, platform engineering, or security tooling. Proficiency in one or more programming languages such as Python, Go, Typescript, or Java.

Strong understanding of software and infrastructure principles, with experience applying them in production environments. Ability to lead cross-functional initiatives that span internal teams and external partners in varying disciplines across engineering, product, finance, and security. Ways to stand out from the crowd: Experience building and operating incident-management processes with internally built and/or externally vended SaaS tools Experience working with building, deploying, and maintaining ML models in production systems along with familiarity with AI agent frameworks or orchestration tools Experience building and operating modern observability platforms to deliver scalable metrics, logs, traces, and profiling Experience working with service catalog and configuration management databases (CMDB) NVIDIA is widely considered to be one of the technology world's most desirable employers.

We have some of the most forward-thinking and hard-working people in the world working for us. Are you creative and autonomous. Do you love a challenge.

If so, we want to hear from you. NVIDIA is leading the way in groundbreaking developments in Artificial Intelligence, High-Performance Computing and Visualization. The GPU, our invention, serves as the visual cortex of modern computers and is at the heart of our products and services.

If you're creative and self-motivated, we want to hear from you. NVIDIA is leading the way in groundbreaking developments in Artificial Intelligence, High-Performance Computing and Visualization. The GPU, our invention, serves as the visual cortex of modern computers and is at the heart of our products and services.

Your base salary will be determined based on your location, experience, and the pay of employees in similar positions. The base salary range is 184,000 USD - 287,500 USD for Level 4, and 224,000 USD - 356,500 USD for Level 5. You will also be eligible for equity and benefits.

Applications for this job will be accepted at least until September 4, 2026. This posting is for an existing vacancy. NVIDIA uses AI tools in its recruiting processes.

NVIDIA is committed to fostering an inclusive work environment and proud to be an equal opportunity employer. As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law.


What Nvidia employees say

Pay

Benefits

Hours and flexibility

Workplace

Get the full story on Breakroom


Nvidia logo

About Nvidia

Sourced by ZipRecruiter

NVIDIA has been transforming computer graphics, PC gaming, and accelerated computing for more than 25 years. It's a unique legacy of innovation that's fueled by great technology--and amazing people. Today, we're tapping into the unlimited potential of AI to define the next era of computing. An era in which our GPU acts as the brains of computers, robots, and self-driving cars that can understand the world. Doing what's never been done before takes vision, innovation, and the world's best talent.

Industry

Computer and electronic product manufacturing

Company size

10,000+ Employees

Headquarters location

Santa Clara, CA, US