ZipRecruiter

Log In

1

Senior Ai Infrastructure Engineer Jobs (NOW HIRING)

Reveille Technologies

AI Infrastructure Engineer

Austin, TX · On-site

$106K - $139K/yr

Hi, Job Title : AI Infrastructure Engineer Location : Austin, TX or Fort mill, SC Duration: Fulltime or Contract Candidates must demonstrate strong hands-on expertise in Python, live coding ...

Seekr

Staff AI Infrastructure Engineer

Austin, TX

$106K - $139K/yr

As a Staff AI Infrastructure Engineer, you will design, build, and operate the platforms that enable large-scale training, serving, evaluation, and deployment of foundation models and autonomous AI ...

Seekr

Staff AI Infrastructure Engineer

Austin, TX · On-site

$106K - $139K/yr

As a Staff AI Infrastructure Engineer, you will design, build, and operate the platforms that enable large-scale training, serving, evaluation, and deployment of foundation models and autonomous AI ...

Seekr

Staff AI Infrastructure Engineer

Austin, TX · On-site

$106K - $139K/yr

As a Staff AI Infrastructure Engineer, you will design, build, and operate the platforms that enable large-scale training, serving, evaluation, and deployment of foundation models and autonomous AI ...

Radiology Partners

Senior AI Infrastructure Engineer

$111K - $151K/yr

RADIOLOGY PARTNERS OVERVIEW Radiology Partners, through its owned and affiliated practices, is a leading radiology practice in the U.S., serving hospitals and other healthcare facilities across the ...

MeshyAI

AI Infrastructure Engineer

Sunnyvale, CA · On-site

$125K - $164K/yr

The AI Infrastructure Engineer role involves ensuring the reliability and scalability of the AI model serving stack, while developing core engineering infrastructure to connect models to product ...

Utilidata

AI Infrastructure Engineer

Ann Arbor, MI · Remote

$170K - $210K/yr

The AI Infrastructure Engineer is responsible for designing, building, and owning the end-to-end infrastructure that serves Utilidata's AI and ML models across edge deployments, cloud environments ...

Autonomous Solutions

AI Infrastructure Engineer IV

Lehi, UT · On-site

$100K - $132K/yr

As an AI Infrastructure Engineer IV , you will play a critical role in designing, building, and maintaining the systems that power our AI and machine learning capabilities. You will ensure our ...

Tencent

Sr. Cloud AI Infrastructure Engineer

Palo Alto, CA · On-site

$127K - $173K/yr

Tencent is a leading technology company seeking a Sr. Cloud AI Infrastructure Engineer. This role involves conducting architecture research, optimizing performance for large-scale cloud computing ...

Meshy LLC

AI Infrastructure Engineer

Sunnyvale, CA

$126K - $165K/yr

The function owns the reliability, scalability, and operability of Meshy\'s AI model serving stack, along with core engineering infrastructure. The team operates a conventional production ...

NIO USA, INC

AI Infrastructure Engineer

San Jose, CA · On-site

$192K - $249K/yr

About the Position We are looking for a senior AI Inference Infrastructure Software Engineer with strong hands-on experience building, optimizing, and deploying high-performance, scalable inference ...

vCluster Labs

AI Infrastructure Engineer

New York, NY · Remote

$140K - $165K/yr

As an AI Infrastructure Engineer, your role will include: * Lead Technical Deployments: Drive end-to-end technical deployments for GPU neocloud and AI Factory customers, from initial bare metal ...

previous pagenext page

Showing results 21-40

All JobsAi Infrastructure Engineer JobsSenior Ai Infrastructure Engineer Jobs

Senior Ai Infrastructure Engineer information

See salary details

$22.5K

$127K

$175.5K

How much do senior ai infrastructure engineer jobs pay per year?

As of Aug 14, 2026, the average yearly pay for senior ai infrastructure engineer in the United States is $126,969.00, according to ZipRecruiter salary data. Most workers in this role earn between $108,500.00 and $147,500.00 per year, depending on experience, location, and employer.

What does a senior AI infrastructure engineer do?

A Senior AI Infrastructure Engineer is responsible for designing, building, and maintaining the large-scale computing systems that support artificial intelligence (AI) and machine learning (ML) workloads. They work on optimizing data pipelines, managing cloud or on-premise infrastructure, ensuring scalability, and enabling efficient training and deployment of AI models. These professionals collaborate closely with data scientists, software engineers, and IT teams to create robust, high-performance environments that support the rapid development and deployment of AI solutions.

What are some typical challenges faced by senior AI infrastructure engineers when scaling AI systems for production?

Senior AI Infrastructure Engineers often encounter challenges related to managing large-scale data pipelines, ensuring low-latency model serving, and maintaining system reliability as user demand grows. Balancing resource allocation for compute-intensive workloads, optimizing infrastructure costs, and implementing robust monitoring are common hurdles. Collaboration with data scientists, DevOps, and product teams is crucial to streamline deployment cycles and rapidly address issues as they arise. Mastery of distributed systems and cloud platforms often distinguishes top performers in this role.

What are the key skills and qualifications needed to thrive as a senior AI infrastructure engineer?

To thrive as a Senior AI Infrastructure Engineer, you need deep expertise in computer science, cloud computing, distributed systems, and AI/ML frameworks, often supported by a relevant degree and significant experience. Proficiency with tools such as Kubernetes, Docker, TensorFlow, PyTorch, and cloud platforms like AWS or Azure—as well as experience with CI/CD pipelines—is typically required. Strong problem-solving abilities, collaboration, and effective communication are standout soft skills for this role. These competencies are crucial for designing scalable, reliable AI infrastructure that supports complex machine learning workflows and organizational goals.
More about Senior Ai Infrastructure Engineer jobs

What cities are hiring for Senior Ai Infrastructure Engineer jobs?

Cities with the most Senior Ai Infrastructure Engineer job openings:

What are the most commonly searched types of Ai Infrastructure Engineer jobs?

The most popular types of Ai Infrastructure Engineer jobs are:

What states have the most Senior Ai Infrastructure Engineer jobs?

States with the most job openings for Senior Ai Infrastructure Engineer jobs include:

What job categories do people searching Senior Ai Infrastructure Engineer jobs look for?

The top searched job categories for Senior Ai Infrastructure Engineer jobs are:

Senior Ai Infrastructure Engineer jobs near you
Infographic showing various Senior Ai Infrastructure Engineer job openings in the United States as of August 2026, with employment types broken down into 100% Full Time. Highlights an 60% In-person, and 40% Remote job distribution, with an average salary of $126,969 per year, or $61 per hour.

AI Infrastructure Engineer / MLOps

Eitacies Inc

San Francisco, CA • On-site

$50 - $60/hr

Full-time

Retirement

Re-posted 9 days ago

Job description

Benefits:
  • 401(k)

AI Infrastructure Engineer / MLOps
San Francisco Bay Area, CA (100% Onsite)
EITACIES is looking for an experienced AI Infrastructure Engineer to support large scale AI and machine learning platforms running in cloud native environments.
Responsibilities
  • Design, deploy, and support scalable AI/ML infrastructure platforms
  • Manage Kubernetes environments running in AWS EKS
  • Build and maintain infrastructure automation using Python and Ansible
  • Support MLOps workflows including model deployment, monitoring, and operationalization
  • Troubleshoot complex Linux-based production environments
  • Partner with engineering teams to improve platform reliability, scalability, and performance
  • Implement observability, monitoring, and operational best practices across AI systems
  • Support modern AI architectures and agent-based workflows
Required Skills
  • 10+ years of Linux systems administration and engineering experience
  • 10+ years of Python development and automation experience
  • 5+ years of Kubernetes administration and operations
  • 5+ years of AWS cloud experience, including AWS EKS
  • 5+ years of infrastructure automation using Ansible
  • Experience supporting production-scale distributed systems
  • Strong troubleshooting and performance optimization skills
  • Experience working in enterprise environments
Preferred Skills
  • Experience with MLOps platforms and machine learning infrastructure
  • Exposure to Agentic AI architectures and AI orchestration frameworks
  • Experience supporting LLM-based applications and AI workloads
  • Knowledge of infrastructure-as-code and DevOps best practices
  • Experience with monitoring, logging, and observability platforms