ZipRecruiter

Log In

1

Senior Ai Infrastructure Engineer Jobs (NOW HIRING)

Autonomous Solutions

AI Infrastructure Engineer IV

Lehi, UT · On-site

$100K - $132K/yr

As an AI Infrastructure Engineer IV , you will play a critical role in designing, building, and maintaining the systems that power our AI and machine learning capabilities. You will ensure our ...

Autonomous Solutions

AI Infrastructure Engineer IV

Lehi, UT · On-site

$100K - $132K/yr

As an AI Infrastructure Engineer IV , you will play a critical role in designing, building, and maintaining the systems that power our AI and machine learning capabilities. You will ensure our ...

Utilidata

AI Infrastructure Engineer

Ann Arbor, MI · On-site +1

$170K - $210K/yr

The AI Infrastructure Engineer is responsible for designing, building, and owning the end-to-end infrastructure that serves Utilidata's AI and ML models across edge deployments, cloud environments ...

BNY

AI Infrastructure Engineer

Lake Mary, FL · Hybrid

$94K - $123K/yr

AI Infrastructure Engineer At BNY, our culture allows us to run our company better and enables employees' growth and success. As a leading global financial services company at the heart of the global ...

BNY

AI Infrastructure Engineer

Lake Mary, FL · Hybrid

$94K - $123K/yr

AI Infrastructure Engineer At BNY, our culture allows us to run our company better and enables employees' growth and success. As a leading global financial services company at the heart of the global ...

Percepta

AI Infrastructure Engineer

$110K - $144K/yr

They are seeking an AI Infrastructure Engineer to own the infrastructure and operational reliability that powers their AI systems, focusing on defining infrastructure patterns and building ...

Percepta

AI Infrastructure Engineer

New York, NY · On-site

$180K - $300K/yr

About the role We're hiring an AI Infrastructure Engineer to own the infrastructure, deployment, and operational reliability that powers Percepta's AI systems, including the autonomous agents at the ...

Meshy LLC

AI Infrastructure Engineer

Sunnyvale, CA

$126K - $165K/yr

The function owns the reliability, scalability, and operability of Meshy\'s AI model serving stack, along with core engineering infrastructure. The team operates a conventional production ...

NIO

AI Infrastructure Engineer

San Jose, CA · On-site

$126K - $165K/yr

About the Position We are looking for a senior AI Inference Infrastructure Software Engineer with strong hands-on experience building, optimizing, and deploying high-performance, scalable inference ...

vCluster Labs

AI Infrastructure Engineer

New York, NY · Remote

$150K - $200K/yr

As an AI Infrastructure Engineer, your role will include: * Lead Technical Deployments: Drive end-to-end technical deployments for GPU neocloud and AI Factory customers, from initial bare metal ...

NIO

AI Infrastructure Engineer

San Jose, CA · On-site

$126K - $165K/yr

About the Position We are looking for a senior AI Inference Infrastructure Software Engineer with strong hands-on experience building, optimizing, and deploying high-performance, scalable inference ...

next page

Showing results 1-20

All JobsAi Infrastructure Engineer JobsSenior Ai Infrastructure Engineer Jobs

Senior Ai Infrastructure Engineer information

See salary details

$22.5K

$127K

$175.5K

How much do senior ai infrastructure engineer jobs pay per year?

As of Jun 9, 2026, the average yearly pay for senior ai infrastructure engineer in the United States is $126,969.00, according to ZipRecruiter salary data. Most workers in this role earn between $108,500.00 and $147,500.00 per year, depending on experience, location, and employer.

What does a Senior AI Infrastructure Engineer do?

A Senior AI Infrastructure Engineer is responsible for designing, building, and maintaining the large-scale computing systems that support artificial intelligence (AI) and machine learning (ML) workloads. They work on optimizing data pipelines, managing cloud or on-premise infrastructure, ensuring scalability, and enabling efficient training and deployment of AI models. These professionals collaborate closely with data scientists, software engineers, and IT teams to create robust, high-performance environments that support the rapid development and deployment of AI solutions.

What are some typical challenges faced by Senior AI Infrastructure Engineers when scaling AI systems for production?

Senior AI Infrastructure Engineers often encounter challenges related to managing large-scale data pipelines, ensuring low-latency model serving, and maintaining system reliability as user demand grows. Balancing resource allocation for compute-intensive workloads, optimizing infrastructure costs, and implementing robust monitoring are common hurdles. Collaboration with data scientists, DevOps, and product teams is crucial to streamline deployment cycles and rapidly address issues as they arise. Mastery of distributed systems and cloud platforms often distinguishes top performers in this role.

What are the key skills and qualifications needed to thrive as a Senior AI Infrastructure Engineer, and why are they important?

To thrive as a Senior AI Infrastructure Engineer, you need deep expertise in computer science, cloud computing, distributed systems, and AI/ML frameworks, often supported by a relevant degree and significant experience. Proficiency with tools such as Kubernetes, Docker, TensorFlow, PyTorch, and cloud platforms like AWS or Azure—as well as experience with CI/CD pipelines—is typically required. Strong problem-solving abilities, collaboration, and effective communication are standout soft skills for this role. These competencies are crucial for designing scalable, reliable AI infrastructure that supports complex machine learning workflows and organizational goals.
More about Senior Ai Infrastructure Engineer jobs
What cities are hiring for Senior Ai Infrastructure Engineer jobs? Cities with the most Senior Ai Infrastructure Engineer job openings:
What are the most commonly searched types of Ai Infrastructure Engineer jobs? The most popular types of Ai Infrastructure Engineer jobs are:
What states have the most Senior Ai Infrastructure Engineer jobs? States with the most job openings for Senior Ai Infrastructure Engineer jobs include:
What job categories do people searching Senior Ai Infrastructure Engineer jobs look for? The top searched job categories for Senior Ai Infrastructure Engineer jobs are:
Senior Ai Infrastructure Engineer jobs near you
Infographic showing various Senior Ai Infrastructure Engineer job openings in the United States as of June 2026, with employment types broken down into 70% Full Time, 28% Part Time, and 2% Contract. Highlights an 87% Physical, 5% Hybrid, and 8% Remote job distribution, with an average salary of $126,969 per year, or $61 per hour.
AI Infrastructure Engineer IV

AI Infrastructure Engineer IV

Autonomous Solutions

Lehi, UT • On-site

$100K - $132K/yr

Full-time

Posted 2 days ago

Job description

At ASI, we are revolutionizing industries with state-of-the-art autonomous robotics solutions. Within the fields of agriculture, construction, landscaping, and logistics, we deliver technologies that enhance safety, productivity, and efficiency. With our core values of Simplicity, Safety, Transparency, Humility, Attention to Detail and Growth guiding everything we do, we're shaping the future of automation in dynamic markets.
As an AI Infrastructure Engineer IV, you will play a critical role in designing, building, and maintaining the systems that power our AI and machine learning capabilities. You will ensure our compute, storage, and cloud environments are scalable, efficient, and tuned for high-performance AI workloads. Working closely with data scientists, robotics engineers, and software teams, you'll develop robust infrastructure that supports the deployment and reliability of our AI-driven autonomous systems.
Responsibilities:
  • Design, build, and maintain high-performance computing infrastructure including CPUs, GPUs, storage, and networking to support AI and ML workloads.
  • Deploy and manage AI systems within cloud environments (AWS, Azure, GCP), ensuring scalability, cost-efficiency, and high availability.
  • Collaborate with data scientists, ML engineers, and software teams to support AI model development, training, and deployment workflows.
  • Implement automation, CI/CD, DevOps, and MLOps practices to create efficient, repeatable, and reliable AI infrastructure processes.
  • Optimize compute and storage systems to achieve maximum performance and throughput for AI/ML pipelines.
  • Monitor system health and troubleshoot performance bottlenecks, infrastructure issues, and deployment challenges.

Required Qualifications:
  • Bachelor's degree in Computer Science, Computer Engineering, or a related technical field.
  • 8+ years of experience in cloud infrastructure, DevOps, or platform engineering with 3+ years working on AI/ML systems.
  • Strong understanding of modern AI infrastructure components, including distributed computing, GPU-accelerated systems, and large-scale storage.
  • Hands-on experience with cloud platforms such as AWS, Azure, or Google Cloud.
  • Proficiency with Kubernetes, Docker, Terraform, or similar containerization and orchestration tools.
  • Strong programming skills in Python and/or C++, with experience supporting machine learning frameworks (TensorFlow, PyTorch, etc.).
  • Experience implementing CI/CD pipelines, MLOps practices, and automation tooling.

At Autonomous Solutions, Inc. (ASI), we are committed to fostering a diverse, inclusive, and equitable workplace where all employees and applicants have equal opportunities. We prohibit discrimination and harassment of any kind based on race, color, religion, sex, national origin, age, disability, genetic information, veteran status, sexual orientation, gender identity, or any other legally protected characteristic. ASI complies with all applicable federal, state, and local laws regarding non-discrimination in employment and is dedicated to providing reasonable accommodations for individuals with disabilities throughout the hiring process.

Apply