ZipRecruiter

Log In

1

Machine Learning Infrastructure Engineer Jobs (NOW HIRING)

Causal Labs

Machine Learning - Infrastructure

San Francisco, CA · On-site

$127K - $173K/yr

Causal Labs is a team of researchers and engineers from self-driving, drug discovery, and robotics ... We look for infrastructure engineers who are excited to tackle unsolved problems. Our training and ...

Maven Robotics

ML Infrastructure Engineer

San Francisco, CA · On-site

$126K - $166K/yr

Role Description We are looking to recruit an exceptional Infrastructure Engineer to own and build the backend systems that power machine learning at Maven Robotics. In this role, you will design and ...

next page

Showing results 1-20

All JobsMachine Learning Infrastructure Engineer Jobs

Machine Learning Infrastructure Engineer information

See salary details

$46.5K

$127.1K

$182K

How much do machine learning infrastructure engineer jobs pay per year?

As of Jul 7, 2026, the average yearly pay for machine learning infrastructure engineer in the United States is $127,066.00, according to ZipRecruiter salary data. Most workers in this role earn between $107,500.00 and $141,000.00 per year, depending on experience, location, and employer.

What are some common challenges faced by Machine Learning Infrastructure Engineers, and how can these be addressed on the job?

Machine Learning Infrastructure Engineers often face challenges such as ensuring infrastructure scalability, managing resource allocation, and maintaining system reliability while supporting rapid experimentation by data science teams. Balancing the needs for flexibility in research environments with production-grade stability requires a deep understanding of both engineering best practices and the unique requirements of machine learning workflows. Collaboration with data scientists, clear communication about infrastructure capabilities, and staying current with fast-evolving technologies are key strategies for success. Most companies encourage ongoing learning and provide opportunities to contribute to architecture decisions, which makes this a rewarding environment for problem-solvers and innovators.

What are the key skills and qualifications needed to thrive in the Machine Learning Infrastructure Engineer position, and why are they important?

To thrive as a Machine Learning Infrastructure Engineer, you need a strong background in computer science, cloud computing, distributed systems, and experience with machine learning frameworks, often supported by a degree in a related field. Familiarity with tools such as Docker, Kubernetes, Terraform, as well as cloud platforms like AWS, GCP, or Azure, and certifications in cloud or DevOps technologies are highly valued. Strong problem-solving abilities, effective communication, and collaboration skills help engineers work seamlessly with data scientists and cross-functional teams. These skills are essential to design, implement, and maintain robust, scalable infrastructure that enables efficient machine learning development and deployment.

What is a Machine Learning Infrastructure Engineer job?

A Machine Learning Infrastructure Engineer designs, builds, and maintains the systems that support the development and deployment of machine learning models. This includes managing data pipelines, optimizing model training and inference, and ensuring scalability and reliability in production environments. They work closely with data scientists, ML engineers, and DevOps teams to create efficient workflows and infrastructure. Key technologies often include cloud platforms, containerization, orchestration tools, and distributed computing frameworks.

More about Machine Learning Infrastructure Engineer jobs
What cities are hiring for Machine Learning Infrastructure Engineer jobs? Cities with the most Machine Learning Infrastructure Engineer job openings:
What states have the most Machine Learning Infrastructure Engineer jobs? States with the most job openings for Machine Learning Infrastructure Engineer jobs include:
What job categories do people searching Machine Learning Infrastructure Engineer jobs look for? The top searched job categories for Machine Learning Infrastructure Engineer jobs are:
Machine Learning Infrastructure Engineer jobs near you
Infographic showing various Machine Learning Infrastructure Engineer job openings in the United States as of July 2026, with employment types broken down into 95% Full Time, 2% Part Time, and 3% Contract. Highlights an 87% Physical, 4% Hybrid, and 9% Remote job distribution, with an average salary of $127,066 per year, or $61.1 per hour.

Senior / Staff Machine Learning Infrastructure Engineer

Waabi

Pittsburgh, PA • On-site, Remote

$157K - $234K/yr

Full-time

Re-posted 24 days ago

Job description

Waabi, founded by AI visionary Raquel Urtasun, is the leader in Physical AI. With a world-class team, we're unlocking the next era of autonomous transportation with technology that's powering commercial autonomous trucks and robotaxis. Waabi is backed by and partners with world leaders in AI, automotive, logistics, and deep tech.

With offices in Toronto, San Francisco, Dallas, and Pittsburgh, Waabi is growing quickly and looking for diverse, innovative and collaborative candidates who want to impact the world in a positive way. To learn more visit: www.waabi.ai

You will..
- Design, develop, and implement the machine learning platform for the continuous deployment and integration of machine learning models.
- Collaborate with data scientists and engineers to understand model requirements and optimize pipeline processes.
- Automate the training, testing and deployment processes for machine learning models.
- Continuously monitor and maintain model pipelines, ensuring optimal performance, accuracy and reliability.
- Optimize machine learning pipelines for scalability, efficiency and cost-effectiveness.
- Ensure compliance with security and data privacy standards in all MLOps activities.
 
Qualifications:
- 3-5 years of experience supporting machine learning training platforms.
- Bachelor’s degree in Computer Science, Data Science or a related field.
- Strong understanding of machine learning principles and model lifecycle management.
- Proficiency in programming languages such as Python, with hands-on experience in machine learning frameworks like TensorFlow or PyTorch.
- Experience with cloud platforms like AWS, Azure, or Google Cloud and their respective machine learning services.
- Experience managing technology such as JupyterHub and Kubeflow.
- Familiarity with containerization and orchestration tools such as Kubernetes and Docker.
- Strong problem-solving skills and ability to troubleshoot complex issues.
- Experience with monitoring tools and practices for model performance in production.
- Ability to work collaboratively in cross-functional teams.
 
Bonus/nice to have: 
- Experience with infrastructure-as-code (IaC) tools such as Terraform or Crossplane.
- Knowledge of big data technologies like Apache Spark or Hadoop.
- Familiarity with data engineering practices and tools.
- Experience with A/B testing and model validation in production environments.
- Relevant MLOps certifications (e.g., AWS Certified Machine Learning – Specialty, DataRobot MLOps Certification) are a plus.
The US yearly salary range for this role is: $157,000 - $234,000 USD in addition to competitive perks & benefits. Waabi (US) Inc.’s yearly salary ranges are determined based on several factors in accordance with the Company’s compensation practices. The salary base range is reflective of the minimum and maximum target for new hire salaries for the position across all US locations.  Note: The Company provides additional compensation for employees in this role, including equity incentive awards and an annual performance bonus.

Perks/Benefits:
- Competitive compensation and equity awards.
- Health and Wellness benefits encompassing Medical, Dental and Vision coverage (for full-time employees only).
- Unlimited Vacation.
- Flexible hours and Work from Home support.
- Daily drinks, snacks and catered meals (when in office).
- Regularly scheduled team building activities and social events both on-site, off-site & virtually.
- As we grow, this list continues to evolve! 

Waabi is a technology start-up building technologies to transform the way the world moves. Join our talented team to be a part of the future and to make an impact!

Waabi is an equal opportunity employer. We celebrate diversity and are committed to creating a supportive, inclusive, and accessible workplace for all our employees. We seek applicants of all backgrounds and identities, across race, color, ethnicity, national origin or ancestry, age, citizenship, religion, sex, sexual orientation, gender identity or expression, military or veteran status, marital status, pregnancy or parental status, caregiver status, disability, or any other characteristic protected by law. We make workplace accommodations for qualified individuals with disabilities as required by applicable law. If reasonable accommodation is needed to participate in the job application or interview process please let our recruiting team know.

We may use artificial intelligence (AI) tools to support parts of the hiring process, such as reviewing applications, analyzing resumes, or assessing responses and identifying potential inconsistencies or verification signals in application materials based on available information. These tools assist our recruitment team but do not replace human judgment. Final hiring decisions are ultimately made by humans. If you would like more information about how your data is processed, please contact us.