ZipRecruiter

Log In

1

Ml Infrastructure Engineer Jobs (NOW HIRING)

Gridware

ML Infrastructure Engineer

San Francisco, CA · On-site

$190K - $250K/yr

Role Description As a Senior ML Infrastructure Engineer, you will work directly in the Automation org with the core ML, Ops, and Analytics teams to help improve and build out the infrastructure ...

Gridware

ML Infrastructure Engineer

San Francisco, CA · On-site

$245K - $250K/yr

Role Description As a Senior ML Infrastructure Engineer, you will work directly in the Automation org with the core ML, Ops, and Analytics teams to help improve and build out the infrastructure ...

Apply Early

Gridware

ML Infrastructure Engineer

San Francisco, CA · On-site

$190K - $250K/yr

Role Description As a Senior ML Infrastructure Engineer, you will work directly in the Automation org with the core ML, Ops, and Analytics teams to help improve and build out the infrastructure ...

Rebar

Senior ML Infrastructure Engineer

New York, NY · On-site

$118K - $161K/yr

Senior ML Infrastructure Engineer Background Rebar is building the next-generation operating system for commercial HVAC, electrical, and plumbing suppliers and subcontractors. Over the past year, our ...

Tennr

ML Infrastructure Engineer

New York, NY · On-site

$190K - $230K/yr

Develop and maintain infrastructure that supports efficient ML operations, including data pipelines, model evaluations, deployments, and training at scale. * Collaborate closely with ML engineers ...

AppLovin

ML Infrastructure Engineer

Palo Alto, CA · On-site

$126K - $165K/yr

They are seeking an ML Infrastructure Engineer to design, develop, and maintain large-scale distributed systems while collaborating with various engineering teams to enhance their infrastructure and ...

AppLovin

ML Infrastructure Engineer

Palo Alto, CA · On-site

$126K - $165K/yr

The ML Infrastructure Engineer will design, develop, and maintain large-scale distributed systems while collaborating with various engineering teams to enhance the company's technology stack.

Graphon.AI

ML Infrastructure Engineer

San Francisco, CA · On-site

$180K - $250K/yr

Universal Infrastructure: A way to stop rebuilding the same context layer for every agent, dataset ... PhD in Robotics and ML. * Clark Zhang, CTO: ex-Meta; PhD in Robotics and ML. * Deepak Mishra, COO: ...

Maven Robotics

ML Infrastructure Engineer

San Francisco, CA · On-site

$126K - $166K/yr

Build intuitive internal tools and abstractions that make complex infrastructure easy for engineers to use. * Lead technical and commercial discussions with cloud and ML compute providers, including ...

Graphon.AI

ML Infrastructure Engineer

San Francisco, CA

$180K - $250K/yr

Universal Infrastructure: A way to stop rebuilding the same context layer for every agent, dataset ... PhD in Robotics and ML. * Clark Zhang, CTO: ex-Meta; PhD in Robotics and ML. * Deepak Mishra, COO: ...

Sunday Inc

ML Infrastructure Engineer

Redwood City, CA · On-site

$131K - $172K/yr

Strong software engineering and systems fundamentals * Experience building distributed systems or large-scale data pipelines * Hands-on experience with ML training infrastructure, ideally PyTorch

Maven Robotics

ML Infrastructure Engineer

San Francisco, CA · On-site

$126K - $166K/yr

Build intuitive internal tools and abstractions that make complex infrastructure easy for engineers to use. * Lead technical and commercial discussions with cloud and ML compute providers, including ...

Zensors

AI/ML Infrastructure Engineer

San Francisco, CA · On-site

$126K - $166K/yr

As a Machine Learning Engineer in ML Runtime & Optimization , you will develop technologies to ... infrastructure. * Model Acceleration: Applying advanced model optimization techniques--such as ...

Manifold Bio

AI/ML Infrastructure Engineer

Boston, MA · On-site

$116K - $153K/yr

Our team of protein engineers, biologists, and computational scientists works across this full ... You have rich ML infrastructure / MLOps experience and are excited to bring it into biotech If you ...

Orion Innovation

Senior ML Infrastructure Engineer

Edison, NJ · On-site

$110K - $149K/yr

The Senior ML Infrastructure Engineer will be responsible for building and maintaining a large-scale document intelligence platform while managing the infrastructure and ensuring efficient model ...

next page

Showing results 1-20

All JobsMl Infrastructure Engineer Jobs

Ml Infrastructure Engineer information

See salary details

$46.5K

$127.1K

$182K

How much do ml infrastructure engineer jobs pay per year?

As of Jul 3, 2026, the average yearly pay for ml infrastructure engineer in the United States is $127,066.00, according to ZipRecruiter salary data. Most workers in this role earn between $107,500.00 and $141,000.00 per year, depending on experience, location, and employer.

What is the difference between Ml Infrastructure Engineer vs Data Engineer?

AspectML Infrastructure EngineerData Engineer
Required CredentialsBachelor's/Master's in CS, experience with cloud platforms, scripting, and ML toolsBachelor's/Master's in CS, experience with databases, ETL, and data pipelines
Work EnvironmentFocus on deploying and maintaining ML systems, cloud infrastructure, and automationDesigning and building data pipelines, managing large datasets, and data storage
Employer & Industry UsageTech companies, AI startups, research labsFinance, healthcare, e-commerce, and data-driven industries

The ML Infrastructure Engineer specializes in building and maintaining the infrastructure that supports machine learning models, focusing on deployment, scalability, and automation. In contrast, Data Engineers primarily develop data pipelines and manage large datasets to enable data analysis and business intelligence. Both roles require strong technical skills and often overlap, but their core focus areas differ significantly.

More about Ml Infrastructure Engineer jobs
What cities are hiring for Ml Infrastructure Engineer jobs? Cities with the most Ml Infrastructure Engineer job openings:
What states have the most Ml Infrastructure Engineer jobs? States with the most job openings for Ml Infrastructure Engineer jobs include:
What job categories do people searching Ml Infrastructure Engineer jobs look for? The top searched job categories for Ml Infrastructure Engineer jobs are:
Ml Infrastructure Engineer jobs near you
ML Infrastructure Engineer

ML Infrastructure Engineer

Mach9 Robotics Inc

San Francisco, CA • On-site

$160K - $200K/yr

Full-time

Posted 8 days ago

Job description

The role
At Mach9, ML infrastructure engineers build and maintain the systems that power production AI models for civil engineering and surveying. Our ML pipeline spans 10,000+ miles of labeled survey data, image segmentation networks, and 3D prediction models serving real-time inference to surveyors and engineers in the field.
This role is ideal for mid-career ML infrastructure engineers with experience building for both training and inference.
You'll build training pipelines that handle deep transformer models on hundreds of terabytes of 3D point cloud and image data. You'll also architect our inference infrastructure, delivering both heavy offline detection algorithms and real-time responsive inference that integrates directly with our CAD software.
Responsibilities
  • Design and build a centralized system for versioning training data, generated datasets, and model artifacts, with full lineage tracking from raw source data through to trained model outputs.
  • Develop and maintain reliable, reproducible ML training and data generation pipelines.
  • Refactor and harden existing training and data generation scripts into composable, testable, and maintainable components.
  • Create CI/CD workflows for validating data pipelines and model training runs, including automated correctness checks and regression detection.
  • Build tooling that enables ML engineers to launch, monitor, and debug training jobs with minimal friction.
  • Optimize and scale real-time model inference services to meet latency and throughput requirements in production, including profiling, batching strategies, and resource-efficient serving.
  • Own the deployment path from trained model artifact to production endpoint, ensuring reliable rollouts, rollback, and monitoring.

Requirements
  • 3+ years of work experience in relevant fields.
  • Bachelor's or Master's degree in Computer Science, Engineering, or equivalent experience.
  • Strong communication skills and the ability to work closely with ML researchers and engineers to understand their workflows and translate them into robust systems.
  • Experience designing and building data versioning, artifact management, or dataset lineage systems (e.g., DVC, LakeFS, Weights & Biases, or custom solutions).
  • Hands-on experience with ML pipeline orchestration tools (e.g., Airflow, Prefect, Metaflow, or similar).
  • Experience with model serving and inference optimization - profiling latency, reducing memory footprint, or scaling serving infrastructure to meet real-time constraints.
  • Ability to read and refactor ML training code - you don't need to design model architectures, but you need to understand what training pipelines are doing well enough to make them reliable.
  • Proficient with Python, PyTorch.

Bonus qualifications
  • Familiarity with AWS infrastructure services.
  • Experience with containerized ML workflows and GPU-accelerated training environments.
  • Experience with model optimization techniques (e.g., quantization, TensorRT, ONNX Runtime, distillation).
  • Knowledge of infrastructure-as-code tools (e.g., AWS CDK, Terraform).
  • Experience building or operating ML systems that handle large unstructured datasets (imagery, 3D data, sensor data).

Apply