San Mateo, CA · On-site
$180 - $240/hr
About the Role This is a hands-on ML Infrastructure Engineer role at an early-stage enterprise AI startup, where you'll own the end-to-end inference and model-serving infrastructure that keeps ...
San Mateo, CA · On-site
$180 - $240/hr
About the Role This is a hands-on ML Infrastructure Engineer role at an early-stage enterprise AI startup, where you'll own the end-to-end inference and model-serving infrastructure that keeps ...
San Francisco, CA · On-site
$190K - $250K/yr
Role Description As a Senior ML Infrastructure Engineer, you will work directly in the Automation org with the core ML, Ops, and Analytics teams to help improve and build out the infrastructure ...
San Francisco, CA · On-site
$190K - $250K/yr
Role Description As a Senior ML Infrastructure Engineer, you will work directly in the Automation org with the core ML, Ops, and Analytics teams to help improve and build out the infrastructure ...
Palo Alto, CA · On-site
$180K - $440K/yr
As an ML Infrastructure Engineer, you will play a pivotal role in building and optimizing the reliable, high-performance ML platform that powers recommendations on X. We're looking for exceptional ...
Palo Alto, CA · On-site
$180K - $440K/yr
As an ML Infrastructure Engineer, you will play a pivotal role in building and optimizing the reliable, high-performance ML platform that powers recommendations on X. We're looking for exceptional ...
San Francisco, CA · On-site
$190K - $250K/yr
Role Description As a Senior ML Infrastructure Engineer, you will work directly in the Automation org with the core ML, Ops, and Analytics teams to help improve and build out the infrastructure ...
Quick apply
San Francisco, CA · On-site
$190K - $250K/yr
Role Description As a Senior ML Infrastructure Engineer, you will work directly in the Automation org with the core ML, Ops, and Analytics teams to help improve and build out the infrastructure ...
San Francisco, CA · On-site
$190K - $250K/yr
Role Description As a Senior ML Infrastructure Engineer, you will work directly in the Automation org with the core ML, Ops, and Analytics teams to help improve and build out the infrastructure ...
San Francisco, CA · On-site
$190K - $250K/yr
Role Description As a Senior ML Infrastructure Engineer, you will work directly in the Automation org with the core ML, Ops, and Analytics teams to help improve and build out the infrastructure ...
San Francisco, CA · On-site
$200 - $280/hr
Engineering San Francisco Full-time $200,000 - $280,000 About the Role Join our ML Infrastructure team to build the systems that train, deploy, and serve our AI models at scale. You'll work at the ...
San Francisco, CA · On-site
$200 - $280/hr
Engineering San Francisco Full-time $200,000 - $280,000 About the Role Join our ML Infrastructure team to build the systems that train, deploy, and serve our AI models at scale. You'll work at the ...
San Mateo, CA · On-site
$122K - $160K/yr
Collaborate with ML and infrastructure teams to ensure seamless integration and drive performance optimization. * Identify infrastructure bottlenecks and lead the engineering effort to resolve them.
Quick apply
San Mateo, CA · On-site
$122K - $160K/yr
Collaborate with ML and infrastructure teams to ensure seamless integration and drive performance optimization. * Identify infrastructure bottlenecks and lead the engineering effort to resolve them.
Palo Alto, CA · On-site
$180K - $440K/yr
As an ML Infrastructure Engineer, you will play a pivotal role in building and optimizing the reliable, high-performance ML platform that powers recommendations on X. We're looking for exceptional ...
Palo Alto, CA · On-site
$180K - $440K/yr
As an ML Infrastructure Engineer, you will play a pivotal role in building and optimizing the reliable, high-performance ML platform that powers recommendations on X. We're looking for exceptional ...
Palo Alto, CA · On-site
$180 - $440/hr
As an ML Infrastructure Engineer, you will play a pivotal role in building and optimizing the reliable, high-performance ML platform that powers recommendations on X. We're looking for exceptional ...
Palo Alto, CA · On-site
$180 - $440/hr
As an ML Infrastructure Engineer, you will play a pivotal role in building and optimizing the reliable, high-performance ML platform that powers recommendations on X. We're looking for exceptional ...
$180K - $440K/yr
As an ML Infrastructure Engineer, you will play a pivotal role in building and optimizing the reliable, high-performance ML platform that powers recommendations on X. We're looking for exceptional ...
Quick apply
$180K - $440K/yr
As an ML Infrastructure Engineer, you will play a pivotal role in building and optimizing the reliable, high-performance ML platform that powers recommendations on X. We're looking for exceptional ...
Palo Alto, CA · On-site
$180 - $440/hr
As an ML Infrastructure Engineer, you will play a pivotal role in building and optimizing the reliable, high-performance ML platform that powers recommendations on X. We're looking for exceptional ...
Palo Alto, CA · On-site
$180 - $440/hr
As an ML Infrastructure Engineer, you will play a pivotal role in building and optimizing the reliable, high-performance ML platform that powers recommendations on X. We're looking for exceptional ...
San Mateo, CA · On-site
$122K - $160K/yr
The shift from copilots to autonomous agents is creating an entirely new infrastructure layer, and ... Set up and scale inference/Ray Serve for ML and LLM model serving, integrated with our data ...
San Mateo, CA · On-site
$122K - $160K/yr
The shift from copilots to autonomous agents is creating an entirely new infrastructure layer, and ... Set up and scale inference/Ray Serve for ML and LLM model serving, integrated with our data ...
Redwood City, CA · On-site
$131K - $172K/yr
They are seeking an ML Infrastructure Engineer to build and shape foundational systems that accelerate the deployment of robots in homes, encompassing responsibilities in training infrastructure ...
Redwood City, CA · On-site
$131K - $172K/yr
They are seeking an ML Infrastructure Engineer to build and shape foundational systems that accelerate the deployment of robots in homes, encompassing responsibilities in training infrastructure ...
San Mateo, CA · On-site
$122K - $160K/yr
The shift from copilots to autonomous agents is creating an entirely new infrastructure layer, and ... Set up and scale inference/Ray Serve for ML and LLM model serving, integrated with our data ...
Quick apply
San Mateo, CA · On-site
$122K - $160K/yr
The shift from copilots to autonomous agents is creating an entirely new infrastructure layer, and ... Set up and scale inference/Ray Serve for ML and LLM model serving, integrated with our data ...
Palo Alto, CA · On-site
$126K - $165K/yr
They are seeking an ML Infrastructure Engineer to design, develop, and maintain large-scale distributed systems while collaborating with various engineering teams to enhance their infrastructure and ...
Palo Alto, CA · On-site
$126K - $165K/yr
They are seeking an ML Infrastructure Engineer to design, develop, and maintain large-scale distributed systems while collaborating with various engineering teams to enhance their infrastructure and ...
New York, NY · On-site
$118K - $161K/yr
Senior ML Infrastructure Engineer Background Rebar is building the next-generation operating system for commercial HVAC, electrical, and plumbing suppliers and subcontractors. Over the past year, our ...
New York, NY · On-site
$118K - $161K/yr
Senior ML Infrastructure Engineer Background Rebar is building the next-generation operating system for commercial HVAC, electrical, and plumbing suppliers and subcontractors. Over the past year, our ...
San Mateo, CA · On-site
$122K - $160K/yr
The shift from copilots to autonomous agents is creating an entirely new infrastructure layer, and ... Set up and scale inference/Ray Serve for ML and LLM model serving, integrated with our data ...
San Mateo, CA · On-site
$122K - $160K/yr
The shift from copilots to autonomous agents is creating an entirely new infrastructure layer, and ... Set up and scale inference/Ray Serve for ML and LLM model serving, integrated with our data ...
San Francisco, CA · On-site
$180K - $250K/yr
Universal Infrastructure: A way to stop rebuilding the same context layer for every agent, dataset ... PhD in Robotics and ML. * Clark Zhang, CTO: ex-Meta; PhD in Robotics and ML. * Deepak Mishra, COO: ...
San Francisco, CA · On-site
$180K - $250K/yr
Universal Infrastructure: A way to stop rebuilding the same context layer for every agent, dataset ... PhD in Robotics and ML. * Clark Zhang, CTO: ex-Meta; PhD in Robotics and ML. * Deepak Mishra, COO: ...
San Francisco, CA · On-site
$180K - $250K/yr
Universal Infrastructure: A way to stop rebuilding the same context layer for every agent, dataset ... PhD in Robotics and ML. * Clark Zhang, CTO: ex-Meta; PhD in Robotics and ML. * Deepak Mishra, COO: ...
San Francisco, CA · On-site
$180K - $250K/yr
Universal Infrastructure: A way to stop rebuilding the same context layer for every agent, dataset ... PhD in Robotics and ML. * Clark Zhang, CTO: ex-Meta; PhD in Robotics and ML. * Deepak Mishra, COO: ...
Redwood City, CA · On-site
$131K - $172K/yr
Required : • Strong software engineering and systems fundamentals • Experience building distributed systems or large-scale data pipelines • Hands-on experience with ML training infrastructure ...
Redwood City, CA · On-site
$131K - $172K/yr
Required : • Strong software engineering and systems fundamentals • Experience building distributed systems or large-scale data pipelines • Hands-on experience with ML training infrastructure ...
$46.5K - $58.8K
1% of jobs
$58.8K - $71.1K
1% of jobs
$71.1K - $83.5K
4% of jobs
$83.5K - $95.8K
9% of jobs
$95.8K - $108.1K
10% of jobs
$108.8K is the 25th percentile. Wages below this are outliers.
$108.1K - $120.4K
10% of jobs
The median wage is $125.4K / yr.
$120.4K - $132.7K
39% of jobs
$135.4K is the 75th percentile. Wages above this are outliers.
$132.7K - $145K
7% of jobs
$145K - $157.4K
10% of jobs
$157.4K - $169.7K
9% of jobs
$169.7K - $182K
1% of jobs
$46.5K
$127.1K
$182K
| Aspect | ML Infrastructure Engineer | Data Engineer |
|---|---|---|
| Required Credentials | Bachelor's/Master's in CS, experience with cloud platforms, scripting, and ML tools | Bachelor's/Master's in CS, experience with databases, ETL, and data pipelines |
| Work Environment | Focus on deploying and maintaining ML systems, cloud infrastructure, and automation | Designing and building data pipelines, managing large datasets, and data storage |
| Employer & Industry Usage | Tech companies, AI startups, research labs | Finance, healthcare, e-commerce, and data-driven industries |
The ML Infrastructure Engineer specializes in building and maintaining the infrastructure that supports machine learning models, focusing on deployment, scalability, and automation. In contrast, Data Engineers primarily develop data pipelines and manage large datasets to enable data analysis and business intelligence. Both roles require strong technical skills and often overlap, but their core focus areas differ significantly.
Cities with the most Ml Infrastructure Engineer job openings:
States with the most job openings for Ml Infrastructure Engineer jobs include:
The top searched job categories for Ml Infrastructure Engineer jobs are:
This is a hands-on ML Infrastructure Engineer role at an early-stage enterprise AI startup, where you'll own the end-to-end inference and model-serving infrastructure that keeps production AI agents running reliably and at scale. You'll sit at the intersection of ML and platform engineering, directly shaping the systems that power real-world, high-stakes deployments in regulated industries like insurance, banking, and healthcare.
What You'll DoOwn inference and model-serving infrastructure end to end, from design through production deployment.
Build and scale systems that enable AI agents to run reliably and efficiently under increasing concurrency.
Collaborate closely with ML and infrastructure teams to ensure seamless integration and performance optimization.
Identify infrastructure bottlenecks and drive cross-functional solutions across engineering teams.
5+ years of experience building and operating ML inference systems, model-serving platforms, or ML infrastructure in production.
Hands-on experience designing and scaling inference-serving infrastructure using frameworks such as TensorFlow Serving, TorchServe, Triton, KServe, or equivalent custom systems.
Strong track record optimizing production ML systems for latency, throughput, and reliability at scale.
Experience with containerization and orchestration (Docker, Kubernetes) for deploying and scaling ML workloads.
Experience building distributed systems that handle concurrent requests and manage resource allocation under load.
Proficiency with observability and debugging tooling for production systems (e.g., Prometheus, Grafana, ELK, distributed tracing).
Cloud platform experience on AWS, GCP, or Azure for deploying and managing ML systems.
Proficiency in at least one systems or backend language — Python, Go, Rust, C++, or Java.
Nice to have: experience with knowledge graphs, semantic search, or graph databases (e.g., Neo4j, Amazon Neptune); real-time or low-latency inference systems; agentic or multi-step reasoning pipelines; enterprise data infrastructure or integration platforms.
On-site in San Mateo, CA. No visa sponsorship is available for this role.
Sourced by ZipRecruiter
