ZipRecruiter

Log In

1

Machine Learning Infrastructure Engineer Jobs in New York

Jane Street

Machine Learning Engineer

New York, NY · On-site

We are looking for an engineer with robust experience in machine learning and strong mathematical ... Experience building and maintaining training and inference infrastructure, with an understanding of ...

Jane Street

Machine Learning Engineer

New York, NY

We are looking for an engineer with robust experience in machine learning and strong mathematical ... Experience building and maintaining training and inference infrastructure, with an understanding of ...

Forhyre

Machine Learning Engineer

New York, NY

We are looking for a Machine Learning Engineer to help us create artificial intelligence products. Machine Learning Engineer responsibilities include creating machine learning models and retraining ...

SageSure

Senior Machine Learning Engineer

Jersey City, NJ · On-site

$127K - $168K/yr

As a Senior Machine Learning Engineer, you'll play a crucial role in optimizing orchestration ... Implement cost-saving strategies to minimize infrastructure expenses while maximizing performance.

Biohub

Machine Learning Engineer, AI

New York, NY

$214K - $335K/yr

The infrastructure problems you solve directly determine what science becomes possible. What You'll ... What You'll Bring * 5+ years of industry experience building and deploying machine learning ...

Good Inside

Senior Machine Learning Engineer

New York, NY · Hybrid

$205K - $235K/yr

The Opportunity Good Inside is seeking a Senior Machine Learning Engineer to join our Engineering ... Build data pipelines and infrastructure to support model serving, feature storage, and real-time ...

Kitware

Machine Learning Engineer

New York, NY · On-site

$85K - $125K/yr

Machine learning experience using visual data * Understanding of a variety of machine learning ... infrastructure. Our customers and collaborators include top universities from around the world ...

Biohub

Machine Learning Engineer, AI

New York, NY · On-site +1

$214K - $335K/yr

The infrastructure problems you solve directly determine what science becomes possible. What You'll ... What You'll Bring * 5+ years of industry experience building and deploying machine learning ...

Fireworks AI

Applied Machine Learning Engineer

New York, NY · On-site

$170K - $240K/yr

At Fireworks, we're building the future of generative AI infrastructure. Our platform delivers the ... As an Applied Machine Learning Engineer, you will serve as a vital bridge between cutting-edge AI ...

Tennr

Backend Software Engineer

Manhattan, NY · On-site

They are seeking a Backend Engineer to architect and implement features across their backend ... and machine learning infrastructure. • Design and maintain complex workflows that leverage ...

Point72

Machine Learning Engineer

New York, NY · On-site

We are seeking a Machine Learning Engineer to join the High Frequency Trading Technology team. This role will apply the latest AI technologies to solve various real-world problems and streamline day ...

Point72

Machine Learning Engineer

New York, NY

We are seeking a Machine Learning Engineer to join the High Frequency Trading Technology team. This role will apply the latest AI technologies to solve various real-world problems and streamline day ...

next page

Showing results 1-20

All JobsMachine Learning Infrastructure Engineer JobsMachine Learning Infrastructure Engineer Jobs in New York

Machine Learning Infrastructure Engineer information

See New York salary details

$50.9K

$139K

$199.1K

How much do machine learning infrastructure engineer jobs pay per year?

As of Jun 25, 2026, the average yearly pay for machine learning infrastructure engineer in New York is $139,015.00, according to ZipRecruiter salary data. Most workers in this role earn between $117,600.00 and $154,300.00 per year, depending on experience, location, and employer.

What are some common challenges faced by Machine Learning Infrastructure Engineers, and how can these be addressed on the job?

Machine Learning Infrastructure Engineers often face challenges such as ensuring infrastructure scalability, managing resource allocation, and maintaining system reliability while supporting rapid experimentation by data science teams. Balancing the needs for flexibility in research environments with production-grade stability requires a deep understanding of both engineering best practices and the unique requirements of machine learning workflows. Collaboration with data scientists, clear communication about infrastructure capabilities, and staying current with fast-evolving technologies are key strategies for success. Most companies encourage ongoing learning and provide opportunities to contribute to architecture decisions, which makes this a rewarding environment for problem-solvers and innovators.

What are the key skills and qualifications needed to thrive in the Machine Learning Infrastructure Engineer position, and why are they important?

To thrive as a Machine Learning Infrastructure Engineer, you need a strong background in computer science, cloud computing, distributed systems, and experience with machine learning frameworks, often supported by a degree in a related field. Familiarity with tools such as Docker, Kubernetes, Terraform, as well as cloud platforms like AWS, GCP, or Azure, and certifications in cloud or DevOps technologies are highly valued. Strong problem-solving abilities, effective communication, and collaboration skills help engineers work seamlessly with data scientists and cross-functional teams. These skills are essential to design, implement, and maintain robust, scalable infrastructure that enables efficient machine learning development and deployment.

What is a Machine Learning Infrastructure Engineer job?

A Machine Learning Infrastructure Engineer designs, builds, and maintains the systems that support the development and deployment of machine learning models. This includes managing data pipelines, optimizing model training and inference, and ensuring scalability and reliability in production environments. They work closely with data scientists, ML engineers, and DevOps teams to create efficient workflows and infrastructure. Key technologies often include cloud platforms, containerization, orchestration tools, and distributed computing frameworks.

What are popular job titles related to Machine Learning Infrastructure Engineer jobs in New York? For Machine Learning Infrastructure Engineer jobs in New York, the most frequently searched job titles are:
What job categories do people searching Machine Learning Infrastructure Engineer jobs in New York look for? The top searched job categories for Machine Learning Infrastructure Engineer jobs in New York are:
What cities in New York are hiring for Machine Learning Infrastructure Engineer jobs? Cities in New York with the most Machine Learning Infrastructure Engineer job openings:
Machine Learning Infrastructure Engineer jobs near you
Machine Learning Engineer

Machine Learning Engineer

Jane Street

New York, NY • On-site

Full-time

Posted 19 days ago

Job description

We are looking for an engineer with robust experience in machine learning and strong mathematical foundations to join our growing ML team and to help drive the direction of our ML platform.
Machine learning is a critical pillar of Jane Street's global business. Our ever-evolving trading environment serves as a unique, rapid-feedback platform for ML experimentation, allowing us to incorporate new ideas with relatively little friction. Our ML team is full of people with a shared love for the craft of software engineering, and for designing APIs and systems that are delightful to use.
We'll rely on your in-depth knowledge of the ML ecosystem and understanding of varying approaches - whether it's neural networks, random forests, gradient-boosted trees, or sophisticated ensemble methods - to aid decision-making so we apply the right tool for the problem at hand. Your work will also focus on enhancing research workflows to tighten our feedback cycles. Successful ML engineers will be able to understand the mechanics behind various modeling techniques, while also being able to break down the mathematics behind them.
If you've never thought about a career in finance, you're in good company. Many of us were in the same position before working here. While there isn't a fixed list of qualifications we're looking for, if you have a curious mind and a passion for solving interesting problems, we have a feeling you'll fit right in.
We're looking for someone with:
  • Experience building and maintaining training and inference infrastructure, with an understanding of what it takes to move from concept to production
  • A strong mathematical background; Good candidates will be excited about things like optimization theory, regularization techniques, linear algebra, and the like
  • A passion for keeping up with the state of the art, whether that means diving into academic papers, experimenting with the latest hardware, or reading the source of a new machine learning package
  • A proven ability to create and maintain an organized research codebase that produces robust, reproducible results while maintaining ease of use
  • Expertise wrangling an ML framework - we're fans of PyTorch, but we'd also love to learn what you know about Jax, TensorFlow, or others
  • An inventive approach and the willingness to ask hard questions about whether we're taking the right approaches and using the right tools

If you're a recruiting agency and want to partner with us, please reach out to agency-partnerships@janestreet.com.

Apply