1

Machine Learning Infrastructure Engineer Jobs in New York

Machine Learning Engineer

New York, NY ยท On-site

$205K - $235K/yr

The Opportunity Good Inside is seeking a Machine Learning Engineer to join our Engineering team ... Build data pipelines and infrastructure to support model serving, feature storage, and real-time ...

We are looking for a Machine Learning Engineer to help us create artificial intelligence products. Machine Learning Engineer responsibilities include creating machine learning models and retraining ...

We are looking for an engineer with robust experience in machine learning and strong mathematical ... Experience building and maintaining training and inference infrastructure, with an understanding of ...

We are looking for an engineer with robust experience in machine learning and strong mathematical ... Experience building and maintaining training and inference infrastructure, with an understanding of ...

About the Position Our goals are to give you a real sense of what it's like to work at Jane Street as a Machine Learning Engineer while also providing a truly unparalleled educational experience. You ...

About the Position Our goals are to give you a real sense of what it's like to work at Jane Street as a Machine Learning Engineer while also providing a truly unparalleled educational experience. You ...

Senior Machine Learning Engineer

Jersey City, NJ ยท On-site

$127K - $168K/yr

As a Senior Machine Learning Engineer, you'll play a crucial role in optimizing orchestration ... Implement cost-saving strategies to minimize infrastructure expenses while maximizing performance.

About the Role We are seeking a skilled and innovative Machine Learning Engineer to join our team. This person will implement and develop machine learning models to enhance our platform ...

AI Infrastructure Engineer

New York, NY

$117K - $154K/yr

About the Role * As an AI Infrastructure Engineer, you are a deep technical contributor with ... You've gone deeper than reading blog posts, ideally having several example machine learning ...

Lead Machine Learning Engineer

New York, NY ยท On-site +1

$112K - $147K/yr

Lead Machine Learning Engineer As a Capital One Machine Learning Engineer (MLE), you'll be part of ... Inform your ML infrastructure decisions using your understanding of ML modeling techniques and ...

Applied Machine Learning Engineer

New York, NY ยท On-site

$170K - $240K/yr

At Fireworks, we're building the future of generative AI infrastructure. Our platform delivers the ... As an Applied Machine Learning Engineer, you will serve as a vital bridge between cutting-edge AI ...

OT Infrastructure Engineer

New York, NY ยท On-site

$160K - $250K/yr

Curiosity - we ask questions and keep learning * Endurance - we build for the long term What It ... The OT Infrastructure Engineer owns the full lifecycle of the OT systems - from architecture and ...

next page

Showing results 1-20

Machine Learning Infrastructure Engineer information

See New York salary details

$50.9K

$139K

$199.1K

How much do machine learning infrastructure engineer jobs pay per year?

As of Jul 16, 2026, the average yearly pay for machine learning infrastructure engineer in New York is $139,015.00, according to ZipRecruiter salary data. Most workers in this role earn between $117,600.00 and $154,300.00 per year, depending on experience, location, and employer.

What are some common challenges faced by Machine Learning Infrastructure Engineers, and how can these be addressed on the job?

Machine Learning Infrastructure Engineers often face challenges such as ensuring infrastructure scalability, managing resource allocation, and maintaining system reliability while supporting rapid experimentation by data science teams. Balancing the needs for flexibility in research environments with production-grade stability requires a deep understanding of both engineering best practices and the unique requirements of machine learning workflows. Collaboration with data scientists, clear communication about infrastructure capabilities, and staying current with fast-evolving technologies are key strategies for success. Most companies encourage ongoing learning and provide opportunities to contribute to architecture decisions, which makes this a rewarding environment for problem-solvers and innovators.

What are the key skills and qualifications needed to thrive in the Machine Learning Infrastructure Engineer position, and why are they important?

To thrive as a Machine Learning Infrastructure Engineer, you need a strong background in computer science, cloud computing, distributed systems, and experience with machine learning frameworks, often supported by a degree in a related field. Familiarity with tools such as Docker, Kubernetes, Terraform, as well as cloud platforms like AWS, GCP, or Azure, and certifications in cloud or DevOps technologies are highly valued. Strong problem-solving abilities, effective communication, and collaboration skills help engineers work seamlessly with data scientists and cross-functional teams. These skills are essential to design, implement, and maintain robust, scalable infrastructure that enables efficient machine learning development and deployment.

What is a Machine Learning Infrastructure Engineer job?

A Machine Learning Infrastructure Engineer designs, builds, and maintains the systems that support the development and deployment of machine learning models. This includes managing data pipelines, optimizing model training and inference, and ensuring scalability and reliability in production environments. They work closely with data scientists, ML engineers, and DevOps teams to create efficient workflows and infrastructure. Key technologies often include cloud platforms, containerization, orchestration tools, and distributed computing frameworks.

What cities in New York are hiring for Machine Learning Infrastructure Engineer jobs? Cities in New York with the most Machine Learning Infrastructure Engineer job openings:
Infographic showing various Machine Learning Infrastructure Engineer job openings in New York as of July 2026, with employment types broken down into 92% Full Time, 5% Part Time, and 3% Contract. Highlights an 89% Physical, 3% Hybrid, and 8% Remote job distribution, with an average salary of $139,015 per year, or $66.8 per hour.
Principal Software Engineer, Machine Learning Infrastructure

Principal Software Engineer, Machine Learning Infrastructure

Snapchat

New York, NY โ€ข On-site

$147K - $198K/yr

Full-time

Medical

Posted 7 days ago


Job description

Snap Inc is a technology company. We believe the camera presents the greatest opportunity to improve the way people live and communicate. Snap contributes to human progress by empowering people to express themselves, live in the moment, learn about the world, and have fun together.


The Company operates Snapchat, a visual messaging app that enhances your relationships with friends, family, and the world, and Specs Inc., a wholly-owned subsidiary dedicated to making computing more human, in addition to Bitmoji, Saturn, and other digital services.


Snap Engineering teams build fun and technically sophisticated products that reach hundreds of millions of Snapchatters around the world, every day. We're deeply committed to the well-being of everyone in our global community, which is why our values are at the root of everything we do. We move fast, with precision, and always execute with privacy at the forefront.

We're looking for a Principal Software Engineer to join Snap's ML Inference team!

What you'll do:

  • Oversee technical strategy and architecture in ML Inference Platform services

  • Design, implement, and scale critical engineering components and services to support ML inference and deployment

  • Work across teams to understand product requirements, evaluate trade-offs, and deliver the solutions needed to build innovative products or services

  • Advocate for and apply best practices when it comes to availability, scalability, operational excellence, and cost management

  • Provide technical direction that influences the entire company

Knowledge, Skills & Abilities

  • Excellent programming and software design skills, including debugging, performance analysis, and test design

  • Proven track record of operating highly-available systems at scale

  • Ability to proactively learn new concepts and technology and apply them at work

  • Skilled at solving ambiguous problems

  • Strong collaboration and mentorship skills

Minimum Qualifications:

  • Bachelors in technical field such as computer science, mathematics, statistics or equivalent years of experience

  • 10+ years of post-Bachelor's software development experience; or a Master's degree in a technical field + 9+ year of post-grad software development experience; or a PhD in a related technical field + 6+ years of post-grad software development experience

  • 2+ years of experience with technical leadership or acting as the domain-expert to a technical organization

  • Experience in technical leadership/ownership and setting technical direction for engineering projects

  • Experience architecting, designing, and developing large scale distributed systems and high-throughput RPC services

Preferred Qualifications:

  • Advanced degree in a technical field such as computer science

  • Experience with cross platform development

  • Ability to promote product excellence and collaboration, driving a portfolio of concurrent engineering projects, from short-term critical feature launches to long-term research initiatives.

  • Ability to create a compelling vision for the future, communicate clearly, and have a collaborative leadership approach.

  • Experience with Tensorflow, PyTorch, Kubernetes, GPU, LLM inference is a plus

If you have a disability or special need that requires accommodation, please don't be shy and provide us some information.

"Default Together" Policy at Snap: At Snap Inc. we believe that being together in person helps us build our culture faster, reinforce our values, and serve our community, customers and partners better through dynamic collaboration. To reflect this, we practice a "default together" approach and expect our team members to work in an office 4+ days per week.

At Snap, we believe that having a team of diverse backgrounds and voices working together will enable us to create innovative products that improve the way people live and communicate. Snap is proud to be an equal opportunity employer, and committed to providing employment opportunities regardless of race, religious creed, color, national origin, ancestry, physical disability, mental disability, medical condition, genetic information, marital status, sex, gender, gender identity, gender expression, pregnancy, childbirth and breastfeeding, age, sexual orientation, military or veteran status, or any other protected classification, in accordance with applicable federal, state, and local laws. EOE, including disability/vets.

We are an Equal Opportunity Employer and will consider qualified applicants with criminal histories in a manner consistent with applicable law (by example, the requirements of the San Francisco Fair Chance Ordinance and the Los Angeles Fair Chance Initiative for Hiring, where applicable).

Our Benefits: Snap Inc. is its own community, so we've got your back! We do our best to make sure you and your loved ones have everything you need to be happy and healthy, on your own terms. Our benefits are built around your needs and include paid parental leave, comprehensive medical coverage, emotional and mental health support programs, and compensation packages that let you share in Snap's long-term success!

Compensation

In the United States, work locations are assigned a pay zone which determines the salary range for the position. The successful candidate's starting pay will be determined based on job-related skills, experience, qualifications, work location, and market conditions. The starting pay may be negotiable within the salary range for the position. These pay zones may be modified in the future.

Zone A (CA, WA, NYC):

The base salary range for this position is $276,000-$414,000 annually.


Zone B:

The base salary range for this position is $262,000-$393,000 annually.

Zone C:

The base salary range for this position is $235,000-$352,000 annually.This position is eligible for equity in the form of RSUs.