ZipRecruiter

Log In

1

Machine Learning Infrastructure Engineer Jobs in New York

SageSure

Senior Machine Learning Engineer

Jersey City, NJ · On-site

$127K - $168K/yr

As a Senior Machine Learning Engineer, you'll play a crucial role in optimizing orchestration ... Implement cost-saving strategies to minimize infrastructure expenses while maximizing performance.

Strivector Corp

Machine Learning

Manhattan, NY · On-site

They are seeking a Machine Learning professional capable of tackling research problems with ... Veterinary, Engineering, Operations, Sales, Quality, HR, and Finance positions. Founded in 2011 ...

Maxana

Infrastructure Engineer

New York, NY · On-site

$130K - $240K/yr

Maxana is seeking an experienced Infrastructure Engineer for a confidential client - a fast-growing ... Learning and development stipend * Working at the forefront of AI infrastructure at scale

Good Inside

Senior Machine Learning Engineer

New York, NY · On-site +1

$205K - $235K/yr

The Opportunity Good Inside is seeking a Senior Machine Learning Engineer to join our Engineering ... Build data pipelines and infrastructure to support model serving, feature storage, and real-time ...

Maxana

Infrastructure Engineer

New York, NY · On-site

$130K - $240K/yr

Maxana is seeking an experienced Infrastructure Engineer for a confidential client -- a fast ... Learning and development stipend * Working at the forefront of AI infrastructure at scale

Maxana

Infrastructure Engineer

New York, NY · On-site

$130K - $240K/yr

Maxana is seeking an experienced Infrastructure Engineer for a confidential client - a fast-growing ... Learning and development stipend * Working at the forefront of AI infrastructure at scale

Capital One

Lead Machine Learning Engineer

New York, NY · On-site +1

$112K - $147K/yr

Lead Machine Learning Engineer As a Capital One Machine Learning Engineer (MLE), you'll be part of ... Inform your ML infrastructure decisions using your understanding of ML modeling techniques and ...

Attentive

Senior Machine Learning Engineer

New York, NY · On-site

$244K - $320K/yr

As a Senior Machine Learning Engineer, you will play a critical role in building, scaling, and ... Our infrastructure runs primarily in Kubernetes hosted in AWS's EKS, using tooling like Istio ...

Capital One

Lead Machine Learning Engineer

New York, NY · On-site

$112K - $147K/yr

Lead Machine Learning Engineer As a Capital One Machine Learning Engineer (MLE), you'll be part of ... Inform your ML infrastructure decisions using your understanding of ML modeling techniques and ...

WITHIN

Machine Learning Engineer

New York, NY · Hybrid

$90K - $254K/yr

We are in search of an exceptional Machine Learning Engineer to join our accomplished team. In this role, you will take the lead in developing and fine-tuning predictive ML models, with a primary ...

Reddit

Machine Learning Engineer

New York, NY · On-site +1

$223K - $260K/yr

Collaborate closely with multiple stakeholders across product, engineering, research and marketing. Train, evaluate, test, and deploy machine learning models. Part-time telecommuting is an option.

next page

Showing results 1-20

All JobsMachine Learning Infrastructure Engineer JobsMachine Learning Infrastructure Engineer Jobs in New York

Machine Learning Infrastructure Engineer information

See New York salary details

$50.9K

$139K

$199.1K

How much do machine learning infrastructure engineer jobs pay per year?

As of Jun 25, 2026, the average yearly pay for machine learning infrastructure engineer in New York is $139,015.00, according to ZipRecruiter salary data. Most workers in this role earn between $117,600.00 and $154,300.00 per year, depending on experience, location, and employer.

What are some common challenges faced by Machine Learning Infrastructure Engineers, and how can these be addressed on the job?

Machine Learning Infrastructure Engineers often face challenges such as ensuring infrastructure scalability, managing resource allocation, and maintaining system reliability while supporting rapid experimentation by data science teams. Balancing the needs for flexibility in research environments with production-grade stability requires a deep understanding of both engineering best practices and the unique requirements of machine learning workflows. Collaboration with data scientists, clear communication about infrastructure capabilities, and staying current with fast-evolving technologies are key strategies for success. Most companies encourage ongoing learning and provide opportunities to contribute to architecture decisions, which makes this a rewarding environment for problem-solvers and innovators.

What are the key skills and qualifications needed to thrive in the Machine Learning Infrastructure Engineer position, and why are they important?

To thrive as a Machine Learning Infrastructure Engineer, you need a strong background in computer science, cloud computing, distributed systems, and experience with machine learning frameworks, often supported by a degree in a related field. Familiarity with tools such as Docker, Kubernetes, Terraform, as well as cloud platforms like AWS, GCP, or Azure, and certifications in cloud or DevOps technologies are highly valued. Strong problem-solving abilities, effective communication, and collaboration skills help engineers work seamlessly with data scientists and cross-functional teams. These skills are essential to design, implement, and maintain robust, scalable infrastructure that enables efficient machine learning development and deployment.

What is a Machine Learning Infrastructure Engineer job?

A Machine Learning Infrastructure Engineer designs, builds, and maintains the systems that support the development and deployment of machine learning models. This includes managing data pipelines, optimizing model training and inference, and ensuring scalability and reliability in production environments. They work closely with data scientists, ML engineers, and DevOps teams to create efficient workflows and infrastructure. Key technologies often include cloud platforms, containerization, orchestration tools, and distributed computing frameworks.

What are popular job titles related to Machine Learning Infrastructure Engineer jobs in New York? For Machine Learning Infrastructure Engineer jobs in New York, the most frequently searched job titles are:
What job categories do people searching Machine Learning Infrastructure Engineer jobs in New York look for? The top searched job categories for Machine Learning Infrastructure Engineer jobs in New York are:
What cities in New York are hiring for Machine Learning Infrastructure Engineer jobs? Cities in New York with the most Machine Learning Infrastructure Engineer job openings:
Machine Learning Infrastructure Engineer jobs near you
Machine Learning Engineer/Senior Machine Learning Engineer - Infra, AI for Drug Discovery

Machine Learning Engineer/Senior Machine Learning Engineer - Infra, AI for Drug Discovery

Genentech, Inc.

New York, NY • On-site

$167K - $310K/yr

Full-time

Posted 12 days ago

Genentech rating

8.8

Company rating: 8.8 out of 10

Based on 22 frontline employees who took The Breakroom Quiz

10th of 72 rated pharmaceutical

Job description

A healthier future. It's what drives us to innovate. To continuously advance science and ensure everyone has access to the healthcare they need today and for generations to come. Creating a world where we all have more time with the people we love. That's what makes us Roche.
Advances in AI, data, and computational sciences are transforming drug discovery and development. Roche's Research and Early Development organisations at Genentech (gRED) and Pharma (pRED) have demonstrated how these technologies accelerate R&D, leveraging data and novel computational models to drive impact. Seamless data sharing and access to models across gRED and pRED are essential to maximising these opportunities. The new Computational Sciences Center of Excellence (CoE) is a strategic, unified group whose goal is to harness this transformative power of data and Artificial Intelligence (AI) to assist our scientists in both pRED and gRED to deliver more innovative and transformative medicines for patients worldwide.
The Opportunity
At Roche's AI for Drug Discovery (AIDD) group (Prescient Design), we are revolutionizing drug discovery with cutting-edge machine learning techniques. We are seeking a highly motivated and skilled ML Engineer to join our growing team within Genentech Research and Early Development AI Drug Development (gRED AIDD). This role is crucial for enhancing the core features that power our machine learning initiatives. The ideal candidate will have deep experience building scalable software and infrastructure, while consistently adhering to corporate standards and best practices.
What you'll do
Machine Learning Engineer - Infra
  • Design, implement, and maintain scalable and reliable ML infrastructure
  • Collaborate closely with ML engineers and data scientists to understand and address their infrastructure needs.
  • Document infrastructure designs, processes, and operational procedures.

Senior Machine Learning Engineer - Infra
  • Design, implement, and maintain scalable and reliable ML infrastructure, leading the architecture and delivery of significant technical solutions.
  • Proactively identify and solve complex, often cross-functional, technical problems within the ML infrastructure domain.
  • Collaborate closely with ML engineers and data scientists to understand and address their infrastructure needs.
  • Document infrastructure designs, processes, and operational procedures.
  • Mentor junior engineers and drive technical alignment and influence across teams.

Who you are
Machine Learning Engineer - Infra
  • BS/MS with 2-3 years of industry experience required
  • Proven experience designing, deploying, and managing infrastructure on AWS (EC2, S3, RDS, etc.).
  • Proficiency in scripting languages (e.g., Python) and compiled languages (e.g., C++, Go, Rust).
  • Strong experience with Git and repository management.
  • Excellent problem-solving skills and a proactive attitude, with the ability to anticipate needs and drive projects to completion.
  • Strong communication and interpersonal skills to effectively collaborate with cross-functional teams and influence technical decisions.
  • Ability to thrive in a fast-paced environment and adapt to evolving requirements while adhering to corporate guidelines.

Senior Machine Learning Engineer - Infra
  • BS/MS with 3-5 years of industry experience required
  • Proven experience designing, deploying, and managing infrastructure on AWS (EC2, S3, RDS, etc.).
  • Proficiency in scripting languages (e.g., Python) and compiled languages (e.g., C++, Go, Rust).
  • Strong experience with Git and repository management.
  • Demonstrated ability to lead technical projects from conception to completion and deliver high-quality, scalable, and reliable software.
  • Excellent problem-solving skills and a proactive attitude, with the ability to anticipate needs and drive projects to completion.
  • Strong communication and interpersonal skills to effectively collaborate with cross-functional teams and influence technical decisions.
  • Ability to thrive in a fast-paced environment and adapt to evolving requirements while adhering to corporate guidelines.

Preferred
  • Extensive experience with large-scale ML model platforms and tools.
  • Deep understanding and experience with PyTorch implementation, especially regarding scaling inference performance.
  • A history of significant contributions to open-source projects or industry standards.

Relocation benefits are NOT available for this job posting
The expected salary range for this position based on the primary location of California for the Machine Learning Engineer is $147,600, - $274,000 and New York is $141,100 - $262,100, and the Senior Machine Learning Engineer for California is $167,400 - $310,800 and New York is $160,100 - $297,300. Actual pay will be determined based on experience, qualifications, geographic location, and other job-related factors permitted by law. A discretionary annual bonus may be available based on individual and Company performance. This position also qualifies for the benefits detailed at the link provided below.
Benefits
#ComputationCoE
#tech4lifeComputationalScience
#tech4lifeAI
Genentech is an equal opportunity employer. It is our policy and practice to employ, promote, and otherwise treat any and all employees and applicants on the basis of merit, qualifications, and competence. The company's policy prohibits unlawful discrimination, including but not limited to, discrimination on the basis of Protected Veteran status, individuals with disabilities status, and consistent with all federal, state, or local laws.
If you have a disability and need an accommodation in relation to the online application process, please contact us by completing this form Accommodations for Applicants.

What Genentech employees say

Pay

Benefits

Hours and flexibility

Workplace

Get the full story on Breakroom

Genentech logo

About Genentech

Sourced by ZipRecruiter

A member of the Roche Group, Genentech has been at the forefront of the biotechnology industry for more than 40 years, using human genetic information to develop novel medicines for serious and life-threatening diseases. Genentech has multiple therapies on the market for cancer & other serious illnesses. Please take this opportunity to learn about Genentech where we believe that our employees are our most important asset & are dedicated to remaining a great place to work.

Industry

Scientific research and development services

Company size

10,000+ Employees

Headquarters location

South San Francisco, CA, US

Year founded

1976

Social media

FacebookTwitter

View All Genentech Jobs

Apply