1

Machine Learning Operations Jobs in New York, NY

It is best suited for someone who is excited by the systems, tooling, and operational side of machine learning. What You'll Do * Build and maintain the workflows and infrastructure that support the ...

Pangram Labs is hiring for a strong junior Machine Learning Engineer. In this role, you will build ... Experience with DevOps tools * Familiarity with cloud-based infrastructure (AWS/GCP)

... machine learning engineer to build the AI decision system that turns raw signals into trusted ... Turn noisy cyber-physical observations into trusted operational decisions. * Define how the system ...

... machine learning engineer to build the AI decision system that turns raw signals into trusted ... Turn noisy cyber-physical observations into trusted operational decisions. * Define how the system ...

Machine Learning Engineer

New York, NY · On-site

$205K - $235K/yr

The Opportunity Good Inside is seeking a Machine Learning Engineer to join our Engineering team ... Infrastructure & DevOps Fluency: Experience with CI/CD, monitoring, observability, and production ...

Machine Learning Engineer

New York, NY · On-site

$205K - $235K/yr

You'll work at the intersection of backend systems and machine learning, building the ... Infrastructure & DevOps Fluency: Experience with CI/CD, monitoring, observability, and production ...

... unprecedented operational efficiency and service levels. At Judi Health, we're deploying the ... We are looking for an experienced software engineer with machine learning expertise to join us in ...

Showing results 41-60

Machine Learning Operations information

See New York, NY salary details

$23

$43

$67

How much do machine learning operations jobs pay per hour?

As of Sep 1, 2026, the average hourly pay for machine learning operations in New York, NY is $43.64, according to ZipRecruiter salary data. Most workers in this role earn between $36.54 and $46.30 per hour, depending on experience, location, and employer.

What is the difference between Machine Learning Operations vs Data Scientist?

AspectMachine Learning OperationsData Scientist
Primary FocusDeploying, maintaining, and scaling ML models in productionAnalyzing data to develop insights and build models
Required SkillsML deployment, cloud platforms, automation, scriptingStatistical analysis, data visualization, programming (Python/R)
Work EnvironmentOperations teams, cloud infrastructure, production systemsResearch environments, data analysis teams, R&D
Common CertificationsCloud certifications, MLOps tools certificationsData science certifications, statistical courses

Machine Learning Operations and Data Scientists often collaborate, but MLOps focuses on deploying and maintaining models in production, while Data Scientists focus on analyzing data and developing models. Both roles require technical skills, but their day-to-day tasks and environments differ.

Is machine learning operations a high paying job?

Machine Learning Operations (MLOps) roles typically offer high salaries due to the specialized skills required, such as expertise in cloud platforms, automation, and data engineering. Compensation varies based on experience, location, and company size, but generally ranks among well-paying tech jobs.

What are machine learning operations?

Machine Learning Operations (MLOps) is a set of practices that combines machine learning, software engineering, and DevOps to deploy, monitor, and maintain machine learning models in production environments. It involves tasks such as model versioning, automation, testing, and ensuring scalability and reliability using tools like CI/CD pipelines and cloud platforms.

What cities near New York, NY are hiring for Machine Learning Operations jobs?

Cities near New York, NY with the most Machine Learning Operations job openings:

Infographic showing various Machine Learning Operations job openings in New York, NY as of August 2026, with employment types broken down into 100% Full Time. Highlights an 67% In-person, and 33% Remote job distribution, with an average salary of $90,776 per year, or $43.6 per hour.

Machine Learning Engineer/Senior Machine Learning Engineer - Devops, AI for Drug Discovery

Genentech, Inc.

New York, NY • On-site

$142K - $182K/yr

Full-time

Re-posted 22 days ago


Genentech rating

8.8

Company rating: 8.8 out of 10

Based on 22 frontline employees who took The Breakroom Quiz

11th of 86 rated pharmaceutical


Job description

A healthier future. It's what drives us to innovate. To continuously advance science and ensure everyone has access to the healthcare they need today and for generations to come. Creating a world where we all have more time with the people we love. That's what makes us Roche.
Advances in AI, data, and computational sciences are transforming drug discovery and development. Roche's Research and Early Development organisations at Genentech (gRED) and Pharma (pRED) have demonstrated how these technologies accelerate R&D, leveraging data and novel computational models to drive impact. Seamless data sharing and access to models across gRED and pRED are essential to maximising these opportunities. The new Computational Sciences Center of Excellence (CoE) is a strategic, unified group whose goal is to harness this transformative power of data and Artificial Intelligence (AI) to assist our scientists in both pRED and gRED to deliver more innovative and transformative medicines for patients worldwide.
The Opportunity
At Roche's AI for Drug Discovery (AIDD) group (Prescient Design), we are revolutionizing drug discovery with cutting-edge machine learning techniques. We are seeking a highly motivated and skilled ML Infrastructure DevOps Engineer to join our growing team within Genentech Research and Early Development AI Drug Development (gRED AIDD). This role is crucial for building and maintaining the scalable and robust infrastructure that powers our machine learning initiatives. The ideal candidate will be proactive, user-facing, and possess a "get-it-done" attitude, while consistently adhering to corporate standards and best practices.
What you'll do
Machine Learning Engineer - DevOps
  • Design, implement, and maintain scalable and reliable ML infrastructure on AWS.
  • Automate deployment, monitoring, alerting, and operational tasks using tools like Terraform and Helm.
  • Manage and optimize CI/CD pipelines and Git repositories for ML projects, ensuring efficient version control to support collaboration and deployment.
  • Collaborate closely with ML engineers and data scientists to understand their infrastructure needs and provide solutions.
  • Troubleshoot and resolve infrastructure-related issues in a timely manner.
  • Implement and enforce security best practices for ML infrastructure.
  • Document infrastructure designs, processes, and operational procedures.
  • Contribute to initiatives independently as part of a team, delivering assigned outputs.
  • Proactively identify issues and gaps, proposing ideas and suggestions for improvements.

Senior Machine Learning Engineer - DevOps
  • Lead the architecture and delivery of significant technical solutions
  • Mentor junior engineers and drive technical alignment and influence across teams
  • Design, implement, and maintain scalable and reliable ML infrastructure on AWS.
  • Demonstrated ability to lead technical projects from conception to completion and deliver high-quality, scalable, and reliable software." to "Who you are
  • Automate deployment, monitoring, alerting, and operational tasks using tools like Terraform and Helm.
  • Manage and optimize CI/CD pipelines and Git repositories for ML projects, ensuring efficient version control to support collaboration and deployment.
  • Collaborate closely with ML engineers and data scientists to understand their infrastructure needs and provide solutions.
  • Troubleshoot and resolve infrastructure-related issues in a timely manner.
  • Implement and enforce security best practices for ML infrastructure.
  • Document infrastructure designs, processes, and operational procedures.
  • Contribute to initiatives independently as part of a team, delivering assigned outputs.
  • Proactively identify issues and gaps, proposing ideas and suggestions for improvements.

Who you are
Machine Learning Engineer - DevOps
  • BS/MS with 2-3 years of industry experience required
  • Proven experience in designing, deploying, and managing infrastructure on Amazon Web Services (AWS), including services such as EC2, S3, RDS, EKS, SageMaker, etc.
  • Strong proficiency with Git and Git repository management.
  • Hands-on experience with Terraform for infrastructure provisioning and management.
  • Experience with Helm for deploying and managing applications on Kubernetes.
  • Proficiency in scripting languages (e.g., Python, Bash) for automation.
  • Excellent problem-solving skills and a strong ability to debug complex issues.
  • Strong communication and interpersonal skills to effectively collaborate with cross-functional teams and user-facing interactions.
  • Demonstrated ability to take initiative, anticipate needs, and drive projects to completion.
  • Ability to thrive in a fast-paced environment and adapt to evolving requirements while adhering to corporate guidelines.
  • Ability to write clean code with little syntax/convention feedback.
  • Applies software engineering best practices (linting automation, unit testing, documentation, CI/CD).
  • Familiarity with modern machine learning methods.
  • Knowledge of and experience with high-performance computing, distributed systems, and cloud computing.

Senior Machine Learning Engineer - DevOps
  • BS/MS with 3-5 years of industry experience required
  • Proven experience in designing, deploying, and managing infrastructure on Amazon Web Services (AWS), including services such as EC2, S3, RDS, EKS, SageMaker, etc.
  • Strong proficiency with Git and Git repository management.
  • Hands-on experience with Terraform for infrastructure provisioning and management.
  • Experience with Helm for deploying and managing applications on Kubernetes.
  • Proficiency in scripting languages (e.g., Python, Bash) for automation.
  • Excellent problem-solving skills and a strong ability to debug complex issues.
  • Strong communication and interpersonal skills to effectively collaborate with cross-functional teams and user-facing interactions.
  • Demonstrated ability to take initiative, anticipate needs, and drive projects to completion.
  • Ability to thrive in a fast-paced environment and adapt to evolving requirements while adhering to corporate guidelines.
  • Ability to write clean code with little syntax/convention feedback.
  • Applies software engineering best practices (linting automation, unit testing, documentation, CI/CD).
  • Familiarity with modern machine learning methods.
  • Knowledge of and experience with high-performance computing, distributed systems, and cloud computing.

Preferred
  • Experience with MLOps platforms and tools.
  • Familiarity with CI/CD pipelines for ML workflows.
  • Knowledge of monitoring and logging tools (e.g., Prometheus, Grafana, ELK stack)

Relocation benefits are NOT available for this job posting
The expected salary range for this position based on the primary location of California for the Machine Learning Engineer is $147,600, - $274,000 and New York is $141,100 - $262,100, and the Senior Machine Learning Engineer for California is $167,400 - $310,800 and New York is $160,100 - $297,300. Actual pay will be determined based on experience, qualifications, geographic location, and other job-related factors permitted by law. A discretionary annual bonus may be available based on individual and Company performance. This position also qualifies for the benefits detailed at the link provided below.
Benefits
#ComputationCoE
#tech4lifeComputationalScience
#tech4lifeAI
Genentech is an equal opportunity employer. It is our policy and practice to employ, promote, and otherwise treat any and all employees and applicants on the basis of merit, qualifications, and competence. The company's policy prohibits unlawful discrimination, including but not limited to, discrimination on the basis of Protected Veteran status, individuals with disabilities status, and consistent with all federal, state, or local laws.
If you have a disability and need an accommodation in relation to the online application process, please contact us by completing this form Accommodations for Applicants.

What Genentech employees say

Pay

Benefits

Hours and flexibility

Workplace

Get the full story on Breakroom


Genentech logo

About Genentech

Sourced by ZipRecruiter

A member of the Roche Group, Genentech has been at the forefront of the biotechnology industry for more than 40 years, using human genetic information to develop novel medicines for serious and life-threatening diseases. Genentech has multiple therapies on the market for cancer & other serious illnesses. Please take this opportunity to learn about Genentech where we believe that our employees are our most important asset & are dedicated to remaining a great place to work.

Industry

Scientific research and development services

Company size

10,000+ Employees

Headquarters location

South San Francisco, CA, US

Year founded

1976

Social media