1

Machine Learning Operations Jobs in New York, NY

Lead Machine Learning Engineer

Manhattan, NY · On-site

$113K - $148K/yr

Participate in operational ownership, incident response, and support for critical production services. SKILLS AND EXPERIENCE Must-Have * 7+ years of software engineering or machine learning ...

Machine Learning Engineer

New York, NY · On-site

$160K - $210K/yr

About the role We are seeking a Machine Learning Engineer to strengthen our element classification ... Advocate for and implement best practices around model deployment, versioning, and operational ...

Machine Learning Engineer

New York, NY · On-site

$180K - $230K/yr

We use it across underwriting, operations, clinical programs, and member experience to build an ... Arlo's underwriting is the core of the business, and it runs on machine learning at serious scale.

With expertise in machine learning, natural language processing, and data discovery, we develop and ... Collaborate closely with the ML Operations team to create automated solutions for managing the ...

With expertise in machine learning, natural language processing, and data discovery, we develop and ... Collaborate closely with the ML Operations team to create automated solutions for managing the ...

Machine Learning Engineer

New York, NY · On-site

$180K - $230K/yr

We use it across underwriting, operations, clinical programs, and member experience to build an ... Arlo's underwriting is the core of the business, and it runs on machine learning at serious scale.

Showing results 21-40

Machine Learning Operations information

See New York, NY salary details

$23

$43

$67

How much do machine learning operations jobs pay per hour?

As of Sep 1, 2026, the average hourly pay for machine learning operations in New York, NY is $43.64, according to ZipRecruiter salary data. Most workers in this role earn between $36.54 and $46.30 per hour, depending on experience, location, and employer.

What is the difference between Machine Learning Operations vs Data Scientist?

AspectMachine Learning OperationsData Scientist
Primary FocusDeploying, maintaining, and scaling ML models in productionAnalyzing data to develop insights and build models
Required SkillsML deployment, cloud platforms, automation, scriptingStatistical analysis, data visualization, programming (Python/R)
Work EnvironmentOperations teams, cloud infrastructure, production systemsResearch environments, data analysis teams, R&D
Common CertificationsCloud certifications, MLOps tools certificationsData science certifications, statistical courses

Machine Learning Operations and Data Scientists often collaborate, but MLOps focuses on deploying and maintaining models in production, while Data Scientists focus on analyzing data and developing models. Both roles require technical skills, but their day-to-day tasks and environments differ.

Is machine learning operations a high paying job?

Machine Learning Operations (MLOps) roles typically offer high salaries due to the specialized skills required, such as expertise in cloud platforms, automation, and data engineering. Compensation varies based on experience, location, and company size, but generally ranks among well-paying tech jobs.

What are machine learning operations?

Machine Learning Operations (MLOps) is a set of practices that combines machine learning, software engineering, and DevOps to deploy, monitor, and maintain machine learning models in production environments. It involves tasks such as model versioning, automation, testing, and ensuring scalability and reliability using tools like CI/CD pipelines and cloud platforms.

What cities near New York, NY are hiring for Machine Learning Operations jobs?

Cities near New York, NY with the most Machine Learning Operations job openings:

Infographic showing various Machine Learning Operations job openings in New York, NY as of August 2026, with employment types broken down into 100% Full Time. Highlights an 67% In-person, and 33% Remote job distribution, with an average salary of $90,776 per year, or $43.6 per hour.

Machine Learning Infrastructure Engineer, GenAI Technology

Point72

New York, NY • On-site

$180K - $300K/yr

Full-time

Retirement

Re-posted 12 days ago


Job description

A Career with Point72's Technology Team

As Point72 reimagines the future of investing, our Technology team is constantly evolving our firm's IT infrastructure and engineering capabilities, positioning us at the forefront of a rapidly evolving technology landscape. We're a team of experts who experiment and work to discover new ways to harness open-source solutions, modern cloud architectures, and sophisticated Artificial Intelligence (AI) solutions, while embracing enterprise agile methodologies. Our commitment to building and innovating in the AI space provides the framework intended to drive smarter decision making and enhance how we build and operate our platforms and applications.

As a member of Point72's Technology team, we encourage and support your professional development from day one-helping you advance your technical skills, contribute innovative ideas, and satisfy your own intellectual curiosity-all while delivering real business impact for our multi-billion-dollar global business. 

WHAT YOU'LL DO

  • Design and implement high-performance infrastructure to support large-scale generative AI and machine learning workloads, enabling faster model iteration and real business impact
  • Design and operate distributed systems for model training, hyperparameter tuning, inference, and data preprocessing pipelines to deliver reliable end-to-end machine learning (ML) workflows
  • Collaborate with ML researchers and engineers to produce models, optimizing compute utilization, training throughput, and inference latency
  • Develop and automate deployment, orchestration, and CI/CD pipelines for models and data workflows using container orchestration and infrastructure-as-code (IaC)
  • Implement observability, monitoring, and cost-management strategies for GPU and accelerator compute environments to maintain predictable performance and spend
  • Evaluate, integrate, and benchmark emerging hardware and software technologies across cloud and on-prem environments to improve scalability and throughput
  • Drive security, compliance, and operational runbooks for GenAI infrastructure including access controls, secrets management, and incident response procedures
  • Troubleshoot, profile, and optimize performance across GPU and CPU compute stacks to remove bottlenecks and increase reliability
  • Document architecture, operational practices, and mentor engineers to expand team capability and accelerate adoption of production-ready GenAI infrastructure

WHAT'S REQUIRED

  • Bachelor's or master's degree in computer science, electrical engineering, or a related technical field
  • 3-7 years of experience building and maintaining scalable compute or machine learning infrastructure systems
  • Deep understanding of distributed systems, container orchestration (Kubernetes), and public cloud platforms such as AWS, Google Cloud Platform, or Azure
  • Hands-on experience with machine learning operations and infrastructure tools such as MLflow, Ray, Airflow, Kubeflow, and Terraform
  • Strong understanding of reinforcement learning concepts and their infrastructure implications
  • Proficiency in Python and systems-level programming in one or more languages such as Go, C++, or Rust
  • Strong debugging, performance profiling, and optimization skills across GPU and CPU compute stacks
  • Experience implementing monitoring, observability, and cost-optimization for GPU/accelerator-based compute environments
  • Excellent collaboration and communication skills with a systems-thinking mindset
  • Commitment to the highest ethical standards

WE TAKE CARE OF OUR PEOPLE

We invest in our people, their careers, their health, and their well-being. When you work here, we provide:

  • Fully-paid health care benefits
  • Generous parental and family leave policies
  • Volunteer opportunities
  • Support for employee-led affinity groups representing women, people of color and the LGBT+ community
  • Mental and physical wellness programs
  • Tuition assistance
  • A 401(k) savings program with an employer match and more

ABOUT POINT72

Point72 is a leading global alternative investment firm led by Steven A. Cohen. Building on more than 30 years of investing experience, Point72 seeks to deliver superior returns for its investors through fundamental and systematic investing strategies across asset classes and geographies. We aim to attract and retain the industry's brightest talent by cultivating an investor-led culture and committing to our people's long-term growth. For more information, visit https://point72.com/.

The annual base salary range for this role is $180,000-$300,000 (USD) , which does not include discretionary bonus compensation or our comprehensive benefits package. Actual compensation offered to the successful candidate may vary from posted hiring range based upon geographic location, work experience, education, and/or skill level, among other things.