ZipRecruiter

Log In

1

Machine Learning Operations Jobs in New York, NY

Spgi

Machine Learning Engineer

New York, NY · On-site +1

$209K - $250K/yr

Deployment and Machine Learning operations; Conducting and publishing Machine Learning research and producing code; Agentic systems, including Large Language Model (LLM) code generation and tool ...

Point72

Machine Learning Engineer

New York, NY · On-site

... day operations, such as creating a production support AI agent that helps monitor production ... PhD or PhD candidate in machine learning, computer science or other AI related research fields

Point72

Machine Learning Engineer

New York, NY

... day operations, such as creating a production support AI agent that helps monitor production ... PhD or PhD candidate in machine learning, computer science or other AI related research fields

Oxman

Machine Learning Research Engineer

New York, NY · On-site

$142K - $184K/yr

D. or equivalent experience in Computer Science, Machine Learning, Operations Research, or related fields. * Demonstrated experience working in cross-functional teams bridging ML research with ...

PhysicsX

Machine Learning Engineer

New York, NY · On-site

... operations - empowering engineers to push the boundaries of possibility. Our customers include ... Who We're Looking For As a Machine Learning Engineer in Delivery, you are a problem solver who ...

next page

Showing results 1-20

All JobsMachine Learning Operations JobsMachine Learning Operations Jobs in New York, NY

Machine Learning Operations information

See New York, NY salary details

$23

$43

$67

How much do machine learning operations jobs pay per hour?

As of Aug 31, 2026, the average hourly pay for machine learning operations in New York, NY is $43.64, according to ZipRecruiter salary data. Most workers in this role earn between $36.54 and $46.30 per hour, depending on experience, location, and employer.

What is the difference between Machine Learning Operations vs Data Scientist?

AspectMachine Learning OperationsData Scientist
Primary FocusDeploying, maintaining, and scaling ML models in productionAnalyzing data to develop insights and build models
Required SkillsML deployment, cloud platforms, automation, scriptingStatistical analysis, data visualization, programming (Python/R)
Work EnvironmentOperations teams, cloud infrastructure, production systemsResearch environments, data analysis teams, R&D
Common CertificationsCloud certifications, MLOps tools certificationsData science certifications, statistical courses

Machine Learning Operations and Data Scientists often collaborate, but MLOps focuses on deploying and maintaining models in production, while Data Scientists focus on analyzing data and developing models. Both roles require technical skills, but their day-to-day tasks and environments differ.

Is machine learning operations a high paying job?

Machine Learning Operations (MLOps) roles typically offer high salaries due to the specialized skills required, such as expertise in cloud platforms, automation, and data engineering. Compensation varies based on experience, location, and company size, but generally ranks among well-paying tech jobs.

What are machine learning operations?

Machine Learning Operations (MLOps) is a set of practices that combines machine learning, software engineering, and DevOps to deploy, monitor, and maintain machine learning models in production environments. It involves tasks such as model versioning, automation, testing, and ensuring scalability and reliability using tools like CI/CD pipelines and cloud platforms.

What cities near New York, NY are hiring for Machine Learning Operations jobs?

Cities near New York, NY with the most Machine Learning Operations job openings:

Machine Learning Operations jobs near you
Infographic showing various Machine Learning Operations job openings in New York, NY as of August 2026, with employment types broken down into 100% Full Time. Highlights an 67% In-person, and 33% Remote job distribution, with an average salary of $90,776 per year, or $43.6 per hour.

Machine Learning Operations Engineer - Remote

Jersey City, NJ • On-site, Remote

NAVA Software Solutions
IT Services • 51 - 200 employees
Learn more about NAVA Software Solutionsexternal

$76K - $102K/yr

Full-time

Re-posted 29 days ago

Job description

NAVA Software solutions is looking for a Machine Learning Operations Engineer
Details:
Machine Learning Operations (MLOps) Engineer - AWS (with LLM Focus)
Location: Remote work
Duration: 12 months
Responsibilities:
  • LLM-Optimized MLOps Infrastructure: Design and implement MLOps infrastructure on AWS tailored for LLMs, leveraging services like SageMaker, EC2 (with GPU instances), S3, ECS/EKS, Lambda, and more.
  • LLM Deployment Pipelines: Build and manage CI/CD pipelines specifically for LLM deployment, addressing unique challenges like model size, inference optimization, and versioning.
  • LLMOps Practices: Implement LLMOps best practices for monitoring model performance, drift detection, prompt management, and feedback loops for continuous improvement.
  • RESTful API Development: Design and develop RESTful APIs to expose LLM capabilities to other applications and services, ensuring scalability, security, and optimal performance.
  • Model Optimization: Apply techniques like quantization, distillation, and pruning to optimize LLM models for efficient inference on AWS infrastructure.
  • Monitoring and Observability: Establish comprehensive monitoring and alerting mechanisms to track LLM performance, latency, resource utilization, and potential biases.
  • Prompt Engineering and Management: Develop strategies for prompt engineering and management to enhance LLM outputs and ensure consistency and safety.
  • Collaboration: Work closely with data scientists, researchers, and software engineers to integrate LLM models into production systems effectively.
  • Cost Optimization: Continuously optimize LLMOps processes and infrastructure for cost-efficiency while maintaining high performance and reliability.

Qualifications:
  • Experience: 3+ years of experience in MLOps or a related field, with hands-on experience in deploying and managing LLMs.
  • AWS Expertise: Strong proficiency in AWS services relevant to MLOps and LLMs, including SageMaker, EC2 (with GPU instances), S3, ECS/EKS, Lambda, and API Gateway.
  • LLM Knowledge: Deep understanding of LLM architectures (e.g., Transformers), training techniques, and inference optimization strategies.
  • Programming Skills: Proficiency in Python and experience with infrastructure-as-code tools (e.g., Terraform, CloudFormation), REST API frameworks (e.g., Flask, FastAPI), and LLM libraries (e.g., Hugging Face Transformers).
  • Monitoring: Familiarity with monitoring and logging tools for LLMs, such as Prometheus, Grafana, and CloudWatch.
  • Containerization: Experience with Docker and container orchestration (e.g., Kubernetes, ECS) for LLM deployment.
  • Problem Solving: Excellent problem-solving and troubleshooting skills in the context of LLMs and MLOps.
  • Communication: Strong communication and collaboration skills to effectively work with cross-functional teams
NAVA Software Solutions logo

About NAVA Software Solutions

Sourced by ZipRecruiter

NAVA is a strategic partner for companies seeking to develop or customize software and products. Our team of experts leverages cutting-edge technology and deep industry knowledge to provide customized solutions that drive business success. Whether you're looking to improve your operations, increase efficiency, or bring a new product to market, NAVA has the expertise and resources to help you achieve your goals. Trust us to be your partner in software and product development.

Industry

It services

Company size

51 - 200 Employees

Headquarters location

Rocky Hill, CT, US

Social media

Facebook

View All NAVA Software Solutions Jobs

Apply