ZipRecruiter

Log In

1

Senior Machine Learning Ops Engineer Jobs in Cary, NC

RIT Solutions, Inc.

Sr Machine Learning Engineer

Raleigh, NC · On-site

$101K - $139K/yr

RIT Solutions, Inc. is seeking a Senior Machine Learning Engineer. The role involves deploying machine learning models at scale and working with cloud services, Kubernetes, and orchestration of ...

Compunnel

Senior Machine Learning Engineer

Raleigh, NC · On-site

$101K - $139K/yr

We are seeking a Senior Machine Learning Engineer to help lead the design and validation of AI-driven product capabilities within the legal domain. This role focuses on defining what to build and why ...

LexisNexis

Senior Machine Learning Engineer III

Raleigh, NC · Hybrid

$118K - $219K/yr

Are you looking to develop your Machine Learning Engineer career? Do you enjoy coaching others to achieve high standards? This is a full-time position based in Raleigh, NC. (Hybrid - 3 days in office ...

Vadum Inc

Machine Learning Engineer

Raleigh, NC

We are seeking a talented and innovative Machine Learning Engineer to join our dynamic team. In ... Generate content for status meetings with customers as a senior technical contributor. * Research ...

Vadum Inc

Machine Learning Engineer

Raleigh, NC · On-site

We are seeking a talented and innovative Machine Learning Engineer to join our dynamic team. In ... Generate content for status meetings with customers as a senior technical contributor. * Research ...

Vadum, Inc.

Machine Learning Engineer

Raleigh, NC · On-site

$96K - $137K/yr

We are seeking a talented and innovative Machine Learning Engineer to join our dynamic team. In ... Generate content for status meetings with customers as a senior technical contributor. * Research ...

CoVar

Machine Learning Engineer

Durham, NC · On-site

The Machine Learning Engineer will develop software and machine learning algorithms to address real-world customer issues and will have opportunities to present their work to high-level customers.

CoVar

Machine Learning Engineer

Durham, NC

Machine Learning Engineer About CoVar CoVar is a small AI/ML R&D software company in Durham, NC, that uses artificial intelligence to solve problems that matter. We develop AI/ML tools to help the ...

CoVar

Machine Learning Engineer

Durham, NC · On-site

... machine learning, Bayesian models, etc. • B.S., preferably M.S. or Ph.D in engineering, math, computer science, or related field • Excellent technical communication skills • Ability to work in ...

Compunnel

Machine Learning Engineer Lead

Raleigh, NC · On-site

$99K - $131K/yr

Job Summary The Machine Learning Engineer Lead will define and lead the architecture of scalable AI ... This senior technical leadership role will focus on large-scale distributed ML systems, LLM and RAG ...

next page

Showing results 1-20

All JobsMachine Learning Ops Engineer JobsSenior Machine Learning Ops Engineer JobsSenior Machine Learning Ops Engineer Jobs in Cary, NC

Senior Machine Learning Ops Engineer information

See Cary, NC salary details

$55.1K

$117.2K

$170K

How much do senior machine learning ops engineer jobs pay per year?

As of Aug 25, 2026, the average yearly pay for senior machine learning ops engineer in Cary, NC is $117,244.00, according to ZipRecruiter salary data. Most workers in this role earn between $96,800.00 and $132,900.00 per year, depending on experience, location, and employer.

What is a senior machine learning ops engineer?

Senior Machine Learning Ops (MLOps) Engineers are experienced professionals who design, build, and maintain the infrastructure and tools needed to deploy, monitor, and scale machine learning models in production environments. They work at the intersection of data science, software engineering, and DevOps to ensure ML models are robust, reliable, and secure. Their responsibilities often include automating model training pipelines, managing cloud resources, implementing CI/CD for ML, and ensuring model reproducibility. Senior MLOps Engineers also mentor junior staff and help define best practices for the organization’s ML workflow.

What are the key skills and qualifications needed to thrive as a senior machine learning ops engineer?

To thrive as a Senior Machine Learning Ops Engineer, you need expertise in machine learning, software engineering, cloud platforms, and experience with CI/CD pipelines, often supported by a computer science degree or equivalent experience. Proficiency with tools like Docker, Kubernetes, TensorFlow, PyTorch, and cloud services such as AWS, GCP, or Azure is typically required, along with familiarity with MLOps frameworks. Strong problem-solving, collaboration, and communication skills help you work effectively with cross-functional teams and manage complex ML model deployments. These skills are essential to ensure reliable, scalable, and efficient deployment of machine learning models in production environments.

What are some common challenges faced by senior machine learning ops engineers when deploying models to production?

Senior Machine Learning Ops Engineers often encounter challenges such as ensuring model reproducibility, managing model versioning, and automating deployment pipelines for scalability. Another key challenge is monitoring model performance and data drift in production, which requires robust logging and alerting systems. Collaborating closely with data scientists, software engineers, and IT teams is essential to address these challenges and maintain a stable, efficient ML infrastructure.

What is the difference between Senior Machine Learning Ops Engineer vs Data Engineer?

AspectSenior Machine Learning Ops EngineerData Engineer
CredentialsExperience with ML frameworks, cloud platforms, scripting, and DevOps toolsStrong SQL, ETL, database, and programming skills, often with cloud experience
Work EnvironmentFocus on deploying, monitoring, and maintaining ML models in productionDesigning and building data pipelines and infrastructure for data processing
Industry UsageCommon in AI/ML-focused companies, tech firms, and data-driven organizationsWidespread across industries for data management and analytics

While both roles involve working with data and cloud platforms, the Senior Machine Learning Ops Engineer specializes in deploying and maintaining machine learning models, whereas the Data Engineer focuses on building data pipelines and infrastructure. Understanding these distinctions helps in choosing the right career path or job search focus.

What are popular job titles related to Senior Machine Learning Ops Engineer jobs in Cary, NC?

For Senior Machine Learning Ops Engineer jobs in Cary, NC, the most frequently searched job titles are:

What cities near Cary, NC are hiring for Senior Machine Learning Ops Engineer jobs?

Cities near Cary, NC with the most Senior Machine Learning Ops Engineer job openings:

Senior Machine Learning Ops Engineer jobs near you
Infographic showing various Senior Machine Learning Ops Engineer job openings in Cary, NC as of August 2026, with employment types broken down into 1% As Needed, 76% Full Time, 21% Part Time, and 2% Contract. Highlights an 86% Physical, 2% Hybrid, and 12% Remote job distribution, with an average salary of $117,244 per year, or $56.4 per hour.

Sr Machine Learning Engineer

RIT Solutions, Inc.

Raleigh, NC • On-site

$101K - $139K/yr

Full-time

Re-posted 8 days ago

Job description

Job Summary:
RIT Solutions, Inc. is seeking a Senior Machine Learning Engineer. The role involves deploying machine learning models at scale and working with cloud services, Kubernetes, and orchestration of agentic systems.
Qualifications:
Required:
• 10+ yrs production ML at scale
• LLM/GenAI/RAG deployment
• Cloud (AWS/Azure/GCP)
• Kubernetes/containerization
• Agentic systems & tool orchestration
• MCP servers
• Strong Python
Preferred:
• MLOps/CI/CD
• Responsible AI
• Multi-step reasoning agents
• Low-latency inference platforms
• Mentoring exp
Company:
Jobdiva Job Portal: https://www1.jobdiva.com/candidates/myjobs/searchjobsdone.jsp?a=xbjdnwgjodtga1y1im2g881fkkeiwd0775lbvq8yqgps8vb2q36w2vj1ga6xxork&compid=-1 Recruitment (contingency search and campus selection). Founded in 2019, the company is headquartered in Arlington, USA, with a team of 201-500 employees. The company is currently Growth Stage.

Apply