1

Senior Machine Learning Ops Engineer Jobs in Durham, NC

Sr Machine Learning Engineer

Raleigh, NC · On-site

$101K - $139K/yr

RIT Solutions, Inc. is seeking a Senior Machine Learning Engineer. The role involves deploying machine learning models at scale and working with cloud services, Kubernetes, and orchestration of ...

Are you looking to develop your Machine Learning Engineer career? Do you enjoy coaching others to achieve high standards? This is a full-time position based in Raleigh, NC. (Hybrid - 3 days in office ...

We are seeking a talented and innovative Machine Learning Engineer to join our dynamic team. In ... Generate content for status meetings with customers as a senior technical contributor. * Research ...

Machine Learning Engineer

Raleigh, NC · On-site

$96K - $137K/yr

We are seeking a talented and innovative Machine Learning Engineer to join our dynamic team. In ... Generate content for status meetings with customers as a senior technical contributor. * Research ...

We are seeking a talented and innovative Machine Learning Engineer to join our dynamic team. In ... Generate content for status meetings with customers as a senior technical contributor. * Research ...

Lead Machine Learning Engineer

Raleigh, NC · On-site

$91K - $120K/yr

We are seeking a Sr. Machine Learning Engineer to define and lead the architecture of scalable AI/ML and agentic systems across our global product portfolio. This is a senior technical leadership ...

New

Machine Learning Engineer About CoVar CoVar is a small AI/ML R&D software company in Durham, NC, that uses artificial intelligence to solve problems that matter. We develop AI/ML tools to help the ...

The Machine Learning Engineer will develop software and machine learning algorithms to address real-world customer issues and will have opportunities to present their work to high-level customers.

... machine learning, Bayesian models, etc. • B.S., preferably M.S. or Ph.D in engineering, math, computer science, or related field • Excellent technical communication skills • Ability to work in ...

next page

Showing results 1-20

Senior Machine Learning Ops Engineer information

See Durham, NC salary details

$57.5K

$122.3K

$177.3K

How much do senior machine learning ops engineer jobs pay per year?

As of Aug 5, 2026, the average yearly pay for senior machine learning ops engineer in Durham, NC is $122,293.00, according to ZipRecruiter salary data. Most workers in this role earn between $101,000.00 and $138,700.00 per year, depending on experience, location, and employer.

What are the key skills and qualifications needed to thrive as a senior machine learning ops engineer?

To thrive as a Senior Machine Learning Ops Engineer, you need expertise in machine learning, software engineering, cloud platforms, and experience with CI/CD pipelines, often supported by a computer science degree or equivalent experience. Proficiency with tools like Docker, Kubernetes, TensorFlow, PyTorch, and cloud services such as AWS, GCP, or Azure is typically required, along with familiarity with MLOps frameworks. Strong problem-solving, collaboration, and communication skills help you work effectively with cross-functional teams and manage complex ML model deployments. These skills are essential to ensure reliable, scalable, and efficient deployment of machine learning models in production environments.

What are some common challenges faced by senior machine learning ops engineers when deploying models to production?

Senior Machine Learning Ops Engineers often encounter challenges such as ensuring model reproducibility, managing model versioning, and automating deployment pipelines for scalability. Another key challenge is monitoring model performance and data drift in production, which requires robust logging and alerting systems. Collaborating closely with data scientists, software engineers, and IT teams is essential to address these challenges and maintain a stable, efficient ML infrastructure.

What is the difference between Senior Machine Learning Ops Engineer vs Data Engineer?

AspectSenior Machine Learning Ops EngineerData Engineer
CredentialsExperience with ML frameworks, cloud platforms, scripting, and DevOps toolsStrong SQL, ETL, database, and programming skills, often with cloud experience
Work EnvironmentFocus on deploying, monitoring, and maintaining ML models in productionDesigning and building data pipelines and infrastructure for data processing
Industry UsageCommon in AI/ML-focused companies, tech firms, and data-driven organizationsWidespread across industries for data management and analytics

While both roles involve working with data and cloud platforms, the Senior Machine Learning Ops Engineer specializes in deploying and maintaining machine learning models, whereas the Data Engineer focuses on building data pipelines and infrastructure. Understanding these distinctions helps in choosing the right career path or job search focus.

What is a senior machine learning ops engineer?

Senior Machine Learning Ops (MLOps) Engineers are experienced professionals who design, build, and maintain the infrastructure and tools needed to deploy, monitor, and scale machine learning models in production environments. They work at the intersection of data science, software engineering, and DevOps to ensure ML models are robust, reliable, and secure. Their responsibilities often include automating model training pipelines, managing cloud resources, implementing CI/CD for ML, and ensuring model reproducibility. Senior MLOps Engineers also mentor junior staff and help define best practices for the organization’s ML workflow.
What are popular job titles related to Senior Machine Learning Ops Engineer jobs in Durham, NC? For Senior Machine Learning Ops Engineer jobs in Durham, NC, the most frequently searched job titles are:
What job categories do people searching Senior Machine Learning Ops Engineer jobs in Durham, NC look for? The top searched job categories for Senior Machine Learning Ops Engineer jobs in Durham, NC are:

Sr Machine Learning Engineer

RIT Solutions, Inc.

Raleigh, NC • On-site

$101K - $139K/yr

Full-time

Re-posted 18 days ago


Job description

Job Summary:
RIT Solutions, Inc. is seeking a Senior Machine Learning Engineer. The role involves deploying machine learning models at scale and working with cloud services, Kubernetes, and orchestration of agentic systems.
Qualifications:
Required:
• 10+ yrs production ML at scale
• LLM/GenAI/RAG deployment
• Cloud (AWS/Azure/GCP)
• Kubernetes/containerization
• Agentic systems & tool orchestration
• MCP servers
• Strong Python
Preferred:
• MLOps/CI/CD
• Responsible AI
• Multi-step reasoning agents
• Low-latency inference platforms
• Mentoring exp
Company:
Jobdiva Job Portal: https://www1.jobdiva.com/candidates/myjobs/searchjobsdone.jsp?a=xbjdnwgjodtga1y1im2g881fkkeiwd0775lbvq8yqgps8vb2q36w2vj1ga6xxork&compid=-1 Recruitment (contingency search and campus selection). Founded in 2019, the company is headquartered in Arlington, USA, with a team of 201-500 employees. The company is currently Growth Stage.