ZipRecruiter

Log In

1

Senior Machine Learning Engineer Jobs in Raleigh, NC

Compunnel

Senior Machine Learning Engineer

Raleigh, NC · On-site

$101K - $139K/yr

We are seeking a Senior Machine Learning Engineer to help lead the design and validation of AI-driven product capabilities within the legal domain. This role focuses on defining what to build and why ...

RIT Solutions, Inc.

Sr Machine Learning Engineer

Raleigh, NC · On-site

$101K - $139K/yr

RIT Solutions, Inc. is seeking a Senior Machine Learning Engineer. The role involves deploying machine learning models at scale and working with cloud services, Kubernetes, and orchestration of ...

Vadum Inc

Machine Learning Engineer

Raleigh, NC

We are seeking a talented and innovative Machine Learning Engineer to join our dynamic team. In ... Generate content for status meetings with customers as a senior technical contributor. * Research ...

Vadum, Inc.

Machine Learning Engineer

Raleigh, NC · On-site

$96K - $137K/yr

We are seeking a talented and innovative Machine Learning Engineer to join our dynamic team. In ... Generate content for status meetings with customers as a senior technical contributor. * Research ...

Vadum Inc

Machine Learning Engineer

Raleigh, NC · On-site

We are seeking a talented and innovative Machine Learning Engineer to join our dynamic team. In ... Generate content for status meetings with customers as a senior technical contributor. * Research ...

LexisNexis

Senior Machine Learning Engineer III

Raleigh, NC · Hybrid

$118K - $219K/yr

Are you looking to develop your Machine Learning Engineer career? Do you enjoy coaching others to achieve high standards? This is a full-time position based in Raleigh, NC. (Hybrid - 3 days in office ...

CoVar

Machine Learning Engineer

Durham, NC · On-site

The Machine Learning Engineer will develop software and machine learning algorithms to address real-world customer issues and will have opportunities to present their work to high-level customers.

CoVar

Machine Learning Engineer

Durham, NC

Machine Learning Engineer About CoVar CoVar is a small AI/ML R&D software company in Durham, NC, that uses artificial intelligence to solve problems that matter. We develop AI/ML tools to help the ...

CoVar

Machine Learning Engineer

Durham, NC · On-site

... machine learning, Bayesian models, etc. • B.S., preferably M.S. or Ph.D in engineering, math, computer science, or related field • Excellent technical communication skills • Ability to work in ...

Compunnel

Machine Learning Engineer Lead

Raleigh, NC · On-site

$99K - $131K/yr

Job Summary The Machine Learning Engineer Lead will define and lead the architecture of scalable AI ... This senior technical leadership role will focus on large-scale distributed ML systems, LLM and RAG ...

RELX Group plc

Machine Learning Engineer Lead

Raleigh, NC · On-site

$115K - $192K/yr

We are seeking a Machine Learning Engineer Lead to design, build, and operate scalable AI/ML systems and agentic architectures that support next-generation legal research and analytics products. This ...

next page

Showing results 1-20

All JobsMachine Learning Engineer JobsSenior Machine Learning Engineer JobsSenior Machine Learning Engineer Jobs in Raleigh, NC

Senior Machine Learning Engineer information

See Raleigh, NC salary details

$57.8K

$123K

$178.4K

How much do senior machine learning engineer jobs pay per year?

As of Aug 25, 2026, the average yearly pay for senior machine learning engineer in Raleigh, NC is $123,017.00, according to ZipRecruiter salary data. Most workers in this role earn between $101,600.00 and $139,500.00 per year, depending on experience, location, and employer.

What does a senior machine learning engineer do?

A Senior Machine Learning Engineer designs, develops, and implements machine learning models to solve complex problems. They are responsible for selecting appropriate algorithms, preprocessing data, and optimizing model performance. Additionally, they collaborate with data scientists, software engineers, and product teams to integrate machine learning solutions into production systems. Senior engineers also mentor junior team members and contribute to setting technical direction for machine learning projects.

What are some common challenges senior machine learning engineers face when deploying models to production, and how can they be addressed?

Senior Machine Learning Engineers often encounter challenges related to model scalability, maintaining performance in real-world scenarios, and ensuring reliable integration with existing systems. Addressing these challenges typically involves thorough testing, implementing robust monitoring for model drift, and collaborating closely with DevOps and software engineering teams to streamline deployment pipelines. Staying updated on best practices in MLOps and adopting tools for automated deployment and monitoring can greatly improve the reliability and efficiency of production models.

What are the key skills and qualifications needed to thrive as a senior machine learning engineer, and why are they important?

To thrive as a Senior Machine Learning Engineer, you need advanced knowledge of machine learning algorithms, statistical modeling, and programming languages like Python or Java, typically supported by a degree in computer science or a related field. Experience with frameworks and tools such as TensorFlow, PyTorch, scikit-learn, and cloud platforms, as well as familiarity with version control and CI/CD systems, is essential. Strong problem-solving, communication, and leadership skills help you collaborate effectively and mentor junior team members. These capabilities are crucial for designing scalable ML solutions and driving impactful results within complex, dynamic projects.

What is the difference between Senior Machine Learning Engineer vs Data Scientist?

AspectSenior Machine Learning EngineerData Scientist
Required CredentialsBachelor's/Master's in CS, ML, or related; experience with ML frameworksBachelor's/Master's in CS, Statistics, or related; strong analytical skills
Work EnvironmentDevelops and deploys ML models in production systemsAnalyzes data, builds models, and provides insights
Industry UsageTech, finance, healthcare, e-commerceResearch, finance, marketing, tech

While both roles require strong technical skills and knowledge of machine learning, Senior Machine Learning Engineers focus more on deploying scalable ML solutions in production environments, whereas Data Scientists primarily analyze data and develop models for insights. The roles often overlap but differ in their core responsibilities and focus areas.

What are the most commonly searched types of Machine Learning Engineer jobs in Raleigh, NC?

The most popular types of Machine Learning Engineer jobs in Raleigh, NC are:

What are popular job titles related to Senior Machine Learning Engineer jobs in Raleigh, NC?

For Senior Machine Learning Engineer jobs in Raleigh, NC, the most frequently searched job titles are:

What job categories do people searching Senior Machine Learning Engineer jobs in Raleigh, NC look for?

The top searched job categories for Senior Machine Learning Engineer jobs in Raleigh, NC are:

What cities near Raleigh, NC are hiring for Senior Machine Learning Engineer jobs?

Cities near Raleigh, NC with the most Senior Machine Learning Engineer job openings:

Senior Machine Learning Engineer jobs near you
Infographic showing various Senior Machine Learning Engineer job openings in Raleigh, NC as of August 2026, with employment types broken down into 1% As Needed, 76% Full Time, 21% Part Time, and 2% Contract. Highlights an 88% Physical, 2% Hybrid, and 10% Remote job distribution, with an average salary of $123,017 per year, or $59.1 per hour.

Senior Machine Learning Engineer

Raleigh, NC • On-site

Compunnel
IT Services • 501 - 1,000 employees
Learn more about Compunnelexternal

$101K - $139K/yr

Contractor

Posted 7 days ago

Job description

Job Summary:
We are seeking a Senior Machine Learning Engineer to help lead the design and validation of AI-driven product capabilities within the legal domain. This role focuses on defining what to build and why, leveraging Python and large language models (LLMs) to solve complex legal workflows. You will drive experimentation, modeling, and evaluation, partnering closely with data scientists to translate validated approaches into scalable, customer-facing solutions.
Key Responsibilities:
• Design, build, and deploy scalable machine learning and generative AI solutions for legal technology products.
• Develop and optimize NLP, LLM, and Retrieval-Augmented Generation (RAG) applications for production environments.
• Engineer agentic AI workflows and multi-step reasoning systems to automate complex legal processes.
• Implement and improve retrieval systems, including vector databases, semantic search, lexical search, and hybrid search architectures.
• Build and maintain ML pipelines, APIs, model serving infrastructure, and cloud-based AI platforms.
• Establish MLOps best practices for model deployment, monitoring, observability, versioning, and lifecycle management.
• Evaluate and optimize model performance, latency, scalability, and cost efficiency across AI applications.
• Partner with product managers, legal subject matter experts, data scientists, and software engineers to deliver business-focused AI solutions.
• Troubleshoot production ML systems, identify performance bottlenecks, and implement continuous improvements.
• Provide technical leadership and mentorship on machine learning engineering, LLM architecture, and AI platform best practices.
Required Qualifications:
• 7-10+ years of AI/machine learning engineering experience, including building RAG systems end-to-end and deploying solutions through production.
• Strong software and Python engineering background, with progression into machine learning engineering.
• Experience designing agentic workflows and applying generative AI techniques, including prompt engineering and end-to-end RAG system development.
• Strong experience working with unstructured data, including text and documents, document processing, NLP, embeddings, retrieval, and agentic systems.
• Strong experience creating production-grade ML systems at scale.
• Strong LLM, Generative AI, and RAG deployment experience, including implementation and end-to-end evaluation.
• Experience with the complete deployment lifecycle, including product development, production maintenance, and new feature development.
• Experience working alongside data scientists throughout the production deployment and lifecycle.
• Strong Python programming skills.
Compunnel logo

About Compunnel

Sourced by ZipRecruiter

Compunnel is a well-known company located in Plainsboro, NJ, US, recognized in the industry of IT Services and Solutions. Established in 1989, Compunnel offers a suite of services that help businesses integrate technology efficiently into their operations, a recognizable name in the IT solutions sphere for over three decades. The company’s service portfolio includes Digital Transformation, Business Intelligence, Cloud Services, Cybersecurity, and Application Modern Services, among others. Guided by its mission "to innovate with industry-leading digital solutions and disruptive tech strategies for unimagining business growth," the company underlines its commitment to offering out-of-the-box solutions to its clients. Remarkable achievements of the company include serving more than 30 Fortune 500 companies and providing job opportunities for over 50,000 individuals.

Industry

It services

Company size

501 - 1,000 Employees

Headquarters location

Plainsboro, NJ, US

Year founded

1994

Social media

FacebookTwitter

View All Compunnel Jobs

Apply