ZipRecruiter

Log In

1

Sr Machine Learning Engineer Jobs in Raleigh, NC

Compunnel

Senior Machine Learning Engineer

Raleigh, NC · On-site

$101K - $139K/yr

We are seeking a Senior Machine Learning Engineer to help lead the design and validation of AI-driven product capabilities within the legal domain. This role focuses on defining what to build and why ...

RIT Solutions, Inc.

Sr Machine Learning Engineer

Raleigh, NC · On-site

$101K - $139K/yr

RIT Solutions, Inc. is seeking a Senior Machine Learning Engineer. The role involves deploying machine learning models at scale and working with cloud services, Kubernetes, and orchestration of ...

TEKsystems

Machine Learning Engineer

Raleigh, NC

$75 - $85/hr

Description About the Role Our client is seeking a Senior Machine Learning Engineer II to help build and scale advanced Agentic AI and Multi-Agent Systems that transform how professionals interact ...

Q2

Senior Machine Learning Engineer

Cary, NC · On-site

$124K - $164K/yr

As a Machine Learning Engineer, you'll design and deliver production-ready AI solutions, develop the tools, APIs, and backend services that enable them, and help shape the future of our AI platform.

Q2

Senior Machine Learning Engineer

Cary, NC · On-site

$113K - $149K/yr

As a Machine Learning Engineer, you'll design and deliver production-ready AI solutions, develop the tools, APIs, and backend services that enable them, and help shape the future of our AI platform.

Vadum Inc

Machine Learning Engineer

Raleigh, NC · On-site

We are seeking a talented and innovative Machine Learning Engineer to join our dynamic team. In ... Generate content for status meetings with customers as a senior technical contributor. * Research ...

Vadum, Inc.

Machine Learning Engineer

Raleigh, NC · On-site

$96K - $137K/yr

We are seeking a talented and innovative Machine Learning Engineer to join our dynamic team. In ... Generate content for status meetings with customers as a senior technical contributor. * Research ...

Vadum Inc

Machine Learning Engineer

Raleigh, NC · On-site

We are seeking a talented and innovative Machine Learning Engineer to join our dynamic team. In ... Generate content for status meetings with customers as a senior technical contributor. * Research ...

LexisNexis

Senior Machine Learning Engineer III

Raleigh, NC · Hybrid

$118K - $219K/yr

Are you looking to develop your Machine Learning Engineer career? Do you enjoy coaching others to achieve high standards? This is a full-time position based in Raleigh, NC. (Hybrid - 3 days in office ...

CoVar

Machine Learning Engineer

Durham, NC · On-site

The Machine Learning Engineer will develop software and machine learning algorithms to address real-world customer issues and will have opportunities to present their work to high-level customers.

CoVar

Machine Learning Engineer

Durham, NC

Machine Learning Engineer About CoVar CoVar is a small AI/ML R&D software company in Durham, NC, that uses artificial intelligence to solve problems that matter. We develop AI/ML tools to help the ...

Syngenta

Machine Learning Engineer

Durham, NC · On-site

Our Data Science and Engineering team in R&D Digital is seeking a motivated Machine Learning Engineer who will drive the development and deployment of advanced computer vision and machine learning ...

Motion Recruitment

Lead Machine Learning Engineer

Raleigh, NC · On-site

$91K - $120K/yr

We are seeking a Sr. Machine Learning Engineer to define and lead the architecture of scalable AI/ML and agentic systems across our global product portfolio. This is a senior technical leadership ...

CoVar

Machine Learning Engineer

Durham, NC · On-site

... machine learning, Bayesian models, etc. • B.S., preferably M.S. or Ph.D in engineering, math, computer science, or related field • Excellent technical communication skills • Ability to work in ...

Q2 India

Machine Learning Engineer

Cary, NC · On-site

As a Machine Learning Engineer, you'll build and operate the production systems behind fraud detection at scale, helping protect nearly two trillion dollars in transactions for millions of users each ...

next page

Showing results 1-20

All JobsSr Machine Learning Engineer JobsSr Machine Learning Engineer Jobs in Raleigh, NC

Sr Machine Learning Engineer information

See Raleigh, NC salary details

$57.8K

$123K

$178.4K

How much do sr machine learning engineer jobs pay per year?

As of Sep 15, 2026, the average yearly pay for sr machine learning engineer in Raleigh, NC is $123,024.00, according to ZipRecruiter salary data. Most workers in this role earn between $101,600.00 and $139,500.00 per year, depending on experience, location, and employer.

What is a Sr Machine Learning Engineer?

Senior Machine Learning Engineers are experienced professionals who design, develop, and implement machine learning models and systems. They work on complex problems, lead technical projects, and often mentor junior engineers. Their responsibilities include data preprocessing, model selection, algorithm development, and optimizing solutions for scalability and performance. Senior ML Engineers also collaborate closely with data scientists, software engineers, and stakeholders to integrate machine learning into products and services.

What are the key skills and qualifications needed to thrive as a Sr Machine Learning Engineer?

To thrive as a Sr Machine Learning Engineer, you need advanced expertise in machine learning theory, programming (Python, R), data modeling, and a strong background in computer science or a related field. Familiarity with tools such as TensorFlow, PyTorch, scikit-learn, cloud platforms (AWS, GCP), and relevant certifications (like TensorFlow Developer) is highly beneficial. Strong problem-solving skills, effective communication, and the ability to lead and mentor teams set top candidates apart. These skills ensure the ability to design scalable ML solutions, collaborate effectively, and drive impactful business outcomes.

How does a Sr Machine Learning Engineer typically collaborate with data scientists and software engineers within a project team?

Sr Machine Learning Engineers frequently act as a bridge between data scientists, who focus on model development and experimentation, and software engineers, who handle system integration and production deployment. They translate prototype models into scalable, production-ready solutions, ensuring that models are optimized for real-world performance. Collaboration often involves reviewing code, aligning on data pipeline requirements, and participating in regular team meetings to address technical and business objectives. This cross-functional teamwork is essential for delivering reliable machine learning products.

What is the difference between Sr Machine Learning Engineer vs Data Scientist?

AspectSr Machine Learning EngineerData Scientist
CredentialsBachelor's/Master's in CS, ML, or related fields; experience with ML frameworksBachelor's/Master's/PhD in CS, Statistics, or related fields; strong analytical skills
Work EnvironmentDevelops and deploys ML models, collaborates with engineering teamsAnalyzes data, builds models, interprets data insights for business
Industry UsageTech, finance, healthcare, e-commerceResearch, marketing, finance, tech

While both roles involve working with data and models, Sr Machine Learning Engineers focus on building and deploying scalable ML systems, whereas Data Scientists primarily analyze data and develop insights. The roles often overlap but differ in technical focus and responsibilities.

What are popular job titles related to Sr Machine Learning Engineer jobs in Raleigh, NC?

For Sr Machine Learning Engineer jobs in Raleigh, NC, the most frequently searched job titles are:

What job categories do people searching Sr Machine Learning Engineer jobs in Raleigh, NC look for?

The top searched job categories for Sr Machine Learning Engineer jobs in Raleigh, NC are:

What cities near Raleigh, NC are hiring for Sr Machine Learning Engineer jobs?

Cities near Raleigh, NC with the most Sr Machine Learning Engineer job openings:

Sr Machine Learning Engineer jobs near you
Infographic showing various Sr Machine Learning Engineer job openings in Raleigh, NC as of September 2026, with employment types broken down into 100% Contract. Highlights an 100% In-person job distribution, with an average salary of $123,024 per year, or $59.1 per hour.

Senior Machine Learning Engineer

Raleigh, NC • On-site

Compunnel
IT Services • 501 - 1,000 employees
Learn more about Compunnelexternal

$101K - $139K/yr

Contractor

Posted 28 days ago

Job description

Job Summary:
We are seeking a Senior Machine Learning Engineer to help lead the design and validation of AI-driven product capabilities within the legal domain. This role focuses on defining what to build and why, leveraging Python and large language models (LLMs) to solve complex legal workflows. You will drive experimentation, modeling, and evaluation, partnering closely with data scientists to translate validated approaches into scalable, customer-facing solutions.
Key Responsibilities:
• Design, build, and deploy scalable machine learning and generative AI solutions for legal technology products.
• Develop and optimize NLP, LLM, and Retrieval-Augmented Generation (RAG) applications for production environments.
• Engineer agentic AI workflows and multi-step reasoning systems to automate complex legal processes.
• Implement and improve retrieval systems, including vector databases, semantic search, lexical search, and hybrid search architectures.
• Build and maintain ML pipelines, APIs, model serving infrastructure, and cloud-based AI platforms.
• Establish MLOps best practices for model deployment, monitoring, observability, versioning, and lifecycle management.
• Evaluate and optimize model performance, latency, scalability, and cost efficiency across AI applications.
• Partner with product managers, legal subject matter experts, data scientists, and software engineers to deliver business-focused AI solutions.
• Troubleshoot production ML systems, identify performance bottlenecks, and implement continuous improvements.
• Provide technical leadership and mentorship on machine learning engineering, LLM architecture, and AI platform best practices.
Required Qualifications:
• 7-10+ years of AI/machine learning engineering experience, including building RAG systems end-to-end and deploying solutions through production.
• Strong software and Python engineering background, with progression into machine learning engineering.
• Experience designing agentic workflows and applying generative AI techniques, including prompt engineering and end-to-end RAG system development.
• Strong experience working with unstructured data, including text and documents, document processing, NLP, embeddings, retrieval, and agentic systems.
• Strong experience creating production-grade ML systems at scale.
• Strong LLM, Generative AI, and RAG deployment experience, including implementation and end-to-end evaluation.
• Experience with the complete deployment lifecycle, including product development, production maintenance, and new feature development.
• Experience working alongside data scientists throughout the production deployment and lifecycle.
• Strong Python programming skills.
Compunnel logo

About Compunnel

Sourced by ZipRecruiter

Compunnel is a well-known company located in Plainsboro, NJ, US, recognized in the industry of IT Services and Solutions. Established in 1989, Compunnel offers a suite of services that help businesses integrate technology efficiently into their operations, a recognizable name in the IT solutions sphere for over three decades. The company’s service portfolio includes Digital Transformation, Business Intelligence, Cloud Services, Cybersecurity, and Application Modern Services, among others. Guided by its mission "to innovate with industry-leading digital solutions and disruptive tech strategies for unimagining business growth," the company underlines its commitment to offering out-of-the-box solutions to its clients. Remarkable achievements of the company include serving more than 30 Fortune 500 companies and providing job opportunities for over 50,000 individuals.

Industry

It services

Company size

501 - 1,000 Employees

Headquarters location

Plainsboro, NJ, US

Year founded

1994

Social media

FacebookTwitter

View All Compunnel Jobs

Apply