ZipRecruiter

Log In

1

Senior Machine Learning Software Engineer Jobs in North Carolina

Compunnel

Senior Machine Learning Engineer

Raleigh, NC · On-site

$101K - $139K/yr

Job Summary: We are seeking a Senior Machine Learning Engineer to help lead the design and ... and software engineers to deliver business-focused AI solutions. • Troubleshoot production ML ...

RIT Solutions, Inc.

Sr Machine Learning Engineer

Raleigh, NC · On-site

$101K - $139K/yr

RIT Solutions, Inc. is seeking a Senior Machine Learning Engineer. The role involves deploying machine learning models at scale and working with cloud services, Kubernetes, and orchestration of ...

Teladoc

Senior Machine Learning Scientist

Concord, NC · On-site +1

Develop modular, well-tested, production-quality software using Python, Spark and SQL to build scalable data engineering, feature engineering, machine learning and AI pipelines following software ...

Vadum Inc

Machine Learning Engineer

Raleigh, NC

Collaborate with other ML and software engineers to produce software/data deliverables. This may ... Generate content for status meetings with customers as a senior technical contributor. * Research ...

Vadum Inc

Machine Learning Engineer

Raleigh, NC · On-site

Collaborate with other ML and software engineers to produce software/data deliverables. This may ... Generate content for status meetings with customers as a senior technical contributor. * Research ...

Vadum, Inc.

Machine Learning Engineer

Raleigh, NC · On-site

$96K - $137K/yr

Collaborate with other ML and software engineers to produce software/data deliverables. This may ... Generate content for status meetings with customers as a senior technical contributor. * Research ...

next page

Showing results 1-20

All JobsMachine Learning Software Engineer JobsSenior Machine Learning Software Engineer JobsSenior Machine Learning Software Engineer Jobs in North Carolina

Senior Machine Learning Software Engineer information

What is a senior machine learning software engineer?

A Senior Machine Learning Software Engineer is an experienced professional who designs, develops, and deploys machine learning models and systems to solve complex problems. They work closely with data scientists, engineers, and other stakeholders to build scalable and efficient solutions that leverage large data sets and advanced algorithms. Their responsibilities often include architecting ML pipelines, optimizing model performance, and mentoring junior team members. Typically, they have a strong background in computer science, programming, and applied mathematics, along with several years of hands-on experience in machine learning and software engineering.

What are some common challenges senior machine learning software engineers face when deploying models to production?

Senior Machine Learning Software Engineers often encounter challenges such as ensuring model scalability, maintaining performance under real-world data conditions, and integrating models seamlessly with existing systems. Handling data drift and monitoring model predictions for accuracy over time are also critical responsibilities. Collaboration with data engineers, DevOps, and product teams is essential to address these challenges and ensure robust, reliable deployments.

What are the key skills and qualifications needed to thrive as a senior machine learning software engineer, and why are they important?

A Senior Machine Learning Software Engineer requires deep expertise in machine learning algorithms, statistical analysis, and strong programming skills in languages like Python or Java, typically supported by a degree in computer science or a related field. Familiarity with frameworks such as TensorFlow, PyTorch, scikit-learn, as well as experience with cloud platforms and version control systems, is standard. Exceptional problem-solving, leadership, and communication skills help drive project success and mentor junior engineers. These competencies are crucial for designing scalable ML solutions, ensuring code quality, and effectively collaborating within cross-functional teams.

What is the difference between Senior Machine Learning Software Engineer vs Data Scientist?

AspectSenior Machine Learning Software EngineerData Scientist
CredentialsBachelor's or Master's in CS, ML, or related; experience with ML frameworksBachelor's or Master's in Data Science, Statistics, or related; strong analytical skills
Work EnvironmentDevelops ML models, integrates algorithms into products, collaborates with engineering teamsAnalyzes data, builds statistical models, visualizes insights, collaborates with business teams
Industry UsageTech, finance, healthcare, e-commerceResearch, finance, marketing, healthcare

While both roles involve working with data and algorithms, Senior Machine Learning Software Engineers focus on developing and deploying scalable ML models within software systems, whereas Data Scientists primarily analyze data to generate insights and inform business decisions.

What are the most commonly searched types of Machine Learning Software Engineer jobs in North Carolina?

The most popular types of Machine Learning Software Engineer jobs in North Carolina are:

What are popular job titles related to Senior Machine Learning Software Engineer jobs in North Carolina?

For Senior Machine Learning Software Engineer jobs in North Carolina, the most frequently searched job titles are:

What job categories do people searching Senior Machine Learning Software Engineer jobs in North Carolina look for?

The top searched job categories for Senior Machine Learning Software Engineer jobs in North Carolina are:

What cities in North Carolina are hiring for Senior Machine Learning Software Engineer jobs?

Cities in North Carolina with the most Senior Machine Learning Software Engineer job openings:

Senior Machine Learning Software Engineer jobs near you
Infographic showing various Senior Machine Learning Software Engineer job openings in North Carolina as of August 2026, with employment types broken down into 100% Full Time. Highlights an 100% In-person job distribution.

Senior Machine Learning Engineer

Compunnel

Raleigh, NC • On-site

$101K - $139K/yr

Contractor

Posted 13 days ago

Job description

Job Summary:
We are seeking a Senior Machine Learning Engineer to help lead the design and validation of AI-driven product capabilities within the legal domain. This role focuses on defining what to build and why, leveraging Python and large language models (LLMs) to solve complex legal workflows. You will drive experimentation, modeling, and evaluation, partnering closely with data scientists to translate validated approaches into scalable, customer-facing solutions.
Key Responsibilities:
• Design, build, and deploy scalable machine learning and generative AI solutions for legal technology products.
• Develop and optimize NLP, LLM, and Retrieval-Augmented Generation (RAG) applications for production environments.
• Engineer agentic AI workflows and multi-step reasoning systems to automate complex legal processes.
• Implement and improve retrieval systems, including vector databases, semantic search, lexical search, and hybrid search architectures.
• Build and maintain ML pipelines, APIs, model serving infrastructure, and cloud-based AI platforms.
• Establish MLOps best practices for model deployment, monitoring, observability, versioning, and lifecycle management.
• Evaluate and optimize model performance, latency, scalability, and cost efficiency across AI applications.
• Partner with product managers, legal subject matter experts, data scientists, and software engineers to deliver business-focused AI solutions.
• Troubleshoot production ML systems, identify performance bottlenecks, and implement continuous improvements.
• Provide technical leadership and mentorship on machine learning engineering, LLM architecture, and AI platform best practices.
Required Qualifications:
• 7-10+ years of AI/machine learning engineering experience, including building RAG systems end-to-end and deploying solutions through production.
• Strong software and Python engineering background, with progression into machine learning engineering.
• Experience designing agentic workflows and applying generative AI techniques, including prompt engineering and end-to-end RAG system development.
• Strong experience working with unstructured data, including text and documents, document processing, NLP, embeddings, retrieval, and agentic systems.
• Strong experience creating production-grade ML systems at scale.
• Strong LLM, Generative AI, and RAG deployment experience, including implementation and end-to-end evaluation.
• Experience with the complete deployment lifecycle, including product development, production maintenance, and new feature development.
• Experience working alongside data scientists throughout the production deployment and lifecycle.
• Strong Python programming skills.
Compunnel logo

About Compunnel

Sourced by ZipRecruiter

Compunnel is a well-known company located in Plainsboro, NJ, US, recognized in the industry of IT Services and Solutions. Established in 1989, Compunnel offers a suite of services that help businesses integrate technology efficiently into their operations, a recognizable name in the IT solutions sphere for over three decades. The company’s service portfolio includes Digital Transformation, Business Intelligence, Cloud Services, Cybersecurity, and Application Modern Services, among others. Guided by its mission "to innovate with industry-leading digital solutions and disruptive tech strategies for unimagining business growth," the company underlines its commitment to offering out-of-the-box solutions to its clients. Remarkable achievements of the company include serving more than 30 Fortune 500 companies and providing job opportunities for over 50,000 individuals.

Industry

It services

Company size

501 - 1,000 Employees

Headquarters location

Plainsboro, NJ, US

Year founded

1994

Social media

FacebookTwitter

View All Compunnel Jobs

Apply