1

Machine Learning Engineer Jobs in Raleigh, NC (NOW HIRING)

Machine Learning Compiler

Raleigh, NC · On-site

$160K - $240K/yr

Engineering Group, Engineering Group > Machine Learning Engineering General Summary: Lead a team of engineers focused on advancing machine learning compiler technologies for cutting-edge AI ...

Deep knowledge of supervised learning, unsupervised learning, feature engineering, model selection ... Familiar with machine learning curricula and common challenges such as understanding bias-variance ...

Machine Learning Tutor

Durham, NC · Remote

$18 - $40/hr

Deep knowledge of supervised learning, unsupervised learning, feature engineering, model selection ... Familiar with machine learning curricula and common challenges such as understanding bias-variance ...

Machine Learning Tutor

Raleigh, NC · Remote

$18 - $40/hr

Deep knowledge of supervised learning, unsupervised learning, feature engineering, model selection ... Familiar with machine learning curricula and common challenges such as understanding bias-variance ...

Job Summary : Qualcomm Technologies, Inc. is focused on advancing machine learning compiler ... Required : • Bachelor's degree in Computer Science, Electrical Engineering, or related field and ...

The role will involve collaborating with Machine Learning Engineers and cross-functional teams throughout the production lifecycle while providing technical mentorship and subject matter expertise.

New

Showing results 41-60

Machine Learning Engineer information

See Raleigh, NC salary details

$28.2K

$115.1K

$173K

How much do machine learning engineer jobs pay per year?

As of Aug 19, 2026, the average yearly pay for machine learning engineer in Raleigh, NC is $115,100.00, according to ZipRecruiter salary data. Most workers in this role earn between $90,700.00 and $138,500.00 per year, depending on experience, location, and employer.

What is a machine learning engineer?

Machine Learning Engineers are specialized software engineers who design, build, and deploy machine learning models and systems. They work at the intersection of software engineering and data science, transforming data-driven prototypes into scalable, production-ready solutions. Their responsibilities include data preprocessing, model selection, algorithm implementation, and optimizing models for performance and efficiency. Machine Learning Engineers often collaborate with data scientists, software developers, and other stakeholders to integrate AI technologies into products and services.

What does a machine learning engineer do?

A machine learning engineer maintains production systems and often works with other engineers. In this career, you work with software development methodology, use modern software development tools, and use agile practices. You also play a role in software design and architecture, so you may occasionally work with a programmer. An engineer may help to predict how a model should perform or seek out regression issues by using different test types and algorithms. To fulfill your duties and responsibilities, you work on a computer and use an array of skills and programs to carry out these tests.

What are the key skills and qualifications needed to thrive as a machine learning engineer, and why are they important?

To thrive as a Machine Learning Engineer, you need strong programming skills (particularly in Python), a solid background in mathematics and statistics, and a degree in computer science or a related field. Experience with machine learning frameworks (such as TensorFlow or PyTorch), data processing tools, and cloud platforms is typically required. Problem-solving ability, effective communication, and adaptability are crucial soft skills for collaborating with teams and translating complex models into practical solutions. These competencies ensure the development, deployment, and continual improvement of machine learning systems that drive business value.

What are some common challenges faced by machine learning engineers when deploying models to production?

Machine Learning Engineers often encounter challenges such as ensuring model scalability, maintaining data consistency between training and production environments, and monitoring model performance over time. Integrating models into existing software infrastructure may require collaboration with DevOps and software engineering teams to address issues like latency, version control, and resource allocation. Additionally, ongoing model maintenance is crucial to prevent model drift and ensure that predictions remain accurate as new data becomes available.

What is the difference between Machine Learning Engineer vs Data Scientist?

AspectMachine Learning EngineerData Scientist
CredentialsBachelor's or Master's in CS, Data Science, or related; experience with ML frameworksBachelor's or Master's in Statistics, Data Science, or related; strong analytical skills
Work EnvironmentDevelops scalable ML models, deploys algorithms into productionAnalyzes data, builds models, interprets data insights
Industry UsageTech companies, startups, AI-focused firmsFinance, healthcare, marketing, research organizations

While both roles work with data and machine learning, Machine Learning Engineers focus on building and deploying scalable ML models in production environments. Data Scientists primarily analyze data, create models, and generate insights. The roles often overlap but differ in their core responsibilities and focus areas.

What are the most commonly searched types of Machine Learning Engineer jobs in Raleigh, NC?

The most popular types of Machine Learning Engineer jobs in Raleigh, NC are:

What cities near Raleigh, NC are hiring for Machine Learning Engineer jobs?

Cities near Raleigh, NC with the most Machine Learning Engineer job openings:

Infographic showing various Machine Learning Engineer job openings in Raleigh, NC as of August 2026, with employment types broken down into 1% As Needed, 76% Full Time, 21% Part Time, and 2% Contract. Highlights an 88% Physical, 2% Hybrid, and 10% Remote job distribution, with an average salary of $115,100 per year, or $55.3 per hour.

Senior Machine Learning Engineer III ***Raleigh, NC***

Reed Elsevier Technology Services

Raleigh, NC • On-site

$118K - $219K/yr

Other

Posted 4 days ago


Job description

Are you looking to develop your Machine Learning Engineer career?
Do you enjoy coaching others to achieve high standards?
This is a full-time position based in Raleigh, NC.
(Hybrid - 3 days in office)
About the Role
We are seeking a Consultant-level Machine Learning Engineer to lead the implementation and scaling of AI systems for legal products. This role focuses on how to build and scale-owning system architecture, infrastructure, and productionization of ML/LLM solutions.
You will partner with Data Scientists to turn validated models and prototypes into reliable, high-performance, customer-facing systems.
Key Responsibilities
  • Architect and implement scalable ML/LLM systems in production.
  • Build and deploy LLM applications, including RAG pipelines and agentic systems.
  • Implement hybrid search systems (semantic + lexical) using embeddings and search platforms.
  • Develop and maintain APIs, microservices, and model serving infrastructure.
  • Build data pipelines and streaming systems for large-scale data processing.
  • Define and develop reusable frameworks, libraries, and infrastructure for AI/ML across teams.
  • Optimize systems for latency, scalability, reliability, and cost efficiency.
  • Establish best practices for deployment, monitoring, observability, and CI/CD.
  • Collaborate with Data Scientists to productionize models and integrate into products.
  • Provide technical leadership in system design and engineering standards.

Required Qualifications
  • Bachelor's degree in Computer Science, Engineering, or a related field.
  • Strong experience implementing and scaling production ML/LLM systems.
  • Deep experience with LLM application development, including RAG and prompt orchestration.
  • Strong experience designing and implementing agentic systems using agent frameworks (e.g., LangChain, LangGraph, AutoGen, Google ADK), including orchestration of multi-step workflows in production environments.
  • Strong experience with hybrid search (semantic + lexical), embeddings, and search platforms (e.g., Solr, OpenSearch).
  • Expertise in distributed systems and cloud-native development, including AWS (S3, DynamoDB).
  • Experience with streaming and messaging systems (e.g., Kafka, SQS) and caching (e.g., Redis).
  • Proficiency in Python and experience with systems languages (e.g., Rust, Go, Scala).
  • Experience building scalable APIs (REST/GraphQL).
  • Experience with containerization and orchestration (Docker, Kubernetes).
  • Strong software engineering fundamentals (system design, testing, CI/CD).

Preferred Qualifications
  • Experience with LLM platforms (e.g., ChatGPT/OpenAI, Claude, Gemini, LangChain, Google ADK).
  • Experience with DevOps and infrastructure as code (e.g., Terraform, CloudFormation, Jenkins).
  • Experience with big data technologies (e.g., Spark, Hadoop).
  • Familiarity with graph databases (e.g., Dgraph, Neo4j, Neptune).
  • Experience building high-availability, low-latency systems.
  • Experience in legal or regulatory domains.

Key Competencies
  • Strong system architecture and scalability mindset.
  • Ownership of implementation, performance, and reliability.
  • Ability to translate data science solutions into production systems.
  • Cross-functional collaboration with DS, product, and platform teams.
  • Excellent debugging, optimization, and operational skills.
  • Clear communication of technical designs and trade-offs.

#AIFluent
U.S. National Base Pay Range: $118,300 - $219,800. Geographic differentials may apply in some locations to better reflect local market rates.This job is eligible for an annual incentive bonus.
We know your well-being and happiness are key to a long and successful career. We are delighted to offer country specific benefits. Click here to access benefits specific to your location.
We are committed to providing a fair and accessible hiring process. If you have a disability or other need that requires accommodation or adjustment, please let us know by completing our Applicant Request Support Form or please contact 1-.
Criminals may pose as recruiters asking for money or personal information. We never request money or banking details from job applicants. Learn more about spotting and avoiding scams here
Please read our Candidate Privacy Policy.
We are an equal opportunity employer: qualified applicants are considered for and treated during employment without regard to race, color, creed, religion, sex, national origin, citizenship status, disability status, protected veteran status, age, marital status, sexual orientation, gender identity, genetic information, or any other characteristic protected by law.
USA Job Seekers:
EEO Know Your Rights.