ZipRecruiter

Log In

1

Rag Engineer Jobs in Raleigh, NC (NOW HIRING)

Compunnel

Senior Machine Learning Engineer

Raleigh, NC · On-site

$101K - $139K/yr

... RAG) applications for production environments. • Engineer agentic AI workflows and multi-step reasoning systems to automate complex legal processes. • Implement and improve retrieval systems ...

TEKsystems

Sr AI/ML Engineer

Durham, NC · Hybrid

$180K - $220K/yr

Skills Foundry, Azure OpenAI, LLM, RAG, Model Context Protocol (MCP), MLOps, Azure AI Services ... ML/AI engineering, with production generative-AI delivery (RAG, copilots, search, or ...

TEKsystems

Sr AI/ML Engineer

Durham, NC · Hybrid

$180K - $220K/yr

Skills Foundry, Azure OpenAI, LLM, RAG, Model Context Protocol (MCP), MLOps, Azure AI Services ... ML/AI engineering, with production generative-AI delivery (RAG, copilots, search, or ...

Compunnel

Machine Learning Engineer Lead

Raleigh, NC · On-site

$99K - $131K/yr

This senior technical leadership role will focus on large-scale distributed ML systems, LLM and RAG architectures, Agentic AI frameworks, tool orchestration, and enterprise platform engineering. The ...

ACA Group

AI Operations Engineer

Durham, NC · On-site

$67K - $90K/yr

Help improve retrieval quality for vector search and RAG pipelines * Assist with evaluation frameworks and benchmark creation for LLM systems * Work with engineering teams to validate MCP connectors ...

ACA Group

AI Operations Engineer

Durham, NC · Hybrid

$67K - $90K/yr

Help improve retrieval quality for vector search and RAG pipelines * Assist with evaluation frameworks and benchmark creation for LLM systems * Work with engineering teams to validate MCP connectors ...

Berriehill Research

Senior AI Technologist

Raleigh, NC · On-site +1

$48.75 - $63/hr

Working closely with business units, engineers, and functional teams, you will leverage applied AI technologies including large language models (LLMs), retrieval-augmented generation (RAG), AI agents ...

GEI Consultants

Data Engineer

Cary, NC · On-site

$90K - $150K/yr

... as RAG. This role works closely with AI Engineers, solution architects, and platform teams to ... ensure data infrastructure is production-ready, secure, and aligned with GEI standards. Essential ...

Deloitte

AI Engineer Consultant

Raleigh, NC · Hybrid

We are hiring an AI Engineer to build and operate the data, features, and GenAI foundations that ... Implement LLM application patterns including RAG, document ingestion/chunking, embeddings, vector ...

RIT Solutions, Inc.

Sr Machine Learning Engineer

Raleigh, NC · On-site

$101K - $139K/yr

Required : • 10+ yrs production ML at scale • LLM/GenAI/RAG deployment • Cloud (AWS/Azure/GCP) • Kubernetes/containerization • Agentic systems & tool orchestration • MCP servers • ...

GEI Consultants

Data Engineer

Cary, NC · On-site

$106K - $127K/yr

... as RAG. This role works closely with AI Engineers, solution architects, and platform teams to ... ensure data infrastructure is production-ready, secure, and aligned with GEI standards. Essential ...

next page

Showing results 1-20

All JobsRag Engineer JobsRag Engineer Jobs in Raleigh, NC

Rag Engineer information

See Raleigh, NC salary details

$57.8K

$88K

$149.2K

How much do rag engineer jobs pay per year?

As of Aug 24, 2026, the average yearly pay for rag engineer in Raleigh, NC is $87,979.00, according to ZipRecruiter salary data. Most workers in this role earn between $66,600.00 and $102,100.00 per year, depending on experience, location, and employer.

What is the difference between Rag Engineer vs Textile Technician?

AspectRag EngineerTextile Technician
Required CredentialsEngineering degree, technical certificationsDiploma or degree in textiles or related field
Work EnvironmentFactories, manufacturing plants, R&D labsTextile mills, production facilities, quality control labs
Industry UsageDesigning and improving rag production processesMonitoring textile quality, testing fabrics

While both roles involve working within the textile industry, a Rag Engineer primarily focuses on the engineering aspects of rag production, process optimization, and machinery, whereas a Textile Technician concentrates on fabric testing, quality control, and ensuring textile standards are met. The roles often overlap in industry settings but differ in technical focus and responsibilities.

How to become a rag engineer?

To become a rag engineer, you typically need a bachelor's degree in engineering, materials science, or a related field. Relevant skills include knowledge of manufacturing processes, quality control, and proficiency with industry tools and equipment; certifications in quality management or safety can also be beneficial. Gaining experience through internships or entry-level positions in manufacturing environments is important for career advancement.

What are popular job titles related to Rag Engineer jobs in Raleigh, NC?

For Rag Engineer jobs in Raleigh, NC, the most frequently searched job titles are:

What job categories do people searching Rag Engineer jobs in Raleigh, NC look for?

The top searched job categories for Rag Engineer jobs in Raleigh, NC are:

What cities near Raleigh, NC are hiring for Rag Engineer jobs?

Cities near Raleigh, NC with the most Rag Engineer job openings:

Rag Engineer jobs near you
Infographic showing various Rag Engineer job openings in Raleigh, NC as of August 2026, with employment types broken down into 94% Full Time, 2% Part Time, and 4% Contract. Highlights an 84% Physical, 5% Hybrid, and 11% Remote job distribution, with an average salary of $87,979 per year, or $42.3 per hour.

Senior Machine Learning Engineer

Compunnel

Raleigh, NC • On-site

$101K - $139K/yr

Contractor

Posted 7 days ago

Job description

Job Summary:
We are seeking a Senior Machine Learning Engineer to help lead the design and validation of AI-driven product capabilities within the legal domain. This role focuses on defining what to build and why, leveraging Python and large language models (LLMs) to solve complex legal workflows. You will drive experimentation, modeling, and evaluation, partnering closely with data scientists to translate validated approaches into scalable, customer-facing solutions.
Key Responsibilities:
• Design, build, and deploy scalable machine learning and generative AI solutions for legal technology products.
• Develop and optimize NLP, LLM, and Retrieval-Augmented Generation (RAG) applications for production environments.
• Engineer agentic AI workflows and multi-step reasoning systems to automate complex legal processes.
• Implement and improve retrieval systems, including vector databases, semantic search, lexical search, and hybrid search architectures.
• Build and maintain ML pipelines, APIs, model serving infrastructure, and cloud-based AI platforms.
• Establish MLOps best practices for model deployment, monitoring, observability, versioning, and lifecycle management.
• Evaluate and optimize model performance, latency, scalability, and cost efficiency across AI applications.
• Partner with product managers, legal subject matter experts, data scientists, and software engineers to deliver business-focused AI solutions.
• Troubleshoot production ML systems, identify performance bottlenecks, and implement continuous improvements.
• Provide technical leadership and mentorship on machine learning engineering, LLM architecture, and AI platform best practices.
Required Qualifications:
• 7-10+ years of AI/machine learning engineering experience, including building RAG systems end-to-end and deploying solutions through production.
• Strong software and Python engineering background, with progression into machine learning engineering.
• Experience designing agentic workflows and applying generative AI techniques, including prompt engineering and end-to-end RAG system development.
• Strong experience working with unstructured data, including text and documents, document processing, NLP, embeddings, retrieval, and agentic systems.
• Strong experience creating production-grade ML systems at scale.
• Strong LLM, Generative AI, and RAG deployment experience, including implementation and end-to-end evaluation.
• Experience with the complete deployment lifecycle, including product development, production maintenance, and new feature development.
• Experience working alongside data scientists throughout the production deployment and lifecycle.
• Strong Python programming skills.
Compunnel logo

About Compunnel

Sourced by ZipRecruiter

Compunnel is a well-known company located in Plainsboro, NJ, US, recognized in the industry of IT Services and Solutions. Established in 1989, Compunnel offers a suite of services that help businesses integrate technology efficiently into their operations, a recognizable name in the IT solutions sphere for over three decades. The company’s service portfolio includes Digital Transformation, Business Intelligence, Cloud Services, Cybersecurity, and Application Modern Services, among others. Guided by its mission "to innovate with industry-leading digital solutions and disruptive tech strategies for unimagining business growth," the company underlines its commitment to offering out-of-the-box solutions to its clients. Remarkable achievements of the company include serving more than 30 Fortune 500 companies and providing job opportunities for over 50,000 individuals.

Industry

It services

Company size

501 - 1,000 Employees

Headquarters location

Plainsboro, NJ, US

Year founded

1994

Social media

FacebookTwitter

View All Compunnel Jobs

Apply