1

Rag Engineer Jobs in Raleigh, NC (NOW HIRING)

Data Engineer

Cary, NC · On-site

$106K - $127K/yr

... as RAG. This role works closely with AI Engineers, solution architects, and platform teams to ... ensure data infrastructure is production-ready, secure, and aligned with GEI standards. Essential ...

Lead Data Engineer

Raleigh, NC

$99K - $131K/yr

The Data Engineer will serve as a liaison to platform user groups ensuring successful ... Using LLMs, creating RAG, choosing vector vs graph db for embedding, etc. * Big Data technologies ...

Lead Data Engineer

Raleigh, NC

$111K - $133K/yr

The Data Engineer will serve as a liaison to platform user groups ensuring successful ... Using LLMs, creating RAG, choosing vector vs graph db for embedding, etc. * Big Data technologies ...

Senior AI Technologist

Raleigh, NC · On-site

$48.75 - $63/hr

Working closely with business units, engineers, and functional teams, you will leverage applied AI technologies including large language models (LLMs), retrieval-augmented generation (RAG), AI agents ...

Lead Data Engineer

Raleigh, NC

$111K - $133K/yr

The Data Engineer will serve as a liaison to platform user groups ensuring successful ... Using LLMs, creating RAG, choosing vector vs graph db for embedding, etc. * Big Data technologies ...

Senior Systems Engineer

Raleigh, NC · On-site

$101K - $139K/yr

Senior Systems Engineer, Data ManagementOur field sales professionals rely on proactive technical ... RAG: Understanding of vector databases (e.g., Elasticsearch,

Senior Systems Engineer

Raleigh, NC · On-site

$101K - $139K/yr

Senior Systems Engineer, Data ManagementOur field sales professionals rely on proactive technical ... RAG: Understanding of vector databases (e.g., Elasticsearch,

New

Senior Systems Engineer

Raleigh, NC · On-site

$101K - $139K/yr

Senior Systems Engineer, Data ManagementOur field sales professionals rely on proactive technical ... RAG: Understanding of vector databases (e.g., Elasticsearch,

New

Senior Systems Engineer

Durham, NC

$101K - $138K/yr

Senior Systems Engineer, Data ManagementOur field sales professionals rely on proactive technical ... RAG: Understanding of vector databases (e.g., Elasticsearch,

Senior Systems Engineer

Durham, NC · On-site

$101K - $138K/yr

Senior Systems Engineer, Data ManagementOur field sales professionals rely on proactive technical ... RAG: Understanding of vector databases (e.g., Elasticsearch,

New

Senior Systems Engineer

Durham, NC · On-site

$101K - $138K/yr

Senior Systems Engineer, Data ManagementOur field sales professionals rely on proactive technical ... RAG: Understanding of vector databases (e.g., Elasticsearch,

New

Implement AI integration patterns such as retrievalaugmented generation (RAG), tool/function ... Use Azure DevOps and GitHub for source control, pull requests, code reviews, branching strategies ...

About the role As an Applied AI Engineer, you will drive the design, build, and deployment of next ... Develop and optimize Retrieval-Augmented Generation (RAG) systems, including embeddings, vector ...

Showing results 21-40

Rag Engineer information

See Raleigh, NC salary details

$57.8K

$88K

$149.2K

How much do rag engineer jobs pay per year?

As of Aug 12, 2026, the average yearly pay for rag engineer in Raleigh, NC is $87,979.00, according to ZipRecruiter salary data. Most workers in this role earn between $66,600.00 and $102,100.00 per year, depending on experience, location, and employer.

What is the difference between Rag Engineer vs Textile Technician?

AspectRag EngineerTextile Technician
Required CredentialsEngineering degree, technical certificationsDiploma or degree in textiles or related field
Work EnvironmentFactories, manufacturing plants, R&D labsTextile mills, production facilities, quality control labs
Industry UsageDesigning and improving rag production processesMonitoring textile quality, testing fabrics

While both roles involve working within the textile industry, a Rag Engineer primarily focuses on the engineering aspects of rag production, process optimization, and machinery, whereas a Textile Technician concentrates on fabric testing, quality control, and ensuring textile standards are met. The roles often overlap in industry settings but differ in technical focus and responsibilities.

What are popular job titles related to Rag Engineer jobs in Raleigh, NC? For Rag Engineer jobs in Raleigh, NC, the most frequently searched job titles are:
What job categories do people searching Rag Engineer jobs in Raleigh, NC look for? The top searched job categories for Rag Engineer jobs in Raleigh, NC are:
What cities near Raleigh, NC are hiring for Rag Engineer jobs? Cities near Raleigh, NC with the most Rag Engineer job openings:
Infographic showing various Rag Engineer job openings in Raleigh, NC as of August 2026, with employment types broken down into 87% Full Time, 7% Part Time, and 6% Contract. Highlights an 85% Physical, 5% Hybrid, and 10% Remote job distribution, with an average salary of $87,979 per year, or $42.3 per hour.

AI Engineer (LLMs for Healthcare)

Keebler Health

Durham, NC • On-site

Full-time

Re-posted 16 days ago


Job description

Job Summary:
Keebler Health is building the operating system for value-based care, aiming to empower healthcare organizations with data-driven insights. The AI Engineer will develop and optimize large language models for healthcare applications, collaborating with professionals to enhance workflows and ensure compliance with healthcare standards.
Responsibilities:
• Fine-tune and optimize large language models (LLMs) to address specific healthcare applications.
• Develop and apply advanced prompt engineering techniques to enhance model outputs for clinical scenarios.
• Implement Retrieval-Augmented Generation (RAG) systems to improve knowledge retrieval from large datasets.
• Work with knowledge graphs to organize and integrate healthcare-specific data for enhanced decision-making.
• Evaluate black-box models using precision, recall, and other performance metrics, ensuring robustness and reliability.
• Collaborate with healthcare professionals to understand workflows and identify opportunities for AI-driven enhancements.
• Design and build AI models that align with healthcare standards and regulations (e.g., HIPAA compliance).
• Integrate domain-specific knowledge of healthcare data, including FHIR and interoperability standards, into AI solutions.
• Develop and maintain scalable, production-ready AI pipelines using MLOps tools.
• Deploy and monitor AI models in production environments to ensure performance and compliance.
• Optimize infrastructure for efficient training, testing, and deployment of models.
• Stay at the forefront of advancements in AI, especially in healthcare applications.
• Identify and resolve performance bottlenecks in AI workflows.
• Explore emerging trends and technologies in LLMs and healthcare to continually improve solutions.
• Partner with cross-functional teams, including data engineers and clinicians, to ensure seamless integration of AI into healthcare workflows.
• Communicate technical results and insights effectively to non-technical stakeholders.
Qualifications:
Required:
• Proven experience in LLM fine-tuning and advanced prompt engineering.
• Strong background in Python and modern ML frameworks (e.g., Huggingface, pyTorch).
• Familiarity with healthcare workflows and regulatory requirements (e.g., HIPAA, FHIR standards).
• Hands-on experience with retrieval-augmented generation (RAG) techniques.
• Expertise in evaluating AI models using performance metrics like precision, and recall.
Preferred:
• Experience with MLOps frameworks such as MLflow, Langfuse, or similar tools.
• Understanding of healthcare data standards, including HL7 and HEDIS metrics.
• Strong problem-solving skills in integrating AI with complex healthcare datasets.
• Familiarity with cloud platforms (e.g., AWS, GCP, or Azure) and containerization (Docker, Kubernetes).
Company:
Keebler Health develops an AI-powered healthcare analytics platform focused on risk adjustment and clinical decision support. Founded in 2023, the company is headquartered in Durham, USA, with a team of 11-50 employees. The company is currently Early Stage.