ZipRecruiter

Log In

1

Ai Rag Jobs in Durham, NC (NOW HIRING)

ACA Group

AI Operations Engineer

Durham, NC · On-site

$67K - $90K/yr

About the Role We are seeking an AI Operations Engineer to help support and optimize our next ... Help improve retrieval quality for vector search and RAG pipelines * Assist with evaluation ...

ACA Group

AI Operations Engineer

Durham, NC · Hybrid

$67K - $90K/yr

About the Role We are seeking an AI Operations Engineer to help support and optimize our next ... Help improve retrieval quality for vector search and RAG pipelines * Assist with evaluation ...

Envestnet

Lead Data Engineer

Raleigh, NC · On-site +1

$111K - $133K/yr

Gen AI: RAG, Embedding, Agents, LLMs, Parameter Tuning * Cloud Computing: AWS * Tools/Products: Data Science Studio, Alteryx, Jupyter, Tableau, PowerBI * Performance optimization for queries and ...

Envestnet

Lead Data Engineer

Raleigh, NC · On-site +1

$111K - $133K/yr

Gen AI: RAG, Embedding, Agents, LLMs, Parameter Tuning * Cloud Computing: AWS * Tools/Products: Data Science Studio, Alteryx, Jupyter, Tableau, PowerBI * Performance optimization for queries and ...

Northern Base

AI Solution Lead

Cary, NC · On-site

... RAG), embeddings, vector databases, prompt engineering, and context engineering ✔ Experience packaging, deploying, serving, and monitoring AI/ML models for real-time and batch inference ✔ Hands ...

Material Bank

Applied AI Engineer

Raleigh, NC · On-site

Develop and optimize Retrieval-Augmented Generation (RAG) systems, including embeddings, vector search, retrieval pipelines, chunking strategies, and relevance tuning. * Build multimodal AI workflows ...

previous pagenext page

Showing results 21-40

All JobsAi Rag JobsAi Rag Jobs in Durham, NC

Ai Rag information

See Durham, NC salary details

$30.9K

$56.3K

$80.7K

How much do ai rag jobs pay per year?

As of Aug 7, 2026, the average yearly pay for ai rag in Durham, NC is $56,283.00, according to ZipRecruiter salary data. Most workers in this role earn between $47,300.00 and $62,800.00 per year, depending on experience, location, and employer.

What are the key skills and qualifications needed to thrive as an AI researcher?

To thrive as an AI Researcher, you need a strong background in computer science, mathematics, and machine learning, usually with an advanced degree such as a Master's or Ph.D. Proficiency with programming languages like Python, deep learning frameworks (e.g., TensorFlow, PyTorch), and familiarity with scientific research tools is essential. Critical thinking, creativity, and effective collaboration are vital soft skills for generating novel ideas and working in multidisciplinary teams. These skills and qualities are crucial to drive innovation and solve complex problems in the rapidly evolving field of artificial intelligence.

What is the difference between Ai Rag vs Data Analyst?

AspectAi RagData Analyst
Required CredentialsTypically a diploma or certification in AI, machine learning, or related fieldsBachelor's degree in statistics, mathematics, or related fields
Work EnvironmentTech companies, AI startups, research labsBusiness, finance, healthcare, and various industries
Employer & Industry UsagePrimarily in AI development and researchAcross industries for data interpretation and decision-making
Common Search & ComparisonYesYes

Ai Rag and Data Analyst roles share overlapping skills in data handling and analysis, but Ai Rag focuses more on AI-specific applications and machine learning, while Data Analysts concentrate on interpreting data to inform business decisions. Both roles are vital in data-driven industries, with Ai Rag often working in AI development environments and Data Analysts supporting strategic insights across sectors.

What is an AI RAG?

AI RAGs, or Retrieval-Augmented Generation systems, are a type of artificial intelligence that combines the power of retrieving information from large databases or documents with generating human-like text responses. This approach allows AI models to provide more accurate, up-to-date, and contextually relevant answers by referencing external data sources during the generation process. RAGs are commonly used in applications like chatbots, search engines, and customer support systems, where comprehensive and factual responses are important.

What are common challenges faced by AI RAG engineers when integrating retrieval systems with large language models?

AI RAG engineers often encounter challenges such as ensuring seamless integration between retrieval systems and language models, maintaining low latency for real-time responses, and handling the quality and relevance of retrieved data. Additionally, tuning the system to balance retrieval accuracy with generative fluency can be complex, especially when dealing with large or unstructured datasets. Collaboration with data engineers, ML researchers, and product teams is essential to address these challenges and optimize system performance.
What are popular job titles related to Ai Rag jobs in Durham, NC? For Ai Rag jobs in Durham, NC, the most frequently searched job titles are:
What job categories do people searching Ai Rag jobs in Durham, NC look for? The top searched job categories for Ai Rag jobs in Durham, NC are:
What cities near Durham, NC are hiring for Ai Rag jobs? Cities near Durham, NC with the most Ai Rag job openings:
Ai Rag jobs near you

AI Operations Engineer

ACA Group

Durham, NC • On-site

$67K - $90K/yr

Full-time

Medical, Dental, Retirement, PTO

Re-posted 5 days ago

Job description

About the Role
We are seeking an AI Operations Engineer to help support and optimize our next-generation AI platform focused on compliance, surveillance, and intelligent workflow automation.This role will work closely with AI engineers, product managers, and domain experts to evaluate AI outputs, manage training and evaluation datasets, improve prompts and agent behaviors, and help operationalize LLM-powered systems across the platform.
** Work Location: Durham, NC/Hybrid-2 days in office**
The ideal candidate is detail-oriented, analytical, and excited about working hands-on with modern AI technologies including agents, MCP servers, vector search, RAG pipelines, document/media processing, and large language models.
Responsibilities
  • Test and evaluate AI agents, prompts, and workflows across multiple use cases
  • Create, maintain, and curate labeled datasets for AI evaluation and tuning
  • Review AI-generated outputs for quality, accuracy, safety, and consistency
  • Update and optimize prompts, agent instructions, and AI "skills"
  • Help improve retrieval quality for vector search and RAG pipelines
  • Assist with evaluation frameworks and benchmark creation for LLM systems
  • Work with engineering teams to validate MCP connectors and integrations
  • Analyze model failures, hallucinations, and edge cases to improve system performance
  • Participate in human-in-the-loop review workflows for AI-generated content
  • Document testing procedures, findings, and recommended improvements
  • Collaborate with compliance and domain experts to refine AI behaviors and detection logic

What working at ACA offers:
We offer a competitive compensation package where you'll be rewarded based on your performance and recognized for the value you bring to our business. Our Total Rewards package includes medical and dental coverage and 401(k) plans, and a wide range of paid time off options as well as a flexible work environment. You'll also be granted time off for designated ACA Paid Holidays, Summer Fridays, Personal/Family Care, and other leaves of absence when needed to support your physical, financial, and emotional well-being. We also offer unique benefits such as Student Debt Forgiveness and Pet Insurance.
About ACA:
ACA Group is the leading governance, risk, and compliance (GRC) advisor in financial services. We empower our clients to reimagine GRC and protect and grow their business. Our innovative approach integrates consulting, managed services, and our ComplianceAlpha® technology platform with the specialized expertise of former regulators and practitioners and our deep understanding of the global regulatory landscape.
What we commit to:
ACA is firmly committed to a policy of nondiscrimination, which applies to recruiting, hiring, placement, promotions, training, discipline, terminations, layoffs, transfers, leaves of absence, compensation and all other terms and conditions of employment. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, age, disability or protected veteran status, or any other legally protected basis, in accordance with applicable law.
VISA SPONSORSHIP IS NOT AVAILABLE FOR THIS ROLE
C2C IS NOT AVAILABLE - W-2 ONLY

Apply