ZipRecruiter

Log In

1

Retrieval Augmented Generation Jobs in Raleigh, NC

Berriehill Research

Senior AI Technologist

Raleigh, NC · On-site +1

$48.75 - $63/hr

Working closely with business units, engineers, and functional teams, you will leverage applied AI technologies including large language models (LLMs), retrieval-augmented generation (RAG), AI agents ...

ARA

Senior AI Technologist

Raleigh, NC · On-site

$48.75 - $63/hr

Working closely with business units, engineers, and functional teams, you will leverage applied AI technologies including large language models (LLMs), retrieval-augmented generation (RAG), AI agents ...

Northern Base

AI Solution Lead

Cary, NC · On-site

... Retrieval-Augmented Generation (RAG), embeddings, vector databases, prompt engineering, and context engineering ✔ Experience packaging, deploying, serving, and monitoring AI/ML models for real-time ...

next page

Showing results 1-20

All JobsRetrieval Augmented Generation JobsRetrieval Augmented Generation Jobs in Raleigh, NC

Retrieval Augmented Generation information

What does a retrieval augmented generation engineer do?

A Retrieval Augmented Generation engineer typically spends their day designing and implementing systems that combine information retrieval with advanced generative models, such as large language models. This includes fine-tuning models, integrating external data sources, developing vector search pipelines, and evaluating output quality. Collaboration with data scientists, machine learning engineers, and product teams is common to ensure the solutions meet user requirements and scale effectively. Additionally, RAG engineers often troubleshoot issues, monitor model performance in production, and stay informed about the latest advancements in AI and information retrieval.

What is a retrieval augmented generation?

A Retrieval Augmented Generation (RAG) job typically involves developing and optimizing AI systems that enhance text generation by incorporating external knowledge retrieved from relevant sources. Professionals in this field work on integrating retrieval mechanisms with large language models to improve the relevance, accuracy, and factual grounding of generated content. Common responsibilities include designing retrieval systems, fine-tuning language models, optimizing performance, and ensuring the seamless integration of factual data into AI-generated text. This role is highly interdisciplinary, involving expertise in natural language processing (NLP), machine learning, and information retrieval.

What skills and qualifications are needed for retrieval augmented generation?

To thrive in a Retrieval Augmented Generation (RAG) engineering role, you need a solid background in machine learning, natural language processing (NLP), and experience with scalable information retrieval systems, typically supported by a relevant degree in computer science or a related field. Familiarity with tools such as Python, PyTorch or TensorFlow, vector databases, and search platforms like Elasticsearch is essential, along with practical experience deploying and tuning RAG pipelines. Strong problem-solving skills, a collaborative mindset, and effective communication abilities set outstanding professionals apart in this field. These competencies are crucial for designing, implementing, and optimizing hybrid retrieval-generation AI systems that address complex, real-world information needs.

What are the most commonly searched types of Retrieval Augmented Generation jobs in Raleigh, NC? The most popular types of Retrieval Augmented Generation jobs in Raleigh, NC are:
What are popular job titles related to Retrieval Augmented Generation jobs in Raleigh, NC? For Retrieval Augmented Generation jobs in Raleigh, NC, the most frequently searched job titles are:
What job categories do people searching Retrieval Augmented Generation jobs in Raleigh, NC look for? The top searched job categories for Retrieval Augmented Generation jobs in Raleigh, NC are:
What cities near Raleigh, NC are hiring for Retrieval Augmented Generation jobs? Cities near Raleigh, NC with the most Retrieval Augmented Generation job openings:
Retrieval Augmented Generation jobs near you
Infographic showing various Retrieval Augmented Generation job openings in Raleigh, NC as of August 2026, with employment types broken down into 66% Full Time, 29% Part Time, and 5% Contract. Highlights an 62% Physical, 3% Hybrid, and 35% Remote job distribution.

Senior AI Technologist

Berriehill Research

Raleigh, NC • On-site, Remote

$48.75 - $63/hr

Full-time

Re-posted 5 days ago

Job description

We are seeking an experienced AI Technologist to drive the discovery, design, and adoption of enterprise AI capabilities across the organization. This is a greenfield opportunity to help build our enterprise AI program from the ground up by identifying high-value use cases, assessing AI readiness, and guiding the implementation of secure, scalable AI solutions.

Working closely with business units, engineers, and functional teams, you will leverage applied AI technologies including large language models (LLMs), retrieval-augmented generation (RAG), AI agents, and automation frameworks to solve real business challenges and improve operational efficiency. This role focuses on applying existing AI technologies to deliver business value rather than developing or training AI models.

You will partner with technical teams to deploy AI solutions in highly regulated on-premises and cloud environments while ensuring alignment with security, governance, and enterprise architecture standards.

Essential Functions:

  • Identify, evaluate, and prioritize opportunities to integrate AI into existing and new organizational processes and tooling.
  • Design and establish data structures, metadata models, naming conventions, and information architecture standards that enable scalable AI solutions.
  • Design AI solution approaches using existing technologies such as large language models (LLMs), retrieval-augmented generation (RAG), AI agents, and orchestration frameworks to address business and operational challenges.
  • Support onboarding new AI projects by identifying data requirements, assessing data readiness, and defining ingestion and preparation workflows.
  • Develop processes to measure and improve ongoing data quality, consistency, completeness, and accuracy across AI datasets and workflows.
  • Define and support data preparation, ingestion, and retrieval workflows that enable production AI applications, retrieval-augmented generation (RAG), and AI agent solutions.
  • Collaborate with technical and business stakeholders across divisions to understand data sources, use cases, and operational constraints.
  • Create and maintain documentation for data standards, transformation logic, onboarding procedures, and quality controls.
  • Partner with AI, software, platform, and security teams to ensure data workflows are scalable, secure, and aligned with organizational objectives.

Experience and Skills Required:

  • Bachelor’s degree in computer science, Data Engineering, Information Systems, Engineering, Mathematics, or a related STEM field 8-10 years of engineering experience
  • 3+ years of experience supporting AI, natural language processing, RAG, and related solutions.
  • Experience preparing and transforming data for analytics, machine learning, search, or AI-enabled applications.
  • Experience designing vector databases and retrieval pipelines.
  • Experience developing MCP Servers and Clients.
  • Understanding of data quality management practices, including validation, normalization, deduplication, and error handling.
  • Experience working with AI platforms, Kubernetes, and cloud AI environments (Azure Foundry, AWS Bedrock).
  • Strong experience developing AI solutions in Python, Golang, or Typescript.
  • Strong analytical, troubleshooting, and documentation skills.
  • Excellent communication skills and the ability to work effectively with cross-functional teams.

Preferred:

  • Experience with data platforms and tooling such as Pandas, Spark, Airflow, dbt, or similar ecosystems.
  • Familiarity with vector databases, embeddings pipelines, chunking strategies, and retrieval-augmented generation workflows.
  • Experience designing data schemas, taxonomies, ontologies, or metadata standards for enterprise information.
  • Experience working in regulated environments with standards such as NIST or CMMC.
  • Experience supporting scientific, engineering, defense, or national security-related data initiatives.
  • Experience working with DevOps systems, git, CI/CD, GitOps.
  • DoD experience.
  • Active Secret clearance preferred, or ability to obtain and maintain a Secret clearance.

Education:

  • Bachelor’s degree in CS, Software Engineering or other IT-related field or equivalent experience

REMOTE WORK NOTICE: This position may be performed fully remote, hybrid, or onsite at an ARA office. Preference will be given to candidates located onsite in the Albuquerque, NM and Raleigh, NC area.

Apply