ZipRecruiter

Log In

1

Llm Ml Rag Jobs in Raleigh, NC (NOW HIRING)

TEKsystems

Principal Data Scientist

Cary, NC

$50 - $85/hr

... RAG, Kubernetes, and vector databases. Experience designing production‑grade ML systems with ... LLM (LangChain) in a business Experience working with AWS, RAG, SageMaker, SQL Skills data science ...

TEKsystems

Sr. Manager Of Data Science

Raleigh, NC

$85 - $96/hr

... generation (RAG) pipelines Hybrid ML + rules-based systems for structured content Lead through ... Mentor and grow a multidisciplinary team of LLM-focused Data Scientists and ML Engineers. Drive ...

TEKsystems

Sr. Manager Of Data Science

Raleigh, NC

... generation (RAG) pipelines Hybrid ML + rules-based systems for structured content Lead through ... Mentor and grow a multidisciplinary team of LLM-focused Data Scientists and ML Engineers. Drive ...

First Citizens Bank

Principal AI Architect

Raleigh, NC · On-site

$160K - $240K/yr

Define and own enterprise AI and GenAI reference architectures, including LLM platforms, RAG ... Architect end-to-end MLOps capabilities, including model lifecycle management, CI/CD for ML ...

First Citizens Bank

Principal AI Architect

Raleigh, NC

$160K - $240K/yr

Define and own enterprise AI and GenAI reference architectures, including LLM platforms, RAG ... Architect end-to-end MLOps capabilities, including model lifecycle management, CI/CD for ML ...

First Citizens Bank

Principal AI Architect

Raleigh, NC · On-site

$160K - $240K/yr

Define and own enterprise AI and GenAI reference architectures, including LLM platforms, RAG ... Architect end-to-end MLOps capabilities, including model lifecycle management, CI/CD for ML ...

Infosys

Gen AI Solution Engineer

Raleigh, NC · On-site

... ML, deep learning, or LLM areas. • Support participation in forums and internal knowledge ... Required : • Enterprise GenAI and Agentic AI solutions across RAG, AI agents, conversational AI ...

next page

Showing results 1-20

All JobsLlm Ml Rag JobsLlm Ml Rag Jobs in Raleigh, NC

Llm Ml Rag information

See Raleigh, NC salary details

$43.7K

$73.2K

$106.9K

How much do llm ml rag jobs pay per year?

As of Jun 27, 2026, the average yearly pay for llm ml rag in Raleigh, NC is $73,197.00, according to ZipRecruiter salary data. Most workers in this role earn between $60,300.00 and $84,600.00 per year, depending on experience, location, and employer.

What are some typical challenges faced when working on Retrieval-Augmented Generation (RAG) systems in large language model (LLM) machine learning roles?

Professionals working on LLM ML RAG systems often encounter challenges such as ensuring the accuracy and relevancy of retrieved documents, managing latency for real-time queries, and seamlessly integrating retrieval mechanisms with generation models. Additionally, keeping up with evolving datasets and maintaining high-quality knowledge bases can be demanding. Collaboration with data engineers and domain experts is common to refine retrieval pipelines and optimize the end-to-end system.

What is the difference between Llm Ml Rag vs Data Scientist?

AspectLlm Ml RagData Scientist
Required CredentialsMaster's or PhD in ML, AI, or related fields; certifications in ML frameworksDegree in Computer Science, Statistics, or related; certifications in data analysis or ML
Work EnvironmentResearch labs, AI development teams, tech companiesBusiness analytics, research, product development teams
Employer & Industry UsageTech firms, AI startups, research institutionsFinance, healthcare, tech, consulting firms
Common Search & ComparisonOften compared for ML specialization and research focusCompared for data analysis, modeling, and business insights

While both roles involve working with machine learning, Llm Ml Rag typically focuses on research and development of large language models, requiring advanced ML expertise. Data Scientists often work on analyzing data, building predictive models, and deriving insights for business decisions. The roles overlap in skills but differ in focus and application areas.

What are the key skills and qualifications needed to thrive as an LLM ML RAG (Retrieval-Augmented Generation) Engineer, and why are they important?

To excel as an LLM ML RAG Engineer, you need a strong background in machine learning, natural language processing, and large language models, typically supported by a degree in computer science or a related field. Proficiency with tools and frameworks like Python, PyTorch/TensorFlow, Hugging Face Transformers, and vector databases (e.g., FAISS, Pinecone) is essential, along with experience in deploying and fine-tuning LLMs and integrating retrieval systems. Strong problem-solving skills, attention to detail, and the ability to collaborate with cross-functional teams distinguish top performers in this role. These skills ensure the effective development and deployment of advanced AI solutions that combine generative and retrieval capabilities for high-impact applications.

What are LLM ML RAG jobs?

LLM ML RAG jobs involve working with Large Language Models (LLMs), Machine Learning (ML), and Retrieval-Augmented Generation (RAG) systems. Professionals in these roles typically design, develop, and optimize AI systems that combine language models with retrieval techniques to improve accuracy, relevance, and factual grounding in generated outputs. These jobs often require expertise in natural language processing, deep learning, data engineering, and information retrieval. Key responsibilities might include integrating RAG pipelines, fine-tuning LLMs, and ensuring high-quality responses from AI applications.
What are popular job titles related to Llm Ml Rag jobs in Raleigh, NC? For Llm Ml Rag jobs in Raleigh, NC, the most frequently searched job titles are:
What job categories do people searching Llm Ml Rag jobs in Raleigh, NC look for? The top searched job categories for Llm Ml Rag jobs in Raleigh, NC are:
What cities near Raleigh, NC are hiring for Llm Ml Rag jobs? Cities near Raleigh, NC with the most Llm Ml Rag job openings:
Llm Ml Rag jobs near you
Principal Data Scientist

Principal Data Scientist

TEKsystems

Cary, NC

$50 - $85/hr

Contractor

Medical, Dental, Vision, Life, Retirement, PTO

Posted 12 days ago

Job description

- Education: Master's or PhD Preferred

- 6–12+ years in Data Science / ML Engineering, with deep experience in LLM‑based systems.

Proven experience building multi-agent architectures (planner‑executor, tool‑use agents, ReAct‑style reasoning).

Strong background in RAG, embeddings, retrieval optimization, and evaluation.

Expertise in NLP, transformers, deep learning, and model fine‑tuning.

Proficiency with PyTorch, HuggingFace, LangChain/LlamaIndex, RAG, Kubernetes, and vector databases.

Experience designing production‑grade ML systems with monitoring, evaluation, and observability.

Description

This role leads the design and development of an advanced multi‑agent AI platform that powers intelligent research, drafting, and reasoning capabilities for large‑scale enterprise knowledge environments. You will architect agent frameworks, optimize retrieval‑augmented generation pipelines, fine‑tune language models, and build the infrastructure that enables AI systems to collaborate, plan, and execute complex tasks reliably. The work directly shapes the next generation of AI‑driven professional tools used by experts in high‑stakes domains.

Core Responsibilities

Architect and implement multi‑agent systems capable of planning, tool use, and coordinated task execution.

Design and optimize RAG pipelines including embeddings, hybrid retrieval, reranking, and context‑window strategies.

Fine‑tune and evaluate small, medium, and large language models for domain‑specific reasoning and summarization.

Develop prompt engineering frameworks, guardrails, and automated evaluation suites for agent reliability.

Build scalable ML services and APIs for production deployment in distributed environments.

Collaborate with product, engineering, and domain experts to translate complex workflows into agentic AI solutions.

Establish best practices for model evaluation, observability, safety, and compliance.

Mentor DS/ML engineers and contribute to long‑term AI strategy and architecture.

Required Expertise

6–12+ years in Data Science / ML Engineering, with deep experience in LLM‑based systems.

Proven experience building agentic architectures (planner‑executor, tool‑use agents, ReAct‑style reasoning).

Strong background in RAG, embeddings, retrieval optimization, and evaluation.

Expertise in NLP, transformers, deep learning, and model fine‑tuning.

Proficiency with PyTorch, HuggingFace, LangChain/LlamaIndex, Ray, Kubernetes, and vector databases.

Experience designing production‑grade ML systems with monitoring, evaluation, and observability.

Strong communication skills and ability to lead technical direction.

Preferred Qualifications

Experience in enterprise search, knowledge management, or high‑compliance domains.

Experience with model distillation, LoRA/QLoRA, PEFT, and model compression.

Experience building evaluation frameworks for hallucination, grounding, and agent reliability.

Familiarity with knowledge graphs, symbolic reasoning, or hybrid neuro‑symbolic systems.

Publications, patents, or open‑source contributions in LLMs or agent systems.

Strong coding skills in Python 7+ years

Be a natural problem solver, able to take a lead in collaborating to resolve issues

Proficiency in IDE debugging : VSCODE and PYCHARM

Have communication skills

5+ years of experience in AI and machine learning

Deep understanding of machine learning algorithms, classification models, diagnostic testing of models

Experience working directly and Transformer based architectures including BERT, RoBERTa, T5 etc. Nd familiarity with large language models and fine tuning

Experience with conversational search / semantic search, reinforcement learning, prompt engineering, hallucination mitigation

Working understanding of the business risks associated with applying LLM (LangChain) in a business

Experience working with AWS, RAG, SageMaker, SQL

Skills

data science, nlp, indexing, semantic search, conversational search, langchain, Generative AI, Large language model, Sql, aws, algorithm, artificial intelligence, Retrieval augmented generation, fine-tuning, Python, Machine learning, cloud computing

Top Skills Details

data science,nlp,indexing,semantic search,conversational search,langchain,Generative AI,Large language model,Sql,aws,algorithm,artificial intelligence,Retrieval augmented generation,fine-tuning

Additional Skills & Qualifications

N/A

Experience Level

Expert Level

Job Type & Location

This is a Contract to Hire position based out of Cary, NC.

Pay and Benefits

The pay range for this position is $50.00 - $85.00/hr.

Eligibility requirements apply to some benefits and may depend on your job classification and length of employment. Benefits are subject to change and may be subject to specific elections, plan, or program terms. If eligible, the benefits available for this temporary role may include the following:
• Medical, dental & vision
• Critical Illness, Accident, and Hospital
• 401(k) Retirement Plan – Pre-tax and Roth post-tax contributions available
• Life Insurance (Voluntary Life & AD&D for the employee and dependents)
• Short and long-term disability
• Health Spending Account (HSA)
• Transportation benefits
• Employee Assistance Program
• Time Off/Leave (PTO, Vacation or Sick Leave)

Workplace Type

This is a fully remote position.

Application Deadline

This position is anticipated to close on Jun 29, 2026.

About TEKsystems

We're partners in transformation. We help clients activate ideas and solutions to take advantage of a new world of opportunity. We are a team of 80,000 strong, working with over 6,000 clients, including 80% of the Fortune 500, across North America, Europe and Asia. As an industry leader in Full-Stack Technology Services, Talent Services, and real-world application, we work with progressive leaders to drive change. That's the power of true partnership. TEKsystems is an Allegis Group company.

The company is an equal opportunity employer and will consider all applications without regards to race, sex, age, color, religion, national origin, veteran status, disability, sexual orientation, gender identity, genetic information or any characteristic protected by law.

About TEKsystems and TEKsystems Global Services

We’re a leading provider of business and technology services. We accelerate business transformation for our customers. Our expertise in strategy, design, execution and operations unlocks business value through a range of solutions. We’re a team of 80,000 strong, working with over 6,000 customers, including 80% of the Fortune 500 across North America, Europe and Asia, who partner with us for our scale, full-stack capabilities and speed. We’re strategic thinkers, hands-on collaborators, helping customers capitalize on change and master the momentum of technology. We’re building tomorrow by delivering business outcomes and making positive impacts in our global communities. TEKsystems and TEKsystems Global Services are Allegis Group companies. Learn more at TEKsystems.com.

The company is an equal opportunity employer and will consider all applications without regard to race, sex, age, color, religion, national origin, veteran status, disability, sexual orientation, gender identity, genetic information or any characteristic protected by law.

San Francisco Fair Chance Ordinance: Pursuant to the San Francisco Fair Chance Ordinance, for all positions located in the city and county of San Francisco, we will consider for employment qualified applicants with arrest and conviction records.

Massachusetts Lie Detector: It is unlawful in Massachusetts to require or administer a lie detector test as a condition of employment or continued employment. An employer who violates this law shall be subject to criminal penalties and civil liability.

Use of Artificial Intelligence (AI): We may use Artificial Intelligence (AI) to support parts of our hiring process, including sourcing, screening, and evaluating candidates. AI helps assess applications and qualifications, but final decisions are made by our hiring team. By applying, you acknowledge and agree that your application may be reviewed using AI tools.

Apply