1

Rag Llm Jobs (NOW HIRING)

LoRA, LangChain, RAG, LLM Fine Tuning). * Hands-on experience with data visualization tools (e.g. Qlik, Power BI, Tableau, Databricks). * Strong quantitative and analytic abilities. Desired Skills:

$140K - $145K/yr

... RAG, LLM based apps). 6+ months of hands on experience with Agentic AI frameworks (CrewAI / AutoGen / LangGraph / LangChain Agents). Strong proficiency in Python and ML libraries (Scikit learn ...

... RAG, LLM based apps). * 6+ months of hands on experience with Agentic AI frameworks (CrewAI / AutoGen / LangGraph / LangChain Agents). * Strong proficiency in Python and ML libraries (Scikit learn ...

Hands-on with RAG architectures, evaluation methodologies, and LLM integration • Cloud & DevOps: Experience with cloud platforms (e.g., Azure, AWS) and CI/CD pipelines • Governance & Compliance:

You'll translate product needs into robust machine learning architectures, own model lifecycle and MLOps, implement safe RAG/LLM systems and observability, and partner closely with Product, Support ...

Software Developer

Mclean, VA · On-site

$190K/yr

Has partial or adjacent experience with RAG, LLM integrations, or semantic search. * Solid experience with Elasticsearch or similar search platforms, but may lack deep optimization experience.

Software Developer

Mclean, VA · On-site

$190K/yr

Has partial or adjacent experience with RAG, LLM integrations, or semantic search. * Solid experience with Elasticsearch or similar search platforms, but may lack deep optimization experience.

Gen AI Lead - RAG (Retrieval-Augmented Generation) Specialist We are looking for a highly skilled ... Proficiency in Python, LLM APIs, and document processing pipelines * US Green Card or Citizenship ...

Showing results 21-40

Rag Llm information

See salary details

$45K

$75.3K

$110K

How much do rag llm jobs pay per year?

As of Aug 8, 2026, the average yearly pay for rag llm in the United States is $75,300.00, according to ZipRecruiter salary data. Most workers in this role earn between $62,000.00 and $87,000.00 per year, depending on experience, location, and employer.

What is the difference between Rag Llm vs Data Scientist?

AspectRag LlmData Scientist
Required CredentialsTypically a master's or PhD in AI, machine learning, or related fieldsUsually a master's or PhD in data science, statistics, or computer science
Work EnvironmentResearch labs, AI development teams, tech companiesBusiness analytics, research, tech firms, consulting
Industry UsageAI research, natural language processing, machine learning projectsData analysis, predictive modeling, data-driven decision making

Rag Llm and Data Scientist roles often overlap in AI and data analysis fields, but Rag Llm focuses more on language models and AI research, while Data Scientists handle broader data analysis and modeling tasks. Both require advanced degrees and work in tech-driven environments, but their core responsibilities differ in scope and application.

What is a RAG LLM?

RAG LLMs, or Retrieval-Augmented Generation Large Language Models, are advanced AI systems that combine the strengths of traditional language models with external data retrieval systems. They work by first searching a relevant database or knowledge base for up-to-date information, and then using a language model to generate responses based on both the retrieved content and their own training. This approach helps LLMs provide more accurate, current, and contextually relevant answers, especially for specialized or rapidly changing topics. RAG LLMs are widely used in customer support, research, and enterprise applications to improve information accuracy and reliability.

How do RAG LLM engineers collaborate with data scientists and product teams to improve retrieval-augmented generation systems?

RAG LLM engineers often work closely with data scientists to fine-tune retrieval mechanisms, optimize model performance, and evaluate system outputs. They also collaborate with product teams to understand user needs, integrate feedback, and ensure the system delivers relevant, accurate information. Regular cross-functional meetings and code reviews are common, fostering a collaborative environment focused on continuous improvement and innovation in response to real-world challenges.

What are the key skills and qualifications needed to thrive as a Retrieval-Augmented Generation (RAG) LLM engineer?

To thrive as a Retrieval-Augmented Generation (RAG) LLM Engineer, you need a strong background in natural language processing, machine learning, and software development, often supported by a degree in computer science or a related field. Familiarity with frameworks like PyTorch, Hugging Face Transformers, vector databases, and cloud platforms, along with experience deploying large language models, is essential. Analytical thinking, problem-solving abilities, and effective communication are crucial soft skills for collaboration and innovation in this fast-evolving space. These skills ensure the development of robust, scalable, and accurate retrieval-augmented AI systems that meet real-world information needs.
More about Rag Llm jobs
What cities are hiring for Rag Llm jobs? Cities with the most Rag Llm job openings:
What states have the most Rag Llm jobs? States with the most job openings for Rag Llm jobs include:
Infographic showing various Rag Llm job openings in the United States as of August 2026, with employment types broken down into 95% Full Time, 1% Part Time, and 4% Contract. Highlights an 76% Physical, 5% Hybrid, and 19% Remote job distribution, with an average salary of $75,300 per year, or $36.2 per hour.

Software Engineer - TS/SCI with Polygraph

General Dynamics Information Technology

Chantilly, VA • On-site

$158K - $214K/yr

Full-time

Re-posted 9 days ago


General Dynamics Information Technology rating

7.8

Company rating: 7.8 out of 10

Based on 63 frontline employees who took The Breakroom Quiz

88th of 223 rated it services


Job description

Share
REQ#: RQ217581Public Trust: None Requisition Type: Regular Your Impact

Own your opportunity to serve as a critical component of our nations safety and security. Make an impact by using your expertise to protect our country from threats.

Job Description

Transform technology into opportunity as a Software Engineer (SME) with GDIT. We are seeking a hands-on software engineer with expertise in designing, developing, and sustaining cloudenabled applications in Lean Agile environments to deliver secure, scalable, and maintainable missioncritical customer systems. The role requires expertise in frontend and backend Web development and modern search engineering technologies, including Large Language Models (LLM), RetrievalAugmented Generation (RAG), and AIassisted retrieval system capabilities development.

KEY TASKS:

  • Participate in all Lean Agile scrums, sprint planning, and grooming sessions.
  • Consult and coordinate with stakeholders for problem resolution, task scheduling, resource needs, and task clarification.
  • Work in partnership with an integrated team of staff and contractors.
  • Coordinate and collaborate with security, operations, engineering, testing, and other teams to provide system information and technical support.
  • Understand and work within approved cloud environments (e.g., AWS).
  • Design, develop, and modify software systems.
  • Unit test software and perform code reviews.
  • Design and implement scalable search and retrieval systems leveraging Elasticsearch.
  • Develop and integrate LLMpowered capabilities, including RetrievalAugmented Generation (RAG) pipelines.
  • Document and track vendor software roadmaps for software and patch version updates.

REQUIRED SKILLS AND DEMONSTRATED EXPERIENCE:

  • Demonstrated experience working in Lean Agile Development environment.
  • Demonstrated experience translating customer and system requirements into actionable design specifications.
  • Demonstrated experience designing system interfaces, including defining integration points, data flows, and data exchange workflows.
  • Demonstrated experience building or integrating LLM-based solutions, including RAG pipelines, semantic search, and AI-assisted retrieval systems.
  • Demonstrated experience designing and implementing data pipelines for hybrid search (BM25 + vector search) in RAG workflows, covering ingestion, chunking, embeddings, and vector retrieval.
  • Demonstrated experience with Elasticsearch, included index design and optimization, query development, relevance tuning, and cluster scaling.
  • Demonstrated hands-on experience in frontend Single Page Applications (SPA) development using React (hooks), HTML5, CSS3, and modern JavaScript best practices.
  • Demonstrated hands-on experience in backend development, including designing and building RESTful APIs with Node.js and Express.js (or comparable modern backend frameworks).
  • Demonstrated hands-on experience troubleshooting web protocols and server technologies, including Apache Tomcat, Node.js, Web Services, and SSL/TLS security configurations.
  • Demonstrated experience using modern testing platforms such as Jest or Karma.
  • Demonstrated experience with DevOps tools including Git, Jenkins, and Nexus.

HIGHLY DESIRED SKILLS AND DEMONSTRATED EXPERIENCE:

  • Experience with the customers Lean Agile methodology.
  • Experience evaluating, selecting, or integrating LLMs (e.g., OpenAI, opensource models) into enterprise applications.
  • Experience with vector databases, hybrid search (keyword + semantic), and relevance optimization.
  • Experience with or exposure to RAG, LLM integrations, or semantic search.
  • Experience with Elasticsearch or similar search platforms, with some exposure to optimization or scaling.
  • Experience mentoring teams in search engineering and AI/LLM best practices, with a demonstrated ability to improve overall team capability.
  • Experience with React + Node/Express development, with the ability to quickly ramp into search/AI domains.
  • Experience working on APIs or systems that integrate with external AI/ML services.
  • Demonstrated ability to learn quickly with guidance and become a team multiplier.

WHAT YOULL NEED TO SUCCEED:

  • Education: Bachelors degree in Computer Science, Engineering, or a related technical discipline, or the equivalent combination of education, technical certifications or training, or work experience.
  • Experience: 10+ years
  • Security clearance: TS/SCI with Polygraph
  • Location: Chantilly, VA (On Customer Site)
  • US Citizenship Required

#WeAreGDIT
#JET
#GDITEnhanced2026
#VA_2026Alumni

Work Requirements
Years of Experience

10 + years of related experience

* may vary based on technical training, certification(s), or degree

Certification
Travel Required

Less than 10%

Citizenship

U.S. Citizenship Required

Salary and Benefit Information

The likely salary range for this position is $158,855 - $214,921. This is not, however, a guarantee of compensation or salary. Rather, salary will be set based on experience, geographic location and possibly contractual requirements and could fall outside of this range.
View information about benefits and our total rewards program.

Our Identity Verification Process

As part of the hiring process, we will ask you to complete an identity verification process that leverages advanced biometrics and artificial intelligence to ensure authenticity and protect against identity fraud. You are expected to be on camera during virtual interviews. We reserve the right to take your picture to verify your identity and prevent fraud. By proceeding, you authorize the collection, processing, and use of your biometric data for identity verification and security purposes.

About Our Work

We are GDIT. A global technology and professional services company that delivers technology solutions and mission services to every major agency across the U.S. government, defense and intelligence community. Our 26,000 experts extract the power of technology to create immediate value and deliver solutions at the edge of innovation. We operate across 50+ countries worldwide, offering leading mission-ready capabilities in AI, cloud, cyber and software development.

Join our Talent Community to stay up to date on our career opportunities and events at gdit.com/tc.

Equal Opportunity Employer / Individuals with Disabilities / Protected Veterans


What General Dynamics Information Technology employees say

Pay

Benefits

Hours and flexibility

Workplace

Get the full story on Breakroom


General Dynamics Information Technology logo

About General Dynamics Information Technology

Sourced by ZipRecruiter

GDIT is a global technology and professional services company that delivers technology solutions and mission services to every major agency across the U.S. government, defense, and intelligence community. Its 30,000 experts extract the power of technology to create immediate value and deliver solutions at the edge of innovation. The company operates across 50+ countries worldwide, offering leading capabilities in digital modernization, AI/ML, cloud, cyber, and application development.

Industry

It services

Company size

10,000+ Employees

Headquarters location

Falls Church, VA, US