ZipRecruiter

Log In

1

Llm Ml Rag Jobs (NOW HIRING)

Apex Informatics

AI/ ML engineer

Title: AI/ML Engineer Location: NJ/ TX Overall Technology Snapshot * AWS Cloud * Base Python ... FAST API * LLM Pipeline in AWS Environment * RAG Architecture, Optimization, and Tuning

Carter Support Services

AI/ML Engineer

Burbank, CA · On-site

$111K - $153K/yr

Develop and optimize prompt engineering strategies for LLM-based systems * Build and deploy RAG ... ML roles * 7+ years of Python experience (expert-level proficiency required) * 7+ years of ...

Carter Support Services

AI/ML Engineer

Burbank, CA · On-site

Develop and optimize prompt engineering strategies for LLM-based systems * Build and deploy RAG ... ML roles * 7+ years of Python experience (expert-level proficiency required) * 7+ years of ...

Futran Tech Solutions Pvt. Ltd.

AI/ML Engineer

MLOps / Platform • Implement CI/CD for ML/LLM workloads using MLflow, Vertex, SageMaker, Databricks, Airflow, Argo, and Kubernetes. • Apply LLM Ops foundations for RAG and GenAI use cases.

SES

Python AI Developer - ZL

Washington, DC · On-site

$57 - $78.50/hr

SQL * AWS Data Services * LLM * ML * Sagemaker * Bedrock Top 3 Soft Skills: * Confidence in ... Familiarity with vector databases (e.g., FAISS, Pinecone) and retrieval-augmented generation (RAG)

SES

Python/GenAI Developer

Herndon, VA · On-site

$51.75 - $71.25/hr

LLM * ML * Sagemaker Experience: 8+ years overall in Software Engineering disciplines, preferably ... Familiarity with vector databases (e.g., FAISS, Pinecone) and retrieval-augmented generation (RAG)

SES

Python Gen AI Developer - ZL

Washington, DC · On-site

$57 - $78.50/hr

SQL * AWS Data Services * LLM * ML * Sagemaker * Bedrock Top 3 Soft Skills: * Confidence in ... Familiarity with vector databases (e.g., FAISS, Pinecone) and retrieval-augmented generation (RAG)

Interon IT Solutions

AI/ML Engineer

Reston, VA · On-site

AI/ML Engineer (Python, AWS, GenAI) Location: Reston, VA (In-person interviews required) Candidate ... Architect and operationalize RAG pipelines , embeddings, vector databases, and LLM-powered ...

Futran Tech Solutions Pvt. Ltd.

AI/ML Engineering

AI / ML Engineering Execution • Oversee development of: o Machine learning models (supervised / unsupervised) o Generative AI and LLM based solutions o Retrieval Augmented Generation (RAG ...

Bomnin Chevrolet Dadeland

Sr. AI/ML Engineer (LLM)

Miami, FL · On-site

$99K - $137K/yr

Create and architect interpreters, Agented Systems, and integrate multi-hop RAG and other LLM ... Provide AI/ML technical leadership and mentorship to other engineers on the team. * Ensure that LLM ...

Wise Skulls

Senior AI/LLM Engineer

Irving, TX · On-site

$100K - $137K/yr

... RAG prompt grounding strategies LLM fine-tuning Neural Network training & tuning Traditional ML models (random forest, k-means clustering, linear regression, etc.) MCP development and consumption ...

Closure Technologies

AI/ML Engineer

Mclean, VA

Experience developing AI/ML applications focused on Retrieval-Augmented Generation (RAG), semantic retrieval, LLM integration, or related AI workflows. * Strong proficiency in Python and modern AI/ML ...

Vizient, Inc.

Sr AI/ML Engineer

Irving, TX · On-site

$102K - $179K/yr

Design and implement RAG pipelines, embedding strategies, and vector search architectures. * Build agentic workflows, prompt strategies, and orchestration patterns for LLM systems. * Own AI/ML ...

Luminary Cloud

LLM Engineer

San Mateo, CA · On-site

Design and optimize RAG pipelines : Build retrieval-augmented generation systems over engineering ... Experience deploying ML systems on cloud platforms (GCP, AWS, Azure) or on-prem infrastructure

Vizient

Sr AI/ML Engineer

Irving, TX

$102K - $179K/yr

Design and implement RAG pipelines, embedding strategies, and vector search architectures. * Build agentic workflows, prompt strategies, and orchestration patterns for LLM systems. * Own AI/ML ...

next page

Showing results 1-20

All JobsLlm Ml Rag Jobs

Llm Ml Rag information

See salary details

$45K

$75.3K

$110K

How much do llm ml rag jobs pay per year?

As of Jul 17, 2026, the average yearly pay for llm ml rag in the United States is $75,300.00, according to ZipRecruiter salary data. Most workers in this role earn between $62,000.00 and $87,000.00 per year, depending on experience, location, and employer.

What are some typical challenges faced when working on Retrieval-Augmented Generation (RAG) systems in large language model (LLM) machine learning roles?

Professionals working on LLM ML RAG systems often encounter challenges such as ensuring the accuracy and relevancy of retrieved documents, managing latency for real-time queries, and seamlessly integrating retrieval mechanisms with generation models. Additionally, keeping up with evolving datasets and maintaining high-quality knowledge bases can be demanding. Collaboration with data engineers and domain experts is common to refine retrieval pipelines and optimize the end-to-end system.

What is the difference between Llm Ml Rag vs Data Scientist?

AspectLlm Ml RagData Scientist
Required CredentialsMaster's or PhD in ML, AI, or related fields; certifications in ML frameworksDegree in Computer Science, Statistics, or related; certifications in data analysis or ML
Work EnvironmentResearch labs, AI development teams, tech companiesBusiness analytics, research, product development teams
Employer & Industry UsageTech firms, AI startups, research institutionsFinance, healthcare, tech, consulting firms
Common Search & ComparisonOften compared for ML specialization and research focusCompared for data analysis, modeling, and business insights

While both roles involve working with machine learning, Llm Ml Rag typically focuses on research and development of large language models, requiring advanced ML expertise. Data Scientists often work on analyzing data, building predictive models, and deriving insights for business decisions. The roles overlap in skills but differ in focus and application areas.

What are the key skills and qualifications needed to thrive as an LLM ML RAG (Retrieval-Augmented Generation) Engineer, and why are they important?

To excel as an LLM ML RAG Engineer, you need a strong background in machine learning, natural language processing, and large language models, typically supported by a degree in computer science or a related field. Proficiency with tools and frameworks like Python, PyTorch/TensorFlow, Hugging Face Transformers, and vector databases (e.g., FAISS, Pinecone) is essential, along with experience in deploying and fine-tuning LLMs and integrating retrieval systems. Strong problem-solving skills, attention to detail, and the ability to collaborate with cross-functional teams distinguish top performers in this role. These skills ensure the effective development and deployment of advanced AI solutions that combine generative and retrieval capabilities for high-impact applications.

What are LLM ML RAG jobs?

LLM ML RAG jobs involve working with Large Language Models (LLMs), Machine Learning (ML), and Retrieval-Augmented Generation (RAG) systems. Professionals in these roles typically design, develop, and optimize AI systems that combine language models with retrieval techniques to improve accuracy, relevance, and factual grounding in generated outputs. These jobs often require expertise in natural language processing, deep learning, data engineering, and information retrieval. Key responsibilities might include integrating RAG pipelines, fine-tuning LLMs, and ensuring high-quality responses from AI applications.
More about Llm Ml Rag jobs
What cities are hiring for Llm Ml Rag jobs? Cities with the most Llm Ml Rag job openings:
What states have the most Llm Ml Rag jobs? States with the most job openings for Llm Ml Rag jobs include:
What job categories do people searching Llm Ml Rag jobs look for? The top searched job categories for Llm Ml Rag jobs are:
Llm Ml Rag jobs near you
Infographic showing various Llm Ml Rag job openings in the United States as of July 2026, with employment types broken down into 96% Full Time, 2% Part Time, and 2% Contract. Highlights an 77% Physical, 4% Hybrid, and 19% Remote job distribution, with an average salary of $75,300 per year, or $36.2 per hour.
AI/ ML engineer

AI/ ML engineer

Apex Informatics

Remote

Other

Posted 20 days ago

Job description

Title: AI/ML Engineer
Location: NJ/ TX
Job Description:
Overall Technology Snapshot
  • AWS Cloud
  • Base Python
  • Python Multithreading and Transaction/State Management
  • FAST API
  • LLM Pipeline in AWS Environment
  • RAG Architecture, Optimization, and Tuning
  • Deployment and Model Refinement

Detailed Technical Skills
  • Strong Python coding skills - Core Python, multithreading, transaction management, asynchronous communication, FAST API
  • Cloud exposure (AWS preferred) - from development through deployment
  • Experience working across the full SDLC, including design discussions and decision-making
  • Clear understanding of LLM, RAG, and ability to explain system design of current projects

Apply