ZipRecruiter

Log In

1

Llm Ml Rag Jobs in Baltimore, MD (NOW HIRING)

eSimplicity

LLM Specialist

Columbia, MD · On-site +1

$93K - $100K/yr

Experience designing, implementing, and optimizing Retrieval-Augmented Generation (RAG) solutions ... Experience designing, deploying, and supporting AI/ML solutions in cloud environments such as ...

ZIO Technologies

AI ML Software Engineer

Annapolis, MD · On-site

$113K - $136K/yr

Building LLM agents for knowledge retrieval, deep research, translation, transcription, redaction ... Knowledge retrieval improvements (RAG, vector search, system integration) * AI capabilities for ...

Bigbear.ai

Senior AI Engineer

Annapolis Junction, MD · On-site

$114K/yr

... AI/ML to develop tools and techniques to include fine tuning Large Language Models (LLM) that ... Experience with static analyzers, RAG framework, and relational and vector databases.

Que Technology Group

AI Engineer

Fort George G Meade, MD · On-site

$120 - $160/hr

... AI/ML to develop tools and techniques to include fine tuning Large Language Models (LLM) that ... Design and implement database solutions to support RAG architectures, artifact storage, audit ...

ARSIEM

361 - AI Engineer

Linthicum, MD · On-site

$126 - $141/hr

... AI/ML to develop tools and techniques to include fine‑tuning Large Language Models (LLM) that ... Design and implement database solutions to support RAG architectures, artifact storage, audit ...

AIToolboard

Senior AI Engineer

Fort George G Meade, MD · On-site

$120 - $190/hr

... AI/ML to develop tools and techniques to include fine tuning Large Language Models (LLM) that ... RAG) systems, and automated testing pipelines. • Develop and optimize data preprocessing ...

Leidos

Senior AI Engineer (SWE-3)

Linthicum Heights, MD · On-site

$102K - $140K/yr

... ML techniques for enhanced vulnerability identification and mitigation capabilities ... LLM orchestration frameworks that coordinate static analyzers, retrieval-augmented generation (RAG ...

next page

Showing results 1-20

All JobsLlm Ml Rag JobsLlm Ml Rag Jobs in Baltimore, MD

Llm Ml Rag information

See Baltimore, MD salary details

$44.7K

$74.8K

$109.3K

How much do llm ml rag jobs pay per year?

As of Sep 6, 2026, the average yearly pay for llm ml rag in Baltimore, MD is $74,820.00, according to ZipRecruiter salary data. Most workers in this role earn between $61,600.00 and $86,400.00 per year, depending on experience, location, and employer.

What is an llm ml rag job?

LLM ML RAG jobs involve working with Large Language Models (LLMs), Machine Learning (ML), and Retrieval-Augmented Generation (RAG) systems. Professionals in these roles typically design, develop, and optimize AI systems that combine language models with retrieval techniques to improve accuracy, relevance, and factual grounding in generated outputs. These jobs often require expertise in natural language processing, deep learning, data engineering, and information retrieval. Key responsibilities might include integrating RAG pipelines, fine-tuning LLMs, and ensuring high-quality responses from AI applications.

What are some typical challenges faced when working on retrieval-augmented generation (RAG) systems in large language model (LLM) machine learning roles?

Professionals working on LLM ML RAG systems often encounter challenges such as ensuring the accuracy and relevancy of retrieved documents, managing latency for real-time queries, and seamlessly integrating retrieval mechanisms with generation models. Additionally, keeping up with evolving datasets and maintaining high-quality knowledge bases can be demanding. Collaboration with data engineers and domain experts is common to refine retrieval pipelines and optimize the end-to-end system.

What are the key skills and qualifications needed to thrive as an llm ml rag engineer, and why are they important?

To excel as an LLM ML RAG Engineer, you need a strong background in machine learning, natural language processing, and large language models, typically supported by a degree in computer science or a related field. Proficiency with tools and frameworks like Python, PyTorch/TensorFlow, Hugging Face Transformers, and vector databases (e.g., FAISS, Pinecone) is essential, along with experience in deploying and fine-tuning LLMs and integrating retrieval systems. Strong problem-solving skills, attention to detail, and the ability to collaborate with cross-functional teams distinguish top performers in this role. These skills ensure the effective development and deployment of advanced AI solutions that combine generative and retrieval capabilities for high-impact applications.

What is the difference between Llm Ml Rag vs Data Scientist?

AspectLlm Ml RagData Scientist
Required CredentialsMaster's or PhD in ML, AI, or related fields; certifications in ML frameworksDegree in Computer Science, Statistics, or related; certifications in data analysis or ML
Work EnvironmentResearch labs, AI development teams, tech companiesBusiness analytics, research, product development teams
Employer & Industry UsageTech firms, AI startups, research institutionsFinance, healthcare, tech, consulting firms
Common Search & ComparisonOften compared for ML specialization and research focusCompared for data analysis, modeling, and business insights

While both roles involve working with machine learning, Llm Ml Rag typically focuses on research and development of large language models, requiring advanced ML expertise. Data Scientists often work on analyzing data, building predictive models, and deriving insights for business decisions. The roles overlap in skills but differ in focus and application areas.

What job categories do people searching Llm Ml Rag jobs in Baltimore, MD look for?

The top searched job categories for Llm Ml Rag jobs in Baltimore, MD are:

What cities near Baltimore, MD are hiring for Llm Ml Rag jobs?

Cities near Baltimore, MD with the most Llm Ml Rag job openings:

Llm Ml Rag jobs near you
Infographic showing various Llm Ml Rag job openings in Baltimore, MD as of August 2026, with employment types broken down into 92% Full Time, 4% Part Time, and 4% Contract. Highlights an 82% Physical, 4% Hybrid, and 14% Remote job distribution, with an average salary of $74,820 per year, or $36 per hour.