ZipRecruiter

Log In

1

Llm Ml Rag Jobs in Chicago, IL (NOW HIRING)

Samprasoft

GenAI Data Scientist

Chicago, IL · On-site

Evaluate various AI/ML /LLM models and map to valid use cases. Optimize the Inference / ML ops from ... Work with RAG, vector stores, and semantic search * Experience with multimodal models * Strong ...

Elevance Health

Senior AI Solutions Engineer

Chicago, IL · On-site

$132.09K - $198.13K/yr

Designs, builds, and deploys end-to-end ML and LLM-based systems (data pipelines, models, prompts ... Builds applied AI solutions such as semantic search, RAG pipelines, and embedding-based systems.

Elevance Health

Senior AI Solutions Engineer

Chicago, IL · On-site

$132.09K - $198.13K/yr

Designs, builds, and deploys end-to-end ML and LLM-based systems (data pipelines, models, prompts ... Builds applied AI solutions such as semantic search, RAG pipelines, and embedding-based systems.

Elevance Health

Senior AI Solutions Engineer

Chicago, IL · On-site

$132.09K - $198.13K/yr

Designs, builds, and deploys end-to-end ML and LLM-based systems (data pipelines, models, prompts ... Builds applied AI solutions such as semantic search, RAG pipelines, and embedding-based systems.

Catalyst Labs, LLC

Applied AI Engineer

Chicago, IL · On-site

$144.30K/yr

Bridge ML systems and product engineering shipping AI-powered features that shape user experience ... Experience with retrieval-augmented generation (RAG) , context engineering , and LLM eval ...

Deloitte

AI Engineer Consultant

Chicago, IL · Hybrid

... ML and LLM-based experiences. Key Responsibilities: * Partner with the Lead AI Solutions Architect ... Implement RAG and document intelligence patterns (ingestion, chunking, embeddings, vector/hybrid ...

Cna

Senior AI & ML Engineer

Chicago, IL · Hybrid

$72K - $141K/yr

Designs and builds reusable pipelines to scale AI/ML solutions in a cloud environment. * Delivers ... Experience with Big Query, Claude Code, RAG, LLM's, ADK, Prompting is expected. Experience with ...

TAG - The Aspen Group

Lead AI Engineer

Chicago, IL · On-site +1

$170K - $200K/yr

... LLM-based architecture, and software engineering. Key Responsibilities: * Architect and develop ... Design and implement RAG pipelines using BigQuery and Vertex AI Engine for knowledge grounding and ...

Kaav Inc.

GenAI Data Scientist

Chicago, IL · On-site

Evaluate various AI/ML /LLM models and map to valid use cases. Optimize the Inference / ML ops from ... Work with RAG, vector stores, and semantic search * Experience with multimodal models * Strong ...

JLL

AI Dev Lead

Chicago, IL

$60.75 - $79.50/hr

Demonstrated proficiency in LLM fine-tuning, prompt engineering, and model optimization ... Demonstrated proficiency in designing and implementing RAG (Retrieval-Augmented Generation) systems

Thoughtworks

Principal AI Architect

Chicago, IL · On-site

Strong command of LLM ecosystems: prompt engineering, fine-tuning, RLHF, RAG architectures, LangChain, LlamaIndex, or equivalent frameworks * Proficiency in Python and familiarity with ML frameworks ...

Saransh Inc

Enterprise AI Architect - Remote

Chicago, IL · On-site

$71 - $91.75/hr

Hands‑on architecture for GenAI, LLM fine‑tuning/RAG, ML Ops, RPA, event streaming, and API‑first integration. Fluency across major hyperscaler stacks (AWS SageMaker & Bedrock ...

Thoughtworks

Principal AI Architect

Chicago, IL

Strong command of LLM ecosystems: prompt engineering, fine-tuning, RLHF, RAG architectures, LangChain, LlamaIndex, or equivalent frameworks * Proficiency in Python and familiarity with ML frameworks ...

Guru Schools

Sr.AI Developer

Northbrook, IL · On-site

$55.25 - $73/hr

... ML or conversational AI * Experience building AI agents or orchestration frameworks * Strong ... AI/LLM frameworks, APIs, and orchestration tools * REST APIs and microservices architecture * Cloud ...

ThoughtWorks

Principal AI Architect

Chicago, IL · On-site

Strong command of LLM ecosystems: prompt engineering, fine-tuning, RLHF, RAG architectures, LangChain, LlamaIndex, or equivalent frameworks * Proficiency in Python and familiarity with ML frameworks ...

Guru Schools

ERP/SAP AI Developer

Northbrook, IL · On-site

... ML or conversational AI * Experience building AI agents or orchestration frameworks * Strong ... AI/LLM frameworks, APIs, and orchestration tools * REST APIs and microservices architecture * Cloud ...

Guru Schools

ERP/SAP AI Developer

Northbrook, IL · On-site

... ML or conversational AI * Experience building AI agents or orchestration frameworks * Strong ... AI/LLM frameworks, APIs, and orchestration tools * REST APIs and microservices architecture * Cloud ...

Guru Schools

Sr.AI Developer

Northbrook, IL · On-site

$56 - $73.75/hr

... ML or conversational AI * Experience building AI agents or orchestration frameworks * Strong ... AI/LLM frameworks, APIs, and orchestration tools * REST APIs and microservices architecture * Cloud ...

CNA

Senior AI & ML Engineer

Chicago, IL · On-site

$72K - $141K/yr

Designs and builds reusable pipelines to scale AI/ML solutions in a cloud environment * Delivers ... Experience with Big Query, Claude Code, RAG, LLM's, ADK, Prompting is expected. Experience with ...

next page

Showing results 1-20

People also search for

All JobsLlm Ml Rag JobsLlm Ml Rag Jobs in Chicago, IL

Llm Ml Rag information

See Chicago, IL salary details

$46.4K

$77.6K

$113.3K

How much do llm ml rag jobs pay per year?

As of May 28, 2026, the average yearly pay for llm ml rag in Chicago, IL is $77,569.00, according to ZipRecruiter salary data. Most workers in this role earn between $63,900.00 and $89,600.00 per year, depending on experience, location, and employer.

What are the key skills and qualifications needed to thrive as an LLM ML RAG (Retrieval-Augmented Generation) Engineer, and why are they important?

To excel as an LLM ML RAG Engineer, you need a strong background in machine learning, natural language processing, and large language models, typically supported by a degree in computer science or a related field. Proficiency with tools and frameworks like Python, PyTorch/TensorFlow, Hugging Face Transformers, and vector databases (e.g., FAISS, Pinecone) is essential, along with experience in deploying and fine-tuning LLMs and integrating retrieval systems. Strong problem-solving skills, attention to detail, and the ability to collaborate with cross-functional teams distinguish top performers in this role. These skills ensure the effective development and deployment of advanced AI solutions that combine generative and retrieval capabilities for high-impact applications.

What are some typical challenges faced when working on Retrieval-Augmented Generation (RAG) systems in large language model (LLM) machine learning roles?

Professionals working on LLM ML RAG systems often encounter challenges such as ensuring the accuracy and relevancy of retrieved documents, managing latency for real-time queries, and seamlessly integrating retrieval mechanisms with generation models. Additionally, keeping up with evolving datasets and maintaining high-quality knowledge bases can be demanding. Collaboration with data engineers and domain experts is common to refine retrieval pipelines and optimize the end-to-end system.

What are LLM ML RAG jobs?

LLM ML RAG jobs involve working with Large Language Models (LLMs), Machine Learning (ML), and Retrieval-Augmented Generation (RAG) systems. Professionals in these roles typically design, develop, and optimize AI systems that combine language models with retrieval techniques to improve accuracy, relevance, and factual grounding in generated outputs. These jobs often require expertise in natural language processing, deep learning, data engineering, and information retrieval. Key responsibilities might include integrating RAG pipelines, fine-tuning LLMs, and ensuring high-quality responses from AI applications.

What is the difference between Llm Ml Rag vs Data Scientist?

AspectLlm Ml RagData Scientist
Required CredentialsMaster's or PhD in ML, AI, or related fields; certifications in ML frameworksDegree in Computer Science, Statistics, or related; certifications in data analysis or ML
Work EnvironmentResearch labs, AI development teams, tech companiesBusiness analytics, research, product development teams
Employer & Industry UsageTech firms, AI startups, research institutionsFinance, healthcare, tech, consulting firms
Common Search & ComparisonOften compared for ML specialization and research focusCompared for data analysis, modeling, and business insights

While both roles involve working with machine learning, Llm Ml Rag typically focuses on research and development of large language models, requiring advanced ML expertise. Data Scientists often work on analyzing data, building predictive models, and deriving insights for business decisions. The roles overlap in skills but differ in focus and application areas.

What are popular job titles related to Llm Ml Rag jobs in Chicago, IL? For Llm Ml Rag jobs in Chicago, IL, the most frequently searched job titles are:
What job categories do people searching Llm Ml Rag jobs in Chicago, IL look for? The top searched job categories for Llm Ml Rag jobs in Chicago, IL are:
What cities near Chicago, IL are hiring for Llm Ml Rag jobs? Cities near Chicago, IL with the most Llm Ml Rag job openings:
Llm Ml Rag jobs near you
GenAI Data Scientist

GenAI Data Scientist

Samprasoft

Chicago, IL • On-site

Other

This job post has expired today. Applications are no longer accepted.

Job description

Data Scientist - GenAI

Working in Emerging Technology team to explore the Generative AI Models and integrate them with traditional AI/ML workloads. Build the AI solution prototypes from ground up to accelerate the adoption. Evaluate various AI/ML /LLM models and map to valid use cases. Optimize the Inference / ML ops from cost and performance point of view. This role will be part of the emerging technology team to construct the ML patterns/ reference patterns for digital platform.

Responsibilities:

  • Lead all stages of AI development including refining product vision, gathering requirements, project planning, software system design, coding, testing, release, deployment and support analytical solutions.
  • Maintains high standards of software quality by establishing good practices and habits Identifies and encourage areas for growth and improvement
  • Communicate with end users and internal customers to help direct development, debugging, and testing of application software for accuracy, integrity, interoperability, and completeness
  • Performs integrated testing and customer acceptance testing of components that requires careful planning and execution to ensure timely, quality results.

Technical Skills Required:

  • 5 years Production grade AI/ML Enterprise experience required.
  • 5 years or more of experience in designing and developing complex ML applications in Python
  • ML architectural patterns to deploy in Cloud (AWS/ Azure / Snowflake)
  • Proven skills in ML Ops / Inference Optimization / ML in Container deployment.
  • Experienced in design, development, delivery of GenAI solutions with all necessary underlying components and integration.
  • Strong proficiency in machine learning frameworks, libraries, and methodologies such as GPT, GANs, TensorFlow, PyTorch, or similar
  • Experience with deep learning architectures and techniques
  • In-depth understanding of DevOps and MLOps

GenAI:

  • Understanding of AI and GenAI domains, GenAI embeddings, and theoretical aspects
  • Work with RAG, vector stores, and semantic search
  • Experience with multimodal models
  • Strong understanding to building validation/Quality frameworks in GenAI Inference
  • LLM Model fine tuning and deployment
  • Optimization of GPU's

Desired Skills:

  • AI/ML certifications in AWS / AZURE / GenAI

Soft Skills Required:

  • Demonstrated leadership on medium to large-scale projects impacting strategic priorities.
  • Ability to cope with shifting priorities, demands and timelines through analytical and problem-solving skills.
  • Ability to effectively prioritize, delegate responsibilities and execute tasks in a high-pressure environment.

Apply