ZipRecruiter

Log In

1

Llm Ml Rag Jobs in Springfield, MA (NOW HIRING)

CVS Health

AI/LLM Engineer

Hartford, CT · On-site

$101K - $203K/yr

Architect and build Retrieval-Augmented Generation (RAG) systems leveraging embeddings, vector ... Hands-on experience building production-grade AI/ML systems, not just prototypes. * Experience ...

Deloitte

Google AI Lead Architect

Hartford, CT · On-site

$55.75 - $76.50/hr

LLM and AI Integration: Integrate and fine-tune Large Language Models (LLMs) and other AI/ML models ... RAG with Vertex AI Search/Vector Search, prompt design, safety policies, observability). * Deep ...

Infosys Limited Digital

AI Engineer

Hartford, CT · On-site

$115K - $138K/yr

... ML, ML, deep learning or LLM models, and proofs of concepts. • Participate in and deliver ... RAG (Retrieval-Augmented Generation) AI Agents / Agentic frameworks Prompt Engineering Proficiency ...

UnitedHealth Group

Software Engineer

Hartford, CT · On-site

$72K - $130K/yr

Develop and optimize RAG (Retrieval-Augmented Generation) pipelines, including document ingestion ... ML or generative AI solutions in production or enterprise environments * 2+ years of experience in ...

UnitedHealth Group

Software Engineer

Hartford, CT · Remote

$72K - $130K/yr

Develop and optimize RAG (Retrieval-Augmented Generation) pipelines, including document ingestion ... ML or generative AI solutions in production or enterprise environments * 2 years of experience in ...

next page

Showing results 1-20

All JobsLlm Ml Rag JobsLlm Ml Rag Jobs in Springfield, MA

Llm Ml Rag information

See Springfield, MA salary details

$44.8K

$75K

$109.6K

How much do llm ml rag jobs pay per year?

As of Jul 28, 2026, the average yearly pay for llm ml rag in Springfield, MA is $75,036.00, according to ZipRecruiter salary data. Most workers in this role earn between $61,800.00 and $86,700.00 per year, depending on experience, location, and employer.

What are some typical challenges faced when working on Retrieval-Augmented Generation (RAG) systems in large language model (LLM) machine learning roles?

Professionals working on LLM ML RAG systems often encounter challenges such as ensuring the accuracy and relevancy of retrieved documents, managing latency for real-time queries, and seamlessly integrating retrieval mechanisms with generation models. Additionally, keeping up with evolving datasets and maintaining high-quality knowledge bases can be demanding. Collaboration with data engineers and domain experts is common to refine retrieval pipelines and optimize the end-to-end system.

What is the difference between Llm Ml Rag vs Data Scientist?

AspectLlm Ml RagData Scientist
Required CredentialsMaster's or PhD in ML, AI, or related fields; certifications in ML frameworksDegree in Computer Science, Statistics, or related; certifications in data analysis or ML
Work EnvironmentResearch labs, AI development teams, tech companiesBusiness analytics, research, product development teams
Employer & Industry UsageTech firms, AI startups, research institutionsFinance, healthcare, tech, consulting firms
Common Search & ComparisonOften compared for ML specialization and research focusCompared for data analysis, modeling, and business insights

While both roles involve working with machine learning, Llm Ml Rag typically focuses on research and development of large language models, requiring advanced ML expertise. Data Scientists often work on analyzing data, building predictive models, and deriving insights for business decisions. The roles overlap in skills but differ in focus and application areas.

What are the key skills and qualifications needed to thrive as an LLM ML RAG (Retrieval-Augmented Generation) Engineer, and why are they important?

To excel as an LLM ML RAG Engineer, you need a strong background in machine learning, natural language processing, and large language models, typically supported by a degree in computer science or a related field. Proficiency with tools and frameworks like Python, PyTorch/TensorFlow, Hugging Face Transformers, and vector databases (e.g., FAISS, Pinecone) is essential, along with experience in deploying and fine-tuning LLMs and integrating retrieval systems. Strong problem-solving skills, attention to detail, and the ability to collaborate with cross-functional teams distinguish top performers in this role. These skills ensure the effective development and deployment of advanced AI solutions that combine generative and retrieval capabilities for high-impact applications.

What are LLM ML RAG jobs?

LLM ML RAG jobs involve working with Large Language Models (LLMs), Machine Learning (ML), and Retrieval-Augmented Generation (RAG) systems. Professionals in these roles typically design, develop, and optimize AI systems that combine language models with retrieval techniques to improve accuracy, relevance, and factual grounding in generated outputs. These jobs often require expertise in natural language processing, deep learning, data engineering, and information retrieval. Key responsibilities might include integrating RAG pipelines, fine-tuning LLMs, and ensuring high-quality responses from AI applications.
What are popular job titles related to Llm Ml Rag jobs in Springfield, MA? For Llm Ml Rag jobs in Springfield, MA, the most frequently searched job titles are:
What job categories do people searching Llm Ml Rag jobs in Springfield, MA look for? The top searched job categories for Llm Ml Rag jobs in Springfield, MA are:
What cities near Springfield, MA are hiring for Llm Ml Rag jobs? Cities near Springfield, MA with the most Llm Ml Rag job openings:
Llm Ml Rag jobs near you
Infographic showing various Llm Ml Rag job openings in Springfield, MA as of June 2026, with employment types broken down into 94% Full Time, 4% Part Time, and 2% Contract. Highlights an 81% Physical, 4% Hybrid, and 15% Remote job distribution, with an average salary of $75,036 per year, or $36.1 per hour.
AI/LLM Engineer

AI/LLM Engineer

CVS Health

Hartford, CT • On-site

$101K - $203K/yr

Full-time

Medical, Dental, Vision, Retirement, PTO

Posted 7 days ago

CVS Health rating

5.8

Company rating: 5.8 out of 10

Based on 4,319 frontline employees who took The Breakroom Quiz

88th of 109 rated pharmacies

Job description

We're building a world of health around every individual - shaping a more connected, convenient and compassionate health experience. At CVS Health, you'll be surrounded by passionate colleagues who care deeply, innovate with purpose, hold ourselvesaccountable and prioritize safety and quality in everything we do. Join us and be part of something bigger - helping to simplify health care one person, one family and one community at a time.

We are seeking an experienced AI / LLM Engineer to design, develop, and operationalize advanced language model-powered applications for enterprise use cases. This role will focus on building text-based reasoning systems, Retrieval-Augmented Generation (RAG) pipelines, and scalable prompt engineering frameworks that enhance decision-making, automation, and knowledge discovery across the organization.

As a key member of a cross-functional team, you will collaborate with business stakeholders to translate business requirements into reliable, explainable, and production-ready AI solutions. You will play a critical role in shaping enterprise AI capabilities by ensuring solutions are secure, responsible, and optimized for real-world performance.

  • Design and implement LLM-powered applications that support complex, text-based reasoning and decision workflows.
  • Develop and refine chain-of-thought-style reasoning approaches and structured prompt patterns to improve model accuracy and interpretability.
  • Architect and build Retrieval-Augmented Generation (RAG) systems leveraging embeddings, vector search, and hybrid retrieval strategies.
  • Create, evaluate, and optimize prompt engineering frameworks, including reusable templates, prompt libraries, and testing methodologies.
  • Implement monitoring, logging, and feedback loops for continuous improvement of AI systems.
  • Ensure compliance with security, governance, and Responsible AI principles.
  • Partner with product and analytics teams to rapidly prototype and iterate AI-driven features.

Tools & Technologies

  • Programming: Python (primary), SQL

  • LLM Platforms: OpenAI, Anthropic, Google Vertex AI
  • Frameworks: LangChain, LlamaIndex, Semantic Kernel
  • Vector Databases: Pinecone, Weaviate, FAISS, MongoDB Atlas Vector Search
  • Data Processing: Spark, Pandas
  • APIs & Services: FastAPI, Flask, REST/gRPC
  • Cloud Platforms: AWS, Azure, Google Cloud Platform (GCP)
  • DevOps & MLOps: Docker, Kubernetes, CI/CD tools
  • Monitoring & Evaluation: Prompt evaluation tools, logging frameworks, observability platforms

Essential Qualifications and Functions:

  • 5+ years expereince
  • Bachelor's or Master's degree in Computer Science, Engineering, Data Science, or a related field, or equivalent practical experience.
  • Strong programming experience in Python and familiarity with software engineering best practices.
  • Hands-on experience building production-grade AI/ML systems, not just prototypes.
  • Experience working with Large Language Models (LLMs) and APIs.
  • Solid understanding of:
    • Natural Language Processing (NLP) fundamentals
    • Machine learning concepts (training, evaluation, overfitting, bias)
  • Practical experience with:
    • Retrieval-Augmented Generation (RAG) systems
    • Prompt engineering and prompt optimization
    • Embeddings and vector search
  • Experience designing and implementing APIs, microservices, or distributed systems.
  • Familiarity with model evaluation techniques and performance metrics.
  • Strong debugging and problem-solving skills in complex systems.

Preferred Qualifications:

  • Experience with LLM platforms such as OpenAI, Anthropic, Google Vertex AI, or similar.
  • Familiarity with orchestration frameworks like LangChain, LlamaIndex, Semantic Kernel, or equivalent.
  • Experience with vector databases (e.g., Pinecone, Weaviate, FAISS, MongoDB Atlas Vector Search).
  • Knowledge of MLOps practices, including CI/CD pipelines for AI systems.
  • Experience deploying solutions in cloud environments (e.g., AWS, Azure, GCP).
  • Exposure to agent-based architectures or multi-step AI workflows.
  • Experience in financial services enterprise environments (or similar data-intensive industries).
  • Experience with evaluation frameworks and benchmarking for LLMs.

This role does not support sponsorship at this time

Anticipated Weekly Hours

40

Time Type

Full time

Pay Range

The typical pay range for this role is:

$101,970.00 - $203,940.00

This pay range represents the base hourly rate or base annual full-time salary for all positions in the job grade within which this position falls. The actual base salary offer will depend on a variety of factors including experience, education, geography and other relevant factors. This position is eligible for a CVS Health bonus, commission or short-term incentive program in addition to the base pay range listed above.

Our people fuel our future. Our teams reflect the customers, patients, members and communities we serve and we are committed to fostering a workplace where every colleague feels valued and that they belong.

Great benefits for great people

We take pride in offering a comprehensive and competitive mix of pay and benefits that reflects our commitment to our colleagues and their families.

This fulltime position is eligible for a comprehensive benefits package designed to support the physical, emotional, and financial wellbeing of colleagues and their families. The benefits for this position include medical, dental, and vision coverage, paid time off, retirement savings options, wellness programs, and other resources, based on eligibility.


Additional details about available benefits are provided during the application process and on Benefits Moments.

We anticipate the application window for this opening will close on: 08/31/2026

Qualified applicants with arrest or conviction records will be considered for employment in accordance with all federal, state and local laws.

What CVS Health employees say

Pay

Benefits

Hours and flexibility

Workplace

Get the full story on Breakroom

Apply