ZipRecruiter

Log In

1

Llm Ml Rag Jobs (NOW HIRING)

Soni Resources

Senior AI/ML Engineer

New York, NY · On-site

$210K/yr

Design, develop, and maintain production-grade AI and ML solutions across cloud and hybrid ... Experience integrating LLM applications with enterprise data sources and retrieval systems (RAG)

Prophecy Technologies

AI/ML Engineer

Hartford, CT · On-site

Build RAG applications using embeddings, vector databases, and prompt engineering techniques ... Integrate LLM applications into services/APIs and ensure performance, reliability, and scalability.

Carter Support Services

AI/ML Engineer

Burbank, CA · On-site

Develop and optimize prompt engineering strategies for LLM-based systems * Build and deploy RAG ... ML roles * 7+ years of Python experience (expert-level proficiency required) * 7+ years of ...

Cresta

Senior Machine Learning Engineer

OR · On-site +1

$205K - $270K/yr

... RAG) systems in enterprise environments. * Experience building and evaluating complex agentic or multi-step LLM workflows. * Strong knowledge of modern ML frameworks and tools (e.g., PyTorch ...

Interon IT Solutions

AI/ML Engineer

Reston, VA · On-site

AI/ML Engineer (Python, AWS, GenAI) Location: Reston, VA (In-person interviews required) Candidate ... Architect and operationalize RAG pipelines , embeddings, vector databases, and LLM-powered ...

Bomnin Chevrolet Dadeland

Sr. AI/ML Engineer (LLM)

Miami, FL · On-site

$99K - $137K/yr

Create and architect interpreters, Agented Systems, and integrate multi-hop RAG and other LLM ... Provide AI/ML technical leadership and mentorship to other engineers on the team. * Ensure that LLM ...

Raas Infotek LLC

AI/ML Engineer

Dallas, TX · On-site

AI/ML Engineer (10+ Years Experience Required) W2 ONLY | No C2C | No 1099 | No Third-Party Vendors ... Build LLM and RAG-based applications. * Deploy AI models into production. * Optimize model ...

New

Northern Base

Senior AI ML Engineer

Chicago, IL · On-site

$120K - $130K/yr

Roles & Responsibilities Design, build, and deploy AI/ML solutions; lead full AI lifecycle from experimentation to production; build ML models and LLM-powered RAG/agent systems; translate business ...

Closure Technologies

AI/ML Engineer

Mclean, VA · On-site

Experience developing AI/ML applications focused on Retrieval-Augmented Generation (RAG), semantic retrieval, LLM integration, or related AI workflows. * Strong proficiency in Python and modern AI/ML ...

Vizient, Inc.

Sr AI/ML Engineer

Centennial, CO · On-site

$102K - $179K/yr

Design and implement RAG pipelines, embedding strategies, and vector search architectures. * Build agentic workflows, prompt strategies, and orchestration patterns for LLM systems. * Own AI/ML ...

Vizient

Sr AI/ML Engineer

Irving, TX · On-site

$102K - $179K/yr

Design and implement RAG pipelines, embedding strategies, and vector search architectures. * Build agentic workflows, prompt strategies, and orchestration patterns for LLM systems. * Own AI/ML ...

Vizient, Inc.

Sr AI/ML Engineer

Chicago, IL · On-site

$102K - $179K/yr

Design and implement RAG pipelines, embedding strategies, and vector search architectures. * Build agentic workflows, prompt strategies, and orchestration patterns for LLM systems. * Own AI/ML ...

Vizient, Inc.

Sr AI/ML Engineer

Irving, TX · On-site

$102K - $179K/yr

Design and implement RAG pipelines, embedding strategies, and vector search architectures. * Build agentic workflows, prompt strategies, and orchestration patterns for LLM systems. * Own AI/ML ...

Vizient

AI/ML Engineer

Englewood, CO · On-site

$77K - $135K/yr

You will contribute across the full AI lifecycle, developing traditional ML models and LLM-powered systems such as Retrieval-Augmented Generation (RAG) pipelines and agentic AI systems. You will ...

Vizient

Sr AI/ML Engineer

Englewood, CO

$102K - $179K/yr

Design and implement RAG pipelines, embedding strategies, and vector search architectures. * Build agentic workflows, prompt strategies, and orchestration patterns for LLM systems. * Own AI/ML ...

Vizient, Inc.

Sr AI/ML Engineer

Irving, TX · On-site

$102K - $179K/yr

Design and implement RAG pipelines, embedding strategies, and vector search architectures. * Build agentic workflows, prompt strategies, and orchestration patterns for LLM systems. * Own AI/ML ...

previous page

Showing results 41-60

All JobsLlm Ml Rag Jobs

Llm Ml Rag information

See salary details

$45K

$75.3K

$110K

How much do llm ml rag jobs pay per year?

As of Aug 6, 2026, the average yearly pay for llm ml rag in the United States is $75,300.00, according to ZipRecruiter salary data. Most workers in this role earn between $62,000.00 and $87,000.00 per year, depending on experience, location, and employer.

What are some typical challenges faced when working on retrieval-augmented generation (RAG) systems in large language model (LLM) machine learning roles?

Professionals working on LLM ML RAG systems often encounter challenges such as ensuring the accuracy and relevancy of retrieved documents, managing latency for real-time queries, and seamlessly integrating retrieval mechanisms with generation models. Additionally, keeping up with evolving datasets and maintaining high-quality knowledge bases can be demanding. Collaboration with data engineers and domain experts is common to refine retrieval pipelines and optimize the end-to-end system.

What is the difference between Llm Ml Rag vs Data Scientist?

AspectLlm Ml RagData Scientist
Required CredentialsMaster's or PhD in ML, AI, or related fields; certifications in ML frameworksDegree in Computer Science, Statistics, or related; certifications in data analysis or ML
Work EnvironmentResearch labs, AI development teams, tech companiesBusiness analytics, research, product development teams
Employer & Industry UsageTech firms, AI startups, research institutionsFinance, healthcare, tech, consulting firms
Common Search & ComparisonOften compared for ML specialization and research focusCompared for data analysis, modeling, and business insights

While both roles involve working with machine learning, Llm Ml Rag typically focuses on research and development of large language models, requiring advanced ML expertise. Data Scientists often work on analyzing data, building predictive models, and deriving insights for business decisions. The roles overlap in skills but differ in focus and application areas.

What are the key skills and qualifications needed to thrive as an llm ml rag engineer, and why are they important?

To excel as an LLM ML RAG Engineer, you need a strong background in machine learning, natural language processing, and large language models, typically supported by a degree in computer science or a related field. Proficiency with tools and frameworks like Python, PyTorch/TensorFlow, Hugging Face Transformers, and vector databases (e.g., FAISS, Pinecone) is essential, along with experience in deploying and fine-tuning LLMs and integrating retrieval systems. Strong problem-solving skills, attention to detail, and the ability to collaborate with cross-functional teams distinguish top performers in this role. These skills ensure the effective development and deployment of advanced AI solutions that combine generative and retrieval capabilities for high-impact applications.

What is an llm ml rag job?

LLM ML RAG jobs involve working with Large Language Models (LLMs), Machine Learning (ML), and Retrieval-Augmented Generation (RAG) systems. Professionals in these roles typically design, develop, and optimize AI systems that combine language models with retrieval techniques to improve accuracy, relevance, and factual grounding in generated outputs. These jobs often require expertise in natural language processing, deep learning, data engineering, and information retrieval. Key responsibilities might include integrating RAG pipelines, fine-tuning LLMs, and ensuring high-quality responses from AI applications.
More about Llm Ml Rag jobs
What cities are hiring for Llm Ml Rag jobs? Cities with the most Llm Ml Rag job openings:
What states have the most Llm Ml Rag jobs? States with the most job openings for Llm Ml Rag jobs include:
What job categories do people searching Llm Ml Rag jobs look for? The top searched job categories for Llm Ml Rag jobs are:
Llm Ml Rag jobs near you
Infographic showing various Llm Ml Rag job openings in the United States as of August 2026, with employment types broken down into 93% Full Time, 2% Part Time, and 5% Contract. Highlights an 82% Physical, 4% Hybrid, and 14% Remote job distribution, with an average salary of $75,300 per year, or $36.2 per hour.

Senior AI/ML Engineer

Soni Resources

New York, NY • On-site

$210K/yr

Full-time

Re-posted 5 days ago

Job description

Soni's client is seeking an Artificial Intelligence / Machine Learning Engineer to design, build, deploy, and support enterprise-scale AI and ML solutions across cloud and hybrid environments. This is a highly hands-on role focused on delivering scalable, secure, and high-performing AI solutions aligned with business and technology objectives.
The ideal candidate will have experience developing production-grade AI applications, LLM-powered solutions, and agentic workflows while collaborating with cross-functional technical and business teams.
Key Responsibilities
  • Design, develop, and maintain production-grade AI and ML solutions across cloud and hybrid platforms
  • Build end-to-end AI application pipelines including data ingestion, prompt engineering, model evaluation, deployment, and monitoring
  • Develop and support LLM-powered applications and agentic workflows
  • Collaborate with engineering, data, and business stakeholders to translate requirements into AI and ML solutions
  • Write scalable, maintainable, and high-quality Python code for AI and ML applications
  • Optimize performance, scalability, reliability, and cost efficiency of AI and ML services
  • Integrate AI and ML applications with enterprise APIs, data lakes, data warehouses, retrieval systems (RAG), and streaming platforms
  • Support AI solution lifecycle management including versioning, prompt iteration, evaluation, and production support
  • Apply security, governance, compliance, and data privacy best practices across AI and ML systems
  • Participate in technical architecture and solution design discussions
  • Stay current on advancements in AI, ML, LLMs, cloud engineering, and orchestration technologies

Required Qualifications
  • 5+ years of experience building and deploying AI and ML solutions
  • Strong hands-on experience developing AI and ML applications within cloud environments
  • Advanced Python programming skills focused on AI/ML engineering and LLM application development
  • Experience building and supporting LLM-powered applications, agentic workflows, and AI orchestration pipelines
  • Experience integrating LLM applications with enterprise data sources and retrieval systems (RAG)
  • Hands-on experience with AI orchestration and observability frameworks such as LangChain, LangSmith, Pydantic AI, or similar technologies
  • Strong understanding of cloud security, AI governance, data privacy, and enterprise AI compliance practices
  • Experience developing scalable, production-grade cloud-native applications

Preferred Qualifications
  • Experience supporting enterprise AI initiatives within professional services or regulated environments
  • Familiarity with vector databases, embedding models, semantic search, and AI evaluation frameworks
  • Experience with containerization and deployment technologies such as Docker and Kubernetes
  • Exposure to MLOps and AI observability best practices
  • Experience integrating AI systems into enterprise business workflows and knowledge management platforms

Compensation: $145,000 to $210,000 annually
Compensation is based on a range of factors that include relevant experience, knowledge, skills, other job-related qualifications.
Soni Resources logo

About Soni Resources

Sourced by ZipRecruiter

Soni is a premier staffing & recruitment company that is disrupting the human capital management space. Headquartered in New York, Soni has presence in 23 markets across the United States. We support each professional relationship with a cutting-edge approach, industry-leading insights, and a human touch. We are trusted to help companies and individuals tackle their challenges and capture their greatest opportunities. We are minority-owned, and diversity & inclusion is in our DNA. We are committed to creating environments where people are empowered to be their authentic selves.

Company size

11 - 50 Employees

Headquarters location

New York, NY, US

View All Soni Resources Jobs

Apply