1

Rag Engineer Jobs Near Me

AI Engineer Location: Columbus, OH (Onsite) We are looking for an experienced AI Engineer to join ... and RAG architectures. * Experience building AI-powered applications using vector databases ...

AI Engineer Location: Columbus, OH (Onsite) We are looking for an experienced AI Engineer to join ... and RAG architectures. * Experience building AI-powered applications using vector databases ...

Dev Ops Engineers

Columbus, OH · On-site

$82.66 - $89.54/hr

... Engineer in Columbus, OH. Responsibilities * Executes creative software solutions, design ... Agentic/RAG-based use cases * Nice-to-have: * Deployment strategies * Multi-cloud exposure ...

New

Build secure LLM/RAG services and ML pipelines that integrate with SIEM/XDR, EDR, SOAR, IAM, ITSM, CMDB, code repos, and cloud telemetry. * Establish engineering standards for secure AI: prompt ...

New

We are hiring an AI Engineer to build and operate the data, features, and GenAI foundations that ... Implement LLM application patterns including RAG, document ingestion/chunking, embeddings, vector ...

Senior Knowledge Engineer

Columbus, OH · On-site

$100K - $138K/yr

Retrieval-Augmented Generation (RAG) architectures * LLM grounding and context design using structured knowledge * Agentic pipeline design: LangChain, LlamaIndex, AutoGen * Prompt engineering for ...

Principal Software Engineer - IE06GE We're determined to make a difference and are proud to be an ... Proficiency in customization techniques across various stages of the RAG pipeline, including model ...

Google Senior Data Engineer

Hartford, OH · On-site

$94K - $266K/yr

Support prompt engineering, embeddings, and retrieval-augmented generation (RAG) experimentation. * Contribute to model testing, validation, and documentation. 3. Requirements Gathering & Client ...

Google Senior Data Engineer

Columbus, OH · On-site

$94K - $266K/yr

Support prompt engineering, embeddings, and retrieval-augmented generation (RAG) experimentation. * Contribute to model testing, validation, and documentation. 3. Requirements Gathering & Client ...

Agent Engineer

Marysville, OH · On-site

$13.75 - $18.50/hr

LLMs (GPT-4, Claude, Gemini), prompt engineering, RAG, vector databases, and agent orchestration (LangChain, Flowise, or similar). • Ability to learn new platforms quickly -- you will ramp on ...

Senior Knowledge Engineer

Columbus, OH · Hybrid

$114K - $150K/yr

Collaborate with AI/ML engineers to integrate knowledge graphs as grounding and context layers for LLM-based agentic pipelines and retrieval-augmented generation (RAG) systems.Design knowledge ...

Senior Knowledge Engineer

Columbus, OH · Hybrid

$114K - $150K/yr

Collaborate with AI/ML engineers to integrate knowledge graphs as grounding and context layers for LLM-based agentic pipelines and retrieval-augmented generation (RAG) systems.Design knowledge ...

next page

Showing results 1-20

Rag Engineer information

See salary details

$59.5K

$90.5K

$153.5K

How much do rag engineer jobs pay per year?

As of Aug 19, 2026, the average yearly pay for rag engineer in the United States is $90,511.00, according to ZipRecruiter salary data. Most workers in this role earn between $68,500.00 and $105,000.00 per year, depending on experience, location, and employer.

What cities are hiring for Rag Engineer jobs?

Cities with the most Rag Engineer job openings:

What states have the most Rag Engineer jobs?

States with the most job openings for Rag Engineer jobs include:

A map of the United States highlighting the number of Rag Engineer job openings by state according to ZipRecruiter. The image is accompanied by a detailed chart listing the number of Rag Engineer job openings in each state, with California having the most at 2 and Hawaii the least at 0.

Tech Lead / Lead Architect - RAG & Agentic AI Urgent Need

Tech Mirrors

Columbus, OH • On-site

$120 - $150/hr

Other

Posted yesterday

New


Job description

Tech Lead / Lead Architect - RAG & Agentic AI

Location: Columbus, OH / Wilmington, DE - 3 days onsite role

Long Term Project

Strong financial and banking domain experience required.

Role Summary

Lead architecture, design, and delivery of Agentic AI and RAG-based solutions, partnering with customers and internal teams to build scalable, secure, and high-impact AI systems.

Must-Have
  • Strong experience in RAG pipelines, embeddings, vector DBs, LLM orchestration, and prompting techniques.
  • Hands-on expertise in AWS (Lambda, API Gateway, Bedrock, S3, OpenSearch, IAM, VPC, Secrets Manager).
  • Ability to design end-to-end AI architecture and build PoCs before committing solutions to customers.
  • Deep understanding of AI guardrails (toxicity, hallucination control), data privacy, and cloud security patterns.
  • Proven ability to lead from the front, mentor teams, and own delivery under tight timelines and high visibility.
  • Strong customer communication skills - ability to explain architecture, trade-offs, and risks clearly.
  • Experience handling model evaluation, observability, performance tuning, and cost optimization in production AI systems.
  • Expertise in API design, microservices integration, and event-driven architectures for AI systems.
Good-to-Have
  • Experience with Agentic AI frameworks (LangGraph, CrewAI, AutoGen, Semantic Kernel, etc.).
  • Exposure to marketing domain use cases (campaign optimization, personalization, analytics, insights).
  • Familiarity with multi-agent orchestration, tool usage (MCP), and human-in-loop workflows.
Screening Checklist (Quick Evaluation for Interviews)

Technical Fit:

  • Can clearly explain a RAG architecture (data ingestion -> embedding -> retrieval -> generation)
  • Has built or deployed production AI/LLM solutions (not just POCs)
  • Understands agent lifecycle, orchestration, and tool integrations
  • Demonstrates AWS architecture + security (IAM roles, network isolation, secrets)
  • Knows prompt engineering + evaluation + guardrails implementation

Architect & Leadership Fit:

  • Has led architecture/design discussions with customers
  • Can drive PoC -> production transition independently
  • Shows ownership mindset (decision-making without dependency)
  • Can mentor/coach developers and review designs/code

Communication & Behavioral Fit:

  • Explains complex AI topics in simple, structured way
  • Asks insightful, strategic questionsDemonstrates ability to handle ambiguity and pressure
#J-18808-Ljbffr