1

Rag Engineer Jobs Near Me

AI Engineer Location: Columbus, OH (Onsite) We are looking for an experienced AI Engineer to join ... and RAG architectures. * Experience building AI-powered applications using vector databases ...

AI Engineer Location: Columbus, OH (Onsite) We are looking for an experienced AI Engineer to join ... and RAG architectures. * Experience building AI-powered applications using vector databases ...

Build secure LLM/RAG services and ML pipelines that integrate with SIEM/XDR, EDR, SOAR, IAM, ITSM, CMDB, code repos, and cloud telemetry. * Establish engineering standards for secure AI: prompt ...

Work with LLMs, prompt engineering, RAG, embeddings, vector databases, and tool/function calling. * Implement agent workflows using frameworks such as LangChain, LangGraph, OpenAI Agent SDK, Google ...

We are hiring an AI Engineer to build and operate the data, features, and GenAI foundations that ... Implement LLM application patterns including RAG, document ingestion/chunking, embeddings, vector ...

Principal Software Engineer - IE06GE We're determined to make a difference and are proud to be an ... Proficiency in customization techniques across various stages of the RAG pipeline, including model ...

next page

Showing results 1-20

Rag Engineer information

See salary details

$59.5K

$90.5K

$153.5K

How much do rag engineer jobs pay per year?

As of Aug 27, 2026, the average yearly pay for rag engineer in the United States is $90,511.00, according to ZipRecruiter salary data. Most workers in this role earn between $68,500.00 and $105,000.00 per year, depending on experience, location, and employer.

What cities are hiring for Rag Engineer jobs?

Cities with the most Rag Engineer job openings:

What states have the most Rag Engineer jobs?

States with the most job openings for Rag Engineer jobs include:

A map of the United States highlighting the number of Rag Engineer job openings by state according to ZipRecruiter. The image is accompanied by a detailed chart listing the number of Rag Engineer job openings in each state, with California having the most at 2 and Hawaii the least at 0.

Tech Lead / Lead Architect - RAG & Agentic AI Urgent Need

Tech Mirrors

Columbus, OH • On-site

$120 - $150/hr

Other

Posted 8 days ago


Job description

Tech Lead / Lead Architect - RAG & Agentic AI

Location: Columbus, OH / Wilmington, DE - 3 days onsite role

Long Term Project

Strong financial and banking domain experience required.

Role Summary

Lead architecture, design, and delivery of Agentic AI and RAG-based solutions, partnering with customers and internal teams to build scalable, secure, and high-impact AI systems.

Must-Have
  • Strong experience in RAG pipelines, embeddings, vector DBs, LLM orchestration, and prompting techniques.
  • Hands-on expertise in AWS (Lambda, API Gateway, Bedrock, S3, OpenSearch, IAM, VPC, Secrets Manager).
  • Ability to design end-to-end AI architecture and build PoCs before committing solutions to customers.
  • Deep understanding of AI guardrails (toxicity, hallucination control), data privacy, and cloud security patterns.
  • Proven ability to lead from the front, mentor teams, and own delivery under tight timelines and high visibility.
  • Strong customer communication skills - ability to explain architecture, trade-offs, and risks clearly.
  • Experience handling model evaluation, observability, performance tuning, and cost optimization in production AI systems.
  • Expertise in API design, microservices integration, and event-driven architectures for AI systems.
Good-to-Have
  • Experience with Agentic AI frameworks (LangGraph, CrewAI, AutoGen, Semantic Kernel, etc.).
  • Exposure to marketing domain use cases (campaign optimization, personalization, analytics, insights).
  • Familiarity with multi-agent orchestration, tool usage (MCP), and human-in-loop workflows.
Screening Checklist (Quick Evaluation for Interviews)

Technical Fit:

  • Can clearly explain a RAG architecture (data ingestion -> embedding -> retrieval -> generation)
  • Has built or deployed production AI/LLM solutions (not just POCs)
  • Understands agent lifecycle, orchestration, and tool integrations
  • Demonstrates AWS architecture + security (IAM roles, network isolation, secrets)
  • Knows prompt engineering + evaluation + guardrails implementation

Architect & Leadership Fit:

  • Has led architecture/design discussions with customers
  • Can drive PoC -> production transition independently
  • Shows ownership mindset (decision-making without dependency)
  • Can mentor/coach developers and review designs/code

Communication & Behavioral Fit:

  • Explains complex AI topics in simple, structured way
  • Asks insightful, strategic questionsDemonstrates ability to handle ambiguity and pressure
#J-18808-Ljbffr