NET and Python) for RAG pipelines, AI agent orchestration, and API integrations; remain a strong individual contributor while leading the team. * Set Engineering Standards: Establish patterns for ...
NET and Python) for RAG pipelines, AI agent orchestration, and API integrations; remain a strong individual contributor while leading the team. * Set Engineering Standards: Establish patterns for ...
Sr. AI Engineering Lead
Raleigh, NC · On-site
$180 - $230/hr
NET and Python) for RAG pipelines, AI agent orchestration, and API integrations; remain a strong individual contributor while leading the team. * Set Engineering Standards: Establish patterns for ...
Sr. AI Engineering Lead
Raleigh, NC · On-site
$180 - $230/hr
NET and Python) for RAG pipelines, AI agent orchestration, and API integrations; remain a strong individual contributor while leading the team. * Set Engineering Standards: Establish patterns for ...
AI Operations Engineer
Durham, NC · On-site
$67K - $90K/yr
About the Role We are seeking an AI Operations Engineer to help support and optimize our next ... Help improve retrieval quality for vector search and RAG pipelines * Assist with evaluation ...
AI Operations Engineer
Durham, NC · On-site
$67K - $90K/yr
About the Role We are seeking an AI Operations Engineer to help support and optimize our next ... Help improve retrieval quality for vector search and RAG pipelines * Assist with evaluation ...
AI Operations Engineer
Durham, NC · Hybrid
$67K - $90K/yr
About the Role We are seeking an AI Operations Engineer to help support and optimize our next ... Help improve retrieval quality for vector search and RAG pipelines * Assist with evaluation ...
AI Operations Engineer
Durham, NC · Hybrid
$67K - $90K/yr
About the Role We are seeking an AI Operations Engineer to help support and optimize our next ... Help improve retrieval quality for vector search and RAG pipelines * Assist with evaluation ...
Understand AI architecture patterns including RAG (Retrieval-Augmented Generation), Agentic AI , Graph RAG, AI Assistants & Copilots, Knowledge Management Platforms, Model Orchestration Frameworks
Understand AI architecture patterns including RAG (Retrieval-Augmented Generation), Agentic AI , Graph RAG, AI Assistants & Copilots, Knowledge Management Platforms, Model Orchestration Frameworks
Understand AI architecture patterns including RAG (Retrieval-Augmented Generation), Agentic AI , Graph RAG, AI Assistants & Copilots, Knowledge Management Platforms, Model Orchestration Frameworks
Understand AI architecture patterns including RAG (Retrieval-Augmented Generation), Agentic AI , Graph RAG, AI Assistants & Copilots, Knowledge Management Platforms, Model Orchestration Frameworks
Understand AI architecture patterns including RAG (Retrieval-Augmented Generation), Agentic AI , Graph RAG, AI Assistants & Copilots, Knowledge Management Platforms, Model Orchestration Frameworks
Understand AI architecture patterns including RAG (Retrieval-Augmented Generation), Agentic AI , Graph RAG, AI Assistants & Copilots, Knowledge Management Platforms, Model Orchestration Frameworks
Principal AI Architect
Raleigh, NC · On-site
Define and own enterprise AI and GenAI reference architectures, including LLM platforms, RAG patterns, agentic systems, and multimodal solutions. * Establish standardized architectural patterns for ...
Principal AI Architect
Raleigh, NC · On-site
Define and own enterprise AI and GenAI reference architectures, including LLM platforms, RAG patterns, agentic systems, and multimodal solutions. * Establish standardized architectural patterns for ...
Principal AI Architect
Raleigh, NC · On-site
Define and own enterprise AI and GenAI reference architectures, including LLM platforms, RAG patterns, agentic systems, and multimodal solutions. * Establish standardized architectural patterns for ...
Principal AI Architect
Raleigh, NC · On-site
Define and own enterprise AI and GenAI reference architectures, including LLM platforms, RAG patterns, agentic systems, and multimodal solutions. * Establish standardized architectural patterns for ...
Principal AI Architect
Raleigh, NC · On-site
Define and own enterprise AI and GenAI reference architectures, including LLM platforms, RAG patterns, agentic systems, and multimodal solutions. * Establish standardized architectural patterns for ...
Principal AI Architect
Raleigh, NC · On-site
Define and own enterprise AI and GenAI reference architectures, including LLM platforms, RAG patterns, agentic systems, and multimodal solutions. * Establish standardized architectural patterns for ...
AI Solution Lead Cary, NC Fulltime, Onsite Must Have Technical/Functional Skills * 13+ years of ... Implement and optimize LLM capabilities including embeddings, RAG, vector search, prompt/context ...
Quick apply
AI Solution Lead Cary, NC Fulltime, Onsite Must Have Technical/Functional Skills * 13+ years of ... Implement and optimize LLM capabilities including embeddings, RAG, vector search, prompt/context ...
AVP, AI (Data Science/Engineer) Remote - EST
Raleigh, NC · Remote
$185K - $235K/yr
We build AI-first, agent-driven products that change how Arch underwrites, services, and learns from its book, combining frontier LLMs, multi-agent systems, retrieval-augmented generation (RAG ...
AVP, AI (Data Science/Engineer) Remote - EST
Raleigh, NC · Remote
$185K - $235K/yr
We build AI-first, agent-driven products that change how Arch underwrites, services, and learns from its book, combining frontier LLMs, multi-agent systems, retrieval-augmented generation (RAG ...
AVP, AI (Data Science/Engineer) Remote - EST
Raleigh, NC · Remote
$185K - $235K/yr
We build AI-first, agent-driven products that change how Arch underwrites, services, and learns from its book, combining frontier LLMs, multi-agent systems, retrieval-augmented generation (RAG ...
AVP, AI (Data Science/Engineer) Remote - EST
Raleigh, NC · Remote
$185K - $235K/yr
We build AI-first, agent-driven products that change how Arch underwrites, services, and learns from its book, combining frontier LLMs, multi-agent systems, retrieval-augmented generation (RAG ...
AVP, AI (Data Science/Engineer) Remote - EST
Raleigh, NC · On-site +1
$185K - $235K/yr
We build AI-first, agent-driven products that change how Arch underwrites, services, and learns from its book, combining frontier LLMs, multi-agent systems, retrieval-augmented generation (RAG ...
AVP, AI (Data Science/Engineer) Remote - EST
Raleigh, NC · On-site +1
$185K - $235K/yr
We build AI-first, agent-driven products that change how Arch underwrites, services, and learns from its book, combining frontier LLMs, multi-agent systems, retrieval-augmented generation (RAG ...
AI Solution Lead
Cary, NC · On-site
... RAG), embeddings, vector databases, prompt engineering, and context engineering ✔ Experience packaging, deploying, serving, and monitoring AI/ML models for real-time and batch inference ✔ Hands ...
Quick apply
AI Solution Lead
Cary, NC · On-site
... RAG), embeddings, vector databases, prompt engineering, and context engineering ✔ Experience packaging, deploying, serving, and monitoring AI/ML models for real-time and batch inference ✔ Hands ...
Agentic AI Platform Engineer - Durham, NC, Orlando, FL, Columbia, SC, Atlanta, GA, Charlotte, NC, Ta
Durham, NC · On-site
Mandatory Skills Agentic AI, LangChain, LangGraph, LlamaIndex, MCP, RAG, Python, FastAPI, Kafka, Kubernetes, Azure AI Foundry, Amazon Bedrock, Enterprise Integration. Best Regards: Lucy Rose Phone ...
Agentic AI Platform Engineer - Durham, NC, Orlando, FL, Columbia, SC, Atlanta, GA, Charlotte, NC, Ta
Durham, NC · On-site
Mandatory Skills Agentic AI, LangChain, LangGraph, LlamaIndex, MCP, RAG, Python, FastAPI, Kafka, Kubernetes, Azure AI Foundry, Amazon Bedrock, Enterprise Integration. Best Regards: Lucy Rose Phone ...
Applied AI Engineer
Raleigh, NC · On-site
Develop and optimize Retrieval-Augmented Generation (RAG) systems, including embeddings, vector search, retrieval pipelines, chunking strategies, and relevance tuning. * Build multimodal AI workflows ...
Quick apply
Applied AI Engineer
Raleigh, NC · On-site
Develop and optimize Retrieval-Augmented Generation (RAG) systems, including embeddings, vector search, retrieval pipelines, chunking strategies, and relevance tuning. * Build multimodal AI workflows ...
AI Agentic/Platform Engineer
Raleigh, NC · On-site +1
$130K - $170K/yr
Build advanced RAG pipelines integrating to enhance reasoning accuracy and context retention ... AI/ML engineering, intelligent automation, Enterprise AI platform architecture and lifecycle ...
AI Agentic/Platform Engineer
Raleigh, NC · On-site +1
$130K - $170K/yr
Build advanced RAG pipelines integrating to enhance reasoning accuracy and context retention ... AI/ML engineering, intelligent automation, Enterprise AI platform architecture and lifecycle ...
Google AI Architect
Raleigh, NC · On-site
Build RAG and agentic solutions using Vertex AI Vector Search and BigQuery vector; implement context management, retrieval strategies, and observability. * Define end-to-end architectures across data ...
Google AI Architect
Raleigh, NC · On-site
Build RAG and agentic solutions using Vertex AI Vector Search and BigQuery vector; implement context management, retrieval strategies, and observability. * Define end-to-end architectures across data ...
Responsible AI Governance Specialist
$15.75 - $21/hr
Document explainability and transparency practices, including Agentic AI and RAG architecture, Agentic RAG workflows, source citations, Shepard's validation, reasoning workflows, and grounding in ...
Responsible AI Governance Specialist
$15.75 - $21/hr
Document explainability and transparency practices, including Agentic AI and RAG architecture, Agentic RAG workflows, source citations, Shepard's validation, reasoning workflows, and grounding in ...
Ai Rag information
See Cary, NC salary details
$29.6K - $34K
5% of jobs
$34K - $38.3K
5% of jobs
$38.3K - $42.7K
6% of jobs
$45.2K is the 25th percentile. Wages below this are outliers.
$42.7K - $47K
14% of jobs
$47K - $51.3K
11% of jobs
The median wage is $53.2K / yr.
$51.3K - $55.7K
21% of jobs
$59.5K is the 75th percentile. Wages above this are outliers.
$55.7K - $60K
15% of jobs
$60K - $64.3K
11% of jobs
$64.3K - $68.7K
4% of jobs
$68.7K - $73K
5% of jobs
$73K - $77.4K
3% of jobs
$29.6K
$54K
$77.4K
How much do ai rag jobs pay per year?
What is an AI RAG?
What are the key skills and qualifications needed to thrive as an AI researcher?
What are common challenges faced by AI RAG engineers when integrating retrieval systems with large language models?
What is the difference between Ai Rag vs Data Analyst?
| Aspect | Ai Rag | Data Analyst |
|---|---|---|
| Required Credentials | Typically a diploma or certification in AI, machine learning, or related fields | Bachelor's degree in statistics, mathematics, or related fields |
| Work Environment | Tech companies, AI startups, research labs | Business, finance, healthcare, and various industries |
| Employer & Industry Usage | Primarily in AI development and research | Across industries for data interpretation and decision-making |
| Common Search & Comparison | Yes | Yes |
Ai Rag and Data Analyst roles share overlapping skills in data handling and analysis, but Ai Rag focuses more on AI-specific applications and machine learning, while Data Analysts concentrate on interpreting data to inform business decisions. Both roles are vital in data-driven industries, with Ai Rag often working in AI development environments and Data Analysts supporting strategic insights across sectors.
What are popular job titles related to Ai Rag jobs in Cary, NC?
For Ai Rag jobs in Cary, NC, the most frequently searched job titles are:
What job categories do people searching Ai Rag jobs in Cary, NC look for?
The top searched job categories for Ai Rag jobs in Cary, NC are:
What cities near Cary, NC are hiring for Ai Rag jobs?
Cities near Cary, NC with the most Ai Rag job openings:

Arthur J. Gallagher & Co. rating
7.6
Based on 93 frontline employees who took The Breakroom Quiz
218th of 315 rated insurance
Job description
Overview
The Senior AI Engineering Lead owns the technical delivery of enterprise AI solutions at AJ Gallagher. Reporting to the Director of AI, you will lead the design, build, and deployment of production AI systems - RAG pipelines, agentic workflows, and Copilot integrations - on our Azure and .NET/Python stack. You will set engineering standards for a growing AI team, mentor developers, and partner directly with business units to turn ambiguous problems into shipped, governed, production-grade AI products in a regulated insurance environment.
How you'll make an impact
- Translate Business Problems into Technical Solutions: Work side-by-side with business leaders and subject-matter experts to unpack ambiguous, unstructured challenges and shape them into well-scoped, buildable AI solutions with a clear delivery path.
- Own AI Solution Architecture: Design and defend end-to-end architectures for GenAI and agentic systems on Microsoft Foundry - spanning Azure OpenAI, Azure AI Search, Foundry Tools, and Copilot Studio - that meet enterprise security, scalability, and data-residency requirements.
- Lead Hands-On Delivery: Write and review production code (C#/.NET and Python) for RAG pipelines, AI agent orchestration, and API integrations; remain a strong individual contributor while leading the team.
- Set Engineering Standards: Establish patterns for agentic development, evaluation, testing, CI/CD (Azure DevOps), and observability so AI solutions are repeatable and maintainable - not one-off prototypes.
- Mentor and Grow Engineers: Coach AI developers through design reviews, pairing, and career development; raise the technical bar across the team.
- Ship to Enterprise Surfaces: Deliver AI capabilities into internal applications, Microsoft Teams, and M365 Copilot, integrating through Foundry agents, Service Bus, Azure Functions, and other cloud-native services.
- Build Governance In: Implement responsible-AI controls - Entra ID/RBAC, IaC Policy, human-in-the-loop checkpoints, audit logging - aligned to Gallagher compliance expectations from day one, not as an afterthought.
- Drive Evaluation and Reliability: Define measurable quality bars (groundedness, accuracy, latency, cost) and build the evaluation harnesses to enforce them before and after release.
- Communicate Up and Across: Translate technical trade-offs into clear recommendations for the Director of AI and business stakeholders; manage delivery risks and dependencies proactively.
About You
- Experience: 7 or more years in software engineering, including experience in building LLM/GenAI systems in production and 2+ years leading engineers or owning technical direction.
- Azure Depth: Hands-on production experience with Microsoft Foundry, Azure OpenAI Service, Azure AI Search, and Azure compute (Functions, Container Apps, or App Service).
- Languages: Strong .NET/C# plus working proficiency in Python; able to review and contribute in both.
- GenAI Engineering: Proven delivery of RAG architectures, agent orchestration (Microsoft Agent Framework, Semantic Kernel, or LangChain), and prompt/evaluation pipelines.
- API and Integration Skills: Designing secure REST APIs and event-driven integrations (Azure API Management, Service Bus) within an enterprise identity model (Entra ID, RBAC).
- Delivery Discipline: Agile experience with Azure DevOps (or equivalent) - backlogs, CI/CD, automated testing, and release management.
- Leadership: Track record of mentoring engineers, running design reviews, and owning technical decisions across multiple concurrent initiatives.
- Regulated Industry Experience: Prior AI/ML delivery in insurance, financial services, or healthcare, with familiarity with model risk management or responsible AI guidance.
- Familiarity with AI-enabled and spec-driven development: Using AI-assisted tooling and agent workflows across the SDLC to quickly deliver production-grade systems.
- Experience with Infrastructure-as-Code: Building applications tightly aligned to Terraform-deployed, optimized infrastructure.
- Evaluation and MLOps Maturity: Built LLMOps tooling - automated evals, red-teaming, drift/cost monitoring - at enterprise scale.
- Architecture Credentials: Azure certifications (AZ-305, AI-103) or equivalent demonstrated architecture ownership.
- Bias for Shipped Outcomes: Measures success by working software in users' hands, not demos or decks; cuts scope intelligently to ship.
- Calm Technical Authority: Makes and defends decisions under ambiguity, and changes course quickly when evidence demands it.
- Force Multiplier: Gets more from the team than from their own keyboard - through mentoring, standards, and unblocking others.
- Governance as a Feature: Treats compliance, security, and auditability as design inputs that build trust, not friction to route around.
- Clear Communicator: Explains complex systems simply to executives and precisely to engineers; writes things down.
- Pragmatic Curiosity: Tracks the fast-moving AI landscape but adopts new tools only when they solve a real AJ Gallagher problem.
Compensation and benefits
At Gallagher, we believe supporting our colleagues goes far beyond the role itself. For more information, visit our Benefits page.
- Competitive compensation
- Comprehensive benefits programs designed to support your well-being
- Career development opportunities and ongoing learning
- A collaborative, people-first culture with accessible leadership
- The opportunity to do meaningful work with global reach and local impact
At Gallagher, we are dedicated to building an inclusive and authentic workplace. If your past experience doesn’t align perfectly, we encourage you to join our Talent Community to stay connected to additional career opportunities. At times, we will consider transferable skills from previous roles.
Gallagher is an affirmative action/equal opportunity employer (Minorities/Females/Veterans/Disabled)
Qualifications:- Experience: 7 or more years in software engineering, including experience in building LLM/GenAI systems in production and 2+ years leading engineers or owning technical direction.
- Azure Depth: Hands-on production experience with Microsoft Foundry, Azure OpenAI Service, Azure AI Search, and Azure compute (Functions, Container Apps, or App Service).
- Languages: Strong .NET/C# plus working proficiency in Python; able to review and contribute in both.
- GenAI Engineering: Proven delivery of RAG architectures, agent orchestration (Microsoft Agent Framework, Semantic Kernel, or LangChain), and prompt/evaluation pipelines.
- API and Integration Skills: Designing secure REST APIs and event-driven integrations (Azure API Management, Service Bus) within an enterprise identity model (Entra ID, RBAC).
- Delivery Discipline: Agile experience with Azure DevOps (or equivalent) - backlogs, CI/CD, automated testing, and release management.
- Leadership: Track record of mentoring engineers, running design reviews, and owning technical decisions across multiple concurrent initiatives.
- Regulated Industry Experience: Prior AI/ML delivery in insurance, financial services, or healthcare, with familiarity with model risk management or responsible AI guidance.
- Familiarity with AI-enabled and spec-driven development: Using AI-assisted tooling and agent workflows across the SDLC to quickly deliver production-grade systems.
- Experience with Infrastructure-as-Code: Building applications tightly aligned to Terraform-deployed, optimized infrastructure.
- Evaluation and MLOps Maturity: Built LLMOps tooling - automated evals, red-teaming, drift/cost monitoring - at enterprise scale.
- Architecture Credentials: Azure certifications (AZ-305, AI-103) or equivalent demonstrated architecture ownership.
- Bias for Shipped Outcomes: Measures success by working software in users' hands, not demos or decks; cuts scope intelligently to ship.
- Calm Technical Authority: Makes and defends decisions under ambiguity, and changes course quickly when evidence demands it.
- Force Multiplier: Gets more from the team than from their own keyboard - through mentoring, standards, and unblocking others.
- Governance as a Feature: Treats compliance, security, and auditability as design inputs that build trust, not friction to route around.
- Clear Communicator: Explains complex systems simply to executives and precisely to engineers; writes things down.
- Pragmatic Curiosity: Tracks the fast-moving AI landscape but adopts new tools only when they solve a real AJ Gallagher problem.
What Arthur J. Gallagher & Co. employees say
Pay
Benefits
Hours and flexibility
Workplace
Get the full story on Breakroom
About Arthur J. Gallagher
Sourced by ZipRecruiter
Industry
Insurance services
Company size
10,000+ Employees
Headquarters location
Rolling Meadows, IL, US
Year founded
1927