2

Remote Rag Jobs in Chicago, IL (NOW HIRING)

Integrate custom LLM embeddings, retrieval-augmented generation (RAG), and automation pipelines ... Employee divides their time between in-office and remote work. Access to an office location is ...

AI Agent Engineer

Chicago, IL · Remote

$125K - $175K/yr

Experience with agent design patterns including prompt engineering, RAG architectures, tool ... Fully remote with a collaborative, low-ego team that has been building software together for over a ...

Posting Type Remote Job Overview We are seeking a Staff Search Engineer to join the Retrieval ... search, embeddings, RAG) approaches. * Drive adoption of retrieval best practices: query ...

AI Agent Engineer

Chicago, IL · On-site +1

$125K - $175K/yr

Experience with agent design patterns including prompt engineering, RAG architectures, tool ... Fully remote with a collaborative, low-ego team that has been building software together for over a ...

AI Agent Engineer

Chicago, IL · Remote

$125K - $175K/yr

Experience with agent design patterns including prompt engineering, RAG architectures, tool ... Fully remote with a collaborative, low-ego team that has been building software together for over a ...

Practical experience with LLM orchestration (RAG, Prompt Engineering) and frameworks like LangChain ... We are proud to be an equal opportunity workplace. #LI-Remote

AI Architect

Chicago, IL · Remote

$140K - $180K/yr

Remote (US or Canada) Rate: $140,000-$180,000 USD (rates vary in Canada) Position Overview ... Architect agentic systems, RAG pipelines, and AI-augmented workflows across the Microsoft, OpenAI ...

Sr. AI Architect

Chicago, IL · Remote

$180K - $225K/yr

Remote (US or Canada) Rate: $180,000-$225,000 USD (rates vary in Canada) Position Overview ... Architect agentic systems, RAG pipelines, and AI-augmented workflows across the Microsoft, OpenAI ...

AI Architect

Chicago, IL · On-site +1

$140K - $180K/yr

Remote (US or Canada) Rate: $140,000-$180,000 USD (rates vary in Canada) Position Overview ... Architect agentic systems, RAG pipelines, and AI-augmented workflows across the Microsoft, OpenAI ...

Sr. AI Architect

Chicago, IL · On-site +1

$180K - $225K/yr

Remote (US or Canada) Rate: $180,000-$225,000 USD (rates vary in Canada) Position Overview ... Architect agentic systems, RAG pipelines, and AI-augmented workflows across the Microsoft, OpenAI ...

next page

Showing results 1-20

People also search for

Remote Rag information

See Chicago, IL salary details

$17

$22

$24

How much do remote rag jobs pay per hour?

As of May 31, 2026, the average hourly pay for remote rag in Chicago, IL is $22.15, according to ZipRecruiter salary data. Most workers in this role earn between $18.56 and $23.51 per hour, depending on experience, location, and employer.

What are the key skills and qualifications needed to thrive as a Remote Rag, and why are they important?

I'm sorry, but 'Remote Rag' does not appear to be a recognized professional occupation. Please provide a valid job title.

What are some common challenges faced by professionals working in a remote RAG (Responsible AI Governance) role?

Professionals in remote RAG roles often encounter challenges related to cross-functional collaboration and maintaining clear communication, especially when working across different time zones. Ensuring alignment on ethical AI standards and compliance requirements can be complex, as it typically involves coordinating with data scientists, legal teams, and business stakeholders. Staying current with evolving regulatory frameworks and best practices in AI governance is also essential, demanding continuous learning and adaptability. Building trust and rapport within a remote team can require extra effort, but leveraging digital collaboration tools and regular check-ins can help mitigate these challenges.

What is a Remote RAG (Retrieval-Augmented Generation) specialist?

A Remote RAG specialist is a professional who works with Retrieval-Augmented Generation (RAG) systems, typically in the field of artificial intelligence and machine learning. RAG combines traditional information retrieval techniques with generative models like large language models to provide more accurate and contextually relevant answers to user queries. Remote RAG specialists often build, fine-tune, and maintain these systems while working from a remote location. They may also work on integrating RAG models into applications, improving retrieval accuracy, and customizing outputs based on user needs.
What are the most commonly searched types of Rag jobs in Chicago, IL? The most popular types of Rag jobs in Chicago, IL are:
What cities near Chicago, IL are hiring for Remote Rag jobs? Cities near Chicago, IL with the most Remote Rag job openings:
AVP, AI Data Engineering, Customer Data Ecosystem

AVP, AI Data Engineering, Customer Data Ecosystem

The Hartford

Naperville, IL • On-site, Remote

$114.30K - $137.30K/yr

Full-time

Posted 5 days ago


The Hartford rating

8.8

Company rating: 8.8 out of 10

Based on 103 frontline employees who took The Breakroom Quiz

53rd of 259 rated insurance


Job description

AVP Data Engineering - GE05AE

We're determined to make a difference and are proud to be an insurance company that goes well beyond coverages and policies. Working here means having every opportunity to achieve your goals - and to help others accomplish theirs, too. Join our team as we help shape the future.

As an AVP of AI Data Engineering for Customer Data Ecosystem (CDE), you will be responsible for defining and advancing the consumer AI-ready data architecture that enables agentic analytics, GenAI applications, and differentiated customer and operational experiences. This role ensures data foundations, context, and engineering patterns are scalable, secure, reusable, and aligned across CDE, applied AI, and enterprise architecture partners. This role will lead a small, high-leverage team of architects, semantic engineers, and innovation team, and serves as the senior technical authority for AI-ready data design within CDE.

This role can have a Hybrid or Remote work schedule. Candidates who live near one of our office locations will have the expectation of working in an office 3 days a week (Tuesday through Thursday) Candidates who do not live near an office will have a remote work arrangement, with the expectation of coming into an office as business needs arise. Must be eligible to work in the US without company sponsorship.

Primary Job Responsibilities

  • Strategy and Execution: Lead the strategy and execution of complex and large Data and Analytics portfolio.

  • Architecture and Solution: Ensure data architecture and solutions align with enterprise-wide standards for Data, AI and Analytics.

  • Effectively communicate strategy, execution progress, and outcomes to diverse stakeholders and promote data capabilities through thought leadership and presentations.

  • AI Data Engineering leader responsible for Implementing AI data pipelines that integrate structured, semi-structured, and unstructured data to support AI and Agentic solutions.

  • Real-Time Data Streaming: Design, build and maintain scalable real-time data pipelines for efficient ingestion, processing, and delivery.

  • Define and operationalize ontologies, context graphs, and knowledge graphs across domains to power reasoning, explainability, and decision intelligence.

  • Lead the design and execution of enterprise-scale semantic layers to standardize business meaning and enable trusted analytics, AI, and Agentic use cases.

  • Enable semantic-first AI and Agentic analytics, ensuring LLMs and agents can consume governed business context, metrics, and rules.

  • Drive production-scale execution of semantic and knowledge platforms with strong standards for performance, governance, security, and lifecycle management.

  • Drive best practices in AI data engineering by establishing standardized processes, promoting cutting-edge technologies, and ensuring data quality and compliance across the enterprise.

  • Leadership: Build, mentor, and lead a high-performing team including Directors, Business data analysts, Data engineers and Release train engineers.

  • Drive efficiency and Productivity: Identify and champion AI augmented productivity improvements across the end-to-end data management lifecycle. This includes researching and implementing innovative solutions such as AI-driven auto-generation of data pipelines, advanced DevOps practices for data and automated data quality frameworks.

  • Technology Evaluation & Adoption: Stay current with emerging trends in Agentic AI and data engineering and lead proof-of-concepts and early pilots for emerging data and AI augmented technologies to accelerate speed to market.

  • Data Governance, Stewardship and Quality: Define and implement robust data management frameworks to ensure successful adoption of Enterprise Data Governance and Data Quality practices.

  • Budget Management: Effectively manage the budget and financials for the portfolio.

  • Develop deep partnerships and alignment with the portfolio and agile value stream frameworks. Experience with Agile at Scale and iterative development through cross-functional teams.

  • Partners with Technology, Data, AI COE, Applied AI and Architecture teams to influence technology, data, platform and tooling strategy.

  • Evangelize Agentic Data Engineering, driving adoption through patterns, playbooks, and real-world deployments across the enterprise.

Skills
  • Mastery level data engineering and architecture skills, including deep expertise in data architecture patterns, lakehouses, data integration, data domains, data products, conversational business intelligence, and cloud technology capabilities.

  • Mastery in implementing scalable AI driven data systems supporting agentic solutions (AWS Lambda, S3, EC2, Langchain, Langgraph, MCP, A2A).

  • Technical expertise in LLMs, AI platforms, prompt engineering, LLM optimization, Retrieval-Augmented Generation (RAG) architectures and vector database technologies (Vertex AI, Postgres, OpenSearch, Pinecone etc.).

  • Experience in multi cloud environment.

  • Experience in Lang chain, AI agents, Vertex AI and Google Agent ecosystem.

  • Strong experience with the design and development of complex data ecosystems leveraging next-generation cloud technology stack across AWS or GCP Cloud and Snowflake.

  • Exceptional presentation and verbal/written communication skills; must be able to communicate effectively at all levels across the organization.

  • Ability to lead successfully in a lean, agile, and fast-paced organization, leveraging Scaled Agile principles and ways of working.

  • Excellent negotiation, influencing, and conflict resolution skills; adept at building strong cross-functional relationships.

  • Preferred experience in the Property & Casualty insurance industry.

Education, Experience, Certifications and Licenses
  • Bachelor's or Master's degree in Computer Science, Data Science or a related field.

  • 12+ years in data engineering, data management and building large-scale data ecosystems.

  • 7+ years in senior leadership roles managing complex data and AI portfolio with hands-on experience.

  • Expertise in real-time data streaming, agentic frameworks, Data APIs, vector stores, and RAG architecture, self-serve analytics and AI.

  • Deep expertise in semantic layer architecture, ontology modeling, and knowledge graph design at enterprise scale.

  • Experience integrating knowledge graphs with LLMs, RAG pipelines, vector stores, and Agentic frameworks.

  • Strong understanding of context-aware data engineering and semantic interoperability.

  • Proven ability to move from strategy pilot scaled enterprise capability.

  • Strong executive influence and thought leadership in Agentic analytics and AI native data engineering.

Compensation

The listed annualized base pay range is primarily based on analysis of similar positions in the external market. Actual base pay could vary and may be above or below the listed range based on factors including but not limited to performance, proficiency and demonstration of competencies required for the role. The base pay is just one component of The Hartford's total compensation package for employees. Other rewards may include short-term or annual bonuses, long-term incentives, and on-the-spot recognition. The annualized base pay range for this role is:

$182,000 - $273,000

Equal Opportunity Employer/Sex/Race/Color/Veterans/Disability/Sexual Orientation/Gender Identity or Expression/Religion/Age

About Us|Our Culture|What It's Like to Work Here|Perks & Benefits


What The Hartford employees say

Pay

Benefits

Hours and flexibility

Workplace

Get the full story on Breakroom


Hartford logo

About Hartford

Sourced by ZipRecruiter

Hartford Financial Services Group, widely recognized as The Hartford, is a renowned company based in Hartford, CT, US. Established in 1810, it has evolved into an industry leader in the insurance and financial services sector, proudly serving more than one million businesses in the US. The Hartford is committed to offering a gamut of insurance products that include homeowners, automobile, and business insurance as well as employee benefits and mutual funds. The company’s core values revolve around customer-focused innovations, diversity and inclusion, and ethical dealings that have earned them a customer-centric reputation. This shapes their mission which revolves around aiding their clients to overcome unforeseen obstacles and enhancing their wealth over time. Among the company's noted accomplishments is being consistently listed among the World's Most Ethical Companies, a testament to their unwavering commitment towards responsible business practices.

Industry

Finance and insurance

Company size

10,000+ Employees

Headquarters location

Hartford, CT, US

Year founded

1810

Social media