1

Retrieval Augmented Generation Jobs in Indiana (NOW HIRING)

Sr. AI Engineer

Indianapolis, IN · On-site

$99K - $137K/yr

Build and implement RAG (Retrieval-Augmented Generation) systems to dramatically improve AI accuracy, including knowledge retrieval pipelines and semantic search optimization for large-scale datasets

Sr. AI Engineer

Indianapolis, IN · On-site

$99K - $137K/yr

Build and implement RAG (Retrieval-Augmented Generation) systems to dramatically improve AI accuracy, including knowledge retrieval pipelines and semantic search optimization for large-scale datasets

Lead Engineer

Indianapolis, IN · On-site

$89K - $118K/yr

... retrieval-augmented generation (RAG) pipelines integrating LLMs with enterprise document repositories and vector search backends. • Standardize prompt engineering frameworks, contextual grounding ...

Production experience with Claude, ChatGPT, and Microsoft Copilot, including prompt engineering, agentic workflows, retrieval-augmented generation, and at least one orchestration or agent framework.

... retrieval-augmented generation, agentic workflows, workflow automation, rules-based components, or hybrid approaches based on business need, data readiness, feasibility, risk, scalability, and ...

Lead Engineer

Indianapolis, IN · On-site

$97K - $129K/yr

Advanced Prompting, RAG & Model Evaluation · Build and operationalize retrieval-augmented generation (RAG) pipelines integrating LLMs with enterprise document repositories and vector search backends ...

Senior Legal Counsel

Indianapolis, IN

$133K - $181K/yr

... retrieval augmented generation ("RAG") models, large language model ("LLM") model training, and/or other emerging artificial intelligence ("AI") technologies, and (v) business associate agreements ...

Senior Legal Counsel

Indianapolis, IN · On-site

$133K - $181K/yr

... retrieval augmented generation ("RAG") models, large language model ("LLM") model training, and/or other emerging artificial intelligence ("AI") technologies, and (v) business associate agreements ...

Senior Legal Counsel

Indianapolis, IN · Hybrid

$133K - $181K/yr

... retrieval augmented generation ("RAG") models, large language model ("LLM") model training, and/or other emerging artificial intelligence ("AI") technologies, and (v) business associate agreements ...

Senior Legal Counsel

Indianapolis, IN · Hybrid

$133K - $181K/yr

... retrieval augmented generation ("RAG") models, large language model ("LLM") model training, and/or other emerging artificial intelligence ("AI") technologies, and (v) business associate agreements ...

next page

Showing results 1-20

Retrieval Augmented Generation information

What are the typical daily responsibilities of a Retrieval Augmented Generation engineer?

A Retrieval Augmented Generation engineer typically spends their day designing and implementing systems that combine information retrieval with advanced generative models, such as large language models. This includes fine-tuning models, integrating external data sources, developing vector search pipelines, and evaluating output quality. Collaboration with data scientists, machine learning engineers, and product teams is common to ensure the solutions meet user requirements and scale effectively. Additionally, RAG engineers often troubleshoot issues, monitor model performance in production, and stay informed about the latest advancements in AI and information retrieval.

What is a Retrieval Augmented Generation job?

A Retrieval Augmented Generation (RAG) job typically involves developing and optimizing AI systems that enhance text generation by incorporating external knowledge retrieved from relevant sources. Professionals in this field work on integrating retrieval mechanisms with large language models to improve the relevance, accuracy, and factual grounding of generated content. Common responsibilities include designing retrieval systems, fine-tuning language models, optimizing performance, and ensuring the seamless integration of factual data into AI-generated text. This role is highly interdisciplinary, involving expertise in natural language processing (NLP), machine learning, and information retrieval.

What are the key skills and qualifications needed to thrive in the Retrieval Augmented Generation position, and why are they important?

To thrive in a Retrieval Augmented Generation (RAG) engineering role, you need a solid background in machine learning, natural language processing (NLP), and experience with scalable information retrieval systems, typically supported by a relevant degree in computer science or a related field. Familiarity with tools such as Python, PyTorch or TensorFlow, vector databases, and search platforms like Elasticsearch is essential, along with practical experience deploying and tuning RAG pipelines. Strong problem-solving skills, a collaborative mindset, and effective communication abilities set outstanding professionals apart in this field. These competencies are crucial for designing, implementing, and optimizing hybrid retrieval-generation AI systems that address complex, real-world information needs.

What are the most commonly searched types of Retrieval Augmented Generation jobs in Indiana? The most popular types of Retrieval Augmented Generation jobs in Indiana are:
What are popular job titles related to Retrieval Augmented Generation jobs in Indiana? For Retrieval Augmented Generation jobs in Indiana, the most frequently searched job titles are:
What job categories do people searching Retrieval Augmented Generation jobs in Indiana look for? The top searched job categories for Retrieval Augmented Generation jobs in Indiana are:
What cities in Indiana are hiring for Retrieval Augmented Generation jobs? Cities in Indiana with the most Retrieval Augmented Generation job openings:
Infographic showing various Retrieval Augmented Generation job openings in Indiana as of June 2026, with employment types broken down into 100% Full Time. Highlights an 56% In-person, 11% Hybrid, and 33% Remote job distribution.
Sr. AI Engineer

Sr. AI Engineer

ZYLO, INC.

Indianapolis, IN • On-site

$99K - $137K/yr

Other

Posted yesterday


Job description

Description

Zylo is the enterprise leader in SaaS Management, enabling companies to discover, manage, and optimize their SaaS applications. Zylo helps companies reduce costs and minimize risk by centralizing SaaS inventory, license, and renewal management. Trusted by industry leaders, Zylo's AI-powered platform provides unmatched visibility into SaaS usage and spend. Powered by the industry's most intelligent discovery engine, Zylo continuously uncovers hidden SaaS applications, giving companies greater control over their SaaS portfolio. With more than 30 million SaaS licenses and $75 billion in SaaS spend under management, Zylo delivers the deepest insights, backed by more data than any other provider.


Overview

We are seeking an experienced Senior AI Engineer to lead the evolution of our enterprise SaaS platform's agentic AI capabilities. You'll drive strategic AI initiatives that solve complex client problems while working with large-scale datasets for global enterprise customers. This role combines deep technical expertise in AI agents, RAG systems, and enterprise integration with strategic thinking about how AI can transform our platform and deliver exceptional business value..


What you will do

  • Drive strategic AI initiatives that directly impact client success and business growth, defining technical roadmaps and influencing product strategy to solve complex enterprise problems
  • Architect and enhance our agentic processes for enterprise-scale deployments, building sophisticated multi-agent orchestration patterns for complex workflows
  • Design advanced agent memory systems and context management solutions that maintain coherence across long-running conversations and extended enterprise tasks
  • Build and implement RAG (Retrieval-Augmented Generation) systems to dramatically improve AI accuracy, including knowledge retrieval pipelines and semantic search optimization for large-scale datasets
  • Develop enterprise-grade MCP (Model Context Protocol) services enabling seamless client agent integration with standardized APIs, security protocols, and comprehensive documentation
  • Leverage AWS technologies (Bedrock, Lambda, etc) to architect AI solutions with optimal performance, cost efficiency, and enterprise-scale LLM integration
  • Design and optimize schemas for storing LLM interactions, agent state, and conversation history while building monitoring systems for AI operations
  • Lead cross-functional initiatives to integrate AI throughout our platform ecosystem, partnering with product and engineering teams to deliver measurable business value
  • Translate complex technical AI concepts into business value, working directly with enterprise clients to understand their needs and influence strategic platform decisions
  • Mentor engineering teams on AI best practices, emerging technologies, and enterprise AI governance while maintaining high engineering standards for production AI systems.

Requirements

What you need

  • Bachelor's or Master's degree in Data Science, Computer Science, Statistics, Mathematics, or a related field.
  • 5+ years of experience in AI/ML engineering with at least 2 years in a senior role
  • Proven experience building and deploying AI agents or conversational AI systems in production
  • Experience working with large-scale enterprise datasets and SaaS platforms.
  • Expertise in design patterns for memory systems and context management solutions and optimization for AI workloads
  • Experience with Amazon Bedrock and AWS Lambda for serverless AI deployments
  • Experience with RAG systems, vector databases, and semantic search
  • Understanding of Model Context Protocol (MCP) and AI agent integration patterns
  • Proficiency in programming languages such as Python, PySpark, SQL and ML frameworks such as TensorFlow, PyTorch..
  • Knowledge of enterprise security patterns and compliance requirements
  • Ability to articulate technical concepts to technical and non-technical stakeholders.
  • Ability to thrive in a fast-paced, dynamic environment.
  • Flexibility to adapt to changing priorities and requirements.

Nice to have

  • Experience in SaaS Management or Software Asset Management.
  • Ph.D. in Data Science, Computer Science, Statistics, Mathematics, or a related field.
  • Knowledge of ethical AI, bias mitigation, and AI safety best practices
  • Experience with LangChain and LangGraph frameworks

At Zylo, we're committed to Growing Stronger Together by fostering a diverse and inclusive workplace. We believe that a variety of perspectives not only fuels innovation, but also allows us to better serve our diverse customer base. If you meet the essential qualifications, we encourage you to apply and join us on this journey. Still growing in your career? Connect with our talent community-we're always looking for future Zylos who share our passion for continuous learning.