ZipRecruiter

Log In

2

Entry Level Retrieval Augmented Generation Jobs in Columbus, OH

Peraton

Full Stack & DevSecOps Engineer

Columbus, OH · On-site

$120 - $150/hr

Experience designing and operating retrieval-augmented generation (RAG) systems -- chunking strategies, embedding models, vector stores, hybrid retrieval, reranking, and grounding/citation patterns

New

Crowe LLP

Machine Learning Engineer

Columbus, OH · On-site

$62K - $100K/yr

Knowledge of prompt engineering and retrieval augmented generation (RAG) and experience with advanced AI tools such as ChatGPT Enterprise and Microsoft Copilot, Azure AI Foundry. * Experience in fine ...

All JobsRetrieval Augmented Generation JobsEntry Level Retrieval Augmented Generation JobsEntry Level Retrieval Augmented Generation Jobs in Columbus, OH

Entry Level Retrieval Augmented Generation information

What is an entry level retrieval augmented generation job?

Entry level retrieval augmented generation jobs involve assisting in the development and optimization of AI systems that combine information retrieval techniques with generative models. Employees in these roles typically help build, test, and maintain systems where AI retrieves relevant data from large databases to enhance the accuracy and relevance of generated responses. These positions often require basic skills in programming, machine learning, and familiarity with natural language processing. They are ideal for recent graduates or those new to AI, offering opportunities to learn about modern AI architectures and contribute to innovative projects. Entry level workers may work under the guidance of senior engineers or researchers, supporting experimentation and evaluation tasks.

What are the key skills and qualifications needed to thrive as an entry level retrieval augmented generation specialist?

To thrive as an Entry Level Retrieval Augmented Generation Specialist, you need a foundational understanding of natural language processing (NLP), information retrieval, and basic programming skills, often supported by a degree in computer science or a related field. Familiarity with tools such as Python, vector databases (like FAISS or Pinecone), and frameworks for large language models (LLMs) is typically required. Strong problem-solving abilities, attention to detail, and effective communication help you collaborate and troubleshoot solutions in team environments. These skills and qualities are crucial for building reliable RAG systems that deliver accurate and relevant information to users.

What are some common challenges faced by entry-level professionals working in retrieval augmented generation roles?

Entry-level professionals in Retrieval Augmented Generation (RAG) often encounter challenges such as understanding how to effectively combine information retrieval systems with large language models and adapting to rapidly evolving technologies. Balancing accuracy and efficiency when designing or fine-tuning retrieval pipelines can also be a learning curve. Additionally, you may need to collaborate closely with data engineers, machine learning specialists, and product teams to ensure the RAG system aligns with business requirements. Staying proactive in learning and engaging with peers can help overcome these challenges and accelerate career growth.

What is the difference between Entry Level Retrieval Augmented Generation vs Entry Level Data Scientist?

AspectEntry Level Retrieval Augmented GenerationEntry Level Data Scientist
Required CredentialsBasic programming, understanding of NLP and AI conceptsBachelor's in Data Science, Computer Science, or related field
Work EnvironmentTech companies, AI startups, research labsTech firms, finance, healthcare, consulting
Industry UsageAI development, NLP applications, chatbot creationData analysis, predictive modeling, data-driven decision making

Entry Level Retrieval Augmented Generation focuses on developing AI models that combine retrieval techniques with generative AI, requiring knowledge of NLP and programming. Entry Level Data Scientist involves analyzing data, building models, and deriving insights, often with a broader data analysis skill set. While both roles require technical skills, Retrieval Augmented Generation is more specialized in AI model development, whereas Data Scientists work across various data projects.

What are the most commonly searched types of Retrieval Augmented Generation jobs in Columbus, OH?

The most popular types of Retrieval Augmented Generation jobs in Columbus, OH are:

What are popular job titles related to Entry Level Retrieval Augmented Generation jobs in Columbus, OH?

For Entry Level Retrieval Augmented Generation jobs in Columbus, OH, the most frequently searched job titles are:

What job categories do people searching Entry Level Retrieval Augmented Generation jobs in Columbus, OH look for?

The top searched job categories for Entry Level Retrieval Augmented Generation jobs in Columbus, OH are:

Entry Level Retrieval Augmented Generation jobs near you
Infographic showing various Entry Level Retrieval Augmented Generation job openings in Columbus, OH as of August 2026, with employment types broken down into 69% Full Time, 28% Part Time, and 3% Contract. Highlights an 66% Physical, 4% Hybrid, and 30% Remote job distribution.

AI & Automation Developer - Remote - Sarnova

Sarnova HC, LLC

Dublin, OH • On-site, Remote

Full-time

Retirement

Re-posted 22 days ago

Sarnova rating

8.2

Company rating: 8.2 out of 10

Based on 11 frontline employees who took The Breakroom Quiz

Job description

Summary:
We're building the future of intelligent systems-and we're looking for an AI and Automation Engineer to help lead the charge. In this role, you'll design, build, and deploy scalable automation solutions that drive efficiency, reduce manual work, and accelerate innovation across the organization.
You'll work closely with teammates in Information Technology as well as business stakeholders to identify automation opportunities and turn them into reliable, AI-driven workflows. From robotic process automation (RPA) to workflow orchestration and generative AI, your work will have a measurable impact in helping to shape Sarnova's future.
Essential Duties and Responsibilities:
  • Design, develop, deploy, and support AI agents using Azure AI Foundry and Microsoft Copilot Studio.

  • Build conversational, autonomous, and multi-agent solutions using the Foundry SDK, Agent Framework, Responses API, Copilot Studio, and related Microsoft AI technologies.

  • Design prompt-based and hosted agents, selecting and optimizing models based on business requirements, performance, quality, and cost.

  • Integrate AI solutions with enterprise data and business systems through APIs, MCP, Power Platform, Dataverse, Dynamics 365, Azure Functions, custom services, and external platforms.

  • Implement Retrieval-Augmented Generation (RAG) and knowledge-grounding solutions using Azure AI Search, Foundry IQ, and enterprise knowledge sources.

  • Design and orchestrate multi-agent workflows, Agent-to-Agent (A2A) coordination, routing, and human-in-the-loop processes.

  • Develop scalable, reusable, secure, and enterprise-ready AI automation solutions.

  • Monitor, troubleshoot, evaluate, and continuously improve AI solution quality, reliability, safety, and performance.

  • Create technical documentation, testing assets, operational playbooks, and implementation standards.

  • Collaborate with business and technical stakeholders to identify, prioritize, and deliver AI-driven solutions that provide measurable business value.

  • Stay current with emerging AI technologies and advancements across Azure AI Foundry, Copilot Studio, Power Platform, and the Microsoft AI ecosystem.

Skills/Experience Required:
  • 2+ years of experience in AI development, automation engineering, software development, or a related field.

  • Hands-on experience designing, developing, deploying, and supporting AI agents using Azure AI Foundry and Microsoft Copilot Studio.

  • Experience with agent development and orchestration, including prompt-based and hosted agents, Foundry SDK, Agent Framework, Responses API, multi-agent workflows, and agent integrations.

  • Experience implementing Retrieval-Augmented Generation (RAG) and knowledge-grounding solutions using Azure AI Search, vector search, embeddings, and citation-based responses.

  • Experience building conversational and autonomous agents in Copilot Studio, including generative answers, knowledge grounding, and workflow automation.

  • Experience integrating AI solutions with Power Platform, Dataverse, Dynamics 365, APIs, Azure Functions, microservices, and enterprise applications.

  • Proficiency in Python (preferred), C#, and/or JavaScript/TypeScript, along with modern development tools such as VS Code, Git, Azure DevOps, and Azure CLI.

  • Knowledge of Model Context Protocol (MCP), custom function tools, external integrations, and API-driven architectures.

  • Strong understanding of leading LLMs, prompt engineering, context management, conversational memory, model evaluation, and AI solution optimization.

  • Experience with Azure services including Azure Functions, Azure AI Search, Storage, Key Vault, Microsoft Entra ID, and microservice-based solutions.

  • Working knowledge of SQL Server, data integration concepts, SharePoint, and Dynamics 365 Finance & Operations and CRM applications.

  • Familiarity with observability, monitoring, application logging, security, Responsible AI practices, governance, and CI/CD deployment processes.

  • Experience delivering automation solutions using Power Automate, UiPath, or similar workflow and automation platforms.

  • Strong analytical, communication, and stakeholder collaboration skills with the ability to translate business requirements into scalable technical solutions

Preferred Qualifications:
  • Bachelor's degree in Computer Science, Software Engineering, Data Science, Information Technology, or a related field; equivalent practical experience will also be considered.

  • Microsoft certifications related to Azure AI, AI Engineering, Power Platform, Copilot Studio, or Agent Development (e.g., Azure AI Engineer Associate or successor certifications).

  • Experience in healthcare, regulated, distribution, manufacturing, or other compliance-focused industries with an understanding of security, privacy, and governance requirements.

Experience with one or more of the following advanced Microsoft AI capabilities is highly desirable:
  • Deploying and managing hosted agents in Azure AI Foundry, including managed runtimes, identity, observability, and enterprise governance.

  • Designing multi-agent architectures, Agent-to-Agent (A2A) coordination, autonomous workflows, and human-in-the-loop processes.

  • Developing and maintaining MCP servers, MCP tool catalogs, reusable agent tools, and custom function integrations.

  • Leveraging Foundry IQ, Azure AI Search, and advanced RAG architectures for enterprise knowledge grounding and retrieval.

  • Utilizing advanced Azure AI Foundry capabilities such as built-in agent tools, managed memory, evaluation frameworks, observability, guardrails, and governance controls.

  • Publishing and managing agents across Microsoft Teams, Microsoft 365 Copilot, Dynamics 365, and custom web experiences.

  • Implementing enterprise AI governance, DLP policies, ALM strategies, environment management, and Responsible AI frameworks.

  • Experience integrating AI solutions with Microsoft Fabric, Power BI, advanced analytics platforms, or enterprise data ecosystems.

  • Knowledge of Microsoft Entra Agent ID, managed identities, enterprise authentication, and secure agent access patterns.

Physical Requirements:
  • Sit, walk, stand, use hands to manipulate, handle, feel, and control items or equipment

  • Reach with hands and arms

  • Talk and hear

  • See and be able to read, write, and interpret text

  • Employee may use computer, phone, copier and other office equipment in the course of a day

  • Occasionally lift and move objects weighing up to 10 pounds

  • Employee may be required to travel for business purposes

  • When working remotely, ability to secure confidential information

  • When working remotely, perform all duties in a professional environment free of noise or anything that would create a negative customer experience

Work environment characteristics described here are representative of those that must be met by an employee to successfully perform the essential function of this job. Reasonable accommodations may be made to enable individuals with disabilities to perform the essential functions. Continuous is defined as 6-8 hours, frequently is defined as 3-6 hours, and occasionally is defined as up to 3 hours.
Work Schedule: Employee will be required to work a minimum of forty (40) hours of per week or as many hours as it may take to perform above job duties. Schedule may vary based on business demands and will require a combination of office hours as well as work performed after hours and/or weekends at times.
Sarnova is an Equal Opportunity Employer. We offer a competitive salary, commensurate with experience, along with a comprehensive benefits package, including 401(k) Plan. EEO/M/F/Veterans/Disabled. Our mission is to be the best partner for those who save and improve patients' lives. Excellence in delivering upon our mission is dependent upon having a diverse team that is empowered to bring their full, authentic self to work each day. We strive to create a workplace that reflects the communities we serve, and we are passionate

What Sarnova employees say

Pay

Benefits

Hours and flexibility

Workplace

Get the full story on Breakroom

Apply