ZipRecruiter

Log In

1

Ai Rag Jobs in Madison, WI (NOW HIRING)

AgSource

AI Engineer

Watertown, WI

VAS is seeking an AI Engineer to lead building of scalable real-time production grade applications ... Build composable, tool-augmented reasoning chains (e.g., RAG, CoT, ReAct, planner-executor)

Farm Systems

AI Engineer

Watertown, WI · On-site

VAS is seeking an AI Engineer to lead building of scalable real-time production grade applications ... Build composable, tool-augmented reasoning chains (e.g., RAG, CoT, ReAct, planner-executor)

AgSource

AI Engineer

Watertown, WI · On-site +1

VAS is seeking an AI Engineer to lead building of scalable real-time production grade applications ... Build composable, tool-augmented reasoning chains (e.g., RAG, CoT, ReAct, planner-executor)

Urus

AI Engineer

Watertown, WI

VAS is seeking an AI Engineer to lead building of scalable real-time production grade applications ... Build composable, tool-augmented reasoning chains (e.g., RAG, CoT, ReAct, planner-executor)

Urus Group LP

AI Engineer

Watertown, WI · On-site +1

VAS is seeking an AI Engineer to lead building of scalable real-time production grade applications ... Build composable, tool-augmented reasoning chains (e.g., RAG, CoT, ReAct, planner-executor)

Springs Window Fashions

Senior AI Engineer

Middleton, WI

$107K - $147K/yr

Build and operationalize generative AI applications using large language models (LLMs), retrieval-augmented generation (RAG), copilots, and intelligent automation that real people across the business ...

Springs Window Fashions

Senior AI Engineer

Middleton, WI · On-site

$107K - $147K/yr

Build and operationalize generative AI applications using large language models (LLMs), retrieval-augmented generation (RAG), copilots, and intelligent automation that real people across the business ...

Springs Window Fashions

Senior AI Engineer

Middleton, WI · On-site

$107K - $147K/yr

Build and operationalize generative AI applications using large language models (LLMs), retrieval-augmented generation (RAG), copilots, and intelligent automation that real people across the business ...

Springs Window Fashions

AI Engineer II

Middleton, WI

$100K - $137K/yr

Build features for generative AI applications-LLMs, RAG, copilots, and automation-that real people across the business actually use. * Help translate business problems into working prototypes and ...

Springs Window Fashions

AI Engineer II

Middleton, WI · On-site

$100K - $137K/yr

Build features for generative AI applications-LLMs, RAG, copilots, and automation-that real people across the business actually use. * Help translate business problems into working prototypes and ...

Springs Window Fashions

AI Engineer II

Middleton, WI · On-site

$100K - $137K/yr

Build features for generative AI applications--LLMs, RAG, copilots, and automation--that real people across the business actually use. * Help translate business problems into working prototypes and ...

Abbott

Lead AI Platform Engineer

Madison, WI · On-site

$99K - $198K/yr

... RAG), NLP/LLM model development and ensure the end-to-end solution meets all technical and business requirements, and SLA specifications. * Complete the development and deployment of AI models and ...

Abbott

Lead AI Platform Engineer

Madison, WI · On-site

$99K - $198K/yr

... RAG), NLP/LLM model development and ensure the end-to-end solution meets all technical and business requirements, and SLA specifications. * Complete the development and deployment of AI models and ...

Abbott

Lead AI Platform Engineer

Madison, WI

$99K - $198K/yr

... RAG), NLP/LLM model development and ensure the end-to-end solution meets all technical and business requirements, and SLA specifications. * Complete the development and deployment of AI models and ...

Zendesk

Senior Fullstack Engineer, Solve

Madison, WI · On-site

$123K - $162K/yr

... AI-powered conversation engine that resolves customer issues across channels. You'll deliver end-to-end features spanning LLM integrations, RAG retrieval, workflow orchestration, and polished ...

Zendesk

Senior Fullstack Engineer, Solve

Madison, WI

$123K - $162K/yr

... AI-powered conversation engine that resolves customer issues across channels. You'll deliver end-to-end features spanning LLM integrations, RAG retrieval, workflow orchestration, and polished ...

Wolters Kluwer

Senior Legal Counsel

Madison, WI · On-site

$140K - $190K/yr

... RAG") models, large language model ("LLM") model training, and/or other emerging artificial intelligence ("AI") technologies, and (v) business associate agreements and/or data processing agreements.

next page

Showing results 1-20

All JobsAi Rag JobsAi Rag Jobs in Madison, WI

Ai Rag information

See Madison, WI salary details

$32.2K

$58.7K

$84.1K

How much do ai rag jobs pay per year?

As of Aug 7, 2026, the average yearly pay for ai rag in Madison, WI is $58,690.00, according to ZipRecruiter salary data. Most workers in this role earn between $49,400.00 and $65,500.00 per year, depending on experience, location, and employer.

What are the key skills and qualifications needed to thrive as an AI researcher?

To thrive as an AI Researcher, you need a strong background in computer science, mathematics, and machine learning, usually with an advanced degree such as a Master's or Ph.D. Proficiency with programming languages like Python, deep learning frameworks (e.g., TensorFlow, PyTorch), and familiarity with scientific research tools is essential. Critical thinking, creativity, and effective collaboration are vital soft skills for generating novel ideas and working in multidisciplinary teams. These skills and qualities are crucial to drive innovation and solve complex problems in the rapidly evolving field of artificial intelligence.

What is the difference between Ai Rag vs Data Analyst?

AspectAi RagData Analyst
Required CredentialsTypically a diploma or certification in AI, machine learning, or related fieldsBachelor's degree in statistics, mathematics, or related fields
Work EnvironmentTech companies, AI startups, research labsBusiness, finance, healthcare, and various industries
Employer & Industry UsagePrimarily in AI development and researchAcross industries for data interpretation and decision-making
Common Search & ComparisonYesYes

Ai Rag and Data Analyst roles share overlapping skills in data handling and analysis, but Ai Rag focuses more on AI-specific applications and machine learning, while Data Analysts concentrate on interpreting data to inform business decisions. Both roles are vital in data-driven industries, with Ai Rag often working in AI development environments and Data Analysts supporting strategic insights across sectors.

What is an AI RAG?

AI RAGs, or Retrieval-Augmented Generation systems, are a type of artificial intelligence that combines the power of retrieving information from large databases or documents with generating human-like text responses. This approach allows AI models to provide more accurate, up-to-date, and contextually relevant answers by referencing external data sources during the generation process. RAGs are commonly used in applications like chatbots, search engines, and customer support systems, where comprehensive and factual responses are important.

What are common challenges faced by AI RAG engineers when integrating retrieval systems with large language models?

AI RAG engineers often encounter challenges such as ensuring seamless integration between retrieval systems and language models, maintaining low latency for real-time responses, and handling the quality and relevance of retrieved data. Additionally, tuning the system to balance retrieval accuracy with generative fluency can be complex, especially when dealing with large or unstructured datasets. Collaboration with data engineers, ML researchers, and product teams is essential to address these challenges and optimize system performance.
What are popular job titles related to Ai Rag jobs in Madison, WI? For Ai Rag jobs in Madison, WI, the most frequently searched job titles are:
What job categories do people searching Ai Rag jobs in Madison, WI look for? The top searched job categories for Ai Rag jobs in Madison, WI are:
What cities near Madison, WI are hiring for Ai Rag jobs? Cities near Madison, WI with the most Ai Rag job openings:
Ai Rag jobs near you

AI Engineer

AgSource

Watertown, WI

Full-time

Posted 10 days ago

Job description

VAS is seeking an AI Engineer to lead building of scalable real-time production grade applications that use AI/ML models. This is a strategic, hands-on position for an experienced technical leader who has a track record of shipping AI-enhanced customer applications and tooling used by engineering teams.


This role will be focused on embedding LLMs, agent-based systems, and automation into core development workflows-boosting productivity, reducing manual toil, and accelerating delivery, essentially transforming how our engineers build, test, and ship software.

Responsibilities

  • Understand customer challenges and how integrating AI capabilities can help lead to solutions that have AI as a differentiator. 
  • Identify opportunities to apply AI for efficiency, growth, and customer value.
  • Drive awareness of AI capabilities and demonstrate how it can address customer needs, improve efficiency, reduce costs, and drive growth.
  • Drive transformation from AI-Ad Hoc to AI-Native engineering practices.
  • Serve as the AI technical SME, conduct R&D (research and development) to meet the needs of our AI strategy.
  • Continuously assess emerging AI tools and make data-driven recommendations.
  • Measure & Accelerate Adoption: Establish KPIs, track progress from the current to 100% adoption, implement interventions to accelerate uptake and communicate impact.
  • Build Center of Excellence: Create forums for knowledge sharing, celebrate wins, and foster peer-to-peer learning.
  • Establish AI governance frameworks and guardrails covering compliance, security, privacy, and ethical AI practices, and embed them into development workflows.
  • LLM Agents & Prompt Engineering
    • Architect and implement LLM agents.
    • Build composable, tool-augmented reasoning chains (e.g., RAG, CoT, ReAct, planner-executor).
    • Integrate vector databases and knowledge graphs to support retrieval-augmented generation (RAG).
    • Design and maintain high-quality prompt strategies for robustness and reliability.
  • Model Context Protocol (MCP) & Backend
    • Develop and maintain scalable APIs, supporting synchronous and asynchronous agent execution.
    • Integrate Model Context Protocol (MCP) to enable secure and structured access to external data and tools within agent workflows.
    • Implement state tracking, context-aware input dispatch, and modular plugin integration within the control plane.
  • Evaluation, Testing & Observability
    • Build unit and behavioral tests for agents, tools, and workflows.
    • Develop tooling for trace analysis, agent state debugging, and hallucination tracking.
    • Compare and benchmark agent orchestration frameworks for trade-offs in speed, reliability, and usability.
  • Model Fine-Tuning & MLOps
    • Integrate, deploy, fine tune and monitor models in production using cloud providers.
    • Set up agent logging, observability dashboards, and recovery workflows.
  • Front-end & User Experience
    • Collaborate with front-end developers or build user-facing components using React, TypeScript.
    • Ensure seamless user and agent interaction via UI and API bridges.

Education & Experience Requirements

  • Bachelor of Science in Software Engineering, Computer Science, Data Science, AI/ML or related field preferred.
  • 10+ years of experience in software development and design.
  • Proven experience in AI/ML solution design and hands experience with AI-powered development tools. 3+ years of experience preferred. 
  • Strong knowledge of Large Language Models, Generative AI, NLP, and Machine Learning concepts. (3+ years of experience preferred).
  • Hands-on experience with deep learning frameworks. 
  • Experience with RAG pipelines, vector databases, and agentic frameworks.
  • Familiarity with cloud-based AI services.

For the past 40 years we've woken up each day to support those that never stop feeding the world - and we have no plans to quit. We set the standard for farm management solutions and fix our eyes on raising the bar to meet the next generation of expectations.

Our software and information solutions help collect and connect a farm's data - from herd management to feed performance, tracking and more. These insights are a source of truth, empowering producers and their trusted advisors to make profit-driven and sustainable management decisions.

Whether near or far, large or small, VAS is at the heart of your dairy.

VAS has deep roots in the industry through its origin within the URUS family of companies. As a holding company with cooperative and private ownership, URUS is a family of businesses at the heart of the dairy and beef industry - Alta Genetics, GENEX, Genetics Australia, Leachman Cattle, Jetstream, PEAK, SCCL, Trans Ova Genetics and VAS.  Each organization has its unique identity, products, and services. These companies work globally to provide cutting-edge dairy and beef genetics, customized reproductive services to maximize conceptions, dairy management information to take producers to the frontline of progressive dairy farming, and an array of products and services to help bovines reach their full genetic potential. URUS has 9 brands in 17 retail countries and employs nearly 2,800 people globally.

Apply