ZipRecruiter

Log In

1

Ai Rag Jobs in Madison, WI (NOW HIRING)

EM Key Solutions Inc

AI Engineer

Oregon, WI · On-site

$120 - $190/hr

Build AI Copilots, AI Agents, and Retrieval‑Augmented Generation (RAG) solutions to improve software engineering, testing, documentation, and operational workflows. * Develop intelligent automation ...

EM Key Solutions Inc

Temporary AI Engineer

Oregon, WI · On-site

$120 - $170/hr

Build AI Copilots, AI Agents, and Retrieval-Augmented Generation (RAG) solutions to improve software engineering, testing, documentation, and operational workflows. * Develop intelligent automation ...

Springs Window Fashions

Senior AI Engineer

Middleton, WI

$107K - $147K/yr

Build and operationalize generative AI applications using large language models (LLMs), retrieval-augmented generation (RAG), copilots, and intelligent automation that real people across the business ...

Springs Window Fashions

Senior AI Engineer

Middleton, WI

$107K - $147K/yr

Build and operationalize generative AI applications using large language models (LLMs), retrieval-augmented generation (RAG), copilots, and intelligent automation that real people across the business ...

Springs Window Fashions

Senior AI Engineer

Middleton, WI · On-site

$107K - $147K/yr

Build and operationalize generative AI applications using large language models (LLMs), retrieval-augmented generation (RAG), copilots, and intelligent automation that real people across the business ...

Imedica

Senior AI Engineer

Madison, WI

$120K - $158K/yr

You own complex AI solutions from technical design through production operation and help establish ... Can articulate when to use RAG, prompting, structured workflows, agents, fine-tuning, or ...

Medica Services Company LLC

Senior AI Engineer

Madison, WI · On-site

$120K - $158K/yr

You own complex AI solutions from technical design through production operation and help establish ... Can articulate when to use RAG, prompting, structured workflows, agents, fine-tuning, or ...

Abbott

Sr. Engineer, AI Platform

Madison, WI · On-site

$99K - $198K/yr

... RAG), NLP/LLM model development and ensure the end-to-end solution meets all technical and business requirements, and SLA specifications. * Complete the development and deployment of AI models and ...

Abbott

Sr. Engineer, AI Platform

Madison, WI · On-site

$99K - $198K/yr

... RAG), NLP/LLM model development and ensure the end-to-end solution meets all technical and business requirements, and SLA specifications. * Complete the development and deployment of AI models and ...

Abbott

Sr. Engineer, AI Platform

Madison, WI · On-site

$99K - $198K/yr

... RAG), NLP/LLM model development and ensure the end-to-end solution meets all technical and business requirements, and SLA specifications. * Complete the development and deployment of AI models and ...

NELNET BUSINESS SOLUTIONS

AI Engineer

Madison, WI · On-site

Our AI Engineer role sits at the center of that work: building, operating, and scaling the AI ... Design retrieval and context strategies (RAG, structured data access, caching, chunking, ranking ...

Abbott Laboratories

Sr. Engineer, AI Platform

Madison, WI · On-site

$99 - $199/hr

... RAG), NLP/LLM model development and ensure the end-to-end solution meets all technical and business requirements, and SLA specifications. * Complete the development and deployment of AI models and ...

Zendesk

Senior Fullstack Engineer, Solve

Madison, WI · On-site

$123K - $162K/yr

... AI-powered conversation engine that resolves customer issues across channels. You'll deliver end-to-end features spanning LLM integrations, RAG retrieval, workflow orchestration, and polished ...

Zendesk

Senior Fullstack Engineer, Solve

Madison, WI · On-site

$123K - $162K/yr

... AI-powered conversation engine that resolves customer issues across channels. You'll deliver end-to-end features spanning LLM integrations, RAG retrieval, workflow orchestration, and polished ...

Wolters Kluwer

Senior Legal Counsel

Madison, WI · On-site

$140K - $190K/yr

... RAG") models, large language model ("LLM") model training, and/or other emerging artificial intelligence ("AI") technologies, and (v) business associate agreements and/or data processing agreements.

Wolters Kluwer

Senior Legal Counsel

Madison, WI · On-site

$140K - $190K/yr

... RAG") models, large language model ("LLM") model training, and/or other emerging artificial intelligence ("AI") technologies, and (v) business associate agreements and/or data processing agreements.

next page

Showing results 1-20

All JobsAi Rag JobsAi Rag Jobs in Madison, WI

Ai Rag information

See Madison, WI salary details

$32.2K

$58.7K

$84.1K

How much do ai rag jobs pay per year?

As of Aug 28, 2026, the average yearly pay for ai rag in Madison, WI is $58,690.00, according to ZipRecruiter salary data. Most workers in this role earn between $49,400.00 and $65,500.00 per year, depending on experience, location, and employer.

What is an AI RAG?

AI RAGs, or Retrieval-Augmented Generation systems, are a type of artificial intelligence that combines the power of retrieving information from large databases or documents with generating human-like text responses. This approach allows AI models to provide more accurate, up-to-date, and contextually relevant answers by referencing external data sources during the generation process. RAGs are commonly used in applications like chatbots, search engines, and customer support systems, where comprehensive and factual responses are important.

What are the key skills and qualifications needed to thrive as an AI researcher?

To thrive as an AI Researcher, you need a strong background in computer science, mathematics, and machine learning, usually with an advanced degree such as a Master's or Ph.D. Proficiency with programming languages like Python, deep learning frameworks (e.g., TensorFlow, PyTorch), and familiarity with scientific research tools is essential. Critical thinking, creativity, and effective collaboration are vital soft skills for generating novel ideas and working in multidisciplinary teams. These skills and qualities are crucial to drive innovation and solve complex problems in the rapidly evolving field of artificial intelligence.

What are common challenges faced by AI RAG engineers when integrating retrieval systems with large language models?

AI RAG engineers often encounter challenges such as ensuring seamless integration between retrieval systems and language models, maintaining low latency for real-time responses, and handling the quality and relevance of retrieved data. Additionally, tuning the system to balance retrieval accuracy with generative fluency can be complex, especially when dealing with large or unstructured datasets. Collaboration with data engineers, ML researchers, and product teams is essential to address these challenges and optimize system performance.

What is the difference between Ai Rag vs Data Analyst?

AspectAi RagData Analyst
Required CredentialsTypically a diploma or certification in AI, machine learning, or related fieldsBachelor's degree in statistics, mathematics, or related fields
Work EnvironmentTech companies, AI startups, research labsBusiness, finance, healthcare, and various industries
Employer & Industry UsagePrimarily in AI development and researchAcross industries for data interpretation and decision-making
Common Search & ComparisonYesYes

Ai Rag and Data Analyst roles share overlapping skills in data handling and analysis, but Ai Rag focuses more on AI-specific applications and machine learning, while Data Analysts concentrate on interpreting data to inform business decisions. Both roles are vital in data-driven industries, with Ai Rag often working in AI development environments and Data Analysts supporting strategic insights across sectors.

What are popular job titles related to Ai Rag jobs in Madison, WI?

For Ai Rag jobs in Madison, WI, the most frequently searched job titles are:

What job categories do people searching Ai Rag jobs in Madison, WI look for?

The top searched job categories for Ai Rag jobs in Madison, WI are:

What cities near Madison, WI are hiring for Ai Rag jobs?

Cities near Madison, WI with the most Ai Rag job openings:

Ai Rag jobs near you

AI Engineer

Oregon, WI • On-site

EM Key Solutions Inc
IT Services • 11 - 50 employees
Learn more about EM Key Solutions Incexternal

$120 - $190/hr

Other

Posted 9 days ago

Job description

AI Engineer

Remote, USA; potential for minimal ad hoc travel

EMKS is seeking an AI Engineer to support the Department of Veterans Affairs (VA) Office of Information Technology (OIT). This position will lead the design, development, and implementation of Artificial Intelligence (AI), Generative AI, Machine Learning (ML), and intelligent automation solutions that enhance enterprise software engineering, testing, DevSecOps, and IT operations.

The successful candidate will collaborate with cross‑functional teams to identify high‑value AI opportunities, develop proof‑of‑concepts, and deliver secure, scalable, production‑ready AI solutions aligned with VA AI governance and Trustworthy AI principles.

Duties/Responsibilities
  • Design and develop AI‑powered applications using Large Language Models (LLMs), Generative AI, and Machine Learning.
  • Build AI Copilots, AI Agents, and Retrieval‑Augmented Generation (RAG) solutions to improve software engineering, testing, documentation, and operational workflows.
  • Develop intelligent automation solutions for test case generation, defect analysis, knowledge management, predictive analytics, and process optimization.
  • Integrate AI capabilities into enterprise applications, APIs, Azure cloud services, and DevSecOps pipelines.
  • Evaluate emerging AI technologies and rapidly develop Proofs of Concept (PoCs).
  • Collaborate with architects, engineers, testers, and business stakeholders to identify and implement innovative AI solutions.
  • Ensure all AI solutions comply with VA cybersecurity, privacy, accessibility, and Trustworthy AI requirements.
Required Qualifications
  • 5+ years in overall software engineering experience.
  • 2+ years of hands‑on experience developing AI, Machine Learning, or Generative AI solutions.
  • Strong programming experience with Python.
  • Experience with Azure OpenAI, OpenAI APIs, or similar LLM platforms.
  • Experience with LangChain, LlamaIndex, Semantic Kernel, or comparable AI frameworks.
  • Experience building Retrieval‑Augmented Generation (RAG) applications and AI Agents.
  • Experience developing REST APIs using FastAPI or similar frameworks.
  • Familiarity with Git, Azure DevOps, CI/CD, Docker, and cloud‑native development.
  • Strong analytical, communication, and problem‑solving skills.
Preferred Qualifications
  • Experience supporting the U.S. Department of Veterans Affairs (VA) or other Federal agencies.
  • Experience with healthcare IT, EHRM, VistA, Oracle Health Millennium, FHIR, or HL7.
  • Experience with Azure AI Studio, Azure Machine Learning, vector databases, and prompt engineering.
  • Knowledge of NIST AI Risk Management Framework, Responsible AI, and Federal AI governance.
Education/Technical Skills
  • Bachelor's degree in Computer Science, Engineering, Data Science, Artificial Intelligence, or related field.
  • Python • Azure OpenAI • OpenAI APIs • LangChain • LangGraph • LlamaIndex • Semantic Kernel • RAG • AI Agents • Machine Learning • FastAPI • Azure AI Studio • Azure DevOps • Docker • Kubernetes • SQL • Git • REST APIs • Vector Databases
Clearance
  • S. Citizenship is required as is successfully passing a thorough Government background screening (Public Trust) requiring the completion of detailed forms and fingerprinting.
  • Ability to obtain and maintain necessary security clearances as required for access to classified information.
Equal Opportunity Employer

EMKS is an Equal Opportunity Employer committed to hiring and retaining qualified and talented individuals. All qualified applicants will receive consideration for employment without regard to race, color, sex, sexual orientation, gender identity, religion, national origin, disability, veteran status, or other legally protected status.

Reasonable Accommodation Requests

EM Key Solutions is committed to working with and providing reasonable accommodation to individuals with physical and mental disabilities. If you need special assistance or accommodation while seeking employment, please e-mail hr@emks.com or call Human Resources at (727)-292-1521. We will make a determination on your request for reasonable accommodation on a case‑by‑case basis.

E-Verify

As a Federal Contractor, we are required to use E-Verify to validate employees' ability to work legally in the United States.

EEO is the Law

The law requires EM Key Solutions to post a notice describing the Federal laws prohibiting job discrimination.

Pay Transparency Non-Discrimination

EM Key Solutions will not discharge or, in any other manner, discriminate against employees or applicants because they have inquired about, discussed, or disclosed their own pay.

Legal Notices

For information regarding your legal rights and protections, please click on the following link: State and Federal Labor Notices

#J-18808-Ljbffr

Apply