1

Generative Ai Testing Jobs in Minnesota (NOW HIRING)

Senior AI/ML Engineer

Eden Prairie, MN · On-site

$106K - $146K/yr

  • Retirement

Design and deploy generative AI and NLP solutions using transformer-based architectures for ... Productionize AI/ML pipelines using CI/CD, testing, monitoring, and observability best practices in ...

Senior AI/ML Engineer

Eden Prairie, MN · On-site +1

$106K - $146K/yr

  • Retirement

Design and deploy generative AI and NLP solutions using transformer-based architectures for ... Productionize AI/ML pipelines using CI/CD, testing, monitoring, and observability best practices in ...

$44.50 - $58.75/hr

The ideal candidate will design AI-powered testing solutions, build reusable automation frameworks, and integrate Generative AI capabilities into software quality processes. Required Qualifications ...

New

  • Medical

  • Dental

  • Vision

  • Life

  • Retirement

  • PTO

... put generative AI in the hands of real users - not just prototypes or notebooks. The ideal ... Drive engineering best practices across the team: code review, testing, CI/CD, documentation, and ...

New

AI-ML Engineer - Finance-Hybrid

Rochester, MN · On-site

  • Medical

  • Dental

  • Vision

  • Retirement

... Generative AI Solutions tailored for finance applications, not clinical. AI/ML Engineers at Mayo ... the design, testing, and maintenance of tools and associated CI/CD pipelines. • Working on ...

Senior AI Engineer

Eden Prairie, MN · On-site

$120 - $160/hr

... Software Testing Services. As a Google Cloud Partner, we excel in Oracle, SAP, and Java ... generative and agentic AI solutions on a multi-cloud, multi-model stack. The ideal candidate is ...

next page

Showing results 1-20

Generative Ai Testing information

What is the difference between Generative Ai Testing vs Data Scientist?

AspectGenerative Ai TestingData Scientist
Required CredentialsKnowledge of AI models, testing tools, programming skillsStatistics, programming, data analysis certifications
Work EnvironmentAI development teams, testing labs, tech companiesResearch labs, tech firms, finance, healthcare
Employer & Industry UsageAI product testing, quality assurance in techData analysis, predictive modeling across industries

Generative Ai Testing focuses on evaluating and validating AI-generated content and models, ensuring quality and accuracy. Data Scientists analyze data, build models, and derive insights. While both roles require programming and AI knowledge, Generative Ai Testing emphasizes testing processes, whereas Data Scientists focus on data analysis and model development.

How do I become a Generative AI Testing?

To become a Generative AI Tester, develop skills in machine learning, natural language processing, and programming languages like Python. Gain experience with AI frameworks such as TensorFlow or PyTorch and understand data quality and model evaluation techniques. Certifications in AI or data science can enhance your qualifications and improve job prospects.

Is Generative AI Testing a good career?

Generative AI Testing is a growing field within AI development that involves evaluating the quality and safety of AI-generated content. It requires skills in machine learning, programming, and understanding AI models, making it a promising career path with increasing demand as AI technologies expand. Professionals in this area can find opportunities in tech companies, research labs, and startups focused on AI innovation.

What are the key skills and qualifications needed to thrive as a generative AI testing specialist, and why are they important?

To thrive as a Generative AI Testing Specialist, you need a robust understanding of machine learning principles, model evaluation techniques, and a background in computer science or a related field. Familiarity with tools such as Python, TensorFlow, PyTorch, and model evaluation frameworks, as well as experience with automated testing platforms, is typically required. Analytical thinking, attention to detail, and strong communication skills help you identify model weaknesses and collaborate effectively with development teams. These skills are crucial to ensure the reliability, safety, and ethical deployment of generative AI solutions.

What are some common challenges faced when testing generative AI models, and how can I prepare to address them in this role?

Testing generative AI models often involves unique challenges such as evaluating the quality and relevance of generated content, detecting bias or inappropriate outputs, and ensuring model consistency across various prompts. You may work closely with data scientists and engineers to create robust evaluation frameworks and develop automated as well as manual testing strategies. Familiarity with prompt engineering, statistical evaluation techniques, and domain-specific knowledge will help you address these challenges effectively. Proactively staying updated on industry best practices and collaborating with cross-functional teams are key to success in this dynamic field.

What is generative AI testing?

Generative AI Testing refers to the process of evaluating and validating AI systems, particularly those that generate content such as text, images, or code. This type of testing focuses on assessing the accuracy, reliability, fairness, and safety of generative models to ensure they function as intended and avoid producing harmful or biased outputs. Testers use various methods, including automated and manual techniques, to check for issues like hallucinations, inappropriate content, or security vulnerabilities. The goal is to build trust in generative AI systems and ensure they meet quality and ethical standards before deployment.

What are popular job titles related to Generative Ai Testing jobs in Minnesota?

For Generative Ai Testing jobs in Minnesota, the most frequently searched job titles are:

What job categories do people searching Generative Ai Testing jobs in Minnesota look for?

The top searched job categories for Generative Ai Testing jobs in Minnesota are:

What cities in Minnesota are hiring for Generative Ai Testing jobs?

Cities in Minnesota with the most Generative Ai Testing job openings:

Infographic showing various Generative Ai Testing job openings in Minnesota as of August 2026, with employment types broken down into 1% As Needed, 88% Full Time, 7% Part Time, 3% Contract, and 1% Nights. Highlights an 88% Physical, 3% Hybrid, and 9% Remote job distribution.

Lead AI Engineer - Remote

UnitedHealth Group

Eden Prairie, MN • On-site, Remote

$145K - $249K/yr

Full-time

Retirement

Posted 14 days ago


UnitedHealth Group rating

7.6

Company rating: 7.6 out of 10

Based on 146 frontline employees who took The Breakroom Quiz

190th of 887 rated healthcare providers


Job description

Optum is a global organization that delivers care, aided by technology to help millions of people live healthier lives. The work you do with our team will directly improve health outcomes by connecting people with the care, pharmacy benefits, data and resources they need to feel their best. Here, you will find a culture guided by inclusion, talented peers, comprehensive benefits and career development opportunities. Come make an impact on the communities we serve as you help us advance health optimization on a global scale. Join us to start Caring. Connecting. Growing together.


We are looking for a Senior GenAI Developer with solid hands-on expertise in both open source and AWS Generative AI stacks. You will design and build production-ready RAG pipelines, agentic AI workflows, and knowledge base chatbots. You will work closely with architects and business stakeholders to deliver accurate, low-hallucination, observable AI solutions at enterprise scale.


You'll enjoy the flexibility to work remotely * from anywhere within the U.S. as you take on some tough challenges. For all hires in the Minneapolis or Washington, D.C. area, you will be required to work in the office a minimum of four days per week.


Primary Responsibilities:

  • Design and build production-grade RAG pipelines using LangChain and LangGraph for stateful agentic workflows
  • Develop and maintain knowledge base chatbots with semantic search, source attribution, and multi-turn conversation memory
  • Implement advanced retrieval strategies - Hybrid Search (vector keyword), HyDE, and Hierarchical / Small-to-Big chunking
  • Build and manage multi-agent orchestration architectures with Agentic RAG patterns (Corrective RAG, Self-RAG)
  • Integrate LLMs (Claude, GPT-4o, Llama 3, Mistral) via API and open-source hosting (Fireworks AI, Groq)
  • Design and operate vector databases - Pinecone, Weaviate, or PGVector - for semantic knowledge storage
  • Build AWS Bedrock-based solutions using Bedrock Agents, Knowledge Bases, and Guardrails
  • Set up evaluation frameworks using Ragas (faithfulness, relevance scoring) and maintain Golden Datasets for CI/AI testing
  • Implement LLM observability using LangSmith or Phoenix - trace calls, debug hallucinations, monitor costs
  • Apply PII redaction pipelines on ingested documents and enforce data security using Model Context Protocol (MCP)
  • Deploy AI backends using FastAPI and Docker with OpenTelemetry for system-wide monitoring
  • Collaborate with Solution Architects to produce HLDs, LLDs, and developer-facing documentation for AI components


You'll be rewarded and recognized for your performance in an environment that will challenge you and give you clear direction on what it takes to succeed in your role as well as provide development for other roles you may be interested in.

Required Qualifications:

  • Bachelor's or Master's degree in Computer Science, Artificial Intelligence, Data Science, or a related field
  • 8 years of overall software / AI engineering experience
  • 2 years of direct hands-on experience building and deploying GenAI / LLM-based applications in production
  • Solid Python development skills - primary language for AI engineering work
  • Demonstrated portfolio or project experience with RAG pipelines, vector databases, and agentic architectures
  • Driver's License and access to reliable transportation


Preferred Qualifications:

  • AWS Certified AI Practitioner (AIF-C01) or Generative AI Developer (AIP-C01) certification
  • AWS Certified Cloud Practitioner or Developer Associate
  • AI/ML Specialty
  • Experience with Graph RAG for complex entity-relationship knowledge bases
  • Experience with Semantic Kernel as an alternative orchestration framework
  • Knowledge of Human-in-the-Loop systems - expert review/voting UI for AI answer correction
  • Familiarity with fine-tuning open-source LLMs (LoRA / QLoRA) on domain-specific datasets
  • Exposure to Amazon Connect integration with Bedrock Agents via Lex V2 for contact centre AI


*All employees working remotely will be required to adhere to UnitedHealth Group's Telecommuter Policy


Pay is based on several factors including but not limited to local labor markets, education, work experience, certifications, etc. In addition to your salary, we offer benefits such as, a comprehensive benefits package, incentive and recognition programs, equity stock purchase and 401k contribution (all benefits are subject to eligibility requirements). No matter where or when you begin a career with us, you'll find a far-reaching choice of benefits and incentives. The salary for this role will range from $145,500 - $249,500 annually based on full-time employment. We comply with all minimum wage laws as applicable.


Application Deadline: This will be posted for a minimum of 2 business days or until a sufficient candidate pool has been collected. Job posting may come down early due to volume of applicants.


At UnitedHealth Group, our mission is to help people live healthier lives and make the health system work better for everyone. We believe everyone-of every race, gender, sexuality, age, location and income-deserves the opportunity to live their healthiest life. Today, however, there are still far too many barriers to good health which are disproportionately experienced by people of color, historically marginalized groups and those with lower incomes. We are committed to mitigating our impact on the environment and enabling and delivering equitable care that addresses health disparities and improves health outcomes - an enterprise priority reflected in our mission.

UnitedHealth Group is an Equal Employment Opportunity employer under applicable law and qualified applicants will receive consideration for employment without regard to race, national origin, religion, age, color, sex, sexual orientation, gender identity, disability, or protected veteran status, or any other characteristic protected by local, state, or federal laws, rules, or regulations.


UnitedHealth Group is a drug-free workplace. Candidates are required to pass a drug test before beginning employment.


What UnitedHealth Group employees say

Pay

Benefits

Hours and flexibility

Workplace

Get the full story on Breakroom