1

Ai Monitoring Jobs in Minnesota (NOW HIRING)

Senior AI/ML Engineer

Eden Prairie, MN · On-site +1

$106K - $146K/yr

  • Retirement

Implement evaluation and monitoring frameworks for generative AI systems including hallucination detection, bias monitoring, and humanintheloop evaluation * Develop safety and governance controls for ...

Manager AI and Automation

Minneapolis, MN · On-site

  • Medical

  • Dental

  • Vision

  • Life

  • Retirement

  • PTO

AI Performance Monitoring: Establish and utilize metrics and processes to monitor the performance and impact of AI solutions, directing adjustments as needed to optimize outcomes and minimize ...

AI Product Leader

Minneapolis, MN · On-site

  • Medical

  • Retirement

Design evaluation and measurement: rubrics, golden datasets, offline/online testing, and monitoring ... Experience with AI-powered low-code platforms (V0, Bolt, Lovable) for rapid prototyping and ...

Lead Engineer Cyber AI - AI Expert

Minneapolis, MN · On-site

$132K - $238K/yr

  • Medical

  • Dental

  • Vision

  • Life

  • Retirement

  • PTO

Monitor workflow and risks; play a leadership role in mitigating risks and removing obstacles. Lead ... The AI space is evolving rapidly and we need strong technologists with a passion to stay current ...

... monitoring). * 2+ years leading security/compliance efforts; familiarity with enterprise security controls (IAM, encryption, secrets, audit logging) and data/privacy (PII, retention, access controls)

Showing results 41-60

Ai Monitoring information

What is AI monitoring?

AI monitoring refers to the process of continuously observing and analyzing artificial intelligence systems to ensure they operate as intended. This includes tracking performance, detecting anomalies, ensuring compliance with ethical guidelines, and identifying potential biases or errors. Effective AI monitoring helps organizations maintain transparency, improve system reliability, and ensure that AI models make fair and accurate decisions. It is essential in applications where AI impacts critical business or societal outcomes.

What are some common challenges faced by professionals in AI monitoring roles, and how can they be addressed?

Professionals in AI Monitoring often encounter challenges such as managing large volumes of data, identifying and responding to atypical model behavior, and ensuring compliance with ethical and regulatory standards. Staying updated on the latest AI trends and best practices, utilizing robust monitoring tools, and collaborating closely with data scientists and engineers can help address these challenges. Regular training and open communication within cross-functional teams are also essential to maintain effective oversight and quickly mitigate potential issues.

What are the key skills and qualifications needed to thrive as an AI monitoring specialist, and why are they important?

To thrive as an AI Monitoring Specialist, you need a solid understanding of data analysis, machine learning concepts, and system monitoring, often supported by a degree in computer science or a related field. Familiarity with monitoring platforms like Datadog, Prometheus, or Splunk, as well as experience with scripting languages and AI model management tools, is typically required. Attention to detail, critical thinking, and strong communication skills help specialists identify issues quickly and collaborate with technical teams. These skills and qualities are crucial for ensuring AI systems operate reliably, securely, and efficiently in real-world applications.

What is the difference between Ai Monitoring vs Data Analyst?

AspectAi MonitoringData Analyst
Required CredentialsTypically requires knowledge of AI systems, programming, and data analysis toolsRequires statistical, analytical, and data visualization skills, often with a degree in data science or related fields
Work EnvironmentOften involves monitoring AI systems in real-time, using specialized software, in tech or AI-focused companiesAnalyzes data sets, creates reports, and provides insights, working in various industries like finance, marketing, or healthcare
Employer & Industry UsageCommon in AI development firms, tech companies, and organizations deploying AI solutionsWidely used across industries for decision-making, reporting, and strategic planning

While both roles involve working with data, Ai Monitoring focuses on overseeing AI system performance and ensuring operational accuracy, whereas Data Analysts interpret data to support business decisions. Understanding these differences helps in choosing the right career path or job search focus.

What job categories do people searching Ai Monitoring jobs in Minnesota look for?

The top searched job categories for Ai Monitoring jobs in Minnesota are:

Infographic showing various Ai Monitoring job openings in Minnesota as of August 2026, with employment types broken down into 1% As Needed, 82% Full Time, 11% Part Time, 5% Contract, and 1% Nights. Highlights an 92% Physical, 3% Hybrid, and 5% Remote job distribution.

Senior AI/ML Engineer

UnitedHealth Group

Eden Prairie, MN • On-site, Remote

$106K - $146K/yr

Full-time

Retirement

Re-posted 24 days ago


UnitedHealth Group rating

7.6

Company rating: 7.6 out of 10

Based on 146 frontline employees who took The Breakroom Quiz

190th of 888 rated healthcare providers


Job description

Transform Healthcare Through AI Innovation at Optum

Optum is a global organization delivering care, powered by data and technology, to help millions of people live healthier lives. At Optum.ai, we are not just witnessing the AI transformation in healthcare-we are leading it. Our mission is clear: to simplify healthcare with AI, turning insight into action at a scale few organizations in the world can match.

As part of the Optum.ai team, you'll work at the intersection of cutting-edge artificial intelligence and real-world healthcare impact. From reducing administrative burden for providers to anticipating patient needs and improving access to quality care, your work will help solve some of healthcare's most complex challenges-and directly improve health outcomes for millions of people.

You'll collaborate with world-class talent across data science, engineering, product, and healthcare domains, backed by the reach and stability of Optum and UnitedHealth Group. Here, responsible innovation matters. So do comprehensive benefits, meaningful career growth, and the opportunity to make a tangible difference-advancing health equity and creating a simpler, more connected healthcare experience for everyone.

This is more than a job. It's a chance to shape the future of healthcare through the transformative power of AI.

Join us to start Caring. Connecting. Growing together. 

Optum AI is UnitedHealth Group's enterprise AI team. We are AI/ML scientists and engineers with deep expertise in AI/ML engineering for healthcare. We develop AI/ML solutions for the highest impact opportunities across UnitedHealth Group businesses including UnitedHealthcare, Optum Financial, Optum Health, Optum Insight, and Optum Rx. In addition to transforming the healthcare journey through responsible AI/ML innovation, our charter also includes developing and supporting an enterprise AI/ML development platform.
As a Senior AI/ML Engineer, you will design and build advanced machine learning and generative AI solutions that power enterprise applications and decision systems. You will work on large language models, retrieval-augmented generation pipelines, and agent-based AI systems while ensuring production-grade reliability, performance, and safety.
 

You'll enjoy the flexibility to work remotely* from anywhere within the U.S. as you take on some tough challenges. For all hires in the Minneapolis or Washington, D.C. area, you will be required to work in the office a minimum of four days per week.

Primary Responsibilities:

  • Design and deploy generative AI and NLP solutions using transformer-based architectures for enterprise use cases such as search, summarization, extraction, conversational AI, and decision support
  • Develop and fine-tune large language model (LLM) applications using commercial and open-source models such as OpenAI, Anthropic/Claude, Gemini, LLaMA, or Mistral
  • Design and implement retrievalaugmented generation (RAG) pipelines including document ingestion, chunking strategies, embedding generation, and vector database integration
  • Build agentic AI systems including singleagent and multiagent workflows capable of tool use, reasoning, planning, and autonomous task execution
  • Implement evaluation and monitoring frameworks for generative AI systems including hallucination detection, bias monitoring, and humanintheloop evaluation
  • Develop safety and governance controls for AI systems including prompt hardening, policy enforcement, and responsible AI guardrails
  • Productionize AI/ML pipelines using CI/CD, testing, monitoring, and observability best practices in cloudnative environments
  • Collaborate with product, platform, and data science teams to translate requirements into scalable AI solutions

You'll be rewarded and recognized for your performance in an environment that will challenge you and give you clear direction on what it takes to succeed in your role as well as provide development for other roles you may be interested in.

Required Qualifications:

  • 5 years of experience in machine learning, AI engineering, or applied data science including development of production ML systems
  • 5 years of experience developing Python-based ML systems using frameworks such as PyTorch, TensorFlow, or Hugging Face
  • 3 years of experience building Generative AI or LLM applications including prompt engineering, model finetuning, and LLM API integrations
  • 2 years of experience designing retrievalaugmented generation (RAG) systems and vector search pipelines
  • 1 year of experience building agentic AI systems including toolcalling, planning frameworks, or multiagent workflows
  • 1 year of experience using AIassisted development or 'vibe coding' tools such as Codex, Claude Code, Cursor, Windsurf, or similar tools
  • Healthcare Experience
  • Must be authorized to work in the United States without the need for current or future employer-sponsored visa sponsorship (e.g., H-1B, TN, F-1/OPT, CPT, or other employment-based visa status)

Preferred Qualifications:

  • Experience with LLM orchestration frameworks such as LangChain, LlamaIndex, or Semantic Kernel
  • Experience optimizing LLM latency, cost, and performance in production environments
  • Experience deploying AI systems on cloud platforms such as AWS, Azure, or GCP
  • Experience working in regulated environments with responsible AI governance requirements

*All employees working remotely will be required to adhere to UnitedHealth Group's Telecommuter Policy.

Pay is based on several factors including but not limited to local labor markets, education, work experience, certifications, etc. In addition to your salary, we offer benefits such as, a comprehensive benefits package, incentive and recognition programs, equity stock purchase and 401k contribution (all benefits are subject to eligibility requirements). No matter where or when you begin a career with us, you'll find a far-reaching choice of benefits and incentives. The salary for this role will range from $120,100 - $214,500 annually based on full-time employment. We comply with all minimum wage laws as applicable.

Application Deadline: This will be posted for a minimum of 2 business days or until a sufficient candidate pool has been collected. Job posting may come down early due to volume of applicants.

At UnitedHealth Group, our mission is to help people live healthier lives and make the health system work better for everyone. We believe everyone-of every race, gender, sexuality, age, location and income-deserves the opportunity to live their healthiest life. Today, however, there are still far too many barriers to good health which are disproportionately experienced by people of color, historically marginalized groups and those with lower incomes. We are committed to mitigating our impact on the environment and enabling and delivering equitable care that addresses health disparities and improves health outcomes - an enterprise priority reflected in our mission.

UnitedHealth Group is an Equal Employment Opportunity employer under applicable law and qualified applicants will receive consideration for employment without regard to race, national origin, religion, age, color, sex, sexual orientation, gender identity, disability, or protected veteran status, or any other characteristic protected by local, state, or federal laws, rules, or regulations.

UnitedHealth Group is a drug - free workplace. Candidates are required to pass a drug test before beginning employment.

#OptumTechPJ 


What UnitedHealth Group employees say

Pay

Benefits

Hours and flexibility

Workplace

Get the full story on Breakroom