ZipRecruiter

Log In

1

Ai Evaluation Jobs in Indiana (NOW HIRING)

V2X

Principal Agentic AI Engineer (T5)

Indianapolis, IN · On-site

The Principal Agentic AI Engineer provides technical leadership across the full system development ... Strong proficiency in modern machine learning techniques, including model development, evaluation ...

Mistral AI

AI Scientist

Warsaw, IN · On-site

$150 - $200/hr

Build tooling and infrastructure to allow training, evaluation and analysis of AI models at scale * Work cross-functionally with other scientists, engineers and product teams to ship AI systems which ...

micro1 AI

Legal AI Trainer - Remote

Fort Wayne, IN · Remote

$90 - $150/hr

This opportunity is for elite lawyers who want to help shape how advanced AI is trained, evaluated, and applied in real-world legal work, especially those who have deep experience with drafting ...

micro1 AI

Legal AI Trainer - Remote

Indianapolis, IN · Remote

$90 - $150/hr

This opportunity is for elite lawyers who want to help shape how advanced AI is trained, evaluated, and applied in real-world legal work, especially those who have deep experience with drafting ...

micro1 AI

Legal AI Trainer - Remote

Fishers, IN · Remote

$90 - $150/hr

This opportunity is for elite lawyers who want to help shape how advanced AI is trained, evaluated, and applied in real-world legal work, especially those who have deep experience with drafting ...

micro1 AI

Legal AI Trainer - Remote

Carmel, IN · Remote

$90 - $150/hr

This opportunity is for elite lawyers who want to help shape how advanced AI is trained, evaluated, and applied in real-world legal work, especially those who have deep experience with drafting ...

next page

Showing results 1-20

All JobsAi Evaluation JobsAi Evaluation Jobs in Indiana

Ai Evaluation information

What is AI evaluation?

AI evaluation refers to the process of assessing the performance, accuracy, fairness, and reliability of artificial intelligence models or systems. This involves testing AI algorithms using various metrics and datasets to ensure they meet desired standards and function as intended. Evaluators may look for issues like bias, errors, or unintended consequences. The goal is to ensure that AI systems are safe, effective, and trustworthy before they are deployed in real-world applications.

What are the key skills and qualifications needed to thrive as an AI evaluator?

To thrive as an AI Evaluator, you need a strong analytical mindset, attention to detail, and familiarity with AI concepts, often supported by a relevant degree in computer science, linguistics, or a related field. Experience with data annotation platforms, evaluation tools, and sometimes knowledge of programming languages like Python are typically required. Excellent communication skills, critical thinking, and the ability to give constructive feedback are crucial soft skills for this role. These abilities ensure that AI systems are accurately assessed, improved, and aligned with user needs and ethical standards.

What are some common challenges faced by professionals working in AI evaluation roles?

Professionals in AI evaluation often encounter challenges such as ensuring unbiased and accurate assessment of AI models, keeping up with rapidly evolving technologies, and interpreting complex data outputs. Balancing thoroughness with tight project deadlines can be demanding, as can collaborating with cross-functional teams like data scientists, product managers, and engineers to align evaluation metrics with business goals. Additionally, understanding and applying ethical guidelines in AI evaluation is increasingly important as organizations prioritize responsible AI deployment.

What is the difference between Ai Evaluation vs Data Analyst?

AspectAi EvaluationData Analyst
Required CredentialsTypically requires knowledge of AI/ML concepts, certifications in AI tools, and data science fundamentalsRequires degrees in statistics, data analysis, or related fields; often certifications in data analysis tools
Work EnvironmentPrimarily in tech companies, AI development teams, or research labsIn various industries including finance, marketing, healthcare, often in office settings
Employer & Industry UsageUsed by AI development firms, tech companies, and research institutionsUsed across multiple industries for data-driven decision making
Search & Comparison IntentPeople compare to understand AI-specific evaluation rolesOften compared to analyze data trends and insights

While both roles involve working with data, Ai Evaluation focuses on assessing AI models and algorithms, whereas Data Analysts interpret data to inform business decisions. Understanding these differences helps professionals choose the right career path or role based on their skills and industry needs.

Can I get paid to evaluate AI?

Yes, AI evaluation is a recognized job role where professionals assess AI systems for accuracy, bias, and performance. These positions often require skills in data analysis, machine learning, and critical thinking, and may be found in tech companies, research labs, or as freelance opportunities.

How much do AI evaluators make?

AI evaluators typically earn between $40,000 and $80,000 annually, depending on experience, location, and the complexity of tasks. The role often requires skills in data analysis, understanding of AI models, and attention to detail, with some positions offering freelance or part-time options.

How to become an AI evaluation?

To become an AI evaluator, candidates typically need a background in computer science, data analysis, or related fields, along with knowledge of machine learning and AI models. Skills in programming languages like Python, experience with data labeling, and understanding of ethical considerations are also important. Gaining certifications in AI or data science can enhance prospects in this role.

What is an AI evaluationer's job?

An AI evaluationer's job involves assessing the performance, accuracy, and fairness of artificial intelligence models. They analyze outputs, identify biases, and ensure the AI systems meet quality standards, often using specialized tools and datasets. Strong analytical skills and knowledge of machine learning are essential for this role.

What are popular job titles related to Ai Evaluation jobs in Indiana?

For Ai Evaluation jobs in Indiana, the most frequently searched job titles are:

What job categories do people searching Ai Evaluation jobs in Indiana look for?

The top searched job categories for Ai Evaluation jobs in Indiana are:

What cities in Indiana are hiring for Ai Evaluation jobs?

Cities in Indiana with the most Ai Evaluation job openings:

Ai Evaluation jobs near you
Infographic showing various Ai Evaluation job openings in Indiana as of August 2026, with employment types broken down into 76% Full Time, 21% Part Time, and 3% Contract. Highlights an 70% Physical, 3% Hybrid, and 27% Remote job distribution.

Lead Technology Product Manager, AI Quality & Evaluation

Wolters Kluwer

Indianapolis, IN • On-site, Remote

Full-time

Medical, Dental, Vision, Retirement, PTO

Re-posted 4 days ago

Wolters Kluwer rating

9.1

Company rating: 9.1 out of 10

Based on 29 frontline employees who took The Breakroom Quiz

26th of 247 rated software companies

Job description

Build the product capabilities that help ensure AI-enabled healthcare experiences are useful, trusted, and responsibly deployed.

At Wolters Kluwer Health, the UpToDate suite supports millions of clinical decisions every day. As AI becomes part of healthcare workflows, quality cannot be treated as a one-time launch checkpoint. AI experiences need to be evaluated,monitored, and improved continuously so clinicians and care teams can trust the information and interactions they rely on.

As Senior Product Manager, AI Quality & Evaluation, you will play a core role in translating clinical quality standards and evaluationstrategyinto scalable product capabilities. Working under product leadership and in close partnership with clinical, technical, and data experts, you will help define the requirements, workflows, tooling, automation, and reporting needed to evaluate AI-enabled experiences before and after launch.

This role does not own the clinical quality standard or statisticalmethodology. It helps make those standards operational at scale through usable tools, repeatable workflows, measurable signals, andclear evidencethat supports product decisions, customer trust, and responsible AI.

What You'll Do

  • Translate expert-defined quality standards and evaluation methods into product requirements, workflows, and roadmap priorities.

  • Drive discovery and delivery for defined AI quality and evaluation capabilities, including tooling, automation, monitoring, evidence capture, and reporting.

  • Partner with clinical, data science, engineering, product, legal, compliance, and customer-facing teams to operationalize AI evaluation before and after launch.

  • Identifyopportunities to automate and scale evaluation workflows while preservingappropriate expertoversight.

  • Define product requirements for review workflows,issuetriage, launch readiness, post-launch monitoring, and quality reporting.

  • Use evaluation insights to inform product improvements, user experience, content quality, model behavior, and operational processes.

  • Track emerging market practices and customer expectations related to AI quality, evaluation, benchmarking, and responsible AI.

  • Translate AI quality and evaluation practices into clear narratives for product leaders, customer-facing teams, and internal stakeholders.

What You'll Bring

  • 5+ years of product management experience in healthcare, enterprise SaaS, data-driven products, platform products, quality, or related areas.

  • Strong product discovery and execution skills, includingrequirementsdefinition, roadmap planning, experimentation, and metrics-driven decision-making.

  • Ability to translate complex clinical, technical, quality, or risk concepts into practical product requirements and workflows.

  • Experience working with engineering, data, clinical, compliance, customer-facing, or operational stakeholders.

  • Strong analytical thinking and comfort defining metrics, dashboards, workflows, and decision criteria.

  • Strong communicationskills, especially around quality, trust, tradeoffs, evidence, and customer value.

  • Curiosity and learning agility around AI, evaluation methods, responsible AI, and emerging technologies.

Preferred Background

  • Experience with AI-enabled products, healthcare technology, quality tooling, data products, search/retrieval quality, content quality, clinical validation, or decision-support products.

  • Familiarity with AI evaluation methods, benchmarks, monitoring, human-in-the-loop review, automation, or applied machine learning concepts.

  • Experience in healthcare, clinical workflows, regulated environments, or professional-information products.

  • Experience supporting customer-facing narratives around product quality, trust, or responsible technology.

What Success Looks Like

  • Expert-defined quality standards are translated into scalable product workflows, tools, and requirements.

  • Evaluation processes become more automated, repeatable, measurable, and usable by cross-functional teams.

  • Product teams have clearer quality signals and launch-readiness criteria for AI-enabled experiences.

  • Evaluation insights improve product quality, customer trust, user experience, and responsible AI practices.

  • Customer-facing teams can clearly explain how AI quality and trust are evaluated.
    #LI-Hybrid

Our Interview Practices

To maintain a fair and genuine hiring process, we kindly ask that all candidates participate in interviews without the assistance of AI tools or external prompts. Our interview process is designed to assess your individual skills, experiences, and communication style. We value authenticity and want to ensure we're getting to know you-not a digital assistant. To help maintain this integrity, we ask to remove virtual backgrounds and include in-person interviews in our hiring process. Please note that use of AI-generated responses or third-party support during interviews will be grounds for disqualification from the recruitment process.

Applicants may be required to appear onsite at a Wolters Kluwer office as part of the recruitment process.

Compensation:

$118,300.00 - $207,400.00 USDThis role is eligible for Bonus.

Compensation range listed is based on primary location of the position. Actual base salary offer is influenced by a wide array of factors including but not limited to skills, experience and actual hiring location. Your recruiter can share more information about the specific offer for the job location during the hiring process.

Additional Information:

Wolters Kluwer offers a wide variety of competitive benefits and programs to help meet your needs and balance your work and personal life, including but not limited to: Medical, Dental, & Vision Plans, 401(k), FSA/HSA, Commuter Benefits, Tuition Assistance Plan, Vacation and Sick Time, and Paid Parental Leave. Full details of our benefits are available upon request.

What Wolters Kluwer employees say

Pay

Benefits

Hours and flexibility

Workplace

Get the full story on Breakroom

Wolters Kluwer logo

About Wolters Kluwer

Sourced by ZipRecruiter

Wolters Kluwer Global Business Services is designed to provide services to the business units in the areas of technology, sourcing, procurement, legal, finance, and accounting which includes our North American-Accounting Center. These global centers promote team collaboration using best practices around a specific focus area to drive results and enhance operational efficiencies. There is a constant endeavor to benchmark against best-in-class industry standards to improve the quality of deliverables, increase cost savings, enhance productivity, and reduce time to market for products and applications

Industry

Accounting services, library and information services and it services

Company size

10,000+ Employees

Headquarters location

Philadelphia, PA, US

View All Wolters Kluwer Jobs

Apply