1

Ai Monitoring Jobs in Kentucky (NOW HIRING)

Senior AI Engineer

Louisville, KY

$100K - $137K/yr

Building AI systems that are accurate, reliable, auditable, and scalable is at the core of this ... Implement observability, monitoring, logging, alerting, and incident response processes for ...

$124 - $127/hr

Monitor industry trends and emerging technologies to inform enterprise AI strategy * Support change management and organizational readiness for AI transformation WHAT YOU BRING * 10+ years of ...

Senior AI Engineer

Louisville, KY

$100K - $137K/yr

Building AI systems that are accurate, reliable, auditable, and scalable is at the core of this ... Implement observability, monitoring, logging, alerting, and incident response processes for ...

Senior AI Engineer

Louisville, KY

$100K - $137K/yr

Building AI systems that are accurate, reliable, auditable, and scalable is at the core of this ... Implement observability, monitoring, logging, alerting, and incident response processes for ...

$110 - $180/hr

Develop evaluation frameworks, automated testing, and monitoring capabilities to measure AI quality, hallucination rates, response accuracy, and overall system performance. * Implement AI guardrails ...

$180 - $240/hr

Design comprehensive end-to-end AI solutions covering data ingestion, feature engineering, model training, inference pipelines, and monitoring frameworks. * Lead the integration of Large Language ...

New

$180 - $240/hr

Own the AI platform cost and license governance, including consumption monitoring, optimization, forecasting, and alignment to budget expectations. * Build and lead the platform support model ...

$120 - $180/hr

Monitor and optimize AI model performance in production environments, ensuring reliability, scalability, and alignment with business goals. * Serve as a technical advisor on AI/ML best practices ...

$120 - $190/hr

Monitor evolving AI regulations * Set compliance expectations for technology and AI vendors * Oversee due diligence, contractual requirements, and ongoing vendor monitoring * Define compliance ...

$140 - $190/hr

Building evals, guardrails, and monitoring for AI-built and AI-embedded systems. Working with stakeholders, architecture, security, and AI governance to clarify requirements and manage risk. Key ...

$140 - $190/hr

Monitor and evaluate the performance of AI systems and clusters, ensuring that they adhere to industry best practices and meet company standards. * Use AI/ML to continuously improve internal ...

$125 - $170/hr

Monitor client‑specific restrictions and legal, regulatory and industry developments related to AI use in communications and highly regulated industries, proactively briefing account teams and ...

$120 - $170/hr

Monitor the AI tool ecosystem and maintain awareness of the latest agentic frameworks, LLM capabilities, and developer tooling trends to ensure our teams remain current and competitive. * Own AI ...

$146 - $234/hr

Establish engineering practices for AI/ML/LLMOps, including automated testing, CI/CD, infrastructure-as-code, release management, model and prompt versioning, evaluation, monitoring, incident ...

$180 - $240/hr

Monitor agent behavior in production and continuously iterate based on feedback and data * Ensure responsible AI practices, including privacy, safety, and bias mitigation QualiticationsRequired

$110 - $170/hr

Monitor the health and performance of AI applications in production. * Resolve bugs, failures, and quality issues across AI workflows and integrations. * Develop and enhance AI features within ...

New

$120 - $180/hr

Lead AI agent governance efforts, including lifecycle management, configuration, access controls, usage monitoring, and compliance with organizational standards.* Establish and maintain AI adoption ...

$117 - $166/hr

Implement production-grade agent observability, session telemetry, step-by-step tracing, and latency monitoring using Cloud Trace , Cloud Logging , and Vertex AI Model Monitoring . * Define and own ...

New

Showing results 41-60

Ai Monitoring information

What is AI monitoring?

AI monitoring refers to the process of continuously observing and analyzing artificial intelligence systems to ensure they operate as intended. This includes tracking performance, detecting anomalies, ensuring compliance with ethical guidelines, and identifying potential biases or errors. Effective AI monitoring helps organizations maintain transparency, improve system reliability, and ensure that AI models make fair and accurate decisions. It is essential in applications where AI impacts critical business or societal outcomes.

What are some common challenges faced by professionals in AI monitoring roles, and how can they be addressed?

Professionals in AI Monitoring often encounter challenges such as managing large volumes of data, identifying and responding to atypical model behavior, and ensuring compliance with ethical and regulatory standards. Staying updated on the latest AI trends and best practices, utilizing robust monitoring tools, and collaborating closely with data scientists and engineers can help address these challenges. Regular training and open communication within cross-functional teams are also essential to maintain effective oversight and quickly mitigate potential issues.

What are the key skills and qualifications needed to thrive as an AI monitoring specialist, and why are they important?

To thrive as an AI Monitoring Specialist, you need a solid understanding of data analysis, machine learning concepts, and system monitoring, often supported by a degree in computer science or a related field. Familiarity with monitoring platforms like Datadog, Prometheus, or Splunk, as well as experience with scripting languages and AI model management tools, is typically required. Attention to detail, critical thinking, and strong communication skills help specialists identify issues quickly and collaborate with technical teams. These skills and qualities are crucial for ensuring AI systems operate reliably, securely, and efficiently in real-world applications.

What is the difference between Ai Monitoring vs Data Analyst?

AspectAi MonitoringData Analyst
Required CredentialsTypically requires knowledge of AI systems, programming, and data analysis toolsRequires statistical, analytical, and data visualization skills, often with a degree in data science or related fields
Work EnvironmentOften involves monitoring AI systems in real-time, using specialized software, in tech or AI-focused companiesAnalyzes data sets, creates reports, and provides insights, working in various industries like finance, marketing, or healthcare
Employer & Industry UsageCommon in AI development firms, tech companies, and organizations deploying AI solutionsWidely used across industries for decision-making, reporting, and strategic planning

While both roles involve working with data, Ai Monitoring focuses on overseeing AI system performance and ensuring operational accuracy, whereas Data Analysts interpret data to support business decisions. Understanding these differences helps in choosing the right career path or job search focus.

Infographic showing various Ai Monitoring job openings in Kentucky as of August 2026, with employment types broken down into 1% As Needed, 81% Full Time, 13% Part Time, and 5% Contract. Highlights an 92% Physical, 3% Hybrid, and 5% Remote job distribution.

Senior AI Engineer

Humana

Louisville, KY

$100K - $137K/yr

Full-time

Medical, Dental, Vision, Life, Retirement, PTO

Posted 16 days ago


Humana rating

8.0

Company rating: 8.0 out of 10

Based on 267 frontline employees who took The Breakroom Quiz

172nd of 315 rated insurance


Job description

Become a part of our caring community
Most AI engineering jobs are a thin wrapper around a model API. This role is different.
We build the platform that transforms millions of clinical documents into trusted, actionable data. Our systems use large language models (LLMs) to read medical records, extract structured facts, answer complex questions with citations back to the source document, and route ambiguous cases to human experts for review.
Our users make decisions that impact real healthcare outcomes, so "good enough" is not good enough. Building AI systems that are accurate, reliable, auditable, and scalable is at the core of this role.
As a Senior AI Applied Engineer, you will design, build, deploy, and operate production AI systems used at scale within one of the largest health insurers in the United States. You will own solutions end-to-end, from user experience and APIs to model orchestration, evaluation frameworks, infrastructure, and production operations.

Why Join Us

  • Build production AI systems where LLMs are in the critical path, not just demos or proofs of concept.

  • Work on extraction, retrieval, agentic workflows, and human-review systems that process real healthcare data at scale.

  • Own projects end-to-end across frontend, backend, AI orchestration, infrastructure, deployment, and operations.

  • Solve challenging problems around accuracy, explainability, traceability, and reliability in regulated environments.

  • Ship quickly in a small, high-impact team that embraces AI-assisted development and rigorous quality standards.

  • Build systems that continuously improve through expert feedback, evaluations, and human-in-the-loop workflows.

Key Responsibilities

  • Design, develop, and deploy full-stack AI-powered applications, including frontend experiences, APIs, backend services, and data pipelines.

  • Build and optimize LLM-based workflows for information extraction, classification, retrieval, summarization, and agentic processes.

  • Develop robust prompt strategies, structured output frameworks, tool-calling capabilities, and fallback mechanisms to improve reliability.

  • Design and implement retrieval-augmented generation (RAG) systems using embeddings, vector databases, and semantic search technologies.

  • Build evaluation frameworks, including benchmark datasets, regression testing, quality metrics, and human review workflows.

  • Develop human-in-the-loop processes that enable clinicians and domain experts to validate AI outputs and provide feedback for continuous improvement.

  • Build and maintain document-processing pipelines, including OCR, document ingestion, metadata extraction, indexing, and search capabilities.

  • Optimize AI systems for accuracy, latency, reliability, scalability, and cost efficiency.

  • Implement observability, monitoring, logging, alerting, and incident response processes for production systems.

  • Deploy and operate services in cloud-native environments using Kubernetes, Docker, CI/CD pipelines, and modern infrastructure tooling.

  • Collaborate with product, engineering, clinical, and operational stakeholders to translate complex business requirements into scalable solutions.

  • Ensure solutions meet privacy, security, compliance, and auditability requirements within a regulated healthcare environment.


Use your skills to make an impact

Required Qualifications

  • Bachelor's degree in Computer Science, Engineering, or a related technical field, or equivalent practical experience.

  • 5+ years of experience building and operating production software systems.

  • Experience developing backend services, APIs, distributed systems, or data-intensive applications.

  • Hands-on experience integrating LLMs into production applications beyond simple chat interfaces, including structured outputs, tool calling, retrieval-augmented generation (RAG), agents, or multi-step workflows.

  • Experience with at least one major AI platform or model provider such as OpenAI, Anthropic, Google, Azure AI, or AWS Bedrock.

  • Strong programming skills in Python and/or TypeScript/JavaScript.

  • Experience debugging, monitoring, and supporting production applications used by real customers.

  • Ability to work independently, navigate ambiguity, and take ownership of projects from concept through deployment.

Preferred Qualifications

  • Experience building AI systems where LLMs are part of the critical production workflow.

  • Experience designing evaluation frameworks, testing strategies, prompt versioning, tracing, and model performance monitoring.

  • Experience with agentic architecture, Model Context Protocol (MCP), tool orchestration frameworks, or autonomous workflows.

  • Experience with React, Next.js, modern frontend development, and full-stack application architecture.

  • Experience deploying and operating workloads in Kubernetes, Docker, and cloud environments.

  • Experience with modern CI/CD practices and infrastructure automation.

  • Experience working in regulated industries such as healthcare, financial services, or government.

  • Familiarity with privacy, compliance, governance, and data protection requirements.

  • Experience using AI-assisted development tools to improve engineering productivity and software quality.

  • Strong problem-solving, communication, and collaboration skills.

Success in This Role

Successful candidates are energized by ambiguity, motivated by ownership, and excited to solve difficult problems where correctness matters. You enjoy building systems that are accurate, traceable, and trustworthy, and you view model failures as engineering challenges to be solved rather than limitations to be accepted.

This role is best suited for engineers who want to own meaningful problems end-to-end and see their work directly impact on users and business outcomes.

Technology Stack

  • TypeScript

  • React / Next.js

  • Python

  • PostgreSQL

  • Gemini on Vertex AI

  • OCR and Document AI technologies

  • Docker

  • Kubernetes

  • Modern CI/CD platforms and tooling

Additional Information

This role operates in a highly regulated environment. Responsible handling of sensitive and protected data is a fundamental requirement and an essential part of our engineering culture.

Work Style: This position follows a hybrid work schedule, requiring employees to work three days per week in the office and the remaining days remotely. Qualified candidates must currently reside within, or be willing to relocate to, a commutable distance from one of the talent markets.

Scheduled Weekly Hours

40

Pay Range

The compensation range below reflects a good faith estimate of starting base pay for full time (40 hours per week) employment at the time of posting. The pay range may be higher or lower based on geographic location and individual pay will vary based on demonstrated job related skills, knowledge, experience, education, certifications, etc.


$141,100 - $194,000 per year


This job is eligible for a bonus incentive plan. This incentive opportunity is based upon company and/or individual performance.

Description of Benefits

Humana, Inc. and its affiliated subsidiaries (collectively, "Humana") offers competitive benefits that support whole-person well-being. Associate benefits are designed to encourage personal wellness and smart healthcare decisions for you and your family while also knowing your life extends outside of work. Among our benefits, Humana provides medical, dental and vision benefits, 401(k) retirement savings plan, time off (including paid time off, company and personal holidays, paid parental and caregiver leave), short-term and long-term disability, life insurance and many other opportunities.
About Us
About Humana: Humana Inc. (NYSE: HUM) is a leading U.S. healthcare company. Through our Humana insurance services and our CenterWell healthcare services, we make it easier for the millions of people we serve to achieve their best health - delivering the care and service they need, when they need it. These efforts are leading to a better quality of life for people with Medicare and Medicaid, families, individuals, military service personnel, and communities at large. Learn more about what we offer atHumana.comand atCenterWell.com.


Equal Opportunity Employer

It is the policy of Humana not to discriminate against any employee or applicant for employment because of race, color, religion, sex, sexual orientation, gender identity, national origin, age, marital status, genetic information, disability or protected veteran status. It is also the policy of Humana to take affirmative action, in compliance with Section 503 of the Rehabilitation Act and VEVRAA, to employ and to advance in employment individuals with disability or protected veteran status, and to base all employment decisions only on valid job requirements. This policy shall apply to all employment actions, including but not limited to recruitment, hiring, upgrading, promotion, transfer, demotion, layoff, recall, termination, rates of pay or other forms of compensation and selection for training, including apprenticeship, at all levels of employment.


What Humana employees say

Pay

Benefits

Hours and flexibility

Workplace

Get the full story on Breakroom


Humana logo

About Humana

Sourced by ZipRecruiter

Humana Inc., headquartered in Louisville, KY., is a leading health care company that offers a wide range of insurance products and health and wellness services that incorporate an integrated approach to lifelong well-being. By leveraging the strengths of its core businesses, Humana believes it can better explore opportunities for existing and emerging adjacencies in health care that can further enhance wellness opportunities for the millions of people across the nation with whom the company has relationships.

Industry

Health care and social assistance

Company size

10,000+ Employees

Headquarters location

Louisville, KY, US

Year founded

1961

Social media