ZipRecruiter

Log In

1

Ai Monitoring Jobs in Florida (NOW HIRING)

Worth AI

Senior Agentic (AI) Engineer

Orlando, FL · On-site +1

$97K - $134K/yr

  • Medical

  • Dental

  • Vision

  • Life

  • Retirement

  • PTO

Worth AI is hiring a Senior Agentic AI Engineer to design and ship production agent systems that ... monitoring. * Architect agent graphs in LangGraph (or comparable - CrewAI, AutoGen, Claude Agent ...

Worth AI

Senior Agentic (AI) Engineer

Orlando, FL · On-site +1

$97K - $134K/yr

  • Medical

  • Dental

  • Vision

  • Life

  • Retirement

  • PTO

Worth AI is hiring a Senior Agentic AI Engineer to design and ship production agent systems that ... monitoring. * Architect agent graphs in LangGraph (or comparable - CrewAI, AutoGen, Claude Agent ...

Worth AI

Senior Agentic (AI) Engineer

Tampa, FL · On-site +1

$98K - $135K/yr

  • Medical

  • Dental

  • Vision

  • Life

  • Retirement

  • PTO

Worth AI is hiring a Senior Agentic AI Engineer to design and ship production agent systems that ... monitoring. * Architect agent graphs in LangGraph (or comparable - CrewAI, AutoGen, Claude Agent ...

Worth AI

Senior Agentic (AI) Engineer

Miami, FL · On-site +1

$99K - $137K/yr

  • Medical

  • Dental

  • Vision

  • Life

  • Retirement

  • PTO

Worth AI is hiring a Senior Agentic AI Engineer to design and ship production agent systems that ... monitoring. * Architect agent graphs in LangGraph (or comparable - CrewAI, AutoGen, Claude Agent ...

TQL

AI Architect

Tampa, FL · On-site

$59.50 - $78.50/hr

  • Medical

  • Dental

  • Vision

  • Retirement

Ensure AI systems are observable with performance and cost monitoring* Innovation & Continuous Improvement* Evaluate emerging AI models, agent frameworks and Azure capabilities for use in logistics ...

Total Quality Logistics

AI Architect

Tampa, FL · On-site

  • Medical

  • Dental

  • Vision

  • Retirement

Ensure AI systems are observable with performance and cost monitoring * Innovation & Continuous Improvement * Evaluate emerging AI models, agent frameworks and Azure capabilities for use in logistics ...

Total Quality Logistics

AI Architect

Tampa, FL · On-site

  • Medical

  • Dental

  • Vision

  • Retirement

Ensure AI systems are observable with performance and cost monitoring * Innovation & Continuous Improvement * Evaluate emerging AI models, agent frameworks and Azure capabilities for use in logistics ...

RELX

AI Agent Engineer

Boca Raton, FL

$75K - $100K/yr

  • Medical

  • Life

Do you enjoy working at the intersection of automation, systems monitoring, and human oversight to ensure safe and highquality AI performance? About the Business: LexisNexis Risk Solutions is the ...

Sherwood Bedding

AI Architect (Salary)

Orlando, FL · On-site

  • Medical

  • Dental

  • Vision

  • Life

  • Retirement

  • PTO

Monitor production AI for quality, drift, cost, and business outcomes; implement auditability and responsible-AI controls. Operational Improvement & Change Leadership * Partner with plant, functional ...

American Express

Senior AI Engineer

Sunrise, FL · On-site

$123K - $215K/yr

  • Medical

  • Dental

  • Vision

  • Life

  • Retirement

Improve operations with AI-based monitoring, quality checks, and governance through automation and analytics. * Build and support shared AI platforms, including agent orchestration, evaluation ...

Apptad, Inc.

AI testing Engineer

Tampa, FL · On-site +1

CloudWatch (monitoring) Required Skills & Experience: Strong Python scripting for automation and testing . Experience in AI/ML model validation and QA workflows. Hands-on with: JSON parsing, schema ...

Tata Consultancy Service Limited

AI Engineer

Sunrise, FL · On-site

$100K - $130K/yr

  • Medical

  • Dental

  • Vision

  • Retirement

  • PTO

Build and optimize end-to-end machine learning pipelines, from data ingestion to model deployment and monitoring. Develop advanced Generative AI applications leveraging Large Language Models (LLMs ...

Vultus Inc

AI/ML Engineer

Miami, FL · On-site +1

$120K - $150K/yr

  • Medical

  • Dental

  • Vision

  • PTO

AI/ML Engineer Experience: 4-7 Years Job Type: Full-Time Location: Remote / Hybrid / Onsite ... Monitor model performance and implement continuous improvements. * Collaborate with Product ...

Valley Bank

AI Engineer

Saint Petersburg, FL · On-site

Perform testing, monitoring, and optimization of deployed automation and AI solutions to ensure reliability and performance. * Gather and analyze process and model performance metrics to drive ...

Deloitte

Google AI Architect

Jacksonville, FL

AI & Engineering leverages cutting-edge engineering capabilities to build, deploy, and operate ... Develop and implement strategies for model deployment, inference, and monitoring, with an emphasis ...

Deloitte

Google AI Architect

Miami, FL

AI & Engineering leverages cutting-edge engineering capabilities to build, deploy, and operate ... Develop and implement strategies for model deployment, inference, and monitoring, with an emphasis ...

previous pagenext page

Showing results 21-40

All JobsAi Monitoring JobsAi Monitoring Jobs in Florida

Ai Monitoring information

What is AI monitoring?

AI monitoring refers to the process of continuously observing and analyzing artificial intelligence systems to ensure they operate as intended. This includes tracking performance, detecting anomalies, ensuring compliance with ethical guidelines, and identifying potential biases or errors. Effective AI monitoring helps organizations maintain transparency, improve system reliability, and ensure that AI models make fair and accurate decisions. It is essential in applications where AI impacts critical business or societal outcomes.

What are some common challenges faced by professionals in AI monitoring roles, and how can they be addressed?

Professionals in AI Monitoring often encounter challenges such as managing large volumes of data, identifying and responding to atypical model behavior, and ensuring compliance with ethical and regulatory standards. Staying updated on the latest AI trends and best practices, utilizing robust monitoring tools, and collaborating closely with data scientists and engineers can help address these challenges. Regular training and open communication within cross-functional teams are also essential to maintain effective oversight and quickly mitigate potential issues.

What are the key skills and qualifications needed to thrive as an AI monitoring specialist, and why are they important?

To thrive as an AI Monitoring Specialist, you need a solid understanding of data analysis, machine learning concepts, and system monitoring, often supported by a degree in computer science or a related field. Familiarity with monitoring platforms like Datadog, Prometheus, or Splunk, as well as experience with scripting languages and AI model management tools, is typically required. Attention to detail, critical thinking, and strong communication skills help specialists identify issues quickly and collaborate with technical teams. These skills and qualities are crucial for ensuring AI systems operate reliably, securely, and efficiently in real-world applications.

What is the difference between Ai Monitoring vs Data Analyst?

AspectAi MonitoringData Analyst
Required CredentialsTypically requires knowledge of AI systems, programming, and data analysis toolsRequires statistical, analytical, and data visualization skills, often with a degree in data science or related fields
Work EnvironmentOften involves monitoring AI systems in real-time, using specialized software, in tech or AI-focused companiesAnalyzes data sets, creates reports, and provides insights, working in various industries like finance, marketing, or healthcare
Employer & Industry UsageCommon in AI development firms, tech companies, and organizations deploying AI solutionsWidely used across industries for decision-making, reporting, and strategic planning

While both roles involve working with data, Ai Monitoring focuses on overseeing AI system performance and ensuring operational accuracy, whereas Data Analysts interpret data to support business decisions. Understanding these differences helps in choosing the right career path or job search focus.

What are popular job titles related to Ai Monitoring jobs in Florida?

For Ai Monitoring jobs in Florida, the most frequently searched job titles are:

What job categories do people searching Ai Monitoring jobs in Florida look for?

The top searched job categories for Ai Monitoring jobs in Florida are:

Ai Monitoring jobs near you
Infographic showing various Ai Monitoring job openings in Florida as of August 2026, with employment types broken down into 1% As Needed, 83% Full Time, 11% Part Time, and 5% Contract. Highlights an 92% Physical, 3% Hybrid, and 5% Remote job distribution.

Senior Agentic (AI) Engineer

Worth AI

Orlando, FL • On-site, Remote

$97K - $134K/yr

Full-time

Medical, Dental, Vision, Life, Retirement, PTO

Re-posted 5 days ago

Job description

Worth AI is hiring a Senior Agentic AI Engineer to design and ship production agent systems that automate KYB, underwriting, and risk decisions on regulated financial data. You'll own agents end-to-end architecture, retrieval, tools, evals, and production deployment and partner closely with our Chief AI Officer, applied scientists, and platform teams.
Responsibilities
  • Design and ship multi-step agentic systems (planner/executor, tool-using, multi-agent, human-in-the-loop) for onboarding, underwriting, case review, and continuous monitoring.
  • Architect agent graphs in LangGraph (or comparable - CrewAI, AutoGen, Claude Agent SDK) with explicit state, durable execution, retries, and safe fallbacks.
  • Build the retrieval layer powering our agents - chunking, hybrid search, reranking, and grounded citation.
  • Own the eval stack: golden sets, offline regression suites, LLM-as-judge, online A/B and shadow evals, and red-teaming for jailbreaks, prompt injection, and PII leakage.
  • Expose agents to production systems via well-typed tools and MCP servers. Treat tool surface area as a product.
  • Drive production MLOps: deployment, versioning, traffic shaping, cost/latency budgets, tracing, and on-call playbooks for agent incidents.
  • Partner with security and compliance to keep agents inside SOC 2, GDPR, CCPA, and fair-lending posture - auditability and explainability built in, not bolted on.
  • Mentor engineers on agent patterns, prompt hygiene, eval discipline, and LLM failure modes.
  • Technology Stack
    • Languages: Python, Node.js, TypeScript
    • Agent / LLM frameworks: LangGraph, LangChain, Claude Agent SDK, MCP, OpenAI SDK
    • Models: Anthropic Claude, OpenAI, open-weight where appropriate
    • Retrieval & Data: PostgreSQL, pgvector, OpenSearch, Kafka, Redshift, Redis
    • Infra: AWS, Kubernetes (EKS), ArgoCD, Terraform
    • Evals & Observability: LangSmith / Langfuse / Braintrust-style tooling, DataDog

Requirements
  • 5+ years of software engineering experience, with 2+ years building production LLM or agentic systems (not just notebooks or demos).
  • Hands-on experience with a modern agent framework (LangGraph strongly preferred) and a track record of shipping agents that run, fail gracefully, and recover.
  • Strong RAG fundamentals chunking, embeddings, hybrid retrieval, reranking, grounding - and judgment about when RAG isn't the right answer.
  • Real eval experience golden sets, offline and online evaluations, used to make ship/no-ship calls.
  • Production MLOps fluency: deployed LLM workloads under real latency, cost, and reliability constraints.
  • Strong Python; comfortable in TypeScript / Node.js.
  • Solid systems engineering instincts APIs, async patterns, queues, databases, distributed system failure modes.
  • Calibrated communicator; thrives in ambiguous, fast-moving environments.
  • Prior experience in fintech, lending, payments, KYB/KYC, fraud, or AML.
  • Experience building MCP servers or other structured tool interfaces for LLMs.
  • Background in classical ML (ranking, scoring, calibration).
  • Experience designing explainable / auditable AI workflows for regulated environments.
  • Open-source contributions to agent frameworks, eval tooling, or retrieval libraries.
  • AWS depth (EKS, MSK, RDS, S3, Lambda) and IaC with Terraform.
Success Metrics
  • Agent Quality: Measurable improvements in task success rate, grounding accuracy, and hallucination rate on our eval suites.
  • Production Reliability: Agents you own meet defined SLOs for latency (P90/P99), tool-call success, and cost per task.
  • Velocity: New agent capabilities go from prototype to production in weeks, without skipping evals or guardrails.
  • Risk Posture: Zero material incidents tied to prompt injection, PII leakage, or unsafe tool use on agents you own.
  • Force Multiplier: Patterns, tools, and eval scaffolding you build get adopted across engineering.

All Remote Hires will be required to travel to Orlando, Florida at least twice per year for Town Halls and team collaboration, in addition to orientation in Orlando.
Benefits
  • Health Care Plan (Medical, Dental & Vision)
  • Retirement Plan (401k, IRA)
  • Life Insurance
  • Flexible Paid Time Off
  • 9 paid Holidays
  • Family Leave
  • Remote
  • Hybrid work (for Orlando Associates)
  • Free Food & Snacks (Orlando)
  • Wellness Resources

Apply