Size AI opportunities with conservative, evidence-based ROI assumptions, targeting tasks whose ... Architect human-in-the-loop workflows with expert review designed in, expanding automation only ...
Size AI opportunities with conservative, evidence-based ROI assumptions, targeting tasks whose ... Architect human-in-the-loop workflows with expert review designed in, expanding automation only ...
Engineer for long-horizon reliability - multi-step task completion, recovery from compounding ... review and prior authorization to claims integrity and care management. Retrieval, grounding ...
Engineer for long-horizon reliability - multi-step task completion, recovery from compounding ... review and prior authorization to claims integrity and care management. Retrieval, grounding ...
... review and prior authorization to claims integrity and care management. Retrieval, grounding ... step task success, failure-mode and regression analysis, and sandboxed test environments ...
... review and prior authorization to claims integrity and care management. Retrieval, grounding ... step task success, failure-mode and regression analysis, and sandboxed test environments ...
Director of Biostatistics
Columbus, GA · Remote
$60 - $100/hr
No prior experience in AI is required -- your domain knowledge is what matters. Scope of Work ... Design and author expert-level evaluation tasks simulating real-world biostatistics challenges ...
Director of Biostatistics
Columbus, GA · Remote
$60 - $100/hr
No prior experience in AI is required -- your domain knowledge is what matters. Scope of Work ... Design and author expert-level evaluation tasks simulating real-world biostatistics challenges ...
Senior AI Engineer
Atlanta, GA · On-site
$100K - $138K/yr
Participate in code reviews and design discussions * Support and mentor mid-level engineers where ... Evaluate agent performance across multi-step tasks (task success rate, error propagation) * Debug ...
Senior AI Engineer
Atlanta, GA · On-site
$100K - $138K/yr
Participate in code reviews and design discussions * Support and mentor mid-level engineers where ... Evaluate agent performance across multi-step tasks (task success rate, error propagation) * Debug ...
Biostatistician
South Fulton, GA · Remote
$60 - $100/hr
No prior experience in AI is required -- your domain knowledge is what matters. Scope of Work ... Design and author expert-level evaluation tasks simulating real-world biostatistics challenges ...
Biostatistician
South Fulton, GA · Remote
$60 - $100/hr
No prior experience in AI is required -- your domain knowledge is what matters. Scope of Work ... Design and author expert-level evaluation tasks simulating real-world biostatistics challenges ...
Director of Biostatistics
Athens, GA · Remote
$60 - $100/hr
No prior experience in AI is required -- your domain knowledge is what matters. Scope of Work ... Design and author expert-level evaluation tasks simulating real-world biostatistics challenges ...
Director of Biostatistics
Athens, GA · Remote
$60 - $100/hr
No prior experience in AI is required -- your domain knowledge is what matters. Scope of Work ... Design and author expert-level evaluation tasks simulating real-world biostatistics challenges ...
Senior AI Engineer
Atlanta, GA · On-site
$120 - $160/hr
Participate in code reviews and design discussions * Support and mentor mid-level engineers where ... Evaluate agent performance across multi-step tasks (task success rate, error propagation) * Debug ...
Senior AI Engineer
Atlanta, GA · On-site
$120 - $160/hr
Participate in code reviews and design discussions * Support and mentor mid-level engineers where ... Evaluate agent performance across multi-step tasks (task success rate, error propagation) * Debug ...
Director of Biostatistics
Savannah, GA · Remote
$60 - $100/hr
No prior experience in AI is required -- your domain knowledge is what matters. Scope of Work ... Design and author expert-level evaluation tasks simulating real-world biostatistics challenges ...
Director of Biostatistics
Savannah, GA · Remote
$60 - $100/hr
No prior experience in AI is required -- your domain knowledge is what matters. Scope of Work ... Design and author expert-level evaluation tasks simulating real-world biostatistics challenges ...
Biostatistician
Sandy Springs, GA · Remote
$60 - $100/hr
No prior experience in AI is required -- your domain knowledge is what matters. Scope of Work ... Design and author expert-level evaluation tasks simulating real-world biostatistics challenges ...
Biostatistician
Sandy Springs, GA · Remote
$60 - $100/hr
No prior experience in AI is required -- your domain knowledge is what matters. Scope of Work ... Design and author expert-level evaluation tasks simulating real-world biostatistics challenges ...
Biostatistician
Columbus, GA · Remote
$60 - $100/hr
No prior experience in AI is required -- your domain knowledge is what matters. Scope of Work ... Design and author expert-level evaluation tasks simulating real-world biostatistics challenges ...
Biostatistician
Columbus, GA · Remote
$60 - $100/hr
No prior experience in AI is required -- your domain knowledge is what matters. Scope of Work ... Design and author expert-level evaluation tasks simulating real-world biostatistics challenges ...
Director of Biostatistics
South Fulton, GA · Remote
$60 - $100/hr
No prior experience in AI is required -- your domain knowledge is what matters. Scope of Work ... Design and author expert-level evaluation tasks simulating real-world biostatistics challenges ...
Director of Biostatistics
South Fulton, GA · Remote
$60 - $100/hr
No prior experience in AI is required -- your domain knowledge is what matters. Scope of Work ... Design and author expert-level evaluation tasks simulating real-world biostatistics challenges ...
Biostatistician
Athens, GA · Remote
$60 - $100/hr
No prior experience in AI is required -- your domain knowledge is what matters. Scope of Work ... Design and author expert-level evaluation tasks simulating real-world biostatistics challenges ...
Biostatistician
Athens, GA · Remote
$60 - $100/hr
No prior experience in AI is required -- your domain knowledge is what matters. Scope of Work ... Design and author expert-level evaluation tasks simulating real-world biostatistics challenges ...
Director of Biostatistics
Sandy Springs, GA · Remote
$60 - $100/hr
No prior experience in AI is required -- your domain knowledge is what matters. Scope of Work ... Design and author expert-level evaluation tasks simulating real-world biostatistics challenges ...
Director of Biostatistics
Sandy Springs, GA · Remote
$60 - $100/hr
No prior experience in AI is required -- your domain knowledge is what matters. Scope of Work ... Design and author expert-level evaluation tasks simulating real-world biostatistics challenges ...
Biostatistician
Augusta, GA · Remote
$60 - $100/hr
No prior experience in AI is required -- your domain knowledge is what matters. Scope of Work ... Design and author expert-level evaluation tasks simulating real-world biostatistics challenges ...
Biostatistician
Augusta, GA · Remote
$60 - $100/hr
No prior experience in AI is required -- your domain knowledge is what matters. Scope of Work ... Design and author expert-level evaluation tasks simulating real-world biostatistics challenges ...
Director of Biostatistics
Augusta, GA · Remote
$60 - $100/hr
No prior experience in AI is required -- your domain knowledge is what matters. Scope of Work ... Design and author expert-level evaluation tasks simulating real-world biostatistics challenges ...
Director of Biostatistics
Augusta, GA · Remote
$60 - $100/hr
No prior experience in AI is required -- your domain knowledge is what matters. Scope of Work ... Design and author expert-level evaluation tasks simulating real-world biostatistics challenges ...
Biostatistician
Savannah, GA · Remote
$60 - $100/hr
No prior experience in AI is required -- your domain knowledge is what matters. Scope of Work ... Design and author expert-level evaluation tasks simulating real-world biostatistics challenges ...
Biostatistician
Savannah, GA · Remote
$60 - $100/hr
No prior experience in AI is required -- your domain knowledge is what matters. Scope of Work ... Design and author expert-level evaluation tasks simulating real-world biostatistics challenges ...
Director of Biostatistics
Macon, GA · Remote
$60 - $100/hr
No prior experience in AI is required -- your domain knowledge is what matters. Scope of Work ... Design and author expert-level evaluation tasks simulating real-world biostatistics challenges ...
Director of Biostatistics
Macon, GA · Remote
$60 - $100/hr
No prior experience in AI is required -- your domain knowledge is what matters. Scope of Work ... Design and author expert-level evaluation tasks simulating real-world biostatistics challenges ...
Biostatistician
Atlanta, GA · Remote
$60 - $100/hr
No prior experience in AI is required -- your domain knowledge is what matters. Scope of Work ... Design and author expert-level evaluation tasks simulating real-world biostatistics challenges ...
Biostatistician
Atlanta, GA · Remote
$60 - $100/hr
No prior experience in AI is required -- your domain knowledge is what matters. Scope of Work ... Design and author expert-level evaluation tasks simulating real-world biostatistics challenges ...
Director of Biostatistics
Atlanta, GA · Remote
$60 - $100/hr
No prior experience in AI is required -- your domain knowledge is what matters. Scope of Work ... Design and author expert-level evaluation tasks simulating real-world biostatistics challenges ...
Director of Biostatistics
Atlanta, GA · Remote
$60 - $100/hr
No prior experience in AI is required -- your domain knowledge is what matters. Scope of Work ... Design and author expert-level evaluation tasks simulating real-world biostatistics challenges ...
Ai Task Reviewer information
What is the difference between Ai Task Reviewer vs Data Annotator?
| Aspect | Ai Task Reviewer | Data Annotator |
|---|---|---|
| Required Credentials | Basic computer skills, training in review guidelines | Basic computer skills, training in annotation tools |
| Work Environment | Remote or office-based, reviewing AI outputs | Remote or office-based, labeling and annotating data |
| Industry Usage | AI development, machine learning projects | Data preparation, machine learning datasets |
| Search & Comparison Intent | Understanding review roles in AI projects | Understanding data labeling roles in AI |
The main difference between an Ai Task Reviewer and a Data Annotator lies in their roles within AI development. Ai Task Reviewers focus on evaluating and validating AI outputs, ensuring quality and accuracy, while Data Annotators are responsible for labeling and preparing data used to train AI models. Both roles are essential in the AI industry, often requiring similar skills but serving different functions in the data pipeline.
Are remote AI task reviewer jobs legit?
How to become an AI Task Reviewer?
What are popular job titles related to Ai Task Reviewer jobs in Georgia?
For Ai Task Reviewer jobs in Georgia, the most frequently searched job titles are:
What job categories do people searching Ai Task Reviewer jobs in Georgia look for?
The top searched job categories for Ai Task Reviewer jobs in Georgia are:
What cities in Georgia are hiring for Ai Task Reviewer jobs?
Cities in Georgia with the most Ai Task Reviewer job openings:

Full-time
Posted 18 days ago
Job description
Job Purpose
Intercontinental Exchange, Inc. (ICE) is seeking an AI and Data Product Manager to lead the transformation of established business workflows by rebuilding them around AI-not by layering AI on top of them. This role owns the strategy, roadmap, and delivery of our AI-powered applications and data products, sitting at the intersection of business operations, data science, machine learning engineering, and our customers. You will be part of a highly visible team central to ICE's strategy to analyze mortgage and market data and deliver AI-driven insights to our clients in a meaningful, responsible, and scalable way.
This is a process-transformation role first and a feature-delivery role second. We hire for the ability to decompose workflows and apply AI where it is verifiable-not for prior expertise in any specific industry. A track record of entering an unfamiliar domain, mapping its workflows, and shipping something measurable is the signal we value most.
Responsibilities
Map and decompose existing business workflows end-to-end-identifying steps that are high-volume, high-variance, and verifiable-before deciding where AI belongs.
Reimagine processes around AI rather than bolting AI onto current steps, prioritizing opportunities by the principle of volume, variance, and verifiability.
Define and own the product vision, strategy, and multi-quarter roadmap for a portfolio of AI applications and data products aligned to business objectives.
Size AI opportunities with conservative, evidence-based ROI assumptions, targeting tasks whose outputs can be reliably graded and avoiding "too much, too fast" over-commitment.
Partner closely with data science and ML engineering to translate models-including predictive analytics, NLP, and LLM/generative AI and agentic solutions-into reliable, production-grade products.
Design evaluation criteria and acceptance thresholds ("define good before building"); establish evals, blind review panels, and LLM-as-judge methods, and monitor for hallucination, bias drift, and model degradation in production.
Architect human-in-the-loop workflows with expert review designed in, expanding automation only after each phase is proven.
Productize ICE's proprietary data assets into well-defined data products such as APIs, data feeds, datasets, dashboards, and embedded analytics.
Write clear product requirement documents (PRDs), user stories, and acceptance criteria; maintain and prioritize the product backlog within an Agile/Scrum environment.
Define success metrics and KPIs (adoption, task success rate, model performance, revenue, ROI) and use data to measure outcomes and continuously improve products.
Drive change management and adoption-bridging data scientists and business owners and getting non-technical stakeholders to embrace AI-changed workflows.
Champion responsible AI in partnership with data science, risk, and compliance: model governance, bias and fairness, explainability, model risk, and data quality.
Ensure products meet regulatory and data-governance requirements relevant to mortgage and financial services (e.g., MISMO, FNMA, FHLMC, GNMA, and applicable privacy standards).
Communicate roadmap, trade-offs, progress, and results to cross-functional partners and executive leadership.
Knowledge and Experience
- 6+ years of product management experience, with demonstrated work building AI/ML-powered products, data products, or workflow-automation solutions (mid-level is the target tier).
A demonstrable example of entering a domain cold, mapping its workflows, identifying AI leverage points, and shipping something measurable-industry independent.
Strong process-decomposition skills: the ability to map a workflow in detail and score steps by volume, variance, and verifiability.
Practical AI literacy: working comprehension of LLMs, RAG, agents, prompt engineering, and evaluation design (you do not need to code or train models).
Empirical mindset: experience designing evals, blind reviews, A/B tests, and acceptance criteria, and iterating against evidence.
Data literacy, including comfort with SQL and analytics tools to define metrics and inform decisions.
Change-management and stakeholder-translation experience getting non-technical teams to adopt new, AI-driven ways of working.
Ability to recall specific metrics from products you have shipped (e.g., hallucination rate, retrieval precision, task success rate, latency).
Proven experience working in Agile/Scrum teams and managing a product backlog.
Excellent written and oral communication, with the ability to explain probabilistic systems to both technical and non-technical audiences.
Preferred Knowledge and Experience
Advanced degree (e.g., MBA) or product/Agile certification (e.g., Pragmatic Institute, CSPO, SAFe POPM).
Hands-on experience with at least one workflow or process platform-e.g., n8n, Zapier, Make, Workato, Celonis, UiPath.
Experience launching generative AI / LLM-based or agentic products or features.
Background that develops process thinking before AI-operations management, management consulting, analytics/data, or growth/experimentation product management.
Familiarity with cloud platforms (e.g., AWS) and modern data warehouses such as Snowflake or Databricks.
Understanding of human-in-the-loop design, model monitoring, drift detection, and responsible-AI frameworks.
Exposure to mortgage technology, capital markets, or financial services is helpful but not required.
- A computer science degree. Roughly 60% of working AI PMs do not hold one; demonstrated AI experience is the signal.
The ability to code or train models. Data literacy and AI comprehension are sufficient.
Prior expertise in mortgage or financial services. Pattern transfer and rapid domain immersion matter more than industry credentials; domain knowledge can be borrowed empirically from practitioners.
Technical & Tool Familiarity
AI/ML Concepts: LLMs, RAG, agents, prompt engineering, and evaluation metrics (precision, recall, F1, hallucination rate, task success rate, latency).
AI Orchestration (Execution): UiPath Maestro, n8n; awareness of agent protocols such as MCP, A2A, and ACP.
Workflow Builders (Prototyping): Any of n8n, Zapier, Make, Workato.
Data Platforms: SQL, Snowflake, Databricks, Spark; data pipelines and ETL concepts.
Cloud: AWS (or comparable cloud environments).
Visualization & BI: SIGMA, Tableau, Microsoft Power BI.
Product & Delivery: Jira, Confluence, Productboard; product analytics.
About IntercontinentalExchange
Sourced by ZipRecruiter
Company size
5,001 - 10,000 Employees
Headquarters location
Atlanta, GA, US
Year founded
1990