Experience in AI/ML data workflows or human-in-the-loop evaluation environments * Prior experience auditing or reviewing the work of others * Familiarity with safety, compliance, or policy-driven ...
Quick apply
Experience in AI/ML data workflows or human-in-the-loop evaluation environments * Prior experience auditing or reviewing the work of others * Familiarity with safety, compliance, or policy-driven ...
Quick apply
Experience in AI/ML data workflows or human-in-the-loop evaluation environments * Prior experience auditing or reviewing the work of others * Familiarity with safety, compliance, or policy-driven ...
Miami, FL · On-site
Contribute to the design of agent personas/roles, workflows, including decision logic, triggers, and escalation paths/human-in-the-loop rules. * Build and configure AI agents using LLMs, retrieval ...
Miami, FL · On-site
Contribute to the design of agent personas/roles, workflows, including decision logic, triggers, and escalation paths/human-in-the-loop rules. * Build and configure AI agents using LLMs, retrieval ...
Contribute to the design of agent personas/roles, workflows, including decision logic, triggers, and escalation paths/human-in-the-loop rules. * Build and configure AI agents using LLMs, retrieval ...
Contribute to the design of agent personas/roles, workflows, including decision logic, triggers, and escalation paths/human-in-the-loop rules. * Build and configure AI agents using LLMs, retrieval ...
Contribute to the design of agent personas/roles, workflows, including decision logic, triggers, and escalation paths/human-in-the-loop rules. * Build and configure AI agents using LLMs, retrieval ...
Contribute to the design of agent personas/roles, workflows, including decision logic, triggers, and escalation paths/human-in-the-loop rules. * Build and configure AI agents using LLMs, retrieval ...
Experience in AI/ML data workflows or human-in-the-loop evaluation environments * Prior experience auditing or reviewing the work of others * Familiarity with safety, compliance, or policy-driven ...
Quick apply
Experience in AI/ML data workflows or human-in-the-loop evaluation environments * Prior experience auditing or reviewing the work of others * Familiarity with safety, compliance, or policy-driven ...
Experience in AI/ML data workflows or human-in-the-loop evaluation environments * Prior experience auditing or reviewing the work of others * Familiarity with safety, compliance, or policy-driven ...
Quick apply
Experience in AI/ML data workflows or human-in-the-loop evaluation environments * Prior experience auditing or reviewing the work of others * Familiarity with safety, compliance, or policy-driven ...
Experience in AI/ML data workflows or human-in-the-loop evaluation environments * Prior experience auditing or reviewing the work of others * Familiarity with safety, compliance, or policy-driven ...
Quick apply
Experience in AI/ML data workflows or human-in-the-loop evaluation environments * Prior experience auditing or reviewing the work of others * Familiarity with safety, compliance, or policy-driven ...
Experience in AI/ML data workflows or human-in-the-loop evaluation environments * Prior experience auditing or reviewing the work of others * Familiarity with safety, compliance, or policy-driven ...
Quick apply
Experience in AI/ML data workflows or human-in-the-loop evaluation environments * Prior experience auditing or reviewing the work of others * Familiarity with safety, compliance, or policy-driven ...
Experience in AI/ML data workflows or human-in-the-loop evaluation environments * Prior experience auditing or reviewing the work of others * Familiarity with safety, compliance, or policy-driven ...
Quick apply
Experience in AI/ML data workflows or human-in-the-loop evaluation environments * Prior experience auditing or reviewing the work of others * Familiarity with safety, compliance, or policy-driven ...
Experience in AI/ML data workflows or human-in-the-loop evaluation environments * Prior experience auditing or reviewing the work of others * Familiarity with safety, compliance, or policy-driven ...
Quick apply
Experience in AI/ML data workflows or human-in-the-loop evaluation environments * Prior experience auditing or reviewing the work of others * Familiarity with safety, compliance, or policy-driven ...
Own prompt design, routing rules, human-in-loop governance * Knowledge base and SOPs. Clean source of truth with named owners per partner. You write the runbooks personally, not just review what ...
Own prompt design, routing rules, human-in-loop governance * Knowledge base and SOPs. Clean source of truth with named owners per partner. You write the runbooks personally, not just review what ...
Own prompt design, routing rules, human-in-loop governance * Knowledge base and SOPs. Clean source of truth with named owners per partner. You write the runbooks personally, not just review what ...
Own prompt design, routing rules, human-in-loop governance * Knowledge base and SOPs. Clean source of truth with named owners per partner. You write the runbooks personally, not just review what ...
Experience in AI/ML data workflows or human-in-the-loop evaluation environments * Prior experience auditing or reviewing the work of others * Familiarity with safety, compliance, or policy-driven ...
Quick apply
Experience in AI/ML data workflows or human-in-the-loop evaluation environments * Prior experience auditing or reviewing the work of others * Familiarity with safety, compliance, or policy-driven ...
$171K - $258K/yr
... in human-in-the-loop evaluation or data annotation workflows Minimum Qualifications MS or PhD in Computer Science, Human-Computer Interaction or equivalent degree 3+ years of experience in mixed ...
$171K - $258K/yr
... in human-in-the-loop evaluation or data annotation workflows Minimum Qualifications MS or PhD in Computer Science, Human-Computer Interaction or equivalent degree 3+ years of experience in mixed ...
Cambridge, MA · On-site
In parallel, the candidate will contribute to the development of high-fidelity Unity-based simulation environments for human-in-the-loop experimentation, operator training, data generation, and ...
Cambridge, MA · On-site
In parallel, the candidate will contribute to the development of high-fidelity Unity-based simulation environments for human-in-the-loop experimentation, operator training, data generation, and ...
This is not just about managing throughput -- it's about shaping how quality is defined, measured, and improved in a human-in-the-loop environment. Project Details * Job Title: Data Quality Lead
Quick apply
This is not just about managing throughput -- it's about shaping how quality is defined, measured, and improved in a human-in-the-loop environment. Project Details * Job Title: Data Quality Lead
This is not just about managing throughput -- it's about shaping how quality is defined, measured, and improved in a human-in-the-loop environment. Project Details * Job Title: Data Quality Lead
Quick apply
This is not just about managing throughput -- it's about shaping how quality is defined, measured, and improved in a human-in-the-loop environment. Project Details * Job Title: Data Quality Lead
This is not just about managing throughput -- it's about shaping how quality is defined, measured, and improved in a human-in-the-loop environment. Project Details * Job Title: Data Quality Lead
Quick apply
This is not just about managing throughput -- it's about shaping how quality is defined, measured, and improved in a human-in-the-loop environment. Project Details * Job Title: Data Quality Lead
Experience in AI/ML data workflows or human-in-the-loop evaluation environments * Prior experience auditing or reviewing the work of others * Familiarity with safety, compliance, or policy-driven ...
Quick apply
Experience in AI/ML data workflows or human-in-the-loop evaluation environments * Prior experience auditing or reviewing the work of others * Familiarity with safety, compliance, or policy-driven ...
Experience in AI/ML data workflows or human-in-the-loop evaluation environments * Prior experience auditing or reviewing the work of others * Familiarity with safety, compliance, or policy-driven ...
Quick apply
Experience in AI/ML data workflows or human-in-the-loop evaluation environments * Prior experience auditing or reviewing the work of others * Familiarity with safety, compliance, or policy-driven ...
$26.5K - $29.5K
1% of jobs
$29.5K - $32.6K
3% of jobs
$32.6K - $35.6K
6% of jobs
$37.8K is the 25th percentile. Wages below this are outliers.
$35.6K - $38.7K
20% of jobs
$38.7K - $41.7K
18% of jobs
The median wage is $41.9K / yr.
$41.7K - $44.8K
17% of jobs
$46.9K is the 75th percentile. Wages above this are outliers.
$44.8K - $47.8K
13% of jobs
$47.8K - $50.9K
9% of jobs
$50.9K - $53.9K
6% of jobs
$53.9K - $57K
3% of jobs
$57K - $60K
3% of jobs
$26.5K
$44.2K
$60K
| Aspect | Human In Loop | Data Annotator |
|---|---|---|
| Required Credentials | Basic technical skills, sometimes certifications in data labeling or AI | Minimal formal credentials, often on-the-job training |
| Work Environment | Collaborative, often integrated into AI development teams | Primarily focused on labeling data, often in a controlled environment |
| Employer & Industry Usage | Tech companies, AI development, machine learning projects | Data labeling services, AI training datasets |
| Search & Comparison Intent | Understanding roles in AI data processes | Data labeling and annotation tasks |
Human In Loop roles involve active collaboration with AI systems, often requiring technical understanding, while Data Annotators focus on labeling data with minimal technical skills. Both roles are essential in AI development but differ in scope and responsibilities.

$38/hr
Full-time
Medical, Dental, Vision, Life, Retirement, PTO
Posted 6 days ago
5.9
Based on 10 frontline employees who took The Breakroom Quiz
336th of 428 rated business services
Welo Data is looking for experienced, detail-oriented professionals to join our team as Data Quality Analysts. This role sits at the center of execution and quality — bridging Data Labeling Associates (DLAs) and Team Leads to ensure work is not only completed, but done right.
You'll work closely with both people and AI systems — auditing outputs, supporting day-to-day execution, and helping teams apply guidelines correctly in fast-moving, real-world scenarios. The work combines data quality, light project coordination, and hands-on training, where your ability to guide others and think critically is just as important as your own output.
Project DetailsImportant: This is a 100% onsite position — remote work is not available for this role. To be considered, candidates must be located in or able to commute to one of the following cities: New York City, Seattle, Bellevue, Redmond, San Francisco, Sunnyvale, or Burlingame. Please only apply if you meet this location requirement.
What You'll DoSourced by ZipRecruiter
Translation services
1,001 - 5,000 Employees
New York, NY, US