Rate and compare multiple AI responses based on correctness, reasoning quality, fluency, and ... Previous experience in AI data training, annotation, editorial QA, localization QA, or professional ...
New
Quick apply
Rate and compare multiple AI responses based on correctness, reasoning quality, fluency, and ... Previous experience in AI data training, annotation, editorial QA, localization QA, or professional ...
New
Quick apply
Rate and compare multiple AI responses based on correctness, reasoning quality, fluency, and ... Previous experience in AI data training, annotation, editorial QA, localization QA, or professional ...
New
Job Title: AI Content Rater - Ukrainian Fluency What if your expertise in Ukrainian language and writing could help improve the next generation of AI systems used by millions of people worldwide?
Quick apply
Job Title: AI Content Rater - Ukrainian Fluency What if your expertise in Ukrainian language and writing could help improve the next generation of AI systems used by millions of people worldwide?
New York, NY · Remote
$20/hr
As an annotator, you may be invited to take part in online projects such as rating AI-generated ... Carefully review provided data (text, images, or videos); * Label or classify content based on ...
New York, NY · Remote
$20/hr
As an annotator, you may be invited to take part in online projects such as rating AI-generated ... Carefully review provided data (text, images, or videos); * Label or classify content based on ...
It scaled from $0 to a multi-million-dollar run rate in a matter of months and recently raised again. Industry: AI / Data The Role The first point of contact for operating companies exploring a new ...
Quick apply
It scaled from $0 to a multi-million-dollar run rate in a matter of months and recently raised again. Industry: AI / Data The Role The first point of contact for operating companies exploring a new ...
New York, NY · On-site +1
$20/hr
As an annotator, you may be invited to take part in online projects such as rating AI-generated ... Carefully review provided data (text, images, or videos); * Label or classify content based on ...
New York, NY · On-site +1
$20/hr
As an annotator, you may be invited to take part in online projects such as rating AI-generated ... Carefully review provided data (text, images, or videos); * Label or classify content based on ...
... ratings and a reach that spans 40+ countries and regions. Leveraging our 350-year heritage, MSIG ... Position Overview We are seeking a seasoned Enterprise Data & AI Architect at the Lead/Principal ...
... ratings and a reach that spans 40+ countries and regions. Leveraging our 350-year heritage, MSIG ... Position Overview We are seeking a seasoned Enterprise Data & AI Architect at the Lead/Principal ...
... ratings and a reach that spans 40+ countries and regions. Leveraging our 350-year heritage, MSIG ... Position Overview We are seeking a seasoned Enterprise Data & AI Architect at the Lead/Principal ...
... ratings and a reach that spans 40+ countries and regions. Leveraging our 350-year heritage, MSIG ... Position Overview We are seeking a seasoned Enterprise Data & AI Architect at the Lead/Principal ...
New York, NY · On-site
AI/ML Data Scientist Location: New York, NY Role Summary: Develop and evaluate machine learning and ... Design prompt libraries and benchmark hallucination rates, sensitivity to input phrasing * Track ...
Quick apply
New York, NY · On-site
AI/ML Data Scientist Location: New York, NY Role Summary: Develop and evaluate machine learning and ... Design prompt libraries and benchmark hallucination rates, sensitivity to input phrasing * Track ...
$150K - $261K/yr
Data Analytics & Reporting Reporting at the enterprise level, this role leads the development and ... Salaries for part-time roles will be pro-rated based on number of hours regularly worked. For ...
$150K - $261K/yr
Data Analytics & Reporting Reporting at the enterprise level, this role leads the development and ... Salaries for part-time roles will be pro-rated based on number of hours regularly worked. For ...
East Brunswick, NJ · On-site
$114K - $136K/yr
Scala/Spark Engineer - Data Engineering & AI Workflows (Over 10+ exp) Location ... Sunnyvale, CA (Onsite)- Prefer local candidates FTE/Contract Salary/hourly Pay rate: Market+ based ...
East Brunswick, NJ · On-site
$114K - $136K/yr
Scala/Spark Engineer - Data Engineering & AI Workflows (Over 10+ exp) Location ... Sunnyvale, CA (Onsite)- Prefer local candidates FTE/Contract Salary/hourly Pay rate: Market+ based ...
New York, NY · Remote
$23/hr
As an annotator, you may be invited to take part in online projects such as rating AI-generated ... Carefully review provided data (text, images, or videos) * Label or classify content based on ...
New York, NY · Remote
$23/hr
As an annotator, you may be invited to take part in online projects such as rating AI-generated ... Carefully review provided data (text, images, or videos) * Label or classify content based on ...
New York, NY · On-site
$155K - $300K/yr
We work directly with frontier AI lab researchers to create evaluations, publish benchmarks, and push the boundary of data. We've grown from $0 to ~$1B run rate and pay ~$60M to over 30K individuals ...
Quick apply
New York, NY · On-site
$155K - $300K/yr
We work directly with frontier AI lab researchers to create evaluations, publish benchmarks, and push the boundary of data. We've grown from $0 to ~$1B run rate and pay ~$60M to over 30K individuals ...
Warren, NJ · Hybrid
$77K - $105K/yr
Data Analyst, Analytics & AI Insights Company: Everest Global Services, Inc. Job Category ... The offered rate of compensation will be based on individual education, experience, qualifications ...
Warren, NJ · Hybrid
$77K - $105K/yr
Data Analyst, Analytics & AI Insights Company: Everest Global Services, Inc. Job Category ... The offered rate of compensation will be based on individual education, experience, qualifications ...
New York, NY · Remote
$139K/yr
... AI efforts.This is a unique opportunity to partner with teams across Meta and shape the company ... Strong commercial negotiation skills, using multiple levers beyond rate (e.g., volume discounts ...
New York, NY · Remote
$139K/yr
... AI efforts.This is a unique opportunity to partner with teams across Meta and shape the company ... Strong commercial negotiation skills, using multiple levers beyond rate (e.g., volume discounts ...
Bridgewater, NJ · On-site
$65 - $75/hr
Support the various AI/ML models that need to be deployed to production. * Troubleshoot various ... Message & data rates apply and message frequency may vary. Consistent with Judge's Privacy Policy ...
Bridgewater, NJ · On-site
$65 - $75/hr
Support the various AI/ML models that need to be deployed to production. * Troubleshoot various ... Message & data rates apply and message frequency may vary. Consistent with Judge's Privacy Policy ...
New York, NY · On-site
$111K - $222K/yr
... Data Scientist will serve as a trusted advisor to business stakeholders, combining hands-on AI ... rate or base annual full-time salary for all positions in the job grade within which this position ...
New York, NY · On-site
$111K - $222K/yr
... Data Scientist will serve as a trusted advisor to business stakeholders, combining hands-on AI ... rate or base annual full-time salary for all positions in the job grade within which this position ...
New York, NY · On-site
$139K - $196K/yr
... Gen AI efforts. This is a unique opportunity to partner with teams across Meta and shape the ... rate (e.g., volume discounts, quality thresholds, speed to market, service levels) • A deep ...
New York, NY · On-site
$139K - $196K/yr
... Gen AI efforts. This is a unique opportunity to partner with teams across Meta and shape the ... rate (e.g., volume discounts, quality thresholds, speed to market, service levels) • A deep ...
It scaled from $0 to a multi-million-dollar run rate in a matter of months and recently raised. Industry: AI / Data The Role As Business Development Representative (Wind-Down), you're the first point ...
Quick apply
It scaled from $0 to a multi-million-dollar run rate in a matter of months and recently raised. Industry: AI / Data The Role As Business Development Representative (Wind-Down), you're the first point ...
New York, NY · On-site
$205K - $300K/yr
We work directly with frontier AI lab researchers to create evaluations, publish benchmarks, and push the boundary of data. We've grown from $0 to ~$1B run rate and pay ~$60M to over 30K individuals ...
Quick apply
New York, NY · On-site
$205K - $300K/yr
We work directly with frontier AI lab researchers to create evaluations, publish benchmarks, and push the boundary of data. We've grown from $0 to ~$1B run rate and pay ~$60M to over 30K individuals ...
New York, NY · On-site
$165K - $185K/yr
... rating of A from AM Best, Fitch and S&P, and A3 from Moody's. Join Our Team We are seeking a ... This is a high-impact role ensuring that data and AI are trusted, compliant, and leveraged ...
New York, NY · On-site
$165K - $185K/yr
... rating of A from AM Best, Fitch and S&P, and A3 from Moody's. Join Our Team We are seeking a ... This is a high-impact role ensuring that data and AI are trusted, compliant, and leveraged ...
$14.62 - $16.96
8% of jobs
$19.01 is the 25th percentile. Wages below this are outliers.
$16.96 - $19.30
19% of jobs
$19.30 - $21.64
15% of jobs
The median wage is $22.99 / hr.
$21.64 - $23.98
14% of jobs
$23.98 - $26.33
12% of jobs
$26.33 - $28.67
6% of jobs
$30.13 is the 75th percentile. Wages above this are outliers.
$28.67 - $31.01
2% of jobs
$31.01 - $33.35
5% of jobs
$33.35 - $35.70
4% of jobs
$35.70 - $38.04
6% of jobs
$38.04 - $40.38
8% of jobs
$14
$26
$40
| Aspect | Overnight Ai Data Rater | Data Annotator |
|---|---|---|
| Credentials | Basic computer skills, sometimes high school diploma | Basic computer skills, sometimes high school diploma |
| Work Environment | Remote, flexible hours, often overnight shifts | Remote or on-site, flexible or regular hours |
| Industry Usage | AI training data, machine learning models | Data labeling, training datasets for AI |
| Job Focus | Reviewing and rating data for AI models | Labeling and annotating data for AI training |
Both Overnight Ai Data Raters and Data Annotators work in AI data preparation, often remotely, with similar entry-level requirements. The key difference is that Overnight Ai Data Raters primarily review and rate data, often during overnight shifts, while Data Annotators focus on labeling and annotating data to create training datasets. Understanding these distinctions helps job seekers find roles aligned with their skills and preferred work hours.
Cities near Basking Ridge, NJ with the most Overnight Ai Data Rater job openings:

Full-time
Posted 2 days ago
New
Job Type: Contractor
Location: Remote
We are seeking experienced English Language Experts to support a high-impact AI training and evaluation project. In this hourly remote role, you will review AI-generated English-language responses, create expert-level language content, evaluate reasoning quality, and provide precise, actionable feedback.
You will help improve AI models by assessing responses for accuracy, clarity, linguistic quality, reasoning, and adherence to prompts. The role requires strong language expertise, analytical thinking, attention to detail, and the ability to clearly explain and correct complex language or reasoning issues.
Key ResponsibilitiesCreate high-quality prompts and expert responses across diverse topics to support AI model training.
Review AI-generated English responses for accuracy, clarity, relevance, and adherence to the given prompt.
Evaluate the quality of reasoning and step-by-step solutions.
Identify errors in logic, meaning, methodology, grammar, syntax, or conceptual understanding.
Fact-check information when necessary and identify unsupported or inaccurate claims.
Edit and revise AI-generated responses to demonstrate correct, natural, and effective language.
Provide precise, clear, and actionable written feedback explaining errors and recommended improvements.
Rate and compare multiple AI responses based on correctness, reasoning quality, fluency, and contextual relevance.
Evaluate AI outputs for ambiguity, inconsistencies, meaning drift, and potential biases.
Apply relevant style guides and maintain consistency in tone, terminology, punctuation, capitalization, and formatting.
Develop AI training content that improves model accuracy, fluency, and contextual understanding.
Test AI models across different use cases to identify potential quality and reliability issues.
Use AI tools such as ChatGPT, Gemini, Perplexity, and other relevant platforms during content creation and evaluation.
Maintain consistent quality and productivity in an hourly, remote contractor environment.
Bachelor’s degree or higher in Linguistics, English, Translation/Localization, Communications, Journalism, or a related field.
Minimum C1 English proficiency, with C2 or native-level command strongly preferred.
Strong knowledge of grammar, syntax, semantics, pragmatics, discourse structure, and stylistic editing.
Exceptional attention to detail and ability to identify subtle errors, ambiguity, inconsistencies, and meaning drift.
Excellent written and verbal communication skills.
Ability to clearly explain corrections, reasoning, and language decisions.
Strong analytical and critical-thinking skills.
Ability to apply style guides and maintain consistency across different content types and registers.
Ability to work independently and reliably in a remote environment across time zones.
Professional proficiency in at least one additional language.
Previous experience in AI data training, annotation, editorial QA, localization QA, or professional copyediting.
Experience evaluating AI-generated content or training data.
Strong hands-on experience using ChatGPT, Gemini, Perplexity, or similar AI tools.
Experience developing prompts or creating AI training datasets.
Familiarity with AI model evaluation, response ranking, or quality assurance.
Experience working with multilingual, technical, editorial, or content-focused projects.
Expert English – C1/C2
Linguistics
Grammar & Syntax
Semantics & Pragmatics
Discourse Analysis
Stylistic Editing
AI Response Evaluation
Prompt Development
AI Training Data
Reasoning Evaluation
Fact-Checking
Editorial Quality Assurance
Attention to Detail
Written Communication
Verbal Communication
Critical Thinking
Multilingual Proficiency