1

Ai Data Rater Jobs in Norwalk, CT (NOW HIRING)

Applied AI Data Analyst

New York, NY · On-site

$180K - $240K/yr

The Role As an Applied AI Data Analyst, you will bridge the gap between our massive, unstructured ... Analyze edge cases, model predictions, hallucination rates, and extraction accuracy for our LLM ...

Gen-AI Data Scientist Lead

New York, NY · On-site

$140K - $180K/yr

Key responsibilities Are you an analytical thinker who enjoys leveraging data and advanced ... rate-limited APIs • you're curious to explore how AI can improve how we build, deliver, and ...

Kroll affirmed a BBB+ (investment grade) deposit rating on January 25, 2024. For the fourth time ... Thirdparty AI & data stewardship: * Support due diligence, testing, and ongoing monitoring of ...

Kroll affirmed a BBB+ (investment grade) deposit rating on January 25, 2024. For the fourth time ... Third-party AI & data stewardship: * Support due diligence, testing, and ongoing monitoring of ...

Sr. Data Scientist

New York, NY · On-site

$162K - $175K/yr

... rated apps of all time What you're applying for We're looking for a Senior AI Data Scientist to help push Lemonade's pricing models into genuinely new territory. You'll sit within our Data Science ...

next page

Showing results 1-20

Ai Data Rater information

What is an AI data rater?

An AI Data Rater evaluates and rates AI-generated content, such as search engine results, chat responses, or recommendations, to improve machine learning models. They follow specific guidelines to assess relevance, accuracy, and quality. This role helps refine AI systems by providing valuable feedback to enhance their performance. It typically requires strong analytical skills, attention to detail, and familiarity with the subject matter being rated.

What does an AI data rater do?

As an AI Data Rater, your main responsibilities include reviewing and evaluating various types of data—such as search queries, images, or social media content—according to detailed guidelines provided by your employer. You will typically work independently, using specialized tools or web-based platforms to rate data quality, relevance, or appropriateness. Attention to detail and consistency are important, as your feedback directly impacts the effectiveness of AI systems. Depending on the employer, you may also participate in training sessions or occasional team meetings to stay updated on the latest guidelines or project requirements.

What skills and qualifications are needed to thrive as an AI data rater?

To succeed as an AI Data Rater, you need strong analytical skills, attention to detail, and proficiency in evaluating data quality, typically requiring at least a high school diploma or equivalent. Familiarity with computer systems, web browsers, and proprietary rating platforms is often necessary, and training in data privacy or AI guidelines is sometimes provided. Excellent time management, adaptability, and effective written communication help candidates stand out in this largely remote and independent role. These skills ensure accurate data evaluations, support AI improvement, and enable consistent, high-quality performance.

What cities near Norwalk, CT are hiring for Ai Data Rater jobs?

Cities near Norwalk, CT with the most Ai Data Rater job openings:

Infographic showing various Ai Data Rater job openings in Norwalk, CT as of July 2026, with employment types broken down into 63% Full Time, and 37% Part Time. Highlights an 60% In-person, and 40% Remote job distribution.

Applied AI Data Analyst

Confido

New York, NY • On-site

$180K - $240K/yr

Full-time

Medical, Dental, Vision, Retirement, PTO

Posted 9 days ago


Job description

Confido is the AI infrastructure powering modern CPG - the platform that 200+ brands like OLIPOP, Simple Mills, Dr. Squatch, and Tropicana use to run everything from deductions to production planning. Finance, accounting, sales, and operations, unified in one system for the first time.
We're growing 5x year over year with a small team in New York City; the people who join now will shape the product, the culture, and the company itself.
If you want your work on shelves everywhere - and outsized ownership while you build - we'd love to meet you.
The Role
As an Applied AI Data Analyst, you will bridge the gap between our massive, unstructured financial and operational datasets to our core R&D team. You will own the evaluation platform of our agentic workflows forecasting pipelines, as well as improve customer facing insights leading to mission-critical decisions.
This role is part of the Applied AI Research department, with options to advance to senior data science and AI/ML engineering roles.
Location: New York, NY (In-Person | Relocation supported)
What you'll do
  • Algorithm & LLM Evaluation: Analyze edge cases, model predictions, hallucination rates, and extraction accuracy for our LLM-driven document processing systems and agentic workflows.
  • Root Cause Analysis: Dig deep into complex datasets (inconsistent financial documents, fragmented enterprise systems) to determine why an extraction or time-series model succeeded or failed.
  • Golden Dataset Curation: Define, curate, and maintain gold-standard evaluation datasets ("golden sets") for automated backtesting of AI agents and demand forecasting models.
  • Performance Monitoring & Evals: Build dashboards, data transformations, and evaluation harnesses to monitor system health, model drift, and AI performance metrics across release cycles.
  • Cross-Functional Collaboration: Partner directly with applied AI engineers, product managers and business operations managers to turn qualitative real-world problem definitions into quantitative product defining insights.

What we're looking for
Required
  • Education: Graduate degree (M.S. or Ph.D.) in Computer Science, Data Science, Statistics, Mathematics, Physics, or a related STEM field.
  • Experience: 2-4 years of experience in a quantitative data analyst or AI evaluation role, working closely alongside AI/ML R&D teams.
  • Programming & Agentic AI: Proficiency in Python and hands-on works with AI/ML models
  • Data Stack: Strong capabilities with SQL and enterprise data infrastructure (PostgreSQL, Snowflake, dbt, AWS).
  • Analytical Mindset: Exceptional ability to translate noisy, unstructured document data into rigorous evaluation insights for engineers.

Nice to have
  • Experience with LLM observability, tracing, and eval frameworks (LangSmith, Arize AI, or TruLens).
  • Proficiency with agentic workflows or multi-agent orchestration.
  • Familiarity with demand forecasting, time-series models, or statistical modeling.
  • Comfort in fast-moving, high-growth NYC startup environments.

Perks + Benefits
  • Equity - own a meaningful piece of the company you're helping build
  • Fully paid health coverage through Aetna - we cover 100% of employee premiums
  • Top-tier dental and vision coverage through Guardian
  • Carrot Fertility Pro - comprehensive fertility and family-forming support
  • 12 weeks of paid parental leave
  • Unlimited PTO - plus regular 4-day holiday weekends we actually take
  • 401(k) through Vestwell
  • Paid relocation support - we'll help you make the move to NYC
  • Fully equipped workspace from day one - laptop, monitor, keyboard, and a $200 stipend to personalize your setup
  • Team perks - catered Friday lunches, team dinners, and unlimited coffee + snacks featuring products from the brands we work with

Confido provides equal employment opportunities to all employees and applicants for employment and prohibits discrimination and harassment of any type without regard to race, color, religion, age, sex, national origin, disability status, genetics, protected veteran status, sexual orientation, gender identity or expression, or any other characteristic protected by federal, state or local laws.