ZipRecruiter

Log In

1

Data Rater Jobs in California (NOW HIRING)

Waymo

Data Scientist

San Diego, CA

Develop novel statistical methods to handle unique aspects of AV data; e.g. rate estimation with rare events, combining real and synthetic data, etc. * Frame and solve ambiguous problems, derive data ...

next page

Showing results 1-20

All JobsData Rater JobsData Rater Jobs in California

Data Rater information

What are the key skills and qualifications needed to thrive as a Data Rater, and why are they important?

To thrive as a Data Rater, you need strong analytical abilities, attention to detail, and proficiency in following detailed guidelines, often requiring at least a high school diploma or equivalent. Familiarity with web-based evaluation tools, spreadsheets, and sometimes proprietary rating platforms is typically expected. Excellent time management, critical thinking, and effective written communication are valuable soft skills for excelling in this role. These skills ensure accurate and consistent data evaluation, which directly impacts the quality and effectiveness of machine learning models and search algorithms.

What are some common challenges Data Raters face, and how can they effectively manage them?

Data Raters often encounter challenges such as maintaining consistency in their evaluations, understanding complex guidelines, and managing repetitive tasks. To effectively handle these, it's important to regularly review guideline updates, seek clarification from team leads when unsure, and use productivity techniques to stay focused during long periods of rating. Collaborating with peers through forums or team meetings can also help share best practices and resolve ambiguities.

What is the difference between Data Rater vs Data Annotator?

AspectData RaterData Annotator
Required CredentialsHigh school diploma or equivalent; some roles may require basic technical skillsHigh school diploma; some roles may prefer familiarity with annotation tools
Work EnvironmentRemote or office-based; often involves reviewing data for qualityRemote or office-based; involves labeling or tagging data for machine learning
Employer & Industry UsageTech companies, data services, AI firmsAI and machine learning companies, data labeling services

Data Raters primarily review and assess data quality, ensuring accuracy and consistency, while Data Annotators focus on labeling data to train machine learning models. Both roles are essential in AI development, often sharing similar skills and work environments, but differ in their specific tasks and objectives.

What are Data Raters?

Data Raters are professionals who evaluate and provide feedback on data, such as search engine results, advertisements, and social media content, to help improve the accuracy and relevance of algorithms. They often work with large tech companies to assess whether content meets specific quality guidelines and user intent. Data Raters typically work remotely on a part-time or flexible schedule, and their work is crucial in training artificial intelligence systems to better understand human preferences.
What are the most commonly searched types of Data Rater jobs in California? The most popular types of Data Rater jobs in California are:
What are popular job titles related to Data Rater jobs in California? For Data Rater jobs in California, the most frequently searched job titles are:
What job categories do people searching Data Rater jobs in California look for? The top searched job categories for Data Rater jobs in California are:
Data Rater jobs near you
Infographic showing various Data Rater job openings in California as of July 2026, with employment types broken down into 1% As Needed, 83% Full Time, 12% Part Time, 1% Temporary, and 3% Contract. Highlights an 87% Physical, 3% Hybrid, and 10% Remote job distribution.
Project Perseus \u007C Data Quality Analyst - German Speakers (Human-in-the-Loop AI)

Project Perseus \u007C Data Quality Analyst - German Speakers (Human-in-the-Loop AI)

Welo Data

Burlingame, CA

$32/hr

Full-time

Re-posted 24 days ago

Job description

Welo Data is looking for experienced, detail-oriented professionals to join our team as Data Quality Analysts. This role sits at the center of execution and quality — bridging Data Labeling Associates (DLAs) and Team Leads to ensure work is not only completed, but done right.

You'll work closely with both people and AI systems — auditing outputs, supporting day-to-day execution, and helping teams apply guidelines correctly in fast-moving, real-world scenarios. The work combines data quality, light project coordination, and hands-on training, where your ability to guide others and think critically is just as important as your own output.

Project Details

  • Job Title: Data Quality Analyst
  • Hiring in: NYC, Seattle, Bellevue, Redmond, San Francisco, Sunnyvale, Burlingame, Austin, Los Angeles, Washington DC, Chicago, Boston
  • Hours: Full-time, 40 hours per week
  • Employment Type: W2 Full-Time Employee
  • Work Authorization: Must be authorized to work in the U.S. (no visa sponsorship)
  • Pay Rate: $38/hour
  • Contract Duration: 1-year contract with possibility of extension

Important: This is a 100% onsite position — remote work is not available for this role. To be considered, candidates must be located in or able to commute to one of the following cities: NYC, Seattle, Bellevue, Redmond, San Francisco, Sunnyvale, Burlingame, Austin, Los Angeles, Washington DC, Chicago, Boston. Please only apply if you meet this location requirement.

What You’ll Do
  • Support quality and execution across DLA teams, ensuring work meets defined standards at scale
  • Audit DLA outputs and provide structured, actionable feedback to improve accuracy and consistency
  • Act as the first line of support for DLAs — answering questions and helping interpret guidelines
  • Help DLAs navigate ambiguity and apply evolving instructions effectively
  • Support onboarding and training of new DLAs through hands-on guidance and coaching
  • Monitor workflows, queues, and blockers — escalating risks and gaps to Team Leads
  • Identify patterns, recurring issues, and edge cases in both human and model outputs
  • Participate in calibrations, team discussions, and stakeholder syncs
  • Contribute to improving guidelines, processes, and overall team performance
  • Document findings and feedback in a clear, concise, and actionable way
What We’re Looking For
  • Native-level language proficiency and a university degree (Bachelor’s or higher).
  • B2 or superior level of English.  
  • 2–4 years of experience in data annotation, content quality, QA, or related fields
  • Strong ability to interpret and apply complex guidelines with consistency
  • Excellent attention to detail with a high bar for quality
  • Ability to stay consistent while working with evolving guidelines and priorities
  • Experience in AI/ML data workflows or human-in-the-loop evaluation environments
  • Prior experience auditing or reviewing the work of others
  • Familiarity with safety, compliance, or policy-driven content evaluation
Benefits
  • Paid Vacation: 6 days
  • Paid Company Holidays: 2 days (Memorial Day and Labor Day)
  • Paid Sick Leave: accrued per applicable state law and company policy
  • Medical, Dental, and Vision Insurance (eligibility applies)
  • Health Savings Account (HSA)
  • 401(k) Retirement Plan
  • Employee Assistance Program
  • Additional voluntary benefits (life, accident, critical illness, etc.)
  • Free Gourmet Food: Free breakfast, lunch, and dinner are provided, featuring a wide variety of cuisines in multiple cafes.
  • Micro-kitchens & Snacks: Offices are stocked with free snacks and beverages, including premium coffee and La Croix.
  • Unique Campus Features: Some locations include roof-top nature parks
  • Commuter Benefits: Free transport, shuttles, and sometimes bike-to-work perks.
Why This Role

This is an opportunity to move beyond traditional data work and play a direct role in how AI systems are evaluated and improved. The work is fast-moving, collaborative, and increasingly central to how modern AI systems are built and deployed.

Please note that in order to verify work authorization as is required by Federal law (I-9 process), all new employees must complete a live video verification with their selected IDs and provide photos of these selected IDs within their first 3 days of employment.
 
To know more details (Click here)
 
In compliance with federal law, all persons hired will be required to verify identity and eligibility to work in the United States and to complete the required employment eligibility verification form upon hire.  In addition, we employ anti-fraud checks to ensure all candidates meet the requirements of the program.
 
 
As a trusted global transformation partner, Welocalize accelerates the global business journey by enabling brands and companies to reach, engage, and grow international audiences. Welocalize delivers multilingual content transformation services in translation, localization, and adaptation for over 250 languages with a growing network of over 400,000 in-country linguistic resources. Driving innovation in language services, Welocalize delivers high-quality training data transformation solutions for NLP-enabled machine learning by blending technology and human intelligence to collect, annotate, and evaluate all content types. Our team works across locations in North America, Europe, and Asia serving our global clients in the markets that matter to them. www.welocalize.com
 
To perform this job successfully, an individual must be able to perform each essential duty satisfactorily. The requirements listed below are representative of the knowledge, skill, and/or ability required. Reasonable accommodations may be made to enable individuals with disabilities to perform essential functions.

We may use artificial intelligence (AI) tools to support parts of the hiring process, such as reviewing applications, analyzing resumes, or assessing responses and identifying potential inconsistencies or verification signals in application materials based on available information. These tools assist our recruitment team but do not replace human judgment. Final hiring decisions are ultimately made by humans. If you would like more information about how your data is processed, please contact us.

Working at Welo Data

What to expect from working at Welo Data

From Welo Data

About Welo Data, in their own words

From Welo Data

Welo Data is a global AI data services company powering the next generation of AI. We build, annotate, and validate the training datasets that make AI models accurate, safe, and ready for the real world — across languages, cultures, and domains.

Our team of experts spans the globe, combining deep technical knowledge with a human-centered approach. If you want your work to shape how AI understands the world, you'll find your place here.

Diversity and inclusion statement

From Welo Data

Our Strength is derived from Winning Together. Welo Data is unequivocally committed to developing and fostering a workplace and organizational culture that values the diversity of thought and perspective delivered by a diverse global workforce operating within an inclusive organization.