ZipRecruiter

Log In

1

Quality Rater Jobs in Massachusetts (NOW HIRING)

LILT, Inc

Senior Quality Manager, Applied AI

Boston, MA ยท On-site

$125K - $160K/yr

Acceptance rates hold at or above target, rework declines over time, and standard QC on standardized workflows is executed and interpreted by Production staff without Quality Manager involvement by ...

LILT

Quality Manager, Applied AI

Boston, MA ยท On-site

Acceptance rates hold at or above target, rework declines over time, and standard QC on standardized workflows is executed and interpreted by Production staff without Quality Manager involvement by ...

IQVIA

Clinical Trial Rater

Boston, MA ยท Remote

The rater will be responsible for administering validated clinicianrated instruments, ensuring high-quality, consistent data collection in accordance with the study protocol, GCP, and regulatory ...

IQVIA

Clinical Trial Rater

Springfield, MA ยท Remote

The rater will be responsible for administering validated clinicianrated instruments, ensuring high-quality, consistent data collection in accordance with the study protocol, GCP, and regulatory ...

IQVIA

Clinical Trial Psych Rater

Boston, MA ยท Remote

Responsibilities include evaluating assessment quality, engaging in live discussions with raters to provide guidance on methodology and scoring techniques, and supporting rater performance through ...

IQVIA

Clinical Trial Psych Rater

Danvers, MA ยท Remote

Responsibilities include evaluating assessment quality, engaging in live discussions with raters to provide guidance on methodology and scoring techniques, and supporting rater performance through ...

Bossard Group

Quality Analyst

Stoughton, MA ยท On-site

Collect, analyze, and interpret quality and operational data to identify trends, risks, and ... Track and report key performance indicators (KPIs) such as PPM, defect rates, returns, SCARs ...

Bossard Americas

Quality Analyst

Stoughton, MA ยท On-site

Collect, analyze, and interpret quality and operational data to identify trends, risks, and ... Track and report key performance indicators (KPIs) such as PPM, defect rates, returns, SCARs ...

UnitedHealth Group

Clinical Quality Consultant

Newton, MA ยท On-site

$91K - $163K/yr

This position leads quality improvement initiatives, analyzes healthcare data, and partners across the organization to drive performance on HEDIS, Star Ratings, CAHPS, and state quality programs.

UnitedHealth Group

Clinical Quality Consultant

Newton, MA ยท Remote

$91K - $163K/yr

This position leads quality improvement initiatives, analyzes healthcare data, and partners across the organization to drive performance on HEDIS, Star Ratings, CAHPS, and state quality programs.

Zoll Medical Corporation

Quality Technician

Chelmsford, MA ยท On-site

$19.90 - $29.80/hr

Supports quality improvement, corrective and prevention action program. Works under general ... rate for this position is: $19.90 to $29.80 Factors which may affect this rate include shift ...

ZOLL Medical Corporation

Quality Technician

Chelmsford, MA ยท On-site

$19.90 - $29.80/hr

Supports quality improvement, corrective and prevention action program. Works under general ... rate for this position is: $19.90 to $29.80 Factors which may affect this rate include shift ...

BIOCYTOGEN, LLC

Quality Associate

Waltham, MA ยท On-site

Periodically compile basic quality metrics (e.g., CAPA closure rates) to assist QA management in trend analysis. * 3. Compliance, Audit & Vendor Support * Audit Readiness: Support the preparation and ...

Biocytogen

Quality Associate

Waltham, MA ยท On-site

Periodically compile basic quality metrics (e.g., CAPA closure rates) to assist QA management in trend analysis. * 3. Compliance, Audit & Vendor Support * Audit Readiness: Support the preparation and ...

MACOM Technology Solutions Holdings

Quality Engineer

Lowell, MA ยท On-site

$71K - $92K/yr

... data rates. Leading technologies, innovative products and driven employees. Come be a part of MACOM and help advance the next generation of connectivity infrastructure! The Quality Engineer will ...

Biocytogen

Quality Associate

Waltham, MA ยท On-site

Periodically compile basic quality metrics (e.g., CAPA closure rates) to assist QA management in trend analysis. * 3. Compliance, Audit & Vendor Support * Audit Readiness: Support the preparation and ...

next page

Showing results 1-20

All JobsQuality Rater JobsQuality Rater Jobs in Massachusetts

Quality Rater information

See Massachusetts salary details

$13

$21

$30

How much do quality rater jobs pay per hour?

As of Sep 14, 2026, the average hourly pay for quality rater in Massachusetts is $21.77, according to ZipRecruiter salary data. Most workers in this role earn between $18.65 and $23.89 per hour, depending on experience, location, and employer.

What is a quality rater?

Quality Raters are individuals who evaluate the relevance and quality of search engine results based on specific guidelines provided by companies like Google. Their feedback helps improve the accuracy and usefulness of search algorithms, ensuring that users receive the most relevant information. Quality Raters do not directly influence search rankings but provide valuable data that search engines use to refine and update their systems. This role is typically remote and requires attention to detail, critical thinking, and a good understanding of the assigned guidelines.

What skills and qualifications are needed to thrive as a quality rater?

To thrive as a Quality Rater, you need strong analytical skills, attention to detail, and proficiency in the language of the evaluation, often supported by a college degree or equivalent experience. Familiarity with web search engines, content guidelines, and online evaluation platforms is typically required. Excellent time management, adaptability, and objective judgment are key soft skills for delivering consistent and unbiased ratings. These skills and qualities are essential to ensure accurate, high-quality feedback that helps improve search engine algorithms and user experiences.

What challenges do quality raters face in maintaining consistency and objectivity?

Quality Raters often encounter challenges in interpreting and applying detailed guidelines consistently across a wide variety of content. Since the work involves subjective judgment, ensuring objectivity and minimizing personal bias is crucial. Regular updates to guidelines mean that raters need to stay current and adapt quickly to changes. Collaborating with peers through forums or team discussions can help clarify ambiguities, but raters must ultimately rely on their own understanding to make fair assessments. Mastering this balance is key to long-term success in the role.

What is the difference between Quality Rater vs Content Moderator?

AspectQuality RaterContent Moderator
Required CredentialsHigh school diploma or equivalent; sometimes a degree in related fieldsHigh school diploma or equivalent; sometimes specialized training
Work EnvironmentRemote, flexible hours, independent workRemote or on-site, may involve shift work
Employer & Industry UsageTech companies, search engines, advertising platformsSocial media platforms, online marketplaces, forums
Work FocusEvaluating search results and content relevanceMonitoring and removing inappropriate or harmful content

While both roles involve online content evaluation, Quality Raters primarily assess search engine results for relevance and quality, whereas Content Moderators focus on monitoring and removing harmful or inappropriate content to ensure platform safety. The roles share similar skills and work environments but differ in their specific focus and employer usage.

What qualifications do you need to be a quality rater?

To be a quality rater, candidates typically need a high school diploma or equivalent, strong analytical skills, and familiarity with internet search engines and online content. Some positions may require fluency in the language of the work and the ability to follow detailed guidelines and instructions.

What are popular job titles related to Quality Rater jobs in Massachusetts?

For Quality Rater jobs in Massachusetts, the most frequently searched job titles are:

What job categories do people searching Quality Rater jobs in Massachusetts look for?

The top searched job categories for Quality Rater jobs in Massachusetts are:

Quality Rater jobs near you
Infographic showing various Quality Rater job openings in Massachusetts as of September 2026, with employment types broken down into 77% Full Time, 17% Part Time, and 6% Contract. Highlights an 94% In-person, and 6% Remote job distribution, with an average salary of $45,272 per year, or $21.8 per hour.

Senior Quality Manager, Applied AI

Boston, MA โ€ข On-site

LILT, Inc
Translation Servicesย โ€ขย 51 - 200 employees
Learn more about LILT, Incexternal

$125K - $160K/yr

Full-time

Posted 13 days ago

Key responsibilities

  • Ensure that workflows are built to deliver measurable quality, including meeting thresholds for raters and reproducibility of scores.

  • Own the development and maintenance of technical tooling and quality infrastructure to monitor quality metrics and detect systemic issues.

  • Manage operational quality at scale by ensuring programs meet quality targets, executing standard quality control, and documenting go/no-go decisions before delivery.

Job description

About LILT
AI is changing how the world communicates - and LILT is leading that transformation.
We're on a mission to make the world's information accessible to everyone, regardless of the language they speak. We use cutting-edge AI, machine translation, and human-in-the-loop expertise to translate content faster, more accurately, and more cost-effectively without compromising on brand, voice, or quality.
At LILT, we empower our teammates with leading tools, global collaboration, and growth opportunities to do their best work. Our company virtues-Work together, win together; Find a way or make one; Dance in the customer's shoes; Quicker than they expect; Quality is Job 1-guide everything we do. We are trusted by Intel Corporation, Canva, the United States Department of Defense, the United States Air Force, ASICS, and hundreds of global Enterprises. Backed by Sequoia, Intel Capital, and Redpoint, we're building a category-defining company in a $50B+ global translation market being redefined by AI.
Key Responsibilities
  • Ensure Workflows Are Built for Quality
    • Outcome: Every Applied AI deliverable ships with measured quality: rater agreement meets agreed thresholds per dimension, rubric scores are reproducible across raters, and reported quality figures hold up under customer audit.
  • Own Technical Tooling & Quality Infrastructure
    • Outcome: Quality metrics for every active program (defect rate, acceptance rate, rework, reviewer reliability, throughput, SLA adherence) are available without manual compilation, and systemic quality issues are detected from workflow data before a customer reports them.
  • Own Operational Quality at Scale
    • Outcome: Concurrent programs meet their quality targets within agreed cost and throughput. Acceptance rates hold at or above target, rework declines over time, and standard QC on standardized workflows is executed and interpreted by Production staff without Quality Manager involvement by the end of the second quarter in role.
  • Delivery sign-off: Every deliverable has a documented go/no-go decision before shipping, based on programmatic QA and a readiness memo with flags. Post-sign-off quality escapes stay below an agreed threshold, and each escape results in a documented process change.
  • Own Customer Quality Remediation
    • Outcome: Customer quality disputes are closed with quantitative analysis, normally at first response. Re-adjudication completes within SLA, recurring defect classes decline release over release, and annotator integrity issues are detected internally before they reach a deliverable.
Qualifications
  • Education: B.S./M.S. in a quantitative field (CS, Statistics, Data Science, Engineering, Linguistics, HCI) or equivalent practical experience.
  • Applied AI / evaluation experience: 6+ years building or operating quality programs for ML/LLM systems (data labeling, benchmark creation, model evaluation, or human-in-the-loop pipelines).
  • Quality systems leadership: Proven ability to design and run end-to-end quality frameworks (rubrics, sampling plans, QC gates, acceptance criteria, escalation paths) across multiple concurrent programs.
  • Measurement & statistics: Strong grasp of reliability and agreement methods (e.g., Krippendorff's ฮฑ, Cohen's ฮบ), power/sample-size intuition, error analysis, and reporting for executive stakeholders.
  • Rater/annotator operations: Experience with calibration, adjudication, targeted retraining, drift monitoring, and integrity/fraud detection in high-throughput human evaluation programs.
  • Tooling & automation: Hands-on with labeling/eval tooling (e.g., Label Studio or similar) and designing deterministic validations; comfort partnering with engineering/research to implement quality instrumentation.
  • Data governance: Strong understanding of dataset/version management, traceability, privacy/compliance constraints, and audit-ready documentation for deliverables.
  • Stakeholder management: Excellent written and verbal communication; able to translate ambiguous research goals into measurable quality targets and negotiate tradeoffs with Applied AI, product, and external partners.
Preferred Skills
  • Fluency in multiple human languages.
  • Proficiency in a programming language and experience working with modern AI frameworks.
Where You'll Work
This position is based in our Boston office and will be expected to work in the office in a hybrid capacity. LILT is hybrid with hubs in SF, NY, Indianapolis, Boston, London, and Berlin.
Authorization to work in the U.S. is a precondition of employment.
  • Boston (highly preferred)
  • Others: SF Bay Area, New York, Indianapolis, London

Our Story
Our founders, Spence and John met at Google working on Google Translate. As researchers at Stanford and Berkeley, they both worked on language technology to make information accessible to everyone. While together at Google, they were amazed to learn that Google Translate wasn't used for enterprise products and services inside the company.The quality just wasn't there. So they set out to build something better. LILT was born.
LILT has been a machine learning company since its founding in 2015. At the time, machine translation didn't meet the quality standard for enterprise translations, so LILT assembled a cutting-edge research team tasked with closing that gap. While meeting customer demand for translation services, LILT has prioritized investments in Large Language Models, human-in-the-loop systems, and now agentic AI.
With AI innovation accelerating and enterprise demand growing, the next phase of LILT's journey is just beginning.
Our Tech
What sets our platform apart:
  • Brand-aware AI that learns your voice, tone, and terminology to ensure every translation is accurate and consistent
  • Agentic AI workflows that automate the entire translation process from content ingestion to quality review to publishing
  • 100+ native integrations with systems like Adobe Experience Manager, Webflow, Salesforce, GitHub, and Google Drive to simplify content translation
  • Human-in-the-loop reviews via our global network of professional linguists, for high-impact content that requires expert review
LILT in the News
  • Featured in The Software Report's Top 100 Software Companies!
  • LILT makes it onto the Inc. 5000 List.
  • LILT's continues to be an intellectual powerhouse, holding numerous patents that help power the most efficient and sophisticated AI and language models in the industry.
  • Check out all our news on our website.

Information collected and processed as part of your application process, including any job applications you choose to submit, is subject to LILT's Privacy Policy at https://lilt.com/legal/privacy.
At LILT, we are committed to a fair, inclusive, and transparent hiring process. As part of our recruitment efforts, we may use artificial intelligence (AI) and automated tools to assist in the evaluation of applications, including rรฉsumรฉ screening, assessment scoring, and interview analysis. These tools are designed to support human decision-making and help us identify qualified candidates efficiently and objectively. All final hiring decisions are made by people. If you have any concerns, require accommodations, or would like to opt-out of the use of AI in our hiring process, please let us know at recruiting@lilt.com.
LILT is an equal opportunity employer. We extend equal opportunity to all individuals without regard to an individual's race, religion, color, national origin, ancestry, sex, sexual orientation, gender identity, age, physical or mental disability, medical condition, genetic characteristics, veteran or marital status, pregnancy, or any other classification protected by applicable local, state or federal laws. We are committed to the principles of fair employment and the elimination of all discriminatory practices.

Apply