... annotation, written by our AI tooling or another person, and confirm, correct, or reject it. TASKS YOU'LL SEE • Feature build -- Add a working feature to a live library without breaking anything ...
... annotation, written by our AI tooling or another person, and confirm, correct, or reject it. TASKS YOU'LL SEE • Feature build -- Add a working feature to a live library without breaking anything ...
AI Agent Trajectory Annotator and Reviewer
Indiana, PA · On-site
$20 - $30/hr
... annotation, written by our AI tooling or another person, and confirm, correct, or reject it. TASKS YOU'LL SEE • Feature build -- Add a working feature to a live library without breaking anything ...
AI Agent Trajectory Annotator and Reviewer
Indiana, PA · On-site
$20 - $30/hr
... annotation, written by our AI tooling or another person, and confirm, correct, or reject it. TASKS YOU'LL SEE • Feature build -- Add a working feature to a live library without breaking anything ...
AI Agent Trajectory Annotator and Reviewer
West Chester, PA · On-site
$20 - $30/hr
... annotation, written by our AI tooling or another person, and confirm, correct, or reject it. TASKS YOU'LL SEE • Feature build -- Add a working feature to a live library without breaking anything ...
AI Agent Trajectory Annotator and Reviewer
West Chester, PA · On-site
$20 - $30/hr
... annotation, written by our AI tooling or another person, and confirm, correct, or reject it. TASKS YOU'LL SEE • Feature build -- Add a working feature to a live library without breaking anything ...
AI Agent Trajectory Annotator and Reviewer
Reading, PA · On-site
$20 - $30/hr
... annotation, written by our AI tooling or another person, and confirm, correct, or reject it. TASKS YOU'LL SEE • Feature build -- Add a working feature to a live library without breaking anything ...
AI Agent Trajectory Annotator and Reviewer
Reading, PA · On-site
$20 - $30/hr
... annotation, written by our AI tooling or another person, and confirm, correct, or reject it. TASKS YOU'LL SEE • Feature build -- Add a working feature to a live library without breaking anything ...
... annotation, written by our AI tooling or another person, and confirm, correct, or reject it. TASKS YOU'LL SEE • Feature build -- Add a working feature to a live library without breaking anything ...
... annotation, written by our AI tooling or another person, and confirm, correct, or reject it. TASKS YOU'LL SEE • Feature build -- Add a working feature to a live library without breaking anything ...
AI Agent Trajectory Annotator and Reviewer
Philadelphia, PA · On-site
$20 - $30/hr
... annotation, written by our AI tooling or another person, and confirm, correct, or reject it. TASKS YOU'LL SEE • Feature build -- Add a working feature to a live library without breaking anything ...
AI Agent Trajectory Annotator and Reviewer
Philadelphia, PA · On-site
$20 - $30/hr
... annotation, written by our AI tooling or another person, and confirm, correct, or reject it. TASKS YOU'LL SEE • Feature build -- Add a working feature to a live library without breaking anything ...
... annotation, written by our AI tooling or another person, and confirm, correct, or reject it. TASKS YOU'LL SEE • Feature build -- Add a working feature to a live library without breaking anything ...
... annotation, written by our AI tooling or another person, and confirm, correct, or reject it. TASKS YOU'LL SEE • Feature build -- Add a working feature to a live library without breaking anything ...
AI Agent Trajectory Annotator and Reviewer
Allentown, PA · On-site
$20 - $30/hr
... annotation, written by our AI tooling or another person, and confirm, correct, or reject it. TASKS YOU'LL SEE • Feature build -- Add a working feature to a live library without breaking anything ...
AI Agent Trajectory Annotator and Reviewer
Allentown, PA · On-site
$20 - $30/hr
... annotation, written by our AI tooling or another person, and confirm, correct, or reject it. TASKS YOU'LL SEE • Feature build -- Add a working feature to a live library without breaking anything ...
Medical Microbiology Consultant - Remote
Allentown, PA · Remote
$70 - $90/hr
Provide written and verbal expertise on microbiological phenomena and their relevance to real-world ... Experience with AI, machine learning, or annotation projects related to biology or microbiology.
Medical Microbiology Consultant - Remote
Allentown, PA · Remote
$70 - $90/hr
Provide written and verbal expertise on microbiological phenomena and their relevance to real-world ... Experience with AI, machine learning, or annotation projects related to biology or microbiology.
Medical Microbiology Consultant - Remote
Philadelphia, PA · Remote
$70 - $90/hr
Provide written and verbal expertise on microbiological phenomena and their relevance to real-world ... Experience with AI, machine learning, or annotation projects related to biology or microbiology.
Medical Microbiology Consultant - Remote
Philadelphia, PA · Remote
$70 - $90/hr
Provide written and verbal expertise on microbiological phenomena and their relevance to real-world ... Experience with AI, machine learning, or annotation projects related to biology or microbiology.
Graphic Designer Expert - Remote
Philadelphia, PA · Remote
$20 - $50/hr
... for AI training. Scope of Work * Annotate editorial, poster, marketing, and short video assets ... Help improve annotation guidelines and maintain quality standards. * Use Figma, Adobe Creative ...
Quick apply
Graphic Designer Expert - Remote
Philadelphia, PA · Remote
$20 - $50/hr
... for AI training. Scope of Work * Annotate editorial, poster, marketing, and short video assets ... Help improve annotation guidelines and maintain quality standards. * Use Figma, Adobe Creative ...
Medical Microbiology Consultant - Remote
Pittsburgh, PA · Remote
$70 - $90/hr
Provide written and verbal expertise on microbiological phenomena and their relevance to real-world ... Experience with AI, machine learning, or annotation projects related to biology or microbiology.
Medical Microbiology Consultant - Remote
Pittsburgh, PA · Remote
$70 - $90/hr
Provide written and verbal expertise on microbiological phenomena and their relevance to real-world ... Experience with AI, machine learning, or annotation projects related to biology or microbiology.
Korean Language Expert
Philadelphia, PA · Remote
$65 - $100/hr
... and annotation processes. * Help develop language guidelines and resources tailored to AI training and evaluation. * Participate in regular written and verbal communication to discuss project ...
Quick apply
Korean Language Expert
Philadelphia, PA · Remote
$65 - $100/hr
... and annotation processes. * Help develop language guidelines and resources tailored to AI training and evaluation. * Participate in regular written and verbal communication to discuss project ...
Child Development Psychologist (PhD) - Remote
Philadelphia, PA · Remote
$100 - $300/hr
Data annotation and AI data evaluation * Scenario analysis * Cross-cultural competence * Guideline creation * Strong written communication * Interdisciplinary collaboration * Ability to work ...
Quick apply
Child Development Psychologist (PhD) - Remote
Philadelphia, PA · Remote
$100 - $300/hr
Data annotation and AI data evaluation * Scenario analysis * Cross-cultural competence * Guideline creation * Strong written communication * Interdisciplinary collaboration * Ability to work ...
Medical Coder - Remote
Philadelphia, PA · Remote
$50 - $80/hr
Collaborate with project teams through written and verbal communication to improve AI training data ... Familiarity with digital annotation tools or healthcare data projects is a plus. * Commitment to ...
Quick apply
Medical Coder - Remote
Philadelphia, PA · Remote
$50 - $80/hr
Collaborate with project teams through written and verbal communication to improve AI training data ... Familiarity with digital annotation tools or healthcare data projects is a plus. * Commitment to ...
Healthcare Attorney - Remote
Philadelphia, PA · Remote
$140 - $400/hr
Provide detailed written feedback to improve AI legal reasoning and content quality. * Identify ... Legal Document Review & Annotation * Policy Analysis * Contract Drafting * U.S. Healthcare ...
Quick apply
Healthcare Attorney - Remote
Philadelphia, PA · Remote
$140 - $400/hr
Provide detailed written feedback to improve AI legal reasoning and content quality. * Identify ... Legal Document Review & Annotation * Policy Analysis * Contract Drafting * U.S. Healthcare ...
Japanese Language Expert - Remote
Philadelphia, PA · Remote
$65 - $100/hr
... AI systems. In this role, you will work with Japanese and English audio and written content ... Familiarity with AI, language technology, or data annotation projects is a plus.
Quick apply
Japanese Language Expert - Remote
Philadelphia, PA · Remote
$65 - $100/hr
... AI systems. In this role, you will work with Japanese and English audio and written content ... Familiarity with AI, language technology, or data annotation projects is a plus.
Indonesian Bilingual Expert - Remote
Philadelphia, PA · Remote
$30 - $65/hr
... linguistic annotation, or quality assurance. * Interest in AI-driven language technologies and ... Written Communication * Verbal Communication * Critical Listening * Quality Assurance
Quick apply
Indonesian Bilingual Expert - Remote
Philadelphia, PA · Remote
$30 - $65/hr
... linguistic annotation, or quality assurance. * Interest in AI-driven language technologies and ... Written Communication * Verbal Communication * Critical Listening * Quality Assurance
English Language Expert - Remote
Philadelphia, PA · Remote
$30 - $50/hr
Previous experience in AI data training, annotation, editorial QA, localization QA, or professional ... Written Communication * Verbal Communication * Critical Thinking * Multilingual Proficiency
Quick apply
English Language Expert - Remote
Philadelphia, PA · Remote
$30 - $50/hr
Previous experience in AI data training, annotation, editorial QA, localization QA, or professional ... Written Communication * Verbal Communication * Critical Thinking * Multilingual Proficiency
Flexible remote AI work. Your schedule. Paid weekly, straight to your bank account.
Hazleton, PA · Remote
Strong readers and writers with good judgment are a great fit. Prior experience in data labeling, annotation, research, writing, or operations is helpful but not required. Requirements * Strong ...
Flexible remote AI work. Your schedule. Paid weekly, straight to your bank account.
Hazleton, PA · Remote
Strong readers and writers with good judgment are a great fit. Prior experience in data labeling, annotation, research, writing, or operations is helpful but not required. Requirements * Strong ...
Ai Annotation Writing information
See Pennsylvania salary details
$13.73 - $21.55
17% of jobs
$23.45 is the 25th percentile. Wages below this are outliers.
$21.55 - $29.38
33% of jobs
$29.38 - $37.20
19% of jobs
$41.50 is the 75th percentile. Wages above this are outliers.
$37.20 - $45.02
11% of jobs
$45.02 - $52.84
6% of jobs
$52.84 - $60.66
3% of jobs
$60.66 - $68.48
2% of jobs
$68.48 - $76.30
2% of jobs
$76.30 - $84.12
0% of jobs
$84.12 - $91.94
3% of jobs
$91.94 - $99.76
3% of jobs
$13
$40
$99
How much do ai annotation writing jobs pay per hour?
What is an AI annotation writing?
An AI Annotation Writing job involves labeling, tagging, and annotating text data to help train machine learning models. This can include tasks like identifying sentiment, correcting grammar, or categorizing content. The goal is to provide high-quality data that improves the accuracy of AI systems. Strong language skills, attention to detail, and familiarity with AI concepts are often required for this role.
What are the primary day-to-day responsibilities in AI annotation writing?
In an AI Annotation Writing role, your daily tasks generally include reading and understanding various types of content, applying accurate labels or tags, and sometimes providing written explanations or classifications based on specific project guidelines. You may work individually or as part of a larger annotation team, often collaborating with data scientists or project managers to clarify requirements and resolve ambiguous cases. Attention to detail is crucial, as the quality of your annotations directly impacts the performance of the resulting AI models. Projects and content types may vary, offering opportunities to develop expertise in different domains and annotation methods.
What are the key skills and qualifications needed to thrive in AI annotation writing, and why are they important?
To excel in AI Annotation Writing, you should have strong attention to detail, excellent written communication skills, and a good understanding of data labeling concepts, typically supported by experience in content creation or data management. Familiarity with annotation tools like Labelbox, Prodigy, or similar software, as well as basic knowledge of data privacy standards, is often required. Diligence, patience, and the ability to follow detailed guidelines help differentiate top performers in this role. These skills are critical for producing high-quality, accurate labeling data that is foundational to effective AI and machine learning model training.
What are the most commonly searched types of Ai Annotation Writing jobs in Pennsylvania?
The most popular types of Ai Annotation Writing jobs in Pennsylvania are:
What are popular job titles related to Ai Annotation Writing jobs in Pennsylvania?
For Ai Annotation Writing jobs in Pennsylvania, the most frequently searched job titles are:
What job categories do people searching Ai Annotation Writing jobs in Pennsylvania look for?
The top searched job categories for Ai Annotation Writing jobs in Pennsylvania are:
- Remote Nonprofit Technology
- Executive Data Scientist Experimentation
- Remote English Literature Research
- Remote Bioinformatics Genetics
- Remote Biology Research
- Contractual Remote Data Annotation
- Remote Biology Data Scientist
- Remote Research Scientist Mechanical Engineering
- Biology Writing Remote
- Remote Biochemistry

$20 - $30/hr
Full-time
Posted 6 days ago
Job description
Type: Contract, hourly
Location: Remote
Hours: 20–30 per week
Pay: $20–30/hour, based on experience and language coverage
Start: Immediate
ABOUT THE ROLE
We evaluate how well advanced AI coding agents solve real engineering problems. An agent is given a real open source codebase inside a container and a hard task, then works on its own for 80 to 250 steps. A trajectory is the full record of that run — every command, result, and decision.
You will do two jobs, and you should expect either on any given day.
•Annotate — Read a trajectory nobody has looked at yet and judge it step by step.
• Review — Take an existing annotation, written by our AI tooling or another person, and confirm, correct, or reject it.
TASKS YOU'LL SEE
• Feature build — Add a working feature to a live library without breaking anything that already worked.
• Rebuild — Work out what a compiled tool does by running it, then rebuild it to match its output, exit codes, and file effects.
• Bug hunt — Find and fix twenty undocumented bugs across a dozen files with no test suite, then record what caused them.
Mostly Python and Go, with some Rust, C, and Ct+. A trajectory runs about 100 steps.
WHAT YOU JUDGE IN A TRAJECTORY
• Was the command right for the state the environment was actually in?
• Did the agent read the previous output correctly?
• Was the step wrong, or only inefficient — these are scored differently.
• Where did the run first go off course — usually earlier than where it visibly broke.
• Did the agent notice its own mistake and recover, or keep building on a false assumption?
• Did it game the grader instead of solving the task (e.g., weakening a test or hardcoding an expected value)?
WHAT WE NEED FROM YOU
• Experience — 2+ years in software engineering, DevOps, or site reliability, with real debugging in real codebases.
• Languages — Strong in Python or Go, and able to read a language you've never used.
• Linux — Comfortable with logs, running processes, build failures, and containers.
• Workflow — Everyday Git, diffs, pull requests, and issue tracking.
• Debugging — Able to work with no test suite and no error message pointing at the cause.
• Focus — Able to hold context across a long run, because step 74 can depend on step 12.
• Writing — Clear English, since every judgement needs an explanation another engineer can check.