You'll build the agentic harness tuned to our existing infrastructure, write code alongside your ... Evaluation frameworks. Prompt engineering at scale. * Engineering: Production-grade Python. SQL ...
You'll build the agentic harness tuned to our existing infrastructure, write code alongside your ... Evaluation frameworks. Prompt engineering at scale. * Engineering: Production-grade Python. SQL ...
You'll build the agentic harness tuned to our existing infrastructure, write code alongside your ... Evaluation frameworks. Prompt engineering at scale. * Engineering: Production-grade Python. SQL ...
You'll build the agentic harness tuned to our existing infrastructure, write code alongside your ... Evaluation frameworks. Prompt engineering at scale. * Engineering: Production-grade Python. SQL ...
You'll build the agentic harness tuned to our existing infrastructure, write code alongside your ... Evaluation frameworks. Prompt engineering at scale. * Engineering: Production-grade Python. SQL ...
You'll build the agentic harness tuned to our existing infrastructure, write code alongside your ... Evaluation frameworks. Prompt engineering at scale. * Engineering: Production-grade Python. SQL ...
You'll build the agentic harness tuned to our existing infrastructure, write code alongside your ... Evaluation frameworks. Prompt engineering at scale. * Engineering: Production-grade Python. SQL ...
You'll build the agentic harness tuned to our existing infrastructure, write code alongside your ... Evaluation frameworks. Prompt engineering at scale. * Engineering: Production-grade Python. SQL ...
Your work will help improve the performance and accuracy of AI-powered language systems. This is a ... Strong command of written and spoken English to follow instructions and evaluation criteria
Quick apply
Your work will help improve the performance and accuracy of AI-powered language systems. This is a ... Strong command of written and spoken English to follow instructions and evaluation criteria
We are seeking highly organized Virtual Assistants to support executive workflows, operations, and AI evaluation initiatives. This fully remote role focuses on coordinating information, managing ...
New
We are seeking highly organized Virtual Assistants to support executive workflows, operations, and AI evaluation initiatives. This fully remote role focuses on coordinating information, managing ...
New
Brand Evaluator - Creative Direction - AI Trainer
Boston, MA · Remote
$80 - $120/hr
Remote Role Responsibilities * Evaluate AI-generated artifacts against domain-specific quality ... Provide clear, structured written feedback to improve AI-generated work products. * Apply deep ...
Quick apply
Brand Evaluator - Creative Direction - AI Trainer
Boston, MA · Remote
$80 - $120/hr
Remote Role Responsibilities * Evaluate AI-generated artifacts against domain-specific quality ... Provide clear, structured written feedback to improve AI-generated work products. * Apply deep ...
Humanities Expert - Arts Evaluator - AI Trainer
Boston, MA · Remote
$80 - $120/hr
Remote Role Responsibilities * Evaluate AI-generated artifacts against domain-specific quality ... Provide clear, structured written feedback to improve AI model outputs . * Apply deep subject ...
Quick apply
Humanities Expert - Arts Evaluator - AI Trainer
Boston, MA · Remote
$80 - $120/hr
Remote Role Responsibilities * Evaluate AI-generated artifacts against domain-specific quality ... Provide clear, structured written feedback to improve AI model outputs . * Apply deep subject ...
Technology AI Evaluation Expert
$60 - $75/hr
This is a fully remote, independent contractor opportunity with flexible working hours ... Write comprehensive ground-truth solutions and structured scoring rubrics. * Design tasks that ...
Technology AI Evaluation Expert
$60 - $75/hr
This is a fully remote, independent contractor opportunity with flexible working hours ... Write comprehensive ground-truth solutions and structured scoring rubrics. * Design tasks that ...
Analytical Evaluator - AI Feedback
San Francisco, CA · Remote
$70/hr
Remote Role Responsibilities * Evaluate AI-generated responses to ensure accuracy and depth in reasoning. * Provide structured written feedback to improve AI model outputs . * Identify nuances ...
Quick apply
Analytical Evaluator - AI Feedback
San Francisco, CA · Remote
$70/hr
Remote Role Responsibilities * Evaluate AI-generated responses to ensure accuracy and depth in reasoning. * Provide structured written feedback to improve AI model outputs . * Identify nuances ...
Cantonese Audio Evaluator 粤语音频评估员
Charleston, WV · Remote
$29.90 - $30/hr
Fluency in written and verbal English to understand instructions, evaluation criteria, and ... remote, with complete autonomy. 🌱 Limitless Growth Optional access to AI and Large ...
Quick apply
Cantonese Audio Evaluator 粤语音频评估员
Charleston, WV · Remote
$29.90 - $30/hr
Fluency in written and verbal English to understand instructions, evaluation criteria, and ... remote, with complete autonomy. 🌱 Limitless Growth Optional access to AI and Large ...
Software Engineer (AI Training) - Remote Contract
$20 - $100/hr
Software Engineer (AI Training) - Remote Contract About the Role What if the code you write could ... writes, understands, and reasons about code * Sharpen your own engineering skills by evaluating ...
Software Engineer (AI Training) - Remote Contract
$20 - $100/hr
Software Engineer (AI Training) - Remote Contract About the Role What if the code you write could ... writes, understands, and reasons about code * Sharpen your own engineering skills by evaluating ...
Software Engineer (AI Training) - Remote Contract
$20 - $100/hr
Software Engineer (AI Training) - Remote Contract About the Role What if the code you write could ... writes, understands, and reasons about code * Sharpen your own engineering skills by evaluating ...
Software Engineer (AI Training) - Remote Contract
$20 - $100/hr
Software Engineer (AI Training) - Remote Contract About the Role What if the code you write could ... writes, understands, and reasons about code * Sharpen your own engineering skills by evaluating ...
IP Law Evaluator - Expert - AI Trainer
Chicago, IL · Remote
$80 - $120/hr
Remote Role Responsibilities * Evaluate AI-generated artifacts against domain-specific quality ... Provide clear, structured written feedback to improve AI model outputs. * Collaborate ...
Quick apply
IP Law Evaluator - Expert - AI Trainer
Chicago, IL · Remote
$80 - $120/hr
Remote Role Responsibilities * Evaluate AI-generated artifacts against domain-specific quality ... Provide clear, structured written feedback to improve AI model outputs. * Collaborate ...
Software Engineer (AI Training) - Remote Contract
$20 - $100/hr
Software Engineer (AI Training) - Remote Contract About the Role What if the code you write could ... writes, understands, and reasons about code * Sharpen your own engineering skills by evaluating ...
Software Engineer (AI Training) - Remote Contract
$20 - $100/hr
Software Engineer (AI Training) - Remote Contract About the Role What if the code you write could ... writes, understands, and reasons about code * Sharpen your own engineering skills by evaluating ...
Software Engineer (AI Training) - Remote Contract
$20 - $100/hr
Software Engineer (AI Training) - Remote Contract About the Role What if the code you write could ... writes, understands, and reasons about code * Sharpen your own engineering skills by evaluating ...
Software Engineer (AI Training) - Remote Contract
$20 - $100/hr
Software Engineer (AI Training) - Remote Contract About the Role What if the code you write could ... writes, understands, and reasons about code * Sharpen your own engineering skills by evaluating ...
Software Engineer (AI Training) - Remote Contract
$20 - $100/hr
Software Engineer (AI Training) - Remote Contract About the Role What if the code you write could ... writes, understands, and reasons about code * Sharpen your own engineering skills by evaluating ...
Software Engineer (AI Training) - Remote Contract
$20 - $100/hr
Software Engineer (AI Training) - Remote Contract About the Role What if the code you write could ... writes, understands, and reasons about code * Sharpen your own engineering skills by evaluating ...
Software Engineer (AI Training) - Remote Contract
$20 - $100/hr
Software Engineer (AI Training) - Remote Contract About the Role What if the code you write could ... writes, understands, and reasons about code * Sharpen your own engineering skills by evaluating ...
Software Engineer (AI Training) - Remote Contract
$20 - $100/hr
Software Engineer (AI Training) - Remote Contract About the Role What if the code you write could ... writes, understands, and reasons about code * Sharpen your own engineering skills by evaluating ...
... Evaluator Type: Contract Compensation: $80-$120/hour Location: Remote Role Responsibilities ... written feedback. * Work independently and asynchronously to meet deadlines while improving AI ...
Quick apply
... Evaluator Type: Contract Compensation: $80-$120/hour Location: Remote Role Responsibilities ... written feedback. * Work independently and asynchronously to meet deadlines while improving AI ...
上海话音频评估员 Shanghainese Audio Evaluator
Charleston, WV · Remote
$43.90 - $44/hr
Fluency in written and verbal English to understand instructions, evaluation criteria, and ... remote, with complete autonomy. 🌱 Limitless Growth Optional access to AI and Large ...
Quick apply
上海话音频评估员 Shanghainese Audio Evaluator
Charleston, WV · Remote
$43.90 - $44/hr
Fluency in written and verbal English to understand instructions, evaluation criteria, and ... remote, with complete autonomy. 🌱 Limitless Growth Optional access to AI and Large ...
Remote Ai Writing Evaluator information
See salary details
$29.5K - $36.5K
13% of jobs
$36.5K - $43.5K
12% of jobs
$43.6K is the 25th percentile. Wages below this are outliers.
$43.5K - $50.5K
14% of jobs
The median wage is $56.6K / yr.
$50.5K - $57.5K
13% of jobs
$57.5K - $64.5K
12% of jobs
$64.5K - $71.5K
6% of jobs
$75.7K is the 75th percentile. Wages above this are outliers.
$71.5K - $78.5K
9% of jobs
$78.5K - $85.5K
11% of jobs
$85.5K - $92.5K
4% of jobs
$92.5K - $99.5K
4% of jobs
$99.5K - $106.5K
2% of jobs
$29.5K
$65.5K
$106.5K
How much do remote ai writing evaluator jobs pay per year?
What is a Remote AI Writing Evaluator?
What are the key skills and qualifications needed to thrive as a remote AI writing evaluator?
What is the difference between Remote Ai Writing Evaluator vs Remote Content Moderator?
| Aspect | Remote Ai Writing Evaluator | Remote Content Moderator |
|---|---|---|
| Credentials | Basic writing or language skills, sometimes certifications in AI or linguistics | Experience in content review, familiarity with platform policies |
| Work Environment | Remote, often flexible hours, focused on evaluating AI-generated content | Remote, may require shift work, monitoring user-generated content |
| Industry Usage | Used in AI and tech companies to improve language models | Used across social media, online platforms, and forums to enforce policies |
While both roles are remote and involve content review, the Remote Ai Writing Evaluator focuses on assessing AI-generated text for quality and accuracy, often requiring language skills or AI knowledge. The Remote Content Moderator reviews user-generated content to ensure compliance with platform policies. Both roles are essential in digital content management but serve different purposes within the industry.
How does a remote AI writing evaluator typically collaborate with development teams to improve AI-generated content?

Full-time
Medical, Dental, Vision, Retirement
Re-posted 18 days ago
State Farm rating
7.4
Based on 1,544 frontline employees who took The Breakroom Quiz
225th of 303 rated insurance
Job description
Being good neighbors – helping people, investing in our communities, and making the world a better place – is who we are at State Farm. It is at the core of how we operate and the reason for our success. Come join a #1 team and do some good!
REMOTE:Qualified candidates living outside a 50-mile radius of a hub location listed below can plan to work remote.
HYBRID: Qualified candidates living within a 50-mile radius of a hub location listed below should plan to spend time working from home and some time working in the office as part of our hybrid work environment.
HUB LOCATIONS: Bloomington, IL; Dunwoody, GA; Richardson, TX; or Tempe, AZ
SPONSORSHIP: Applicants for this position are required to be eligible to lawfully work in the U.S. immediately; employer will not sponsor applicants for U.S. work authorization (e.g. H-1B visa) for this opportunity.
Responsibilities
Lead a team of 3-5 embedded agentic engineers who work inside Product Oriented Delivery pods, helping engineers, analysts, and product owners ship twice as fast with twice the quality through agentic workflows. You'll build the agentic harness tuned to our existing infrastructure, write code alongside your team, run the developer community, and ensure a steady stream of innovation projects make it to production on Databricks
What You'll Own
- Team Leadership (30%) – Hire, manage, and grow 3-5 embedded engineers. 1:1s, career development, removing blockers. You code 30-40% of the time.
- Agentic Harness (25%) – Build the agentic harness tuned to our infrastructure – hooks, connectors, and integrations with Claude for code quality checks, artifact generation, and next-best-action guidance through the SDLC.
- Databricks Solutions (20%) – Production templates for Medallion pipelines, Unity Catalog governance, MLflow, PySpark. Not PoCs – real systems with monitoring and runbooks.
- Developer Community (15%) – Demos, office hours, pattern libraries. Measure adoption and impact.
- Production Readiness (10%) – Quality gates, automated checks, incident coaching, ET handoff.
What Success Looks Like
- Team hired, embedded in pods, and shipping agentic infrastructure
- Developer adoption >70% – teams actively using agentic tools in daily work
- Projects consistently shipping to production with proper monitoring and handoff
- Cycle time cut in half. Incidents down 50%. Measured, not estimated.
- Developer community thriving with demos, office hours, and a living pattern library
- You've developed a successor on your team
Stack
Databricks (Delta Lake, Unity Catalog, MLflow, PySpark) / Anthropic Claude API / Python, SQL / AWS (Lambda, ECS, RDS) / DataDog, Prometheus, Grafana / Git / CLI tools, VS Code extensions, CI/CD hooks
Culture
- Kindness is the standard. In the code, the docs, the commit messages.
- Objective over agreement. Debate hard, commit fully.
- Agentic-first. If an LLM can augment it, we do it.
- Production or nothing. We ship.
- Blameless accountability. RCAs that teach, not punish.
- Player-coach model. Leaders build alongside the team.
- 2x2 is the mission. Measured, not aspirational.
Qualifications
Must-Haves
- Leadership: 2+ years managing engineering teams. Experience with embedded/distributed teams. Coaching mindset.
- Production (Non-Negotiable): Shipped end-to-end systems to production with real users, SLAs, and on-call. Not PoCs. 1+ year operating production ML/AI systems.
- Databricks: 2+ years production Databricks (Delta Lake, Unity Catalog, MLflow, PySpark). Medallion architecture. Cost optimization.
- Agentic/LLMs: Anthropic Claude production experience (structured outputs, tool use, multi-turn). Built developer tools with LLMs. Evaluation frameworks. Prompt engineering at scale.
- Engineering: Production-grade Python. SQL expertise. CI/CD. API design. Code quality obsession. Threat modeling. Chaos engineering.
- Communication: Technical teaching. Influence without authority. Clear written communication. Stakeholder management.
Nice-to-Haves
- Developer platforms or CLI tools. DORA/SPACE metrics. Open-source contributions. Event streaming. Privacy regulations. Insurance/fintech/regulated industries. Lightweight UI skills (Streamlit, Gradio, FastAPI + HTMX).
Our Benefits
Because work-life balance is a priority at State Farm, compensation is based on our standard 38:45-hour work week!
- Potential starting salary range: $151,000 - $247,000. Starting salary will be based on skills, background, and experience. High end of the range limited to applicants with significant relevant experience and living in high cost of labor location like CA/NY/NJ/Etc.
- Potential yearly incentive pay up to 18% of base salary
At State Farm, we offer more than just a paycheck. Check out our suite of benefits designed to give you the flexibility you need to take care of you and your family!
- Get Paid! On top of our competitive pay, you are eligible for an annual raise and bonus.
- Stay Well! Focus on you and your family’s health with our robust health and wellbeing programs. State Farm pays most of your healthcare premium, and we offer multiple healthcare plan options, including a high deductible plan. All medical plans provide 100% coverage for in-network preventative care, AND you and your family have access to vision, dental, telemedicine, 24/7 mental health professionals, and much more!
- Develop and Grow! Take advantage of educational benefits like industry leading training programs, top-notch tuition assistance programs, employee resource groups, and mentoring.
- Plan Ahead! Plan for those big moments in life with benefits like fertility/IVF/adoption assistance, college coaching, national discount programs, interactive monthly financial workshops, free financial coaching, and more. You can also start a savings account or consider financing through our State Farm Federal Credit Union!
- Take a Little “You” Time! You will have access to our generous time off policies designed so you can plan around holidays, family events, volunteering, or just to take a relaxing day off. With the opportunity to initially earn up to 20 days annually plus parental leave, paid holidays, celebration day, life leave (40 hours/year), bereavement leave, and community service/education support days, there will be plenty of time for you!
- Give Back! We offer several ways to give back through our Matching Gift Program, Good Neighbor Grant Program, and the Employee Assistance Fund.
- Finish Strong! Plan for retirement using free financial advisors and a 401(k) plan with company contributions of up to 7% of your salary.
Visit our State Farm Careers page for more information on our benefits, locations, and the hiring process of joining the State Farm team!
Qualifications:Must-Haves
- Leadership: 2+ years managing engineering teams. Experience with embedded/distributed teams. Coaching mindset.
- Production (Non-Negotiable): Shipped end-to-end systems to production with real users, SLAs, and on-call. Not PoCs. 1+ year operating production ML/AI systems.
- Databricks: 2+ years production Databricks (Delta Lake, Unity Catalog, MLflow, PySpark). Medallion architecture. Cost optimization.
- Agentic/LLMs: Anthropic Claude production experience (structured outputs, tool use, multi-turn). Built developer tools with LLMs. Evaluation frameworks. Prompt engineering at scale.
- Engineering: Production-grade Python. SQL expertise. CI/CD. API design. Code quality obsession. Threat modeling. Chaos engineering.
- Communication: Technical teaching. Influence without authority. Clear written communication. Stakeholder management.
Nice-to-Haves
- Developer platforms or CLI tools. DORA/SPACE metrics. Open-source contributions. Event streaming. Privacy regulations. Insurance/fintech/regulated industries. Lightweight UI skills (Streamlit, Gradio, FastAPI + HTMX).
What State Farm employees say
Pay
Benefits
Hours and flexibility
Workplace
Get the full story on Breakroom
About State Farm
Sourced by ZipRecruiter
Industry
Insurance services and finance and insurance
Company size
10,000+ Employees
Headquarters location
Bloomington, IL, US