ZipRecruiter

Log In

1

Virtual Ai Rater Jobs in Texas (NOW HIRING)

Apex Systems

Senior Gen-AI Software Engineer

Southlake, TX · On-site

$115K - $152K/yr

Southlake, TX (Onsite) Rate: Up to 85hr on w2 Role Overview You will join a significant technical ... Everforth Apex uses a virtual recruiter as part of the application process. Click for more details.

Apex Systems

Generative AI Context Engineer

Plano, TX · On-site

Everforth Apex uses a virtual recruiter as part of the application process. Click for more details ... Message and data rates may apply. Carriers are not liable for delayed or undelivered messages. You ...

Apex Systems

AI RTE

Houston, TX · On-site

$49.25 - $65.75/hr

Everforth Apex uses a virtual recruiter as part of the application process. Click for more details ... Message and data rates may apply. Carriers are not liable for delayed or undelivered messages. You ...

Apex Systems

Senior AI/ML Engineer

Houston, TX · On-site

$99K - $137K/yr

Everforth Apex uses a virtual recruiter as part of the application process. Click for more details ... Message and data rates may apply. Carriers are not liable for delayed or undelivered messages. You ...

previous pagenext page

Showing results 21-40

All JobsAi Rater JobsVirtual Ai Rater JobsVirtual Ai Rater Jobs in Texas

Virtual Ai Rater information

What is a Virtual AI Rater?

Virtual AI Raters are individuals who remotely evaluate and assess the accuracy, relevance, and quality of artificial intelligence outputs, such as search engine results, ads, or chatbot responses. They follow specific guidelines to rate or annotate data, helping improve AI systems' performance. This role typically requires strong attention to detail, familiarity with online search engines, and the ability to provide objective feedback. Virtual AI Raters usually work part-time and have flexible schedules, making it a popular option for those seeking remote work opportunities.

What are the key skills and qualifications needed to thrive as a Virtual AI Rater, and why are they important?

To thrive as a Virtual AI Rater, you generally need strong analytical skills, attention to detail, and proficiency in English or the target language, often supported by a high school diploma or higher. Familiarity with web browsers, online research, and rating platforms or proprietary evaluation systems is typically required. Excellent time management, reliability, and the ability to follow detailed instructions set top performers apart in this role. These skills ensure accurate and consistent feedback, which is crucial for improving AI systems and maintaining quality standards.

What are some common challenges Virtual AI Raters face when evaluating AI-generated content, and how can these be addressed?

Virtual AI Raters often encounter challenges such as maintaining objectivity, adapting to evolving evaluation criteria, and managing repetitive tasks. To address these, it's important to follow standardized guidelines closely, participate in regular calibration sessions with peers or supervisors, and utilize provided tools for efficient task management. Engaging in ongoing training and staying updated on best practices can also help raters ensure consistent and high-quality evaluations.

What are the most commonly searched types of Ai Rater jobs in Texas?

The most popular types of Ai Rater jobs in Texas are:

What are popular job titles related to Virtual Ai Rater jobs in Texas?

For Virtual Ai Rater jobs in Texas, the most frequently searched job titles are:

What job categories do people searching Virtual Ai Rater jobs in Texas look for?

The top searched job categories for Virtual Ai Rater jobs in Texas are:

What cities in Texas are hiring for Virtual Ai Rater jobs?

Cities in Texas with the most Virtual Ai Rater job openings:

Virtual Ai Rater jobs near you
Infographic showing various Virtual Ai Rater job openings in Texas as of August 2026, with employment types broken down into 80% Full Time, 18% Part Time, and 2% Contract. Highlights an 63% Physical, 4% Hybrid, and 33% Remote job distribution.

Senior Python Engineer - AI Coding Agent Evaluation (Freelance)

Mindrift

Houston, TX • Remote

$200/hr

Part-time

Re-posted 3 days ago

Job description

Please submit your CV in English and indicate your level of English proficiency.


Mindrift connects specialists with project-based AI opportunities for leading tech companies, focused on testing, evaluating, and improving AI systems. Participation is project-based, not permanent employment.

What this opportunity involves:
We're building a dataset to evaluate AI coding agents - how well a model handles real-world developer tasks.


You'll create challenging tasks and evaluation criteria within realistic simulated environments:

  • Build realistic developer environments - a virtual company with codebase, infrastructure, and context (tickets, docs, conversations) that forms a believable development history
  • Design tasks from intermediate states of these environments - craft the prompt, define what "solved" means, and ensure the task is solvable by an AI agent
  • Write tests that verify agent solutions - accept all valid approaches and reject incorrect ones, neither too strict nor too lenient
  • Iterate on tasks and tests based on QA feedback - review agent solutions, analyze failures, and refine until the evaluation is fair and robust

What this is NOT:

  • Not data labeling
  • Not prompt engineering
  • Not writing code from scratch - the agent writes most of the code; you guide and evaluate

What we look for:

  • 8+ years in software development
  • Core stack: Python (FastAPI), JavaScript/TypeScript (React), Docker, Postgres, Kafka, Redis
  • Experience writing tests (functional, integration)
  • English proficiency - B2+

Why this is hard:
Frontier models are already good at coding. Creating a task that genuinely challenges the best models is non-trivial. You need to deeply understand where models fail and what scenarios reveal the difference between a good and a bad solution. Tasks have many valid solutions - writing tests that accept all correct solutions and reject incorrect ones is harder than it sounds.

How it works
Apply Pass qualification(s) Join a project Complete tasks Get paidEffort estimate


Tasks for this project are estimated to take 30 hours to complete, depending on complexity. This is an estimate and not a schedule requirement; you choose when and how to work. Tasks must be submitted by the deadline and meet the listed acceptance criteria to be accepted.

Compensation:
Paid per accepted task. Your rate depends on the qualification tier you reach and how efficiently you complete tasks - up to the equivalent of $200/hr. Because payment is per task, a faster pace raises your effective hourly rate.

Apply