1

Virtual Ai Rater Jobs in New Rochelle, NY (NOW HIRING)

## Staff Software Engineer, AIApplyremote type: Hybridlocations: New Yorktime type: Full timeposted on: Posted 12 Days Agojob requisition id: 001446**Make Your Mark:**As an AI Staff Engineer you'll

Software Engineer, Data

New York, NY · Remote

$100K - $130K/yr

About Castellum.AI Castellum.AI is an AI layer for compliance infrastructure. We provide intelligence data, AI-driven screening across Sanction, PEPs, and Adverse Media, and AI Agents to resolve

AI Operations Lead

White Plains, NY · On-site

$157K/yr

Who We Are and Why Join Us At OnMed our purpose is simple but powerful...to improve the quality of life and sense of well-being in our communities by bringing access to healthcare to everyone,

AI Operations Lead

White Plains, NY · On-site

$157K/yr

Who We Are and Why Join Us At OnMed our purpose is simple but powerful...to improve the quality of life and sense of well-being in our communities by bringing access to healthcare to everyone,

AI Operations Lead

White Plains, NY · On-site

$157K/yr

Who We Are and Why Join Us At OnMed our purpose is simple but powerful...to improve the quality of life and sense of well-being in our communities by bringing access to healthcare to everyone,

AI Intern | Summer Internship Program

Jersey City, NJ · Hybrid

$16.50 - $21.75/hr

Program Overview: Verisk's 2027 Summer Internship Program is designed to provide you with meaningful real-world experience, professional development, and networking opportunities. Recognized as a Top

Showing results 21-40

Virtual Ai Rater information

See New Rochelle, NY salary details

$11

$25

$34

How much do virtual ai rater jobs pay per hour?

As of Sep 2, 2026, the average hourly pay for virtual ai rater in New Rochelle, NY is $25.11, according to ZipRecruiter salary data. Most workers in this role earn between $21.01 and $28.22 per hour, depending on experience, location, and employer.

What is a Virtual AI Rater?

Virtual AI Raters are individuals who remotely evaluate and assess the accuracy, relevance, and quality of artificial intelligence outputs, such as search engine results, ads, or chatbot responses. They follow specific guidelines to rate or annotate data, helping improve AI systems' performance. This role typically requires strong attention to detail, familiarity with online search engines, and the ability to provide objective feedback. Virtual AI Raters usually work part-time and have flexible schedules, making it a popular option for those seeking remote work opportunities.

What are the key skills and qualifications needed to thrive as a Virtual AI Rater, and why are they important?

To thrive as a Virtual AI Rater, you generally need strong analytical skills, attention to detail, and proficiency in English or the target language, often supported by a high school diploma or higher. Familiarity with web browsers, online research, and rating platforms or proprietary evaluation systems is typically required. Excellent time management, reliability, and the ability to follow detailed instructions set top performers apart in this role. These skills ensure accurate and consistent feedback, which is crucial for improving AI systems and maintaining quality standards.

What are some common challenges Virtual AI Raters face when evaluating AI-generated content, and how can these be addressed?

Virtual AI Raters often encounter challenges such as maintaining objectivity, adapting to evolving evaluation criteria, and managing repetitive tasks. To address these, it's important to follow standardized guidelines closely, participate in regular calibration sessions with peers or supervisors, and utilize provided tools for efficient task management. Engaging in ongoing training and staying updated on best practices can also help raters ensure consistent and high-quality evaluations.

What job categories do people searching Virtual Ai Rater jobs in New Rochelle, NY look for?

The top searched job categories for Virtual Ai Rater jobs in New Rochelle, NY are:

What cities near New Rochelle, NY are hiring for Virtual Ai Rater jobs?

Cities near New Rochelle, NY with the most Virtual Ai Rater job openings:

Staff Software Engineer, AI

BlackLine

Manhattan, NY • On-site

$210 - $263/hr

Other

Re-posted 25 days ago


Job description

## Staff Software Engineer, AIApplyremote type: Hybridlocations: New Yorktime type: Full timeposted on: Posted 12 Days Agojob requisition id: 001446**Make Your Mark:**As an AI Staff Engineer you'll play a crucial role in developing and refining our product’s AI. You'll report directly to our VP of Engineering and work closely with our engineering and product teams to enhance our AI capabilities and drive innovation in our fin-tech AI platform. **You'll Get To:*** Responsibilities:* Utilize the best-in-class models available on the market to deliver meaningful solutions for our clients, bringing them from the idea stage all the way to production* Collaborate with the team to integrate AI solutions into our existing production processes* Design and implement scalable AI system architecture handling including model orchestration, caching strategies, and fallback mechanisms* Evaluate and implement new AI technologies and methodologies to keep WiseLayer and BlackLine at the cutting edge **What You'll Bring:*** Years of Experience in Related Field:* 4+ years of experience as a Full Stack Software Engineer or a similar role developing, shipping, and testing of software within a well-established enterprise, bonus points if at a fast growth enterprise* Education: Bachelor's degree in Computer Science, Engineering or a related field* Technical/Specialized Knowledge, Skills, and Abilities:* Demonstrated experience working with production LLM APIs (OpenAI, Anthropic, Google, etc.) including handling rate limits, cost optimization, and performance monitoring in live systems (not just vibe coding)* Clear experience utilizing frameworks like RAG in production applications to further enhance the foundational models for proprietary applications and datasets* Experience with AI system testing methodologies including model evaluation, A/B testing of AI features, and monitoring model performance in production* Experience with data pipelines and ETL/ELT processes (given our data-intensive AI workflows) **We’re Even More Excited If You Have:*** Prior working experience with appliances such as firewalls, routers and load balancers. **Thrive at BlackLine Because You Are Joining:** * A technology-based company with a sense of adventure and a vision for the future. Every door at BlackLine is open. Just bring your brains, your problem-solving skills, and be part of a winning team at the world's most trusted name in Finance Automation!* A culture that is kind, open, and accepting. It's a place where people can embrace what makes them unique, and the mix of cultural backgrounds and varying interests cultivates diverse thought and perspectives.* A culture where BlackLiner's continued growth and learning is empowered. BlackLine offers a wide variety of professional development seminars and inclusive affinity groups to celebrate and support our diversity. BlackLine is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to sex, gender identity or expression, race, ethnicity, age, religious creed, national origin, physical or mental disability, ancestry, color, marital status, sexual orientation, military or veteran status, status as a victim of domestic violence, sexual assault or stalking, medical condition, genetic information, or any other protected class or category recognized by applicable equal employment opportunity or other similar laws. BlackLine recognizes that the ways we work and the workplace itself has shifted. We innovate in a workplace that optimizes a combination of virtual and in-person interactions to maximize collaboration and nurture our culture. Candidates who live within a reasonable commute to one of our offices will work in the office at least 3 days a week.**Salary Range:**$210,000.00-$263,000.00**Pay Transparency Statement:**Placement within this range depends upon several factors, including the applicant's prior relevant job experience, skill set, and geographic location.In addition to base pay, BlackLine also offers short-term and long-term incentive programs, based on eligibility, along with a robust offering of benefit and wellness plans.We are committed to pay transparency and ensuring candidates have clear information about compensation expectations. For roles that include variable incentive components such as an Incentive Compensation Plan (ICP) or On-Target Earnings (OTE), the compensation structure may follow a split model – for example, a 50/50, 70/30, or 60/40 ratio between base salary and variable incentive.BlackLine is committed to creating an inclusive and accessible experience for all candidates. If you require a reasonable accommodation that would better enable your success during the application or interview process, please complete this form.**Accommodations:**BlackLine is committed to creating an inclusive and accessible experience for all candidates. If you require a reasonable accommodation that would better enable your success during the application or interview process, please complete this form. #J-18808-Ljbffr