ZipRecruiter

Log In

1

Ai Data Rater Jobs in Virginia (NOW HIRING)

Apex Systems

Sr. Data and AI Engineer

Arlington, VA · On-site

$180K - $200K/yr

Job#: 3033207 Sr. Data and AI Engineer Location: 100% remote Employment Type: Contract to Perm Role ... Message and data rates may apply. Carriers are not liable for delayed or undelivered messages. You ...

Steampunk

AI Evaluation Scientist

Mclean, VA

$105K - $145K/yr

The AI Evaluation Scientist will work closely with engineers, data scientists, governance analysts ... rate, and safety metrics. * Build and maintain automated evaluation scripts, tests, and pipelines ...

Steampunk

AI Evaluation Scientist

Mclean, VA · On-site

$105K - $145K/yr

The AI Evaluation Scientist will work closely with engineers, data scientists, governance analysts ... rate, and safety metrics. * Build and maintain automated evaluation scripts, tests, and pipelines ...

Steampunk

AI Evaluation Scientist

Mclean, VA · On-site

$105K - $145K/yr

The AI Evaluation Scientist will work closely with engineers, data scientists, governance analysts ... rate, and safety metrics. * Build and maintain automated evaluation scripts, tests, and pipelines ...

Steampunk

AI Evaluation Scientist

Mclean, VA · On-site

$105K - $145K/yr

The AI Evaluation Scientist will work closely with engineers, data scientists, governance analysts ... rate, and safety metrics. * Build and maintain automated evaluation scripts, tests, and pipelines ...

Steampunk

AI Evaluation Scientist

Mclean, VA

$105K - $145K/yr

The AI Evaluation Scientist will work closely with engineers, data scientists, governance analysts ... rate, and safety metrics. * Build and maintain automated evaluation scripts, tests, and pipelines ...

previous pagenext page

Showing results 21-40

All JobsAi Data Rater JobsAi Data Rater Jobs in Virginia

Ai Data Rater information

What is an AI data rater?

An AI Data Rater evaluates and rates AI-generated content, such as search engine results, chat responses, or recommendations, to improve machine learning models. They follow specific guidelines to assess relevance, accuracy, and quality. This role helps refine AI systems by providing valuable feedback to enhance their performance. It typically requires strong analytical skills, attention to detail, and familiarity with the subject matter being rated.

What skills and qualifications are needed to thrive as an AI data rater?

To succeed as an AI Data Rater, you need strong analytical skills, attention to detail, and proficiency in evaluating data quality, typically requiring at least a high school diploma or equivalent. Familiarity with computer systems, web browsers, and proprietary rating platforms is often necessary, and training in data privacy or AI guidelines is sometimes provided. Excellent time management, adaptability, and effective written communication help candidates stand out in this largely remote and independent role. These skills ensure accurate data evaluations, support AI improvement, and enable consistent, high-quality performance.

What does an AI data rater do?

As an AI Data Rater, your main responsibilities include reviewing and evaluating various types of data—such as search queries, images, or social media content—according to detailed guidelines provided by your employer. You will typically work independently, using specialized tools or web-based platforms to rate data quality, relevance, or appropriateness. Attention to detail and consistency are important, as your feedback directly impacts the effectiveness of AI systems. Depending on the employer, you may also participate in training sessions or occasional team meetings to stay updated on the latest guidelines or project requirements.

What are the most commonly searched types of Ai Data Rater jobs in Virginia?

The most popular types of Ai Data Rater jobs in Virginia are:

What are popular job titles related to Ai Data Rater jobs in Virginia?

For Ai Data Rater jobs in Virginia, the most frequently searched job titles are:

What job categories do people searching Ai Data Rater jobs in Virginia look for?

The top searched job categories for Ai Data Rater jobs in Virginia are:

What cities in Virginia are hiring for Ai Data Rater jobs?

Cities in Virginia with the most Ai Data Rater job openings:

Ai Data Rater jobs near you
Infographic showing various Ai Data Rater job openings in Virginia as of August 2026, with employment types broken down into 72% Full Time, and 28% Part Time. Highlights an 46% In-person, and 54% Remote job distribution.

Data Analyst / Dashboard Developer (Secret Clearance)

System One

Hampton, VA • On-site

Contractor

Re-posted 23 days ago

Job description

Data Analyst/Dashboard Developer Secret clearance required must be able to obtain TS/SCI Must be Security+ certified Langley Air Force Base, VA – onsite Direct Hire The Data Analyst / Dashboard Developer builds, maintains, and continuously improves the?live Performance Dashboard?that serves as the authoritative source for all contract performance data. Integrate data feeds from training systems, token management platforms, help desk operations, and workflow development pipelines into a unified dashboard accessible to the Contracting Officer's Representative (COR) and ACC leadership without requiring manual reports from the Program Manager. This is not a periodic reporting role. Build a?real-time performance intelligence system?that enables proactive decision-making, identifies emerging risks before they become performance failures, and demonstrates mission value through documented metrics. Works directly determines whether ACC leadership trusts the data they see—or whether they question every number. Required Qualifications: • 3+ years?of DoD or federal government data analytics and dashboard development experience • Proven track record building executive-level dashboards with automated data integration from multiple source systems • Experience supporting performance-based contracts with KPI-driven QASP surveillance • Familiarity with DoD data governance, security classification, and PII handling requirements • CompTIA Security+?(DoD 8140.03 baseline) – Required Technical Proficiency (Required): • Power BI?/ Power Automate proficiency –?Required?(must have hands-on experience building dashboards with automated data refresh, calculated fields, and drill-down capabilities) • Advanced proficiency with?Microsoft Excel?(Power Query, Power Pivot, DAX formulas, pivot tables, advanced charting) • SQL?query writing for data extraction and transformation • Experience with?DAF365?and?SharePoint?environments –?Strongly Preferred • Familiarity with?Power Automate?for workflow automation and data pipeline orchestration Analytical Competencies: • Strong statistical analysis and data visualization skills • Ability to translate complex data into executive-level narratives and actionable insights • Understanding of performance measurement frameworks (KPIs, OKRs, Balanced Scorecard) • Experience with trend analysis, variance analysis, and predictive modeling • Attention to detail in data validation and quality assurance Preferred Qualifications: • Microsoft Certified: Data Analyst Associate (Power BI certification) • Tableau Desktop Specialist or Certified Associate certification • Experience with Python or R for advanced statistical analysis • Background supporting Air Force or ACC organizations • Familiarity with Earned Value Management (EVM) and schedule performance metrics • Understanding of AI/ML platforms, RPA tools, or data analytics applications • Previous work supporting DoD AI/data initiatives • Experience with FedRAMP-authorized cloud platforms (Azure Government, AWS GovCloud) Essential Job Functions: Live Performance Dashboard Development & Maintenance: • Build and deploy the?live Performance Dashboard?within?60 days of contract award?on?Power BI?hosted on FedRAMP-authorized or?DAF365?platforms • Integrate data feeds from multiple source systems including: • Token and License Management System (TLMS)?– token allocation, utilization, compliance status by wing and directorate • Learning Management System (LMS)?– training completions, assessment scores, proficiency tracking • Help Desk Ticketing System?– response times, resolution rates, recurring issue categories • Integrated Master Schedule (IMS)?– task completion, schedule performance, milestone tracking • Workflow Development Pipeline?– prototype status, transition timelines, ROI documentation • Ensure dashboard displays all six PWS-required KPI categories: • Training completions prior to access grant • Token and license utilization by wing and directorate • AI and RPA workflow development and transition status • Help desk response and resolution rates • Travel execution against approved wing visit schedules • Quarterly performance trends and year-over-year comparisons Data Integration & Quality Assurance: • Establish automated data pipelines from source systems to the dashboard with?daily refresh cycles?(or more frequent where technically feasible) • Validate data accuracy through cross-referencing with source system reports and manual audits • Identify and resolve data quality issues including missing records, duplicate entries, and classification mismatches • Coordinate with the?Token/Resource Administrator,?Help Desk Analysts, and?Program Analyst?to ensure source data integrity • Document all data transformation logic, calculation methodologies, and business rules in technical specifications • Maintain a data dictionary defining every metric, dimension, and KPI displayed on the dashboard Quarterly Performance Brief Data Packages: • Generate comprehensive?Quarterly Performance Brief data packages?for PM and COR review?5+ business days?before scheduled briefs • Produce executive summary slides showing KPI trends, QASP standard compliance, and performance variance analysis • Develop drill-down appendices with wing-level breakouts, directorate comparisons, and time-series trend charts • Coordinate with the?Stakeholder Engagement & KM Specialist?to package metrics into governance-ready narratives • Prepare data visualizations optimized for executive audiences (clear, concise, actionable) • Document all data sources, assumptions, and calculation methods for COR transparency Service Desk Trend Analysis & Training Feedback Loop: • Conduct?monthly service desk trend analysis?identifying: • Top 10 recurring issue categories requiring knowledge base articles or training updates • Response and resolution time performance against QAP standards • Ticket volume trends by wing, directorate, and platform • Knowledge gaps indicating curriculum deficiencies • Platform issues requiring vendor escalation or technical advisory engagement • Deliver service desk analysis reports to the?Deputy PM?within?5 business days?of each month close to feed the?training feedback loop • Track time from knowledge gap identification to updated training deployment as a mandatory KPI • Measure knowledge base utilization impact on ticket volume reduction over time Utilization Analytics & Resource Optimization: • Analyze token and license utilization patterns to identify: • Underutilized allocations suitable for reallocation • High-demand wings requiring additional resource allocation • Cost-sharing opportunities across participating wings • Compliance gaps where users received tokens without completing training • Generate?monthly utilization reports?for the Token/Resource Administrator showing allocation efficiency and compliance status • Produce cost-per-user and cost-per-wing analytics supporting ACC budget planning • Forecast future resource requirements based on training completion trends and wing expansion plans Ad Hoc Analysis & Decision Support: • Respond to ad hoc data requests from the PM, COR, and functional leads within?2 business days • Conduct root cause analysis when KPIs fall below QASP thresholds, identifying contributing factors and corrective action recommendations • Support?RAID log?population with data-driven risk assessments and impact quantification • Perform comparative analyses across wings to identify best practices and adoption barriers • Develop predictive models forecasting training completion rates, token demand, and workflow development throughput Schedule and Availability: Core Hours: 0800-1700 EST, Monday-Friday), with occasional extended hours to meet mission deadlines or support operational events Flexibility:? Occasional early morning or evening meetings to accommodate wing schedules across time zones Surge Periods:? Increased hours during major milestones, events, or exercises (with advance notice) Security Environment: • Work with classified information up to Top Secret/SCI level • Compliance with OPSEC, CUI handling, and classification protocols • Subject to security inspections, audits, and continuous evaluation • Adherence to base access, badge, and facility security requirements Performance Expectations: Measured against deliverable quality and timeliness: • Dashboard operational within 60 days?of contract award with all six PWS KPI categories integrated • Daily data refresh cycles?maintained with 99%+ uptime (excluding planned maintenance) • Quarterly performance brief data packages?delivered 5+ business days before scheduled briefs with zero data accuracy issues requiring correction • Monthly service desk trend analysis?delivered within 5 business days of month close • Ad hoc analysis requests?completed within 2 business days of PM/COR request • Data quality audits?conducted quarterly with findings documented and corrective actions implemented within 10 days Ref: #851-Rockville-S1 #M1 #LI-VH1