ZipRecruiter

Log In

1

Overnight Ai Data Rater Jobs in Virginia (NOW HIRING)

Steampunk

AI Evaluation Scientist

Mclean, VA

$105K - $145K/yr

The AI Evaluation Scientist will work closely with engineers, data scientists, governance analysts ... rate, and safety metrics. * Build and maintain automated evaluation scripts, tests, and pipelines ...

Steampunk

AI Evaluation Scientist

Mclean, VA · On-site

$105K - $145K/yr

The AI Evaluation Scientist will work closely with engineers, data scientists, governance analysts ... rate, and safety metrics. * Build and maintain automated evaluation scripts, tests, and pipelines ...

Steampunk

AI Evaluation Scientist

Mclean, VA · On-site

$105K - $145K/yr

The AI Evaluation Scientist will work closely with engineers, data scientists, governance analysts ... rate, and safety metrics. * Build and maintain automated evaluation scripts, tests, and pipelines ...

Steampunk

AI Evaluation Scientist

Mclean, VA · On-site

$105K - $145K/yr

The AI Evaluation Scientist will work closely with engineers, data scientists, governance analysts ... rate, and safety metrics. * Build and maintain automated evaluation scripts, tests, and pipelines ...

Steampunk

AI Evaluation Scientist

Mclean, VA · On-site

$105K - $145K/yr

The AI Evaluation Scientist will work closely with engineers, data scientists, governance analysts ... rate, and safety metrics. * Build and maintain automated evaluation scripts, tests, and pipelines ...

previous pagenext page

Showing results 21-40

All JobsAi Data Rater JobsOvernight Ai Data Rater JobsOvernight Ai Data Rater Jobs in Virginia

Overnight Ai Data Rater information

What is an Overnight AI Data Rater?

Overnight AI Data Raters are individuals who work outside of regular business hours to evaluate and label data used to train artificial intelligence systems. Their main responsibilities include reviewing text, images, audio, or video content and providing accurate assessments or categorizations according to specific guidelines. This work is crucial in ensuring AI models can learn from high-quality and unbiased data. Typically, these roles are remote and may require attention to detail, consistency, and adherence to data privacy standards.

What is the difference between Overnight Ai Data Rater vs Data Annotator?

AspectOvernight Ai Data RaterData Annotator
CredentialsBasic computer skills, sometimes high school diplomaBasic computer skills, sometimes high school diploma
Work EnvironmentRemote, flexible hours, often overnight shiftsRemote or on-site, flexible or regular hours
Industry UsageAI training data, machine learning modelsData labeling, training datasets for AI
Job FocusReviewing and rating data for AI modelsLabeling and annotating data for AI training

Both Overnight Ai Data Raters and Data Annotators work in AI data preparation, often remotely, with similar entry-level requirements. The key difference is that Overnight Ai Data Raters primarily review and rate data, often during overnight shifts, while Data Annotators focus on labeling and annotating data to create training datasets. Understanding these distinctions helps job seekers find roles aligned with their skills and preferred work hours.

What are the key skills and qualifications needed to thrive as an Overnight AI Data Rater?

To thrive as an Overnight AI Data Rater, you need strong analytical skills, attention to detail, and proficiency in following complex guidelines, usually supported by at least a high school diploma or equivalent. Familiarity with data labeling tools, web browsers, and sometimes proprietary platforms is important, as well as the ability to quickly adapt to evolving AI systems. Excellent time management, self-motivation, and clear written communication help individuals excel in this often-remote, independent role. These skills ensure accurate data evaluation, which is crucial for improving AI systems and maintaining quality standards during off-peak hours.

What are some common challenges faced by Overnight AI Data Raters, and how can they be managed?

Overnight AI Data Raters often encounter challenges such as maintaining focus during late-night shifts and accurately evaluating large volumes of data within tight deadlines. Managing these challenges involves establishing a consistent sleep schedule, taking regular breaks to avoid fatigue, and using productivity tools to track progress. Collaborating with team members via chat platforms can also help resolve uncertainties in data interpretation, ensuring high-quality work even during less supervised hours.
What are the most commonly searched types of Ai Data Rater jobs in Virginia? The most popular types of Ai Data Rater jobs in Virginia are:
What cities in Virginia are hiring for Overnight Ai Data Rater jobs? Cities in Virginia with the most Overnight Ai Data Rater job openings:
Overnight Ai Data Rater jobs near you

Data Analyst / Dashboard Developer (Secret Clearance)

System One

Hampton, VA • On-site

Contractor

Re-posted 18 days ago

Job description

Data Analyst/Dashboard Developer Secret clearance required must be able to obtain TS/SCI Must be Security+ certified Langley Air Force Base, VA – onsite Direct Hire The Data Analyst / Dashboard Developer builds, maintains, and continuously improves the?live Performance Dashboard?that serves as the authoritative source for all contract performance data. Integrate data feeds from training systems, token management platforms, help desk operations, and workflow development pipelines into a unified dashboard accessible to the Contracting Officer's Representative (COR) and ACC leadership without requiring manual reports from the Program Manager. This is not a periodic reporting role. Build a?real-time performance intelligence system?that enables proactive decision-making, identifies emerging risks before they become performance failures, and demonstrates mission value through documented metrics. Works directly determines whether ACC leadership trusts the data they see—or whether they question every number. Required Qualifications: • 3+ years?of DoD or federal government data analytics and dashboard development experience • Proven track record building executive-level dashboards with automated data integration from multiple source systems • Experience supporting performance-based contracts with KPI-driven QASP surveillance • Familiarity with DoD data governance, security classification, and PII handling requirements • CompTIA Security+?(DoD 8140.03 baseline) – Required Technical Proficiency (Required): • Power BI?/ Power Automate proficiency –?Required?(must have hands-on experience building dashboards with automated data refresh, calculated fields, and drill-down capabilities) • Advanced proficiency with?Microsoft Excel?(Power Query, Power Pivot, DAX formulas, pivot tables, advanced charting) • SQL?query writing for data extraction and transformation • Experience with?DAF365?and?SharePoint?environments –?Strongly Preferred • Familiarity with?Power Automate?for workflow automation and data pipeline orchestration Analytical Competencies: • Strong statistical analysis and data visualization skills • Ability to translate complex data into executive-level narratives and actionable insights • Understanding of performance measurement frameworks (KPIs, OKRs, Balanced Scorecard) • Experience with trend analysis, variance analysis, and predictive modeling • Attention to detail in data validation and quality assurance Preferred Qualifications: • Microsoft Certified: Data Analyst Associate (Power BI certification) • Tableau Desktop Specialist or Certified Associate certification • Experience with Python or R for advanced statistical analysis • Background supporting Air Force or ACC organizations • Familiarity with Earned Value Management (EVM) and schedule performance metrics • Understanding of AI/ML platforms, RPA tools, or data analytics applications • Previous work supporting DoD AI/data initiatives • Experience with FedRAMP-authorized cloud platforms (Azure Government, AWS GovCloud) Essential Job Functions: Live Performance Dashboard Development & Maintenance: • Build and deploy the?live Performance Dashboard?within?60 days of contract award?on?Power BI?hosted on FedRAMP-authorized or?DAF365?platforms • Integrate data feeds from multiple source systems including: • Token and License Management System (TLMS)?– token allocation, utilization, compliance status by wing and directorate • Learning Management System (LMS)?– training completions, assessment scores, proficiency tracking • Help Desk Ticketing System?– response times, resolution rates, recurring issue categories • Integrated Master Schedule (IMS)?– task completion, schedule performance, milestone tracking • Workflow Development Pipeline?– prototype status, transition timelines, ROI documentation • Ensure dashboard displays all six PWS-required KPI categories: • Training completions prior to access grant • Token and license utilization by wing and directorate • AI and RPA workflow development and transition status • Help desk response and resolution rates • Travel execution against approved wing visit schedules • Quarterly performance trends and year-over-year comparisons Data Integration & Quality Assurance: • Establish automated data pipelines from source systems to the dashboard with?daily refresh cycles?(or more frequent where technically feasible) • Validate data accuracy through cross-referencing with source system reports and manual audits • Identify and resolve data quality issues including missing records, duplicate entries, and classification mismatches • Coordinate with the?Token/Resource Administrator,?Help Desk Analysts, and?Program Analyst?to ensure source data integrity • Document all data transformation logic, calculation methodologies, and business rules in technical specifications • Maintain a data dictionary defining every metric, dimension, and KPI displayed on the dashboard Quarterly Performance Brief Data Packages: • Generate comprehensive?Quarterly Performance Brief data packages?for PM and COR review?5+ business days?before scheduled briefs • Produce executive summary slides showing KPI trends, QASP standard compliance, and performance variance analysis • Develop drill-down appendices with wing-level breakouts, directorate comparisons, and time-series trend charts • Coordinate with the?Stakeholder Engagement & KM Specialist?to package metrics into governance-ready narratives • Prepare data visualizations optimized for executive audiences (clear, concise, actionable) • Document all data sources, assumptions, and calculation methods for COR transparency Service Desk Trend Analysis & Training Feedback Loop: • Conduct?monthly service desk trend analysis?identifying: • Top 10 recurring issue categories requiring knowledge base articles or training updates • Response and resolution time performance against QAP standards • Ticket volume trends by wing, directorate, and platform • Knowledge gaps indicating curriculum deficiencies • Platform issues requiring vendor escalation or technical advisory engagement • Deliver service desk analysis reports to the?Deputy PM?within?5 business days?of each month close to feed the?training feedback loop • Track time from knowledge gap identification to updated training deployment as a mandatory KPI • Measure knowledge base utilization impact on ticket volume reduction over time Utilization Analytics & Resource Optimization: • Analyze token and license utilization patterns to identify: • Underutilized allocations suitable for reallocation • High-demand wings requiring additional resource allocation • Cost-sharing opportunities across participating wings • Compliance gaps where users received tokens without completing training • Generate?monthly utilization reports?for the Token/Resource Administrator showing allocation efficiency and compliance status • Produce cost-per-user and cost-per-wing analytics supporting ACC budget planning • Forecast future resource requirements based on training completion trends and wing expansion plans Ad Hoc Analysis & Decision Support: • Respond to ad hoc data requests from the PM, COR, and functional leads within?2 business days • Conduct root cause analysis when KPIs fall below QASP thresholds, identifying contributing factors and corrective action recommendations • Support?RAID log?population with data-driven risk assessments and impact quantification • Perform comparative analyses across wings to identify best practices and adoption barriers • Develop predictive models forecasting training completion rates, token demand, and workflow development throughput Schedule and Availability: Core Hours: 0800-1700 EST, Monday-Friday), with occasional extended hours to meet mission deadlines or support operational events Flexibility:? Occasional early morning or evening meetings to accommodate wing schedules across time zones Surge Periods:? Increased hours during major milestones, events, or exercises (with advance notice) Security Environment: • Work with classified information up to Top Secret/SCI level • Compliance with OPSEC, CUI handling, and classification protocols • Subject to security inspections, audits, and continuous evaluation • Adherence to base access, badge, and facility security requirements Performance Expectations: Measured against deliverable quality and timeliness: • Dashboard operational within 60 days?of contract award with all six PWS KPI categories integrated • Daily data refresh cycles?maintained with 99%+ uptime (excluding planned maintenance) • Quarterly performance brief data packages?delivered 5+ business days before scheduled briefs with zero data accuracy issues requiring correction • Monthly service desk trend analysis?delivered within 5 business days of month close • Ad hoc analysis requests?completed within 2 business days of PM/COR request • Data quality audits?conducted quarterly with findings documented and corrective actions implemented within 10 days Ref: #851-Rockville-S1 #M1 #LI-VH1