1

Data Annotation Research Jobs in Virginia (NOW HIRING)

Coordinate data collection and annotation efforts for supervised training efforts * Design and implement tests for machine learning algorithm effectiveness and performance monitoring * Research and ...

Senior Data Scientist

Reston, VA · On-site

  • Medical

  • Dental

  • Vision

  • Life

  • Retirement

  • PTO

Coordinate data collection and annotation efforts for supervised training efforts * Design and implement tests for machine learning algorithm effectiveness and performance monitoring * Research and ...

Senior Data Scientist

Reston, VA · On-site

  • Medical

  • Dental

  • Vision

  • Life

  • Retirement

  • PTO

Coordinate data collection and annotation efforts for supervised training efforts * Design and implement tests for machine learning algorithm effectiveness and performance monitoring * Research and ...

Director, Product Management, Platform Services

Mclean, VA · On-site

$235K - $246K/yr

  • Medical

  • Dental

  • Vision

  • Life

  • Retirement

Partner with Data Science and Research to operationalize model development, evaluation, annotation, and quality measurement, and to move research into production reliably. * Define and enforce ...

Staff Engineer, AI

Herndon, VA · On-site +1

  • Medical

  • Dental

  • Vision

  • Life

  • Retirement

  • PTO

Collaborate with the Data QA team to define annotation standards, resolve taxonomy issues, and ... Experience researching, building, and evaluating production-ready CV models for detection ...

Senior Machine Learning Engineer

Mclean, VA

$105K - $145K/yr

... ML R&D software company with offices in Durham, NC and McLean, VA, that uses artificial ... Experience with data curation/annotation workflows and dataset quality control. * Software ...

Staff Engineer, AI

Herndon, VA · On-site

  • Medical

  • Dental

  • Vision

  • Life

  • Retirement

  • PTO

Collaborate with the Data QA team to define annotation standards, resolve taxonomy issues, and ... Experience researching, building, and evaluating production-ready CV models for detection ...

... Data QA team to define annotation standards, resolve taxonomy issues, and identify data-quality ... researching, building, and evaluating production-ready CV models for detection, segmentation ...

... Data QA team to define annotation standards, resolve taxonomy issues, and identify data-quality ... researching, building, and evaluating production-ready CV models for detection, segmentation ...

Data Annotation Research information

What are some common challenges faced in data annotation research roles, and how can they be addressed?

Professionals in Data Annotation Research often encounter challenges such as maintaining consistency in labeling, dealing with ambiguous data, and managing large datasets efficiently. These issues can be addressed by following detailed annotation guidelines, participating in regular calibration sessions with the team, and utilizing annotation tools that support quality control checks. Collaboration with data scientists and project managers is essential to clarify ambiguities and ensure that annotated data meets the project's requirements. Staying proactive in communication and continuous learning helps to minimize errors and improve overall data quality.

What is the difference between Data Annotation Research vs Data Labeling Specialist?

AspectData Annotation ResearchData Labeling Specialist
CredentialsTypically requires a background in data science, research methods, or related fieldsOften requires basic technical skills and experience with labeling tools
Work EnvironmentResearch labs, tech companies, or remote research teamsData centers, tech companies, or remote labeling teams
Industry UsageUsed in AI/ML research, developing annotation methodologiesUsed in preparing datasets for machine learning models
Search & Comparison IntentUnderstanding research-focused roles in data annotationLooking for practical data labeling jobs

Data Annotation Research involves exploring new annotation techniques and improving data quality for AI models, often requiring research skills. In contrast, Data Labeling Specialists focus on applying existing labeling tools to annotate datasets efficiently. Both roles are essential in AI development but differ in scope and expertise.

What is data annotation research?

Data annotation research involves studying and developing methods for labeling data, such as images, text, or audio, to be used in training machine learning models. Researchers in this field focus on improving annotation accuracy, efficiency, and scalability, as well as addressing challenges like bias and consistency. This work is critical because high-quality annotated data is essential for building effective AI systems. Data annotation research often includes exploring new tools, techniques, and guidelines for human annotators or automated labeling systems.

What are the key skills and qualifications needed to thrive as a data annotation researcher, and why are they important?

To thrive as a Data Annotation Researcher, you need strong attention to detail, analytical thinking, and familiarity with data labeling concepts, often supported by a degree in computer science, linguistics, or a related field. Experience with annotation platforms, data management tools, and sometimes knowledge of programming languages like Python are typically required. Excellent communication, problem-solving abilities, and the capacity to work independently set standout contributors apart. These skills ensure high-quality, accurate data labeling, which is crucial for developing reliable AI and machine learning models.

What are popular job titles related to Data Annotation Research jobs in Virginia?

For Data Annotation Research jobs in Virginia, the most frequently searched job titles are:

What job categories do people searching Data Annotation Research jobs in Virginia look for?

The top searched job categories for Data Annotation Research jobs in Virginia are:

What cities in Virginia are hiring for Data Annotation Research jobs?

Cities in Virginia with the most Data Annotation Research job openings:

Artificial Intelligence / Machine Learning Lead Verification and Validation Engineer

The Pennsylvania State University

Reston, VA • On-site, Remote

$106K - $140K/yr

Full-time

Medical, Dental, Vision, Retirement, PTO

Posted 22 days ago


Job description

APPLICATION INSTRUCTIONS:
  • CURRENT PENN STATE EMPLOYEE (faculty, staff, technical service, or student), please login to Workday to complete the internal application process. Please do not apply here, apply internally through Workday.
  • CURRENT PENN STATE STUDENT (not employed previously at the university) and seeking employment with Penn State, please login to Workday to complete the student application process. Please do not apply here, apply internally through Workday.
  • If you are NOT a current employee or student, please click "Apply" and complete the application process for external applicants.

Approval of remote and hybrid work is not guaranteed regardless of work location.For additional information on remote work at Penn State, seeNotice to Out of State Applicants.

POSITION SPECIFICS

We are searching for a talented, experienced, organized, and a highly motivated AI/ML Engineer to join the Visualization and Decision Support Division within the All-Domain Analytics and Signatures Office (A2SO) at the Applied Research Laboratory (ARL) at Penn State. You will lead our Independent Verification and Validation (IV&V) and Data Curation Center of Excellence. This team serves as the foundation for effective machine learning-building, curating, and governing the data that directly determines whether AI/ML models succeed in operationally relevant environments. This position can be filled in State College, PA or Reston, VA.

ARL is an authorized DoD SkillBridge partner and welcomes all transitioning military members to apply.

You will:

  • Serve as the technical lead for the IV&V and Data Curation Center of Excellence, setting priorities, defining standards, and driving the team's technical direction
  • Mentor, guide, and coordinate a team of engineers performing data labeling, annotation, curation, and IV&V across multiple data modalities
  • Establish and evolve annotation standards, labeling guidelines, data governance frameworks, and quality assurance processes to ensure consistency and reproducibility at scale
  • Design and oversee data pipelines for ingestion, transformation, quality control, and cataloging of classified and open-source data
  • Lead IV&V efforts on datasets and model outputs, defining acceptance criteria and fitness-for-use standards
  • Serve as the primary point of contact between the data curation team and research scientists, algorithm developers, and program stakeholders to translate data needs into actionable plans
  • Present findings, status, and recommendations to leadership and sponsors through well-constructed briefings, papers, and technical artifacts
  • Evaluate and introduce tools, platforms, and best practices for annotation (e.g., CVAT, Label Studio), data versioning, and metadata management
  • Drive automation of manual data analysis and curation processes to improve efficiency and scalability
  • Architect and maintain data catalogs, metadata schemas, and access-controlled repositories that make curated datasets discoverable and accessible to the broader research team
  • Work within an Agile development environment within a large research team

Required Skills/Experience areas include:

  • Bachelor's Degree in Computer Science, Data Science, Information Science, Engineering, or a related technical field
  • Extensive experience designing and managing data curation, annotation, or IV&V workflows for AI/ML systems
  • Deep understanding of machine learning fundamentals, including how data quality, labeling strategies, and dataset composition impact model training, evaluation, and deployment
  • Strong proficiency in Python and SQL for data manipulation, pipeline development, and analysis
  • Experience with data annotation tools and platforms (e.g., CVAT, Label Studio, or equivalent)
  • Success in environments where various forms of communication and organizational skills were crucial to be effective

Preferred Skills/Experience areas include:

  • Prior experience leading or managing a technical team
  • Experience working with DoD or Intelligence Community data, workflows, or operational environments
  • Familiarity with geospatial data formats (shapefiles, GeoJSON, AIS), imagery/FMV exploitation, or signals data processing
  • Experience with data versioning tools (e.g., DVC, LakeFS) or data catalog platforms
  • Knowledge of IV&V methodologies and test and evaluation practices for data-driven systems
  • Experience with containerized development environments (Docker, Kubernetes) and cloud platforms (AWS, Azure)
  • Master's degree or higher in a relevant field
  • Current eligibility to access classified information at the Top Secret/ SCI level or higher and may be subject to a government background investigation to updated clearance eligibility, if required

Your working location will be fully-on site located in either State College, PA or Reston, VA.

MINIMUM EDUCATION, WORK EXPERIENCE & REQUIRED CERTIFICATIONS

If filled as R&D Engineer - Artificial Intelligence (ARL) - Principal Professional, this position requires: Bachelor's Degree - Engineering or Science 19+ years of relevant experience Required Certifications: None If filled as R&D Engineer - Artificial Intelligence (ARL) - Senior Professional, this position requires: Bachelor's Degree - Engineering or Science 14+ years of relevant experience Required Certifications: None

ARL's purpose is to research and develop innovative solutions to challenging scientific, engineering, and technology problems in support of the Navy, the Intel Community (IC), and other federal government customers.

FOR FURTHER INFORMATION on ARL, visit our website atwww.arl.psu.edu.

BACKGROUND CHECKS/CLEARANCES

Employment with the University will require successful completion of background check(s) in accordance with University policies.Notice regarding employment at the Applied Research Laboratory (ARL): Employees must be eligible to obtain a government security clearance, participate in the ARL drug testing program, and comply with electronic and physical monitoring requirements applicable to federal contractors. ARL operates in a secure information environment involving Unclassified, Controlled Unclassified Information (CUI), and Classified information. Personal electronic devices brought onsite must be registered and may be restricted from certain areas. You must be a U.S. citizen to apply.

SALARY & BENEFITS

The salary range for this position, including all possible grades, is $168,000.00 - $318,840.00. This salary range includes an adjustment based on required geographic work location.

Salary Structure - Information on Penn State's salary structure

Penn State provides a competitive benefits package for full-time employees designed to support both personal and professional well-being. In addition to comprehensive medical, dental, and vision coverage, employees enjoy robust retirement plans and substantial paid time off which includes holidays, vacation and sick time. One of the standout benefits is the generous 75% tuition discount, available to employees as well as eligible spouses and children. For more detailed information, please visit our Benefits Page.

CAMPUS SECURITY CRIME STATISTICS

Pursuant to the Jeanne Clery Disclosure of Campus Security Policy and Campus Crime Statistics Act and the Pennsylvania Act of 1988, Penn State publishes a combined Annual Security and Annual Fire Safety Report (ASR). The ASR includes crime statistics and institutional policies concerning campus security, such as those concerning alcohol and drug use, crime prevention, the reporting of crimes, sexual assault, and other matters. The ASR is available for review here.

EEO IS THE LAW

Penn State is an equal opportunity employer and is committed to providing employment opportunities to all qualified applicants without regard to race, color, religion, age, sex, sexual orientation, gender identity, national origin, disability or protected veteran status. If you are unable to use our online application process due to an impairment or disability, please contact 814-865-1473.

Federal Contractors Labor Law Poster

PA State Labor Law Poster

Penn State Policies

Copyright Information

Hotlines


Pennsylvania State University logo

About Pennsylvania State University

Sourced by ZipRecruiter

Pennsylvania State University, often referred to as Penn State, is a major, public, research-intensive university located in University Park, PA, US. This esteemed institution serves as an important player within the education industry, offering a plethora of academic programs across various disciplines. The university was founded in 1855 with the mission to provide quality education, advanced research, and service to society. Penn State holds firmly to values of integrity, respect, and excellence, fostering a diverse and inclusive community. The university is renowned for its research productivity and its high-ranking programs in areas like engineering, business, and education. One notable achievement of the institution is its designation as a "R1: Doctoral Universities – Very high research activity," demonstrating its commitment to scholarship and discovery.

Industry

Education

Company size

11 - 50 Employees

Headquarters location

University Park, PA, US

Year founded

1855

Social media