... Technology (NIST) Professional Research Experience Program (PREP). NIST recognizes that its ... Gain familiarity with existing literature on data annotation and LLM as judge * Understand NIST ...
... Technology (NIST) Professional Research Experience Program (PREP). NIST recognizes that its ... Gain familiarity with existing literature on data annotation and LLM as judge * Understand NIST ...
Ukrainian Language Annotator
Annapolis Junction, MD · On-site
$61K - $107K/yr
... analytic technologies. In this role, you will be responsible for annotating and analyzing ... Prior experience in data annotation, transcription, translation, or linguistic analysis ...
Ukrainian Language Annotator
Annapolis Junction, MD · On-site
$61K - $107K/yr
... analytic technologies. In this role, you will be responsible for annotating and analyzing ... Prior experience in data annotation, transcription, translation, or linguistic analysis ...
Arabic Language Annotator
Annapolis Junction, MD · On-site
$61K - $107K/yr
... analytic technologies. In this role, you will be responsible for annotating and analyzing ... Prior experience in data annotation, transcription, translation, or linguistic analysis ...
Arabic Language Annotator
Annapolis Junction, MD · On-site
$61K - $107K/yr
... analytic technologies. In this role, you will be responsible for annotating and analyzing ... Prior experience in data annotation, transcription, translation, or linguistic analysis ...
(ID: 2026-2574) Axle is a bioscience and information technology company that offers advancements in ... annotation, DEG), and Digital Spatial Profiling (annotation, QC, normalization, spatial ...
(ID: 2026-2574) Axle is a bioscience and information technology company that offers advancements in ... annotation, DEG), and Digital Spatial Profiling (annotation, QC, normalization, spatial ...
(ID: 2026-2574) Axle is a bioscience and information technology company that offers advancements in ... annotation, DEG), and Digital Spatial Profiling (annotation, QC, normalization, spatial ...
Quick apply
(ID: 2026-2574) Axle is a bioscience and information technology company that offers advancements in ... annotation, DEG), and Digital Spatial Profiling (annotation, QC, normalization, spatial ...
Data Scientist II
Rockville, MD · On-site
(ID: 2026-2574) Axle is a bioscience and information technology company that offers advancements in ... annotation, DEG), and Digital Spatial Profiling (annotation, QC, normalization, spatial ...
Data Scientist II
Rockville, MD · On-site
(ID: 2026-2574) Axle is a bioscience and information technology company that offers advancements in ... annotation, DEG), and Digital Spatial Profiling (annotation, QC, normalization, spatial ...
Senior Data Scientist
Woodlawn, MD · On-site
GenAI/NLP libraries (regex, spaCy, LangChain), text annotation tools, semantic frameworks ... Prior federal/state government IT project experience strongly preferred Nice to Have :- * Hadoop ...
Senior Data Scientist
Woodlawn, MD · On-site
GenAI/NLP libraries (regex, spaCy, LangChain), text annotation tools, semantic frameworks ... Prior federal/state government IT project experience strongly preferred Nice to Have :- * Hadoop ...
Review nucleotide sequence and annotation data submitted by individual laboratories and large-scale ... Familiarity with DNA sequencing technologies, genome-assembly methods, and sequence-analysis tools.
Quick apply
Review nucleotide sequence and annotation data submitted by individual laboratories and large-scale ... Familiarity with DNA sequencing technologies, genome-assembly methods, and sequence-analysis tools.
Genomic Data Curator / Molecular Biologist - Sequence Analysis & Workflows
Bethesda, MD · On-site
$90K - $120K/yr
Review nucleotide sequence and annotation data submitted by individual laboratories and large-scale ... Familiarity with DNA sequencing technologies, genome-assembly methods, and sequence-analysis tools.
Genomic Data Curator / Molecular Biologist - Sequence Analysis & Workflows
Bethesda, MD · On-site
$90K - $120K/yr
Review nucleotide sequence and annotation data submitted by individual laboratories and large-scale ... Familiarity with DNA sequencing technologies, genome-assembly methods, and sequence-analysis tools.
Genome Data Curator / Molecular Biologist - GenBank Submissions
Bethesda, MD · On-site
$90K - $120K/yr
Review whole-genome sequence and annotation data from individual laboratories and large-scale ... assembly technologies. * Familiarity with public molecular biology resources such as GenBank ...
Genome Data Curator / Molecular Biologist - GenBank Submissions
Bethesda, MD · On-site
$90K - $120K/yr
Review whole-genome sequence and annotation data from individual laboratories and large-scale ... assembly technologies. * Familiarity with public molecular biology resources such as GenBank ...
Review whole-genome sequence and annotation data from individual laboratories and large-scale ... assembly technologies. * Familiarity with public molecular biology resources such as GenBank ...
Quick apply
Review whole-genome sequence and annotation data from individual laboratories and large-scale ... assembly technologies. * Familiarity with public molecular biology resources such as GenBank ...
Subject Matter Expert- RxNav
Bethesda, MD · On-site
Department of Health and Human Services (DHHS) agencies to develop data science solutions to ... Experience in content development and/or text annotation (e.g., annotation of certain types of ...
Subject Matter Expert- RxNav
Bethesda, MD · On-site
Department of Health and Human Services (DHHS) agencies to develop data science solutions to ... Experience in content development and/or text annotation (e.g., annotation of certain types of ...
Senior Software Developer (C++) in Bioinformatics and Big Data
Bethesda, MD · On-site
$58.25 - $77/hr
NCBI's annotation pipelines not only serve these diverse expert communities - they actually drive ... Experience with Cloud technologies a strong plus
Senior Software Developer (C++) in Bioinformatics and Big Data
Bethesda, MD · On-site
$58.25 - $77/hr
NCBI's annotation pipelines not only serve these diverse expert communities - they actually drive ... Experience with Cloud technologies a strong plus
Senior Software Developer (C++) in Bioinformatics and Big Data
Bethesda, MD · On-site +1
$58.25 - $77/hr
NCBI's annotation pipelines not only serve these diverse expert communities - they actually drive ... Experience with Cloud technologies a strong plus
Senior Software Developer (C++) in Bioinformatics and Big Data
Bethesda, MD · On-site +1
$58.25 - $77/hr
NCBI's annotation pipelines not only serve these diverse expert communities - they actually drive ... Experience with Cloud technologies a strong plus
Department of Health and Human Services (DHHS) agencies to develop data science solutions to ... Experience in content development and/or text annotation (e.g., annotation of certain types of ...
Department of Health and Human Services (DHHS) agencies to develop data science solutions to ... Experience in content development and/or text annotation (e.g., annotation of certain types of ...
Linguist
California, MD · On-site
$35 - $40/hr
... technologies, and LLM/AI data operations and a proven ability to support data collection, synthetic data generation, annotation, and evaluation for LLM training, alignment, and AI agent development.
Linguist
California, MD · On-site
$35 - $40/hr
... technologies, and LLM/AI data operations and a proven ability to support data collection, synthetic data generation, annotation, and evaluation for LLM training, alignment, and AI agent development.
Senior Data Scientist
Baltimore, MD · On-site
$70 - $80/hr
... text annotation, and semantic frameworks. · Excellent problem-solving skills, ability to ... Desired Qualifications: · Prior experience delivering IT projects within federal or state ...
Quick apply
Senior Data Scientist
Baltimore, MD · On-site
$70 - $80/hr
... text annotation, and semantic frameworks. · Excellent problem-solving skills, ability to ... Desired Qualifications: · Prior experience delivering IT projects within federal or state ...
Senior Data Scientist
$200K - $210K/yr
... annotation tools and semantic frameworks Ability to clean and process large amounts of real-world ... Prior experience with federal or state governments IT projects Industry experience preferred ...
Senior Data Scientist
$200K - $210K/yr
... annotation tools and semantic frameworks Ability to clean and process large amounts of real-world ... Prior experience with federal or state governments IT projects Industry experience preferred ...
(ID: 2026-2316) Axle is a bioscience and information technology company that offers advancements in ... Develop benchmark datasets, annotation guidelines, and evaluation pipelines for scientific ...
Quick apply
(ID: 2026-2316) Axle is a bioscience and information technology company that offers advancements in ... Develop benchmark datasets, annotation guidelines, and evaluation pipelines for scientific ...
... annotation tools and semantic frameworks. \n * Ability to clean and process large amounts of real ... Prior experience with federal or state governments IT projects. \n * Industry experience preferred ...
... annotation tools and semantic frameworks. \n * Ability to clean and process large amounts of real ... Prior experience with federal or state governments IT projects. \n * Industry experience preferred ...
Data Annotation Tech information
See Maryland salary details
$11.90 - $13.89
3% of jobs
$13.89 - $15.89
19% of jobs
$16.43 is the 25th percentile. Wages below this are outliers.
$15.89 - $17.88
11% of jobs
$17.88 - $19.87
13% of jobs
The median wage is $20.77 / hr.
$19.87 - $21.87
11% of jobs
$21.87 - $23.86
12% of jobs
$25.67 is the 75th percentile. Wages above this are outliers.
$23.86 - $25.85
8% of jobs
$25.85 - $27.85
8% of jobs
$27.85 - $29.84
6% of jobs
$29.84 - $31.84
5% of jobs
$31.84 - $33.83
4% of jobs
$11
$22
$33
How much do data annotation tech jobs pay per hour?
What are the key skills and qualifications needed to thrive in the Data Annotation Tech position, and why are they important?
To thrive as a Data Annotation Tech, you need keen attention to detail, basic computer literacy, and familiarity with data labeling standards, often supported by a high school diploma or equivalent. Experience with annotation platforms, image or text labeling tools, and basic knowledge of data management systems is highly valuable. Strong organizational skills, patience, and effective communication set top candidates apart in this field. These skills and qualities ensure annotated data is accurate, consistent, and valuable for machine learning or AI projects.
What does a typical day look like for a Data Annotation Tech?
A typical day as a Data Annotation Tech involves reviewing large sets of data—such as images, text, or audio—and accurately labeling or categorizing them using specialized software. You may work independently or as part of a team, following specific project guidelines to ensure data integrity and consistency. Collaboration with project managers or data scientists is common when clarifying ambiguous data points or addressing annotation challenges. Additionally, productivity targets and quality checks are a regular part of the workflow, helping to keep projects on schedule and maintain high standards.
What is a Data Annotation Tech job?
A Data Annotation Tech is responsible for labeling and categorizing data, such as text, images, audio, or video, to train machine learning models. They follow specific guidelines to ensure accuracy and consistency in annotations, which helps improve the performance of AI systems. This role often involves repetitive tasks, attention to detail, and familiarity with various annotation tools. Data annotation is crucial for AI development in industries like healthcare, finance, and autonomous driving.

Full-time
Posted 19 days ago
Johns Hopkins Medicine rating
7.5
Based on 205 frontline employees who took The Breakroom Quiz
230th of 890 rated healthcare providers
Job description
PREP Research Associate
This position is part of the National Institute of Standards and Technology (NIST) Professional Research Experience Program (PREP). NIST recognizes that its research staff may want to collaborate with researchers at academic institutions on specific projects of mutual interest and, therefore, requires those institutions to be recipients of a PREP award. The PREP program involves staff from a wide range of backgrounds conducting scientific research across various fields. Individuals in this position will perform technical work supporting the collaboration's scientific research.
Research Title:
Reliability of Human and LLM Annotations for AI Risk Assessment
The work will entail:
This project focuses on using Large Language Models (LLMs) to provide annotations of evaluation data (a.k.a., LLM as judge), and the design of an Inter-Annotator Agreement study to assess the reliability of both human and LLM annotations. The candidate will explore assessing the indicators of a given AI-related risk, determining how to identify them, and providing annotators with examples to annotate the presence of various risks. The project aims to develop an annotation framework for AI risk assessment and establish metrics for data quality in AI risk research, supporting broader work at NIST in assessing and measuring the validity and reliability of AI-related risks in data annotation.
U.S. Citizen Preferred
Key responsibilities will include but are not limited to:
- Gain familiarity with existing literature on data annotation and LLM as judge
- Understand NIST's role and ongoing efforts in assessing and measuring the validity and reliability of AI-related risks in data annotation
- Contribute to developing an annotation framework for AI risk assessment
- Collaborate effectively with cross-functional and interdisciplinary stakeholders to ensure successful project outcomes
Deliverables
- Contributions to a NIST report that supports ongoing NIST AI evaluation efforts focused on the design of an Inter-Annotator Agreement to assess the reliability of both human and LLM annotations.
Qualifications
- Background in Computer Science, Data Science, or related field.
- Education level: Bachelor's or Graduate Degree
- Strong interest in data annotation and AI risks
- Familiarity with scientific reading and technical writing
Application Instructions
Please upload the following with your application:
• CV/Resume
*Please limit C.V to 3 pages only and ONLY include a valid email address for your contact info. Your resume will not be considered if the following information is included on your CV/resume.
• Self portraits
• Phone number
• Home address/Country
• Citizenship status
• Languages spoken
• Sex/Gender
Privacy Act Statement
Authority: 15 U.S.C. § 278g-1(e)(1) and (e)(3) and 15 U.S.C. § 272(b) and (c)
Purpose: The National Institute for Standards and Technology (NIST) hosts the Professional Research Experience Program (PREP) which is designed to provide valuable laboratory experience and financial assistance to undergraduates, post-bachelor's degree holders, graduate students, master's degree holders, postdocs, and faculty.
PREP is a 5-year cooperative agreement between NIST laboratories and participating PREP Universities to establish a collaborative research relationship between NIST and U.S. institutions of higher education in the following disciplines including (but may not be limited to) biochemistry, biological sciences, chemistry, computer science, engineering, electronics, materials science, mathematics, nanoscale science, neutron science, physical science, physics, and statistics. This collection of information is needed to facilitate administrative functions of the PREP Program.
Routine Uses: NIST will use the information collected to perform the requisite reviews of the applications to determine eligibility, and to meet programmatic requirements. Disclosure of this information is also subject to all the published routine uses as identified in the Privacy Act System of Records Notices: NIST-1: NIST Associates.
Disclosure: Furnishing this information is voluntary. When you submit the form, you are indicating your voluntary consent for NIST to use of the information you submit for the purpose stated.
What Johns Hopkins Medicine employees say
Pay
Benefits
Hours and flexibility
Workplace
Get the full story on Breakroom
About Johns Hopkins Hospital
Sourced by ZipRecruiter
Industry
Health care and social assistance
Company size
10,000+ Employees
Headquarters location
Baltimore, MD, US
Year founded
1889