Gain familiarity with existing literature on data annotation and LLM as judge * Understand NIST ... Home address/Country • Citizenship status • Languages spoken • Sex/Gender Privacy Act ...
Gain familiarity with existing literature on data annotation and LLM as judge * Understand NIST ... Home address/Country • Citizenship status • Languages spoken • Sex/Gender Privacy Act ...
Arabic Language Annotator
Annapolis Junction, MD · On-site
$61K - $107K/yr
... based on linguistic insights. Basic Qualifications * Native or near-native fluency in Arabic, with ... Prior experience in data annotation, transcription, translation, or linguistic analysis ...
Arabic Language Annotator
Annapolis Junction, MD · On-site
$61K - $107K/yr
... based on linguistic insights. Basic Qualifications * Native or near-native fluency in Arabic, with ... Prior experience in data annotation, transcription, translation, or linguistic analysis ...
In-Home Based BCBA
Rockville, MD · On-site
$90 - $100/hr
Advanced, easy-to-use tools that simplify data collection and charting * The best of both worlds - the resources of a large organization combined with the collegiality and support of the local care ...
In-Home Based BCBA
Rockville, MD · On-site
$90 - $100/hr
Advanced, easy-to-use tools that simplify data collection and charting * The best of both worlds - the resources of a large organization combined with the collegiality and support of the local care ...
In-Home Based BCBA
$90 - $100/hr
Advanced, easy-to-use tools that simplify data collection and charting * The best of both worlds - the resources of a large organization combined with the collegiality and support of the local care ...
In-Home Based BCBA
$90 - $100/hr
Advanced, easy-to-use tools that simplify data collection and charting * The best of both worlds - the resources of a large organization combined with the collegiality and support of the local care ...
In-Home Based BCBA
Rockville, MD · On-site +1
$90 - $100/hr
Advanced, easy-to-use tools that simplify data collection and charting * The best of both worlds - the resources of a large organization combined with the collegiality and support of the local care ...
In-Home Based BCBA
Rockville, MD · On-site +1
$90 - $100/hr
Advanced, easy-to-use tools that simplify data collection and charting * The best of both worlds - the resources of a large organization combined with the collegiality and support of the local care ...
... annotation, DEG), and Digital Spatial Profiling (annotation, QC, normalization, spatial ... Incorporate AI/LLM-based extraction where appropriate, with clear validation and communication to ...
Quick apply
... annotation, DEG), and Digital Spatial Profiling (annotation, QC, normalization, spatial ... Incorporate AI/LLM-based extraction where appropriate, with clear validation and communication to ...
... annotation, DEG), and Digital Spatial Profiling (annotation, QC, normalization, spatial ... Incorporate AI/LLM-based extraction where appropriate, with clear validation and communication to ...
... annotation, DEG), and Digital Spatial Profiling (annotation, QC, normalization, spatial ... Incorporate AI/LLM-based extraction where appropriate, with clear validation and communication to ...
Data Scientist II
Rockville, MD · On-site
... annotation, DEG), and Digital Spatial Profiling (annotation, QC, normalization, spatial ... Incorporate AI/LLM-based extraction where appropriate, with clear validation and communication to ...
Data Scientist II
Rockville, MD · On-site
... annotation, DEG), and Digital Spatial Profiling (annotation, QC, normalization, spatial ... Incorporate AI/LLM-based extraction where appropriate, with clear validation and communication to ...
In this role, you will provide high-quality, evidence-based Applied Behavior Analysis (ABA) therapy ... record data on client progress Collaborate with families and clinical team members to support ...
Quick apply
In this role, you will provide high-quality, evidence-based Applied Behavior Analysis (ABA) therapy ... record data on client progress Collaborate with families and clinical team members to support ...
This position involves developing automated solutions for the annotation of language data. This ... materials based on available information. These tools assist our recruitment team but do not ...
This position involves developing automated solutions for the annotation of language data. This ... materials based on available information. These tools assist our recruitment team but do not ...
... Arkansas - Home Teleworkers, California - Home Teleworkers, Colorado - Home Teleworkers ... Support platform modernization and data enablement initiatives , including adopting cloud-based ...
... Arkansas - Home Teleworkers, California - Home Teleworkers, Colorado - Home Teleworkers ... Support platform modernization and data enablement initiatives , including adopting cloud-based ...
... Arkansas - Home Teleworkers, California - Home Teleworkers, Colorado - Home Teleworkers ... Support platform modernization and data enablement initiatives , including adopting cloud-based ...
... Arkansas - Home Teleworkers, California - Home Teleworkers, Colorado - Home Teleworkers ... Support platform modernization and data enablement initiatives , including adopting cloud-based ...
... our Home-Based Primary Care Program serving Baltimore, Howard County, and Anne Arundel County ... Ability to analyze data to synthesize and summarize information, and make judgments regarding ...
... our Home-Based Primary Care Program serving Baltimore, Howard County, and Anne Arundel County ... Ability to analyze data to synthesize and summarize information, and make judgments regarding ...
... Arkansas - Home Teleworkers, California - Home Teleworkers, Colorado - Home Teleworkers ... Support platform modernization and data enablement initiatives , including adopting cloud-based ...
... Arkansas - Home Teleworkers, California - Home Teleworkers, Colorado - Home Teleworkers ... Support platform modernization and data enablement initiatives , including adopting cloud-based ...
Senior Data Scientist
Woodlawn, MD · On-site
Train/optimize NLP/LLM models; build Python-based pipelines * Build cloud-native solutions on AWS ... GenAI/NLP libraries (regex, spaCy, LangChain), text annotation tools, semantic frameworks
Senior Data Scientist
Woodlawn, MD · On-site
Train/optimize NLP/LLM models; build Python-based pipelines * Build cloud-native solutions on AWS ... GenAI/NLP libraries (regex, spaCy, LangChain), text annotation tools, semantic frameworks
... our Home-Based Primary Care Program serving Baltimore, Howard County, and Anne Arundel County ... Ability to analyze data to synthesize and summarize information, and make judgments regarding ...
... our Home-Based Primary Care Program serving Baltimore, Howard County, and Anne Arundel County ... Ability to analyze data to synthesize and summarize information, and make judgments regarding ...
Data & Hardware Intern
Rockville, MD · On-site
$30/hr
Data & Hardware Operations CoOp/ Intern Origin AI, an ADT Company Location: HQ Rockville, MD About ... Origin is redefining home security with TruShield℠ Security, a hardware-free, router-based ...
Quick apply
Data & Hardware Intern
Rockville, MD · On-site
$30/hr
Data & Hardware Operations CoOp/ Intern Origin AI, an ADT Company Location: HQ Rockville, MD About ... Origin is redefining home security with TruShield℠ Security, a hardware-free, router-based ...
Data & Hardware Intern
Rockville, MD · On-site
$30/hr
Data & Hardware Operations CoOp/ Intern Origin AI, an ADT Company Location: HQ Rockville, MD About ... Origin is redefining home security with TruShield℠ Security, a hardware-free, router-based ...
Quick apply
Data & Hardware Intern
Rockville, MD · On-site
$30/hr
Data & Hardware Operations CoOp/ Intern Origin AI, an ADT Company Location: HQ Rockville, MD About ... Origin is redefining home security with TruShield℠ Security, a hardware-free, router-based ...
ME00573-Data Scientist 3
Fort George G Meade, MD · On-site
$135K - $180K/yr
Experience developing models for tokenization, text processing, and linguistic annotation ... Experience working with multilingual or speech-based datasets * Familiarity with deep learning ...
ME00573-Data Scientist 3
Fort George G Meade, MD · On-site
$135K - $180K/yr
Experience developing models for tokenization, text processing, and linguistic annotation ... Experience working with multilingual or speech-based datasets * Familiarity with deep learning ...
Senior Data Scientist
Woodlawn, MD · On-site
$200K - $210K/yr
... create Python based pipelines Experience building cloud native solutions on AWS Determine the ... annotation tools and semantic frameworks Ability to clean and process large amounts of real-world ...
Senior Data Scientist
Woodlawn, MD · On-site
$200K - $210K/yr
... create Python based pipelines Experience building cloud native solutions on AWS Determine the ... annotation tools and semantic frameworks Ability to clean and process large amounts of real-world ...
Home Based Data Annotation information
Can I do data annotation with no experience?
Is it hard to get hired for data annotation?
Is data annotation a legitimate job?
What is the difference between Home Based Data Annotation vs Data Labeler?
| Aspect | Home Based Data Annotation | Data Labeler |
|---|---|---|
| Credentials | Basic computer skills, attention to detail | Similar; no formal certifications typically required |
| Work Environment | Remote, home-based | Remote or in-office, depending on employer |
| Industry Usage | AI, machine learning, tech companies | AI, machine learning, tech companies |
| Job Tasks | Annotating data for training AI models | Labeling data for AI training |
Both roles involve labeling data for AI systems, often working remotely. Home Based Data Annotation emphasizes working from home with flexible hours, while Data Labeler may work in various environments. Both positions are essential in AI development and share similar skills and industry usage.
How to make 2000 a week working from home?
Full-time
Re-posted 22 days ago
Johns Hopkins Medicine rating
7.5
Based on 205 frontline employees who took The Breakroom Quiz
231st of 890 rated healthcare providers
Job description
PREP Research Associate
This position is part of the National Institute of Standards and Technology (NIST) Professional Research Experience Program (PREP). NIST recognizes that its research staff may want to collaborate with researchers at academic institutions on specific projects of mutual interest and, therefore, requires those institutions to be recipients of a PREP award. The PREP program involves staff from a wide range of backgrounds conducting scientific research across various fields. Individuals in this position will perform technical work supporting the collaboration's scientific research.
Research Title:
Reliability of Human and LLM Annotations for AI Risk Assessment
The work will entail:
This project focuses on using Large Language Models (LLMs) to provide annotations of evaluation data (a.k.a., LLM as judge), and the design of an Inter-Annotator Agreement study to assess the reliability of both human and LLM annotations. The candidate will explore assessing the indicators of a given AI-related risk, determining how to identify them, and providing annotators with examples to annotate the presence of various risks. The project aims to develop an annotation framework for AI risk assessment and establish metrics for data quality in AI risk research, supporting broader work at NIST in assessing and measuring the validity and reliability of AI-related risks in data annotation.
U.S. Citizen Preferred
Key responsibilities will include but are not limited to:
- Gain familiarity with existing literature on data annotation and LLM as judge
- Understand NIST's role and ongoing efforts in assessing and measuring the validity and reliability of AI-related risks in data annotation
- Contribute to developing an annotation framework for AI risk assessment
- Collaborate effectively with cross-functional and interdisciplinary stakeholders to ensure successful project outcomes
Deliverables
- Contributions to a NIST report that supports ongoing NIST AI evaluation efforts focused on the design of an Inter-Annotator Agreement to assess the reliability of both human and LLM annotations.
Qualifications
- Background in Computer Science, Data Science, or related field.
- Education level: Bachelor's or Graduate Degree
- Strong interest in data annotation and AI risks
- Familiarity with scientific reading and technical writing
Application Instructions
Please upload the following with your application:
• CV/Resume
*Please limit C.V to 3 pages only and ONLY include a valid email address for your contact info. Your resume will not be considered if the following information is included on your CV/resume.
• Self portraits
• Phone number
• Home address/Country
• Citizenship status
• Languages spoken
• Sex/Gender
Privacy Act Statement
Authority: 15 U.S.C. § 278g-1(e)(1) and (e)(3) and 15 U.S.C. § 272(b) and (c)
Purpose: The National Institute for Standards and Technology (NIST) hosts the Professional Research Experience Program (PREP) which is designed to provide valuable laboratory experience and financial assistance to undergraduates, post-bachelor's degree holders, graduate students, master's degree holders, postdocs, and faculty.
PREP is a 5-year cooperative agreement between NIST laboratories and participating PREP Universities to establish a collaborative research relationship between NIST and U.S. institutions of higher education in the following disciplines including (but may not be limited to) biochemistry, biological sciences, chemistry, computer science, engineering, electronics, materials science, mathematics, nanoscale science, neutron science, physical science, physics, and statistics. This collection of information is needed to facilitate administrative functions of the PREP Program.
Routine Uses: NIST will use the information collected to perform the requisite reviews of the applications to determine eligibility, and to meet programmatic requirements. Disclosure of this information is also subject to all the published routine uses as identified in the Privacy Act System of Records Notices: NIST-1: NIST Associates.
Disclosure: Furnishing this information is voluntary. When you submit the form, you are indicating your voluntary consent for NIST to use of the information you submit for the purpose stated.
What Johns Hopkins Medicine employees say
Pay
Benefits
Hours and flexibility
Workplace
Get the full story on Breakroom
About Johns Hopkins Hospital
Sourced by ZipRecruiter
Industry
Health care and social assistance
Company size
10,000+ Employees
Headquarters location
Baltimore, MD, US
Year founded
1889