The project aims to develop an annotation framework for AI risk assessment and establish metrics ... mathematics, nanoscale science, neutron science, physical science, physics, and statistics. This ...
The project aims to develop an annotation framework for AI risk assessment and establish metrics ... mathematics, nanoscale science, neutron science, physical science, physics, and statistics. This ...
... annotation of language data with parts of speech information, and improved existing models by ... Mathematical, Computational, Statistical Relevant experience must be in designing/implementing ...
... annotation of language data with parts of speech information, and improved existing models by ... Mathematical, Computational, Statistical Relevant experience must be in designing/implementing ...
Data Scientist
Fort George G Meade, MD · On-site
... annotation of language data with parts of speech information, and improved existing models by ... Mathematical, Computational, Statistical Relevant experience must be in designing/implementing ...
Data Scientist
Fort George G Meade, MD · On-site
... annotation of language data with parts of speech information, and improved existing models by ... Mathematical, Computational, Statistical Relevant experience must be in designing/implementing ...
... annotation of language data with parts of speech information, and improved existing models by ... Mathematical, Computational, Statistical Relevant experience must be in designing/implementing ...
... annotation of language data with parts of speech information, and improved existing models by ... Mathematical, Computational, Statistical Relevant experience must be in designing/implementing ...
... Image Annotation, and working with API integrations • Evangelize Scale and interact with ... Mathematics, or other quantitative fields • Strong project management and interpersonal skills ...
... Image Annotation, and working with API integrations • Evangelize Scale and interact with ... Mathematics, or other quantitative fields • Strong project management and interpersonal skills ...
... Image Annotation, and working with API integrations • Evangelize Scale and interact with ... Mathematics, or other quantitative fields • Strong project management and interpersonal skills ...
... Image Annotation, and working with API integrations • Evangelize Scale and interact with ... Mathematics, or other quantitative fields • Strong project management and interpersonal skills ...
Data Scientist 3
Annapolis Junction, MD · On-site
You will develop automated solutions for the annotation of language data with parts of speech ... Foundations: (Mathematical, Computational, Statistical). * Data Processing: (Data management and ...
Data Scientist 3
Annapolis Junction, MD · On-site
You will develop automated solutions for the annotation of language data with parts of speech ... Foundations: (Mathematical, Computational, Statistical). * Data Processing: (Data management and ...
TACHS Tutor
Laurel, MD · Remote
$40/hr
Skilled at teaching reading passage annotation, grammar rule application, and mental math estimation strategies for TACHS. Guides students through vocabulary-in-context questions, paragraph ...
TACHS Tutor
Laurel, MD · Remote
$40/hr
Skilled at teaching reading passage annotation, grammar rule application, and mental math estimation strategies for TACHS. Guides students through vocabulary-in-context questions, paragraph ...
TACHS Tutor
Alexandria, VA · Remote
$40/hr
Skilled at teaching reading passage annotation, grammar rule application, and mental math estimation strategies for TACHS. Guides students through vocabulary-in-context questions, paragraph ...
TACHS Tutor
Alexandria, VA · Remote
$40/hr
Skilled at teaching reading passage annotation, grammar rule application, and mental math estimation strategies for TACHS. Guides students through vocabulary-in-context questions, paragraph ...
TACHS Tutor
Fairfax, VA · Remote
$40/hr
Skilled at teaching reading passage annotation, grammar rule application, and mental math estimation strategies for TACHS. Guides students through vocabulary-in-context questions, paragraph ...
TACHS Tutor
Fairfax, VA · Remote
$40/hr
Skilled at teaching reading passage annotation, grammar rule application, and mental math estimation strategies for TACHS. Guides students through vocabulary-in-context questions, paragraph ...
TACHS Tutor
Rockville, MD · Remote
$40/hr
Skilled at teaching reading passage annotation, grammar rule application, and mental math estimation strategies for TACHS. Guides students through vocabulary-in-context questions, paragraph ...
TACHS Tutor
Rockville, MD · Remote
$40/hr
Skilled at teaching reading passage annotation, grammar rule application, and mental math estimation strategies for TACHS. Guides students through vocabulary-in-context questions, paragraph ...
TACHS Tutor
Bowie, MD · Remote
$40/hr
Skilled at teaching reading passage annotation, grammar rule application, and mental math estimation strategies for TACHS. Guides students through vocabulary-in-context questions, paragraph ...
TACHS Tutor
Bowie, MD · Remote
$40/hr
Skilled at teaching reading passage annotation, grammar rule application, and mental math estimation strategies for TACHS. Guides students through vocabulary-in-context questions, paragraph ...
TACHS Tutor
College Park, MD · Remote
$40/hr
Skilled at teaching reading passage annotation, grammar rule application, and mental math estimation strategies for TACHS. Guides students through vocabulary-in-context questions, paragraph ...
TACHS Tutor
College Park, MD · Remote
$40/hr
Skilled at teaching reading passage annotation, grammar rule application, and mental math estimation strategies for TACHS. Guides students through vocabulary-in-context questions, paragraph ...
TACHS Tutor
Leesburg, VA · Remote
$40/hr
Skilled at teaching reading passage annotation, grammar rule application, and mental math estimation strategies for TACHS. Guides students through vocabulary-in-context questions, paragraph ...
TACHS Tutor
Leesburg, VA · Remote
$40/hr
Skilled at teaching reading passage annotation, grammar rule application, and mental math estimation strategies for TACHS. Guides students through vocabulary-in-context questions, paragraph ...
TACHS Tutor
Washington, DC · Remote
$40/hr
Skilled at teaching reading passage annotation, grammar rule application, and mental math estimation strategies for TACHS. Guides students through vocabulary-in-context questions, paragraph ...
TACHS Tutor
Washington, DC · Remote
$40/hr
Skilled at teaching reading passage annotation, grammar rule application, and mental math estimation strategies for TACHS. Guides students through vocabulary-in-context questions, paragraph ...
AI Engineer - AI+CryoET
Ashburn, VA · On-site
Identify where additional human annotation and proofreading will be most helpful and design and ... Master's or PhD in Computer Science, Applied Mathematics, Physics, Computational Chemistry, or a ...
AI Engineer - AI+CryoET
Ashburn, VA · On-site
Identify where additional human annotation and proofreading will be most helpful and design and ... Master's or PhD in Computer Science, Applied Mathematics, Physics, Computational Chemistry, or a ...
Data Scientist 3
Annapolis, MD · On-site
$161K - $211K/yr
... annotation of language data with parts of speech information, and improve existing models by ... Foundations: (Mathematical, Computational, Statistical). * Data Processing: (Data management and ...
Data Scientist 3
Annapolis, MD · On-site
$161K - $211K/yr
... annotation of language data with parts of speech information, and improve existing models by ... Foundations: (Mathematical, Computational, Statistical). * Data Processing: (Data management and ...
ISEE- Lower Level Tutor
Fairfax, VA · Remote
$40/hr
... and Mathematics Achievement covering arithmetic, basic geometry, and pre-algebra for students ... Guides students through reading passage annotation, word relationship identification, multi-step ...
ISEE- Lower Level Tutor
Fairfax, VA · Remote
$40/hr
... and Mathematics Achievement covering arithmetic, basic geometry, and pre-algebra for students ... Guides students through reading passage annotation, word relationship identification, multi-step ...
Collaborate with the Data QA team to define annotation standards, resolve taxonomy issues, and ... Bachelor's degree in CS/EE/math/statistics or a related quantitative field. Strong proficiency in ...
Collaborate with the Data QA team to define annotation standards, resolve taxonomy issues, and ... Bachelor's degree in CS/EE/math/statistics or a related quantitative field. Strong proficiency in ...
ISEE- Lower Level Tutor
Leesburg, VA · Remote
$40/hr
... and Mathematics Achievement covering arithmetic, basic geometry, and pre-algebra for students ... Guides students through reading passage annotation, word relationship identification, multi-step ...
ISEE- Lower Level Tutor
Leesburg, VA · Remote
$40/hr
... and Mathematics Achievement covering arithmetic, basic geometry, and pre-algebra for students ... Guides students through reading passage annotation, word relationship identification, multi-step ...
Annotation Math information
What are the key skills and qualifications needed to thrive as an Annotation Math Specialist, and why are they important?
To thrive as an Annotation Math Specialist, you need a solid understanding of mathematics, attention to detail, and familiarity with educational or assessment standards, often supported by a relevant degree. Proficiency with annotation tools, data labeling platforms, and sometimes LaTeX or similar mathematical typesetting systems is typically required. Strong analytical thinking, communication, and the ability to work independently are essential soft skills for accuracy and consistency. These skills and qualities are crucial to ensure high-quality, precise annotations that support machine learning, educational resources, or assessment development.
What are some common challenges faced by professionals in Annotation Math roles, and how can they be addressed?
Professionals in Annotation Math roles often encounter challenges such as interpreting ambiguous mathematical data, maintaining consistency in labeling complex equations, and managing repetitive tasks that require high attention to detail. Addressing these challenges involves following clear annotation guidelines, collaborating with team members to resolve uncertainties, and utilizing quality assurance tools to minimize errors. Regular feedback sessions and ongoing training also help ensure accuracy and support professional growth in this specialized field.
What are Annotation Math jobs?
Annotation Math jobs involve labeling, tagging, and categorizing mathematical data, such as equations, formulas, graphs, or written math problems, to create high-quality datasets. These annotated datasets are often used to train artificial intelligence (AI) and machine learning models to recognize and process mathematical content accurately. Annotation Math professionals need a strong understanding of mathematics, attention to detail, and familiarity with annotation tools or platforms. This work is critical for improving technologies like automated math solvers, educational apps, and document digitization.
What is the difference between Annotation Math vs Data Annotator?
| Aspect | Annotation Math | Data Annotator |
|---|---|---|
| Required Credentials | Basic education, sometimes specialized training in annotation tools | High school diploma or equivalent, on-the-job training |
| Work Environment | Data labeling teams, tech companies, remote or onsite | Data labeling teams, tech companies, remote or onsite |
| Industry Usage | AI, machine learning, data science | AI, machine learning, data science |
| Common Search Intent | Understanding roles related to data annotation and math | Comparing data annotation jobs |
Annotation Math and Data Annotator roles both involve data labeling within AI and machine learning industries. Annotation Math may focus more on mathematical annotations, while Data Annotator generally covers broader data labeling tasks. Both roles often share similar work environments and required skills, making them closely related in the data annotation field.
What are popular job titles related to Annotation Math jobs in Washington? For Annotation Math jobs in Washington, the most frequently searched job titles are:
What job categories do people searching Annotation Math jobs in Washington look for? The top searched job categories for Annotation Math jobs in Washington are:
What cities in Washington are hiring for Annotation Math jobs? Cities in Washington with the most Annotation Math job openings:
Full-time
Posted 26 days ago
Johns Hopkins Medicine rating
7.5
Based on 200 frontline employees who took The Breakroom Quiz
219th of 865 rated healthcare providers
Job description
Description
PREP Research Associate
This position is part of the National Institute of Standards and Technology (NIST) Professional Research Experience Program (PREP). NIST recognizes that its research staff may want to collaborate with researchers at academic institutions on specific projects of mutual interest and, therefore, requires those institutions to be recipients of a PREP award. The PREP program involves staff from a wide range of backgrounds conducting scientific research across various fields. Individuals in this position will perform technical work supporting the collaboration's scientific research.
Research Title:
Reliability of Human and LLM Annotations for AI Risk Assessment
The work will entail:
This project focuses on using Large Language Models (LLMs) to provide annotations of evaluation data (a.k.a., LLM as judge), and the design of an Inter-Annotator Agreement study to assess the reliability of both human and LLM annotations. The candidate will explore assessing the indicators of a given AI-related risk, determining how to identify them, and providing annotators with examples to annotate the presence of various risks. The project aims to develop an annotation framework for AI risk assessment and establish metrics for data quality in AI risk research, supporting broader work at NIST in assessing and measuring the validity and reliability of AI-related risks in data annotation.
U.S. Citizen Preferred
Key responsibilities will include but are not limited to:
Deliverables
Qualifications
Application Instructions
Please upload the following with your application:
• CV/Resume
*Please limit C.V to 3 pages only and ONLY include a valid email address for your contact info. Your resume will not be considered if the following information is included on your CV/resume.
• Self portraits
• Phone number
• Home address/Country
• Citizenship status
• Languages spoken
• Sex/Gender
Privacy Act Statement
Authority: 15 U.S.C. § 278g-1(e)(1) and (e)(3) and 15 U.S.C. § 272(b) and (c)
Purpose: The National Institute for Standards and Technology (NIST) hosts the Professional Research Experience Program (PREP) which is designed to provide valuable laboratory experience and financial assistance to undergraduates, post-bachelor's degree holders, graduate students, master's degree holders, postdocs, and faculty.
PREP is a 5-year cooperative agreement between NIST laboratories and participating PREP Universities to establish a collaborative research relationship between NIST and U.S. institutions of higher education in the following disciplines including (but may not be limited to) biochemistry, biological sciences, chemistry, computer science, engineering, electronics, materials science, mathematics, nanoscale science, neutron science, physical science, physics, and statistics. This collection of information is needed to facilitate administrative functions of the PREP Program.
Routine Uses: NIST will use the information collected to perform the requisite reviews of the applications to determine eligibility, and to meet programmatic requirements. Disclosure of this information is also subject to all the published routine uses as identified in the Privacy Act System of Records Notices: NIST-1: NIST Associates.
Disclosure: Furnishing this information is voluntary. When you submit the form, you are indicating your voluntary consent for NIST to use of the information you submit for the purpose stated.
PREP Research Associate
This position is part of the National Institute of Standards and Technology (NIST) Professional Research Experience Program (PREP). NIST recognizes that its research staff may want to collaborate with researchers at academic institutions on specific projects of mutual interest and, therefore, requires those institutions to be recipients of a PREP award. The PREP program involves staff from a wide range of backgrounds conducting scientific research across various fields. Individuals in this position will perform technical work supporting the collaboration's scientific research.
Research Title:
Reliability of Human and LLM Annotations for AI Risk Assessment
The work will entail:
This project focuses on using Large Language Models (LLMs) to provide annotations of evaluation data (a.k.a., LLM as judge), and the design of an Inter-Annotator Agreement study to assess the reliability of both human and LLM annotations. The candidate will explore assessing the indicators of a given AI-related risk, determining how to identify them, and providing annotators with examples to annotate the presence of various risks. The project aims to develop an annotation framework for AI risk assessment and establish metrics for data quality in AI risk research, supporting broader work at NIST in assessing and measuring the validity and reliability of AI-related risks in data annotation.
U.S. Citizen Preferred
Key responsibilities will include but are not limited to:
- Gain familiarity with existing literature on data annotation and LLM as judge
- Understand NIST's role and ongoing efforts in assessing and measuring the validity and reliability of AI-related risks in data annotation
- Contribute to developing an annotation framework for AI risk assessment
- Collaborate effectively with cross-functional and interdisciplinary stakeholders to ensure successful project outcomes
Deliverables
- Contributions to a NIST report that supports ongoing NIST AI evaluation efforts focused on the design of an Inter-Annotator Agreement to assess the reliability of both human and LLM annotations.
Qualifications
- Background in Computer Science, Data Science, or related field.
- Education level: Bachelor's or Graduate Degree
- Strong interest in data annotation and AI risks
- Familiarity with scientific reading and technical writing
Application Instructions
Please upload the following with your application:
• CV/Resume
*Please limit C.V to 3 pages only and ONLY include a valid email address for your contact info. Your resume will not be considered if the following information is included on your CV/resume.
• Self portraits
• Phone number
• Home address/Country
• Citizenship status
• Languages spoken
• Sex/Gender
Privacy Act Statement
Authority: 15 U.S.C. § 278g-1(e)(1) and (e)(3) and 15 U.S.C. § 272(b) and (c)
Purpose: The National Institute for Standards and Technology (NIST) hosts the Professional Research Experience Program (PREP) which is designed to provide valuable laboratory experience and financial assistance to undergraduates, post-bachelor's degree holders, graduate students, master's degree holders, postdocs, and faculty.
PREP is a 5-year cooperative agreement between NIST laboratories and participating PREP Universities to establish a collaborative research relationship between NIST and U.S. institutions of higher education in the following disciplines including (but may not be limited to) biochemistry, biological sciences, chemistry, computer science, engineering, electronics, materials science, mathematics, nanoscale science, neutron science, physical science, physics, and statistics. This collection of information is needed to facilitate administrative functions of the PREP Program.
Routine Uses: NIST will use the information collected to perform the requisite reviews of the applications to determine eligibility, and to meet programmatic requirements. Disclosure of this information is also subject to all the published routine uses as identified in the Privacy Act System of Records Notices: NIST-1: NIST Associates.
Disclosure: Furnishing this information is voluntary. When you submit the form, you are indicating your voluntary consent for NIST to use of the information you submit for the purpose stated.
What Johns Hopkins Medicine employees say
Pay
Benefits
Hours and flexibility
Workplace
Get the full story on Breakroom
About Johns Hopkins Hospital
Sourced by ZipRecruiter
Industry
Health care and social assistance
Company size
10,000+ Employees
Headquarters location
Baltimore, MD, US
Year founded
1889