1

Data Annotation Ai Training Jobs in West Virginia

WV · On-site

$200K/yr

Define annotation guidelines, taxonomies, and edge-case protocols for each labeling program ... Scale AI, Labelbox, Prodigy, or similar acceptable) * Track record managing outsourced labeling ...

$170 - $200/hr

Prior involvement in AI training, expert annotation, or reasoning-focused datasets * Background in formal methods research or proof assistant development * Academic or professional experience in pure ...

$170 - $200/hr

Prior involvement in AI training, expert annotation, or reasoning-focused datasets * Background in formal methods research or proof assistant development * Academic or professional experience in pure ...

Join Welo Data's Global Contributor Network Welo Data, part of Welocalize, is a global AI data ... in annotation, evaluation, and prompt creation--always on your terms. Note: This is not an active ...

Join Welo Data's Global Contributor Network Welo Data, part of Welocalize, is a global AI data ... in annotation, evaluation, and prompt creation--always on your terms. Note: This is not an active ...

$65K/yr

Support onboarding, training, and performance management of team members. * Monitor throughput ... Background in data collection, AI, data annotation, or digital operations. * Familiarity with ...

Head of AI - Platform AI

Charleston, WV · Remote

$215K - $245K/yr

... data engineering, model development, testing, and production deployment. AI Infrastructure and Scalability: * Build and optimize infrastructure for distributed AI training using GPUs, TPUs, and cloud ...

What if your knowledge English language could help improve the AI.     WHAT YOU'LL DO   * Evaluate the aesthetic quality, readability, and overall polish of digital map designs. * Assess ...

Senior Data Scientist

Kearneysville, WV · On-site

$133K - $169K/yr

S. Coast Guard (USCG) Data & AI Integration Team. This role is primarily responsible for ... Experience developing, training, and deploying enterprise-level machine learning models and data ...

Data Center Architect, CSA

Friendly, WV · On-site +1

$54.50 - $70.25/hr

... AI systems. As our compute infrastructure scales to support frontier model training and deployment ... As Anthropic scales its data center program across multiple sites in the United States and ...

AI/ML Engineer

WV · On-site +1

Data Science and Data Engineering Job Qualifications: Skills: Actionable Insights, Data Analysis ... Implement automated model training, testing, validation, deployment, rollback, and alerting.

We want AI to be safe and beneficial for our users and for society as a whole. Our team is a ... A field relevant to the role as demonstrated through coursework, training, or professional ...

New

... AI)/Machine Learning (ML) capabilities that support operational decision-making and fulfill AO ... Create training, job aids, and communications to support user adoption. * Define and optimize ...

Data Center Portfolio Lead

Friendly, WV · On-site +1

$320K - $405K/yr

We want AI to be safe and beneficial for our users and for society as a whole. Our team is a ... A field relevant to the role as demonstrated through coursework, training, or professional ...

Data Science and Data Engineering Job Qualifications: Skills: Analytics, End-to-End Testing ... for developing, training, evaluating, and deploying AI/ML solutions. Experience designing ...

Set and evolve AI engineering standards, including model integration, data architecture, LLMOps ... Additionally, we do not participate in academic training programs or work-study programs through an ...

Set and evolve AI engineering standards, including model integration, data architecture, LLMOps ... Additionally, we do not participate in academic training programs or work-study programs through an ...

The AI Enablement Specialist develops and maintains training materials, facilitates workshops and ... Data Science, healthcare information technology or a related field.OR2. Bachelor's degree in ...

next page

Showing results 1-20

Data Annotation Ai Training information

What are popular job titles related to Data Annotation Ai Training jobs in West Virginia?

For Data Annotation Ai Training jobs in West Virginia, the most frequently searched job titles are:

What job categories do people searching Data Annotation Ai Training jobs in West Virginia look for?

The top searched job categories for Data Annotation Ai Training jobs in West Virginia are:

What cities in West Virginia are hiring for Data Annotation Ai Training jobs?

Cities in West Virginia with the most Data Annotation Ai Training job openings:

Infographic showing various Data Annotation Ai Training job openings in West Virginia as of August 2026, with employment types broken down into 100% Full Time. Highlights an 50% In-person, and 50% Remote job distribution.

Senior Manager, Machine Learning (Data Operations)

Coalition, Inc.

WV • On-site

$200K/yr

Full-time

Medical, Dental, Vision, PTO

Re-posted 15 days ago


Job description

About the role
Coalition's machine learning models are only as good as the data they're trained on. This role exists to make sure that data is right.

You'll own labeling quality and methodology across Coalition - designing annotation tasks, defining quality frameworks, and ensuring every labeled dataset meets the standard required to ship production ML models. You'll manage our labeling platform (Label Studio), work directly with ML and product teams to structure labeling programs, and oversee outsourced labeling vendors to hit quality and throughput targets.
 

This role reports to the Chief Product Officer and sits at the intersection of product, ML, and operations. You won't manage internal labelers - all annotation work is outsourced - but you will be the single point of accountability for whether Coalition's labeled data is accurate, consistent, and fit for purpose.
Responsibilities
  • Labeling quality & methodology: Define annotation guidelines, taxonomies, and edge-case protocols for each labeling program. Establish gold standard datasets, inter-annotator agreement (IAA) targets, and audit sampling processes. Identify and remediate mislabeled data in existing datasets.
  • Platform & tooling: Serve as the primary user and requirements driver for Label Studio - defining project configuration needs, workflow designs, pre-labeling pipeline requirements, and integration points with ML infrastructure. Partner with the data engineering team that builds and maintains the platform.
  • Cross-functional partnership: Work with ML engineers, data scientists, and product managers to translate model requirements into well-structured labeling tasks. Challenge teams on task design when labeling instructions are ambiguous or likely to produce unreliable labels.
  • Vendor management: Source, onboard, and manage external labeling vendors and BPOs in coordination with Coalition's operations team. Set quality SLAs, run calibration sessions, and manage feedback loops to labelers. Hold vendors accountable to accuracy, not just throughput.
  • Measurement & improvement: Define and track operational metrics - label accuracy, IAA scores, cost per label, turnaround time - and use them to drive continuous improvement. Identify opportunities for active learning, model-assisted labeling, and pre-annotation to reduce cost without sacrificing quality.
Skills and Qualifications
  • 5+ years in ML data operations, data labeling, or a related field (ML engineering, data science, or data engineering with heavy labeling exposure)
  • Deep understanding of annotation quality frameworks: IAA, consensus labeling, gold standard evaluation, error taxonomy, and calibration workflows
  • Direct experience managing labeling platforms (Label Studio strongly preferred; Scale AI, Labelbox, Prodigy, or similar acceptable)
  • Track record managing outsourced labeling vendors or BPOs for ML data production
  • Familiarity with common ML labeling tasks: text classification, NER, document extraction, intent detection
  • Comfortable working in Python and SQL; bonus if you've built tooling around labeling workflows or quality measurement
  • Strong opinions on what makes labeled data good or bad, and the willingness to push back when it's bad
  • Experience in insurance, cybersecurity, or fintech is a plus but not required
Compensation

Our compensation reflects the cost of labor across several US geographic markets. The US base salary for this position ranges from $134,400/year in our lowest geographic market up to $200,000/year in our highest geographic market. Consistent with applicable laws, an employee's pay within this range is based on a number of factors, which include but are not limited to relevant education, skills, job-related knowledge, qualifications, work experience, credentials, and/or geographic location. Your recruiter can share more on target salary for your location during the interview process. Coalition, Inc. reserves the right to modify this range as needed.

Perks
  • 100% medical, dental and vision coverage
  • Flexible PTO policy
  • Annual home office stipend and WeWork access
  • Mental & physical health wellness programs (One Medical, Headspace, Wellhub, and more)!
  • Competitive compensation and opportunity for advancement