Annotation Labelling Jobs in North Carolina (NOW HIRING)

Job Description We are seeking an AI Data Annotation Training Data Contractor to join our dynamic team. The ideal candidate will have strong experience in AI/ML data labeling, QA, and evaluation across NLP, information retrieval, entity extraction, routing/classification, semantic search, and RAG/LLM applications, and a proven ability to deliver accurate, consistent annotations and evaluation datasets at scale. Responsibilities: Annotate and label large datasets for AI/ML training and evaluation tasks across text, tabular, and retrieval workflows.

Create labels for query classification, intent detection, entity and time extraction, metric identification, semantic similarity, relevance ranking, and document retrieval quality. Tag and classify user queries, documents, entities, metadata, tool routing, structured vs. unstructured query type, human preference, and LLM response quality.

Perform QA reviews to ensure consistency, accuracy, completeness, and adherence to acceptance criteria; escalate ambiguities and edge cases. Participate in inter-annotator agreement, calibration sessions, and feedback loops to refine dataset quality. Assist in building evaluation datasets, benchmark suites, and golden sets for classifiers, retrieval systems, and LLM generation quality.

Review AI outputs, provide structured scoring and feedback, and help identify failure modes, hallucinations, routing issues, and retrieval gaps. Follow detailed annotation specifications and operational procedures; document decisions, edge cases, and standards. Support taxonomy and schema refinement; organize datasets, metadata, and labeling workflows across tools and platforms.

Work effectively within Agile development practices and collaborate with data science, ML engineering, and platform teams. Required Skills & Qualifications: Bachelor's degree or equivalent practical experience. Experience with data annotation, data labeling, QA, research operations, or analytical workflows.

Ability to follow complex technical instructions and detailed labeling guidelines with high accuracy. Strong attention to detail, organizational skills, and written communication. Comfort with large datasets, structured processes, spreadsheets, and labeling interfaces.

Ability to work independently, manage priorities, and meet deadlines in a fast-paced environment. Preferred Skills: Familiarity with RAG, LLM evaluation, semantic search, and information retrieval concepts. Experience working in Agile/Scrum settings and collaborating with ML engineering teams.

Why BCforward? At BCforward, we believe in advancing lives and careers. When you join our team, you gain access to: Competitive compensation and benefits.

Opportunities for growth with global clients. A supportive, inclusive culture that values innovation and people. Exposure to cutting-edge technologies and projects.

About Our Commitment BCforward is an equal opportunity employer. We value diversity and are committed to creating an inclusive environment for all employees. All qualified applicants will receive consideration for employment without regard to race, color, religion, gender, sexual orientation, gender identity, national origin, age, disability, or veteran status.

Interested? Apply Now! If this sounds like the right opportunity for you, please apply with your most recent resume.