Brillfy Technology

Job Title: QA Specialist – Generative AI / LLM
Location: Louisville, KY (Onsite)
Hours: Minimum 30 Hours/Week

Job Summary

Centific is seeking an experienced QA Specialist to support Generative AI and Large Language Model (LLM) projects. The ideal candidate will review data annotations, ensure quality standards, provide actionable feedback to annotators, and maintain high-quality AI training data. This is a fully onsite opportunity in Louisville, KY.

Required Skills

• 2–3+ years of Quality Assurance/Quality Management experience, preferably in AI data labeling or annotation projects
• Experience reviewing and validating annotated data
• Strong understanding of AI/LLM data annotation workflows
• Experience creating or reviewing annotation guidelines
• Excellent written and verbal English communication
• Strong attention to detail and analytical skills
• Proficiency with Microsoft Office (Excel, Outlook, PowerPoint)
• Ability to work onsite in Louisville, KY

Preferred Qualifications

• Bachelor''s degree (Linguistics or related field preferred)
• Experience with GenAI, LLM, Data Annotation, RLHF, or AI training datasets
• Experience providing quality feedback and coaching annotators