ZipRecruiter

Log In

Welo Data
Welo Data

Welo Data is a provider of training and evaluation services for artificial intelligence models.

10 Welo Data Software Jobs Hiring Near You

Welo Data

Search Quality Rater - Spanish (US)

Charleston, WV · Remote

$16.50 - $21/hr

Our main goal for this project is to develop and augment AI data. To put it more plainly, you will ... Reliable anti-virus software (as you will be surfing the web as part of the work) * Ability to ...

All JobsWelo Data Software Jobs

Welo Data Jobs Information

What are the most popular job types at Welo Data?
    What are the most popular jobs at Welo Data?
    What are the most popular categories at Welo Data?
    Infographic showing various Software job openings at Welo Data in the United States as of June 2026, with employment types broken down into 96% Full Time, 3% Part Time, and 1% Contract. Highlights an 96% Physical, and 4% Remote job distribution.
    Senior Prompt Engineer: LLM Migration & Optimization

    Senior Prompt Engineer: LLM Migration & Optimization

    Welo Data

    Charleston, WV • Remote

    $96K - $132K/yr

    Part-time

    Posted 12 days ago

    Job description

    Are you an expert at navigating the complex architecture of Large Language Models? Welo Data is seeking a Senior Prompt Engineer to lead the technical migration of template workflows into high-performance LLM autoraters.

    This role is designed for a technical specialist who understands that "perfecting a prompt" is a rigorous engineering discipline. You will leverage advanced APG/APO tools and manual refinement to ensure our automated systems meet—and exceed—human crowd baselines in accuracy and nuance.

    🚀 The Mission: Automated Quality at Scale
    • Architectural Migration: Take full ownership of the end-to-end technical migration of templates to LLM autoraters.
    • Optimization Leadership: Utilize Automatic Prompt Generation (APG) and supervise Automated Prompt Optimization (APO) tools to push model performance past plateaus and deadlocks.
    • Metrics-Driven Excellence: Continuously measure quality against "gold data" baselines, tracking precision, recall, and $F_1$ scores to justify launch readiness.
    • Edge-Case Engineering: Manually draft and refine complex prompts to overcome anti-patterns and architecture gaps that automated tools can't solve.
    Project Details
    • Job Title: Senior Prompt Engineer (LLM Migration)
    • Schedule: Part-Time (Set your own hours within project milestones)
    • Location: 100% Remote (Must be based in the United States)
    • Employment Type: Freelance / Independent Contractor
    Candidate Profile
    • Educational Foundation: Bachelor’s, Master’s, or PhD in Computer Science, Data Science, Computational Linguistics, or a related analytical field.
    • Prompt Engineering Mastery: 4+ years of experience tuning LLMs for strict, structured outputs, complex classification, and few-shot learning.
    • Analytical Power: High proficiency in identifying error patterns and using SQL or data analytics tools to monitor performance.
    • Technical Agility: Fast learner capable of mastering proprietary internal tools and "Goose API" style interfaces with minimal oversight.
    Preferred Technical Skills
    • Familiarity with shadowbot monitoring and disagreement tracking.
    • Experience in AI model evaluation and software engineering.
    • Deep understanding of semantics, logic, and Chain-of-Thought (CoT) prompting.
    • Proven ability to draft high-level Launch Certification Documentation.
    Recruitment & Onboarding
    1. Technical Review: Submit your CV and portfolio of LLM optimization work.
    2. Prompt Assessment: Demonstrate your ability to navigate complex template clusters and APO deadlocks.
    3. Tooling Deep-Dive: Get access to our internal technical suite and migration workflows.
    4. Launch: Begin your part-time engagement and lead the shift to LLM-driven autorating.

    Working at Welo Data

    What to expect from working at Welo Data

    From Welo Data

    About Welo Data, in their own words

    From Welo Data

    Welo Data is a global AI data services company powering the next generation of AI. We build, annotate, and validate the training datasets that make AI models accurate, safe, and ready for the real world — across languages, cultures, and domains.

    Our team of experts spans the globe, combining deep technical knowledge with a human-centered approach. If you want your work to shape how AI understands the world, you'll find your place here.

    Diversity and inclusion statement

    From Welo Data

    Our Strength is derived from Winning Together. Welo Data is unequivocally committed to developing and fostering a workplace and organizational culture that values the diversity of thought and perspective delivered by a diverse global workforce operating within an inclusive organization.