ZipRecruiter

Log In

1

Ai Data Rater Jobs in Georgia (NOW HIRING)

Datavault AI Inc.

Data Scientist

Atlanta, GA · On-site

Datavault AI, along with its event-technology subsidiary Event Citadel (formerly CompuSystems ... Quantify model performance: precision, recall, calibration, inter-rater agreement against human ...

Kforce Technology Staffing

Senior Data Analyst

Atlanta, GA · On-site

$82K - $104K/yr

Experience leveraging automation and AI-driven insights for analytics * Strong stakeholder ... and data rates may apply. Carriers are not liable for delayed or undelivered messages. You will ...

Krest Global Solutions

DATA Engineer GCP

Atlanta, GA · On-site

$58 - $60/hr

EST Rate: $58-60/hour on 1099/C2C Location: Atlanta, GA (Hybrid - 3 days on-site) We are looking ... AI/ML Integration: Collaborate with data scientists to support Vertex AI workflows and explore the ...

Kforce Technology Staffing

Data Entry Specialist

Atlanta, GA · On-site

$16.25 - $22/hr

Apply Today? you agree to receive calls, AI-generated calls, text messages or emails from Kforce ... and data rates may apply. Carriers are not liable for delayed or undelivered messages. You will ...

Kforce Technology Staffing

Data Entry Specialist

Atlanta, GA · On-site

$16.25 - $22/hr

Apply Today? you agree to receive calls, AI-generated calls, text messages or emails from Kforce ... and data rates may apply. Carriers are not liable for delayed or undelivered messages. You will ...

Worth AI

Senior Agentic (AI) Engineer

Atlanta, GA · On-site +1

$100K - $138K/yr

Retrieval & Data: PostgreSQL, pgvector, OpenSearch, Kafka, Redshift, Redis * Infra: AWS, Kubernetes ... Measurable improvements in task success rate, grounding accuracy, and hallucination rate on our ...

Salesforce, Inc.

ES Data Ops Strategist

Atlanta, GA · On-site

Agentforce is the future of AI, and you are the future of Salesforce. About Salesforce Salesforce ... escalation rates, severity distributions, and Cost to Serve * Design and implement local data ...

previous pagenext page

Showing results 21-40

All JobsAi Data Rater JobsAi Data Rater Jobs in Georgia

Ai Data Rater information

What is an AI data rater?

An AI Data Rater evaluates and rates AI-generated content, such as search engine results, chat responses, or recommendations, to improve machine learning models. They follow specific guidelines to assess relevance, accuracy, and quality. This role helps refine AI systems by providing valuable feedback to enhance their performance. It typically requires strong analytical skills, attention to detail, and familiarity with the subject matter being rated.

What skills and qualifications are needed to thrive as an AI data rater?

To succeed as an AI Data Rater, you need strong analytical skills, attention to detail, and proficiency in evaluating data quality, typically requiring at least a high school diploma or equivalent. Familiarity with computer systems, web browsers, and proprietary rating platforms is often necessary, and training in data privacy or AI guidelines is sometimes provided. Excellent time management, adaptability, and effective written communication help candidates stand out in this largely remote and independent role. These skills ensure accurate data evaluations, support AI improvement, and enable consistent, high-quality performance.

What does an AI data rater do?

As an AI Data Rater, your main responsibilities include reviewing and evaluating various types of data—such as search queries, images, or social media content—according to detailed guidelines provided by your employer. You will typically work independently, using specialized tools or web-based platforms to rate data quality, relevance, or appropriateness. Attention to detail and consistency are important, as your feedback directly impacts the effectiveness of AI systems. Depending on the employer, you may also participate in training sessions or occasional team meetings to stay updated on the latest guidelines or project requirements.

What are the most commonly searched types of Ai Data Rater jobs in Georgia? The most popular types of Ai Data Rater jobs in Georgia are:
What are popular job titles related to Ai Data Rater jobs in Georgia? For Ai Data Rater jobs in Georgia, the most frequently searched job titles are:
What job categories do people searching Ai Data Rater jobs in Georgia look for? The top searched job categories for Ai Data Rater jobs in Georgia are:
What cities in Georgia are hiring for Ai Data Rater jobs? Cities in Georgia with the most Ai Data Rater job openings:
Ai Data Rater jobs near you
Infographic showing various Ai Data Rater job openings in Georgia as of August 2026, with employment types broken down into 70% Full Time, and 30% Part Time. Highlights an 60% In-person, and 40% Remote job distribution.

Data Scientist

Datavault AI Inc.

Atlanta, GA • On-site

Full-time

Posted 17 days ago

Job description

Data Scientist
Location: Atlanta, GA Hybrid
Employment Type: Full-Time

About Us: Datavault AI, along with its event-technology subsidiary Event Citadel (formerly CompuSystems), operates across a diverse portfolio of technology and service divisions.

Datavault AI Inc. delivers high-performance computing software, Web 3.0 data-management solutions, and advanced audio technologies to a broad range of industries.

Event Citadel (formerly CompuSystems), founded in 1976, is a trusted provider of end-to-end event technology solutions, offering registration, ticketing, lead retrieval, and attendee-engagement services for events of all sizes across trade, association, corporate, and government markets.

Job Description:

We’re looking for a Data Scientist to drive measurable improvement of our AI systems — including a multi-agent LLM pipeline that profiles, classifies, and values customer data assets, and a classification service that builds our reference dataset from public sources. You’ll own the evaluation strategy, ground-truth corpus design, and statistical rigor that turns “the agent feels better” into “the agent is measurably 18% more accurate at industry classification on our latest corpus.” This is a hands-on, high-ownership role where you’ll be the technical authority on what “good” looks like for our AI outputs.

Key Responsibilities:

  • Design, build, and maintain evaluation frameworks for our multi-agent LLM pipelines covering classification, PII detection, valuation, retrieval, segmentation, and synthesis — with regression-detection rigor.
  • Curate, expand, and version synthetic and real-world test corpora that exercise our AI pipelines end-to-end across 20+ industry verticals.
  • Quantify model performance: precision, recall, calibration, inter-rater agreement against human-verified ground truth, drift detection across releases.
  • Partner with engineering to design prompt experiments, agent variants, and structured-output schema iterations; report results with statistical confidence intervals — not anecdotes.
  • Improve vector-search comparable retrieval: embedding model selection, retrieval evaluation (recall@k, MRR), taxonomy refinement, classification accuracy uplift.
  • Evaluate prompt strategies, tool-use patterns, and routing logic; recommend model-tier choices backed by cost/accuracy data.
  • Profile production traces to identify failure modes (hallucinated outputs, mis-classifications, missed PII), then design experiments to fix them.
  • Work cross-functionally with engineering, product, and domain experts to translate fuzzy product goals (“the analysis should feel insightful”) into quantitative success metrics.
  • Communicate findings through written reports, dashboards, and decision memos that executive leadership can act on.


Qualifications:

  • Bachelor’s degree in Computer Science, Statistics, Data Science, Machine Learning, or related quantitative discipline, or equivalent professional experience. Master’s or PhD preferred.
  • 3+ years of professional data science, ML engineering, or AI evaluation experience shipping models or AI systems to production.
  • Strong Python skills (Pandas, NumPy, scikit-learn, PyTorch or TensorFlow), with comfort writing production-quality code that engineers will run in CI.
  • Proven experience evaluating LLM-based systems: prompt experimentation, structured-output validation, hallucination detection, retrieval evaluation, judge-LLM patterns.
  • Solid grasp of classical statistics: hypothesis testing, confidence intervals, sample-size calculation, power analysis, calibration.
  • SQL proficiency for ad-hoc analysis on PostgreSQL; comfortable with embedded analytical databases for offline evaluation.
  • Experience with vector databases and embedding models.
  • Ability to translate business goals into measurable evaluation criteria, and willingness to push back when a “metric” doesn’t measure what stakeholders thin

What We Offer:

  • Competitive salary and benefits package.
  • A fast-paced, high-impact work environment.
  • Opportunity to work closely with executive leadership.
  • The chance to work with cutting-edge technologies and make a significant impact.
  • A culture of innovation, ownership, and growth.