1

Ai Data Rater Jobs in Virginia (NOW HIRING)

... of Data Scientists and Engineers to use Generative AI technology in supporting Federal use cases ... Design experiments to evaluate generative model behavior (e.g., hallucination rates, factuality ...

... of Data Scientists and Engineers to use Generative AI technology in supporting Federal use cases ... Design experiments to evaluate generative model behavior (e.g., hallucination rates, factuality ...

... of Data Scientists and Engineers to use Generative AI technology in supporting Federal use cases ... Design experiments to evaluate generative model behavior (e.g., hallucination rates, factuality ...

Data Scientist (Generative AI)

Mclean, VA · On-site

$125K - $160K/yr

... of Data Scientists and Engineers to use Generative AI technology in supporting Federal use cases ... Design experiments to evaluate generative model behavior (e.g., hallucination rates, factuality ...

... of Data Scientists and Engineers to use Generative AI technology in supporting Federal use cases ... Design experiments to evaluate generative model behavior (e.g., hallucination rates, factuality ...

Data Scientist (Generative AI)

Mclean, VA · On-site +1

$125K - $160K/yr

... of Data Scientists and Engineers to use Generative AI technology in supporting Federal use cases ... Design experiments to evaluate generative model behavior (e.g., hallucination rates, factuality ...

Data Scientist Specialist

Mclean, VA · On-site +1

$80 - $95.73/hr

Architect and implement AI agents, agentic workflows, and full-scale GenAI applications. * Develop ... The pay rate for this position is between $80.00 and $95.73 per hour. Please note that the final ...

Data Scientist (Generative AI)

Mclean, VA · On-site

$125K - $160K/yr

... of Data Scientists and Engineers to use Generative AI technology in supporting Federal use cases ... Design experiments to evaluate generative model behavior (e.g., hallucination rates, factuality ...

Data Scientist (Generative AI)

Mclean, VA · On-site +1

$125K - $160K/yr

... of Data Scientists and Engineers to use Generative AI technology in supporting Federal use cases ... Design experiments to evaluate generative model behavior (e.g., hallucination rates, factuality ...

... of Data Scientists and Engineers to use Generative AI technology in supporting Federal use cases ... Design experiments to evaluate generative model behavior (e.g., hallucination rates, factuality ...

Sr. Data Engineer (AI/ML)

Reston, VA · Remote

$100K - $160K/yr

Position: Sr Data Engineer (AI/ML) Location: Remote Security Clearance: DHS Suitability - contract ... Message & data rates apply and message frequency may vary. Consistent with Judge's Privacy Policy ...

The AI Evaluation Scientist will work closely with engineers, data scientists, governance analysts ... rate, and safety metrics. * Build and maintain automated evaluation scripts, tests, and pipelines ...

AI Evaluation Scientist

Mclean, VA · On-site

$105K - $145K/yr

The AI Evaluation Scientist will work closely with engineers, data scientists, governance analysts ... rate, and safety metrics. * Build and maintain automated evaluation scripts, tests, and pipelines ...

The AI Evaluation Scientist will work closely with engineers, data scientists, governance analysts ... rate, and safety metrics. * Build and maintain automated evaluation scripts, tests, and pipelines ...

next page

Showing results 1-20

Ai Data Rater information

What is an AI Data Rater job?

An AI Data Rater evaluates and rates AI-generated content, such as search engine results, chat responses, or recommendations, to improve machine learning models. They follow specific guidelines to assess relevance, accuracy, and quality. This role helps refine AI systems by providing valuable feedback to enhance their performance. It typically requires strong analytical skills, attention to detail, and familiarity with the subject matter being rated.

What are the key skills and qualifications needed to thrive in the Ai Data Rater position, and why are they important?

To succeed as an AI Data Rater, you need strong analytical skills, attention to detail, and proficiency in evaluating data quality, typically requiring at least a high school diploma or equivalent. Familiarity with computer systems, web browsers, and proprietary rating platforms is often necessary, and training in data privacy or AI guidelines is sometimes provided. Excellent time management, adaptability, and effective written communication help candidates stand out in this largely remote and independent role. These skills ensure accurate data evaluations, support AI improvement, and enable consistent, high-quality performance.

What are some typical daily responsibilities for an AI Data Rater?

As an AI Data Rater, your main responsibilities include reviewing and evaluating various types of data—such as search queries, images, or social media content—according to detailed guidelines provided by your employer. You will typically work independently, using specialized tools or web-based platforms to rate data quality, relevance, or appropriateness. Attention to detail and consistency are important, as your feedback directly impacts the effectiveness of AI systems. Depending on the employer, you may also participate in training sessions or occasional team meetings to stay updated on the latest guidelines or project requirements.

What are the most commonly searched types of Ai Data Rater jobs in Virginia? The most popular types of Ai Data Rater jobs in Virginia are:
What job categories do people searching Ai Data Rater jobs in Virginia look for? The top searched job categories for Ai Data Rater jobs in Virginia are:
What cities in Virginia are hiring for Ai Data Rater jobs? Cities in Virginia with the most Ai Data Rater job openings:

Data Scientist (Generative AI)

Steampunk

Mclean, VA

$125K - $160K/yr

Other

Posted 16 days ago


Job description

Overview

We are looking for seasoned Data Scientist (Generative) to work with our existing team of Data Scientists and Engineers to use Generative AI technology in supporting Federal use cases. We are looking for a more than just a "Data Scientist", but a technologist with excellent communication and customer service skills and a passion for data and problem solving.

Contributions

Contributions include:

  • Design and train advanced machine learning models, especially generative models like GANs, VAEs, or transformer-based models. 
  • Work closely with ML Engineers and Software Developers to transition models from a research and development stage to production. 
  • Stay updated with the latest research and trends in AI to implement cutting-edge solutions. 
  • Evaluate the performance of foundational models (e.g., GPT, LLaMA, Claude) on domain-specific tasks and fine-tune them using supervised, reinforcement, or instruction tuning methods to align outputs with user needs and business goals. 
  • Design and optimize prompts, few-shot examples, and system instructions to improve LLM behavior in constrained environments (e.g., RAG pipelines, multi-agent workflows, decision support systems). 
  • Identify, clean, label, and synthesize high-quality datasets for model training, fine-tuning, or retrieval-augmented generation (RAG). 
  • Design experiments to evaluate generative model behavior (e.g., hallucination rates, factuality, coherence, safety), define appropriate benchmarks, and use metrics like BLEU, ROUGE, perplexity, and human evaluations. 
  • Ability to leverage and integrate various data management tools at scale - cloud experience preferred 
  • Support an Agile software development lifecycle 
  • You will contribute to the growth of our AI & Data Exploitation Practice! 
Qualifications

Qualifications include:

  • Ability to hold a position of public trust with the US government. 
  • Bachelor's degree in computer science, data science/statistics, information systems, engineering, business, or a scientific or technical discipline 
  • 2-4 years industry experience developing ML/AI solutions and a passion for solving complex problems.  
  • Must have hands-on experience in building and deploying generative models, with a portfolio of relevant projects 
  • Must be proficient in Python, with strong coding practices for scalability and reproducibility. 
  • Demonstrated experience in building, training, and deploying generative models like Generative Adversarial Networks (GANs), Variational Autoencoders (VAEs), or autoregressive models like Transformer-based architectures. 
  • Demonstrated experience manipulating structured and unstructured data for analysis 
  • Demonstrated experience using AI frameworks like TensorFlow, PyTorch, Keras, or JAX. 
  • Ability to implement and modify complex neural network architectures. 
  • Skilled in using data manipulation and analysis libraries such as Pandas, NumPy, SciPy, and Scikit-learn. 
  • Experience with model training, fine-tuning, and evaluation using frameworks like PyTorch or TensorFlow. 
  • Deep knowledge of natural language processing techniques, including tokenization, embeddings, attention mechanisms, and prompt engineering. 
  • Hands-on experience with large language models (e.g., GPT, LLaMA, Claude, Mistral) and associated libraries (e.g., Hugging Face Transformers). 
  • Familiar with retrieval-augmented generation (RAG), data labeling, synthetic data generation, and data governance best practices. 
  • Proficiency in Python and ML tooling (e.g., Jupyter, Git, Docker, APIs). Able to work in cross-functional teams to deliver AI capabilities into production environments, and write modular/reusable code. 
  • Experience in Cloud analytics (AWS, Azure, or Google Cloud Platform - GCP) with tools such as AWS SageMaker, AWS Bedrock, Azure OpenAI, etc. 
  • Experience with DevSecOps, as it applies to data science and MLOps 
  • Data visualization skills in Tableau, Power BI, D3, ArcGIS, or similar are a plus 
  • Experience with Elasticsearch, AWS Kendra, Azure Cognitive Search, or similar tool is a plus 
About steampunk

Steampunk relies on several factors to determine salary, including but not limited to geographic location, contractual requirements, education, knowledge, skills, competencies, and experience. The projected compensation range for this position is $125,000 to $160,000.  The estimate displayed represents a typical annual salary range for this position. Annual salary is just one aspect of Steampunk's total compensation package for employees. Learn more about additional Steampunk benefits here. 

Identity Statement

As part of the application process, you are expected to be on camera during interviews and assessments. We reserve the right to take your picture to verify your identity and prevent fraud.

Steampunk is a Change Agent in the Federal contracting industry, bringing new thinking to clients in the Homeland, Federal Civilian, Health and DoD sectors.  Through our Human-Centered delivery methodology, we are fundamentally changing the expectations our Federal clients have for true shared accountability in solving their toughest mission challenges.  As an employee owned company, we focus on investing in our employees to enable them to do the greatest work of their careers - and rewarding them for outstanding contributions to our growth. If you want to learn more about our story, visit http://www.steampunk.com.

We are an equal opportunity employer and all qualified applicants will receive consideration for employment without regard to race, color, religion, sex, national origin, disability status, protected veteran status, or any other characteristic protected by law. Steampunk participates in the E-Verify program.

Employment Type: OTHER