1

Generative Ai Testing Jobs in Ohio (NOW HIRING)

AI/ML Engineer, Senior

Dayton, OH ยท On-site

$150 - $200/hr

Your work will leverage deep experience with MLโ€‘based NLP, LLMs and generative AI, computer ... Conduct model optimization, tuning, versioning, and AB testing to ensure robust mission impact.

AI/ML Engineer, Senior

Dayton, OH ยท Hybrid

$99K - $225K/yr

Your work will leverage deep experience with MLbased NLP, LLMs and generative AI, computer vision ... Conduct model optimization, tuning, versioning, and AB testing to ensure robust mission impact.

AI/ML Engineer, Senior

Dayton, OH ยท On-site

$99K - $225K/yr

Your work will leverage deep experience with ML-based NLP, LLMs and generative AI, computer vision ... Conduct model optimization, tuning, versioning, and AB testing to ensure robust mission impact.

AI/ML Engineer, Senior

Dayton, OH ยท Hybrid

$99K - $225K/yr

Your work will leverage deep experience with MLbased NLP, LLMs and generative AI, computer vision ... Conduct model optimization, tuning, versioning, and AB testing to ensure robust mission impact.

AI Engineer Lead[100%REMOTE]

Columbus, OH ยท On-site

$99K - $130K/yr

... or generative AI, and agents/ virtual assistants to software applications. AI Engineer is ... Experience in developing, testing, and deploying chatbot applications. ยท Ability to facilitate and ...

Senior AI/ML Software Engineer

Cincinnati, OH ยท On-site

$117K - $155K/yr

This position will be responsible for the analysis, design, testing, development and maintenance of ... Design, develop, train, fine-tune, deploy, and maintain Machine Learning models, Generative AI ...

$100 - $125/hr

Strong methodological expertise in Generative AI (LLMs & VLMs), High-Level Task-Planning, and ... testing) * Experience with deploying edge-to-cloud hybrid systems is a strong plus * Team spirit ...

Showing results 41-60

Generative Ai Testing information

What is generative AI testing?

Generative AI Testing refers to the process of evaluating and validating AI systems, particularly those that generate content such as text, images, or code. This type of testing focuses on assessing the accuracy, reliability, fairness, and safety of generative models to ensure they function as intended and avoid producing harmful or biased outputs. Testers use various methods, including automated and manual techniques, to check for issues like hallucinations, inappropriate content, or security vulnerabilities. The goal is to build trust in generative AI systems and ensure they meet quality and ethical standards before deployment.

What are some common challenges faced when testing generative AI models, and how can I prepare to address them in this role?

Testing generative AI models often involves unique challenges such as evaluating the quality and relevance of generated content, detecting bias or inappropriate outputs, and ensuring model consistency across various prompts. You may work closely with data scientists and engineers to create robust evaluation frameworks and develop automated as well as manual testing strategies. Familiarity with prompt engineering, statistical evaluation techniques, and domain-specific knowledge will help you address these challenges effectively. Proactively staying updated on industry best practices and collaborating with cross-functional teams are key to success in this dynamic field.

What are the key skills and qualifications needed to thrive as a generative AI testing specialist, and why are they important?

To thrive as a Generative AI Testing Specialist, you need a robust understanding of machine learning principles, model evaluation techniques, and a background in computer science or a related field. Familiarity with tools such as Python, TensorFlow, PyTorch, and model evaluation frameworks, as well as experience with automated testing platforms, is typically required. Analytical thinking, attention to detail, and strong communication skills help you identify model weaknesses and collaborate effectively with development teams. These skills are crucial to ensure the reliability, safety, and ethical deployment of generative AI solutions.

What is the difference between Generative Ai Testing vs Data Scientist?

AspectGenerative Ai TestingData Scientist
Required CredentialsKnowledge of AI models, testing tools, programming skillsStatistics, programming, data analysis certifications
Work EnvironmentAI development teams, testing labs, tech companiesResearch labs, tech firms, finance, healthcare
Employer & Industry UsageAI product testing, quality assurance in techData analysis, predictive modeling across industries

Generative Ai Testing focuses on evaluating and validating AI-generated content and models, ensuring quality and accuracy. Data Scientists analyze data, build models, and derive insights. While both roles require programming and AI knowledge, Generative Ai Testing emphasizes testing processes, whereas Data Scientists focus on data analysis and model development.

How do I become a Generative AI Testing?

To become a Generative AI Tester, develop skills in machine learning, natural language processing, and programming languages like Python. Gain experience with AI frameworks such as TensorFlow or PyTorch and understand data quality and model evaluation techniques. Relevant certifications and hands-on projects can enhance your qualifications for roles in AI testing environments.

Is Generative AI Testing a good career?

Generative AI Testing is a growing field within AI development, focusing on evaluating the quality and safety of AI-generated content. It requires skills in machine learning, programming, and understanding AI models, often involving tools like Python and TensorFlow. The role offers opportunities in tech companies and research labs, with demand expected to increase as AI applications expand.

What job categories do people searching Generative Ai Testing jobs in Ohio look for?

The top searched job categories for Generative Ai Testing jobs in Ohio are:

What cities in Ohio are hiring for Generative Ai Testing jobs?

Cities in Ohio with the most Generative Ai Testing job openings:

Infographic showing various Generative Ai Testing job openings in Ohio as of August 2026, with employment types broken down into 1% As Needed, 78% Full Time, 15% Part Time, 5% Contract, and 1% Nights. Highlights an 85% Physical, 2% Hybrid, and 13% Remote job distribution.

AI/ML Engineer, Senior

Dayton, OH โ€ข On-site

Phase2 Technology
Software Developmentย โ€ขย 51 - 200 employees

$150 - $200/hr

Other

Medical, Life, Retirement, PTO

Re-posted 5 days ago


Job description

Job Number: R0242678

AI/ML Engineer, Senior

The Opportunity

As a Senior Artificial Intelligence and Machine Learning (AI/ML) Engineer, you will design, build, and deploy advanced AI/ML solutions that modernize mission systems and accelerate decisionโ€‘making across the national security ecosystem. You will contribute endโ€‘toโ€‘end, spanning data processing, model development, MLOps, and integration of scalable AI capabilities into operational environments.

Your work will leverage deep experience with MLโ€‘based NLP, LLMs and generative AI, computer vision, and modern software engineering practices, consistent with the companyโ€™s AI/ML engineering role definitions. You will partner closely with crossโ€‘functional engineering, mission SMEs, and product teams to deliver productionโ€‘grade systems aligned with Booz Allenโ€™s AI modernization approaches.

What You'll Work On
  • Design, develop, and implement AI/ML models, including NLP, LLMโ€‘based pipelines, deep learning architectures, and computer vision models, aligned to mission requirements.
  • Build and optimize scalable data pipelines to support training, evaluation, and continuous improvement of models.
  • Develop endโ€‘toโ€‘end production systems, including microservices, APIs, automation frameworks, and cloudโ€‘native or edgeโ€‘deployed AI services.
  • Integrate AI/ML capabilities into operational environments with attention to security, reliability, observability, and performance.
  • Conduct model optimization, tuning, versioning, and AB testing to ensure robust mission impact.
  • Apply modern software engineering patterns, including Python, Java, Scala, and Rust, microservices, and distributed systems, as consistent with Booz Allenโ€™s AI/ML engineering frameworks.
  • Collaborate with multidisciplinary teams to identify mission needs, gather requirements, and define technical approaches.
  • Prepare technical documentation, contribute to design reviews, and support customerโ€‘driven requirements.
You Have
  • 5+ years of experience developing ML models such as NLP or LLM, CV, deep learning, generative AI, or reinforcement learning.
  • 5+ years of experience developing AI/ML capabilities to operate in a microservice stack.
  • Experience developing or maintaining productionโ€‘grade APIs, microservices, or distributed systems.
  • Experience with data processing frameworks and scientific computing libraries such as NumPy, Pandas, PyTorch, TensorFlow, or scikitโ€‘learn.
  • Experience designing, configuring, or deploying software systems in operational environments.
  • Experience with CI/CD tooling, source control such as GitLab, and containerization technologies such as Docker, Podman, or Kubernetes.
  • Active TS/SCI clearance; willingness to take a polygraph exam.
  • Bachelor's degree in a STEM field.
Nice If You Have
  • Experience in GPU programming, including CUDA or RAPIDs.
  • Experience with AWS and containerization of models in a classified environment.
  • Experience with LLM orchestration, RAG pipelines, grounding, or hallucinationโ€‘mitigation workflows.
  • Experience with MLOps platforms, distributed training, or hybrid cloud environments such as AWS, Azure, and GCP.
  • Experience with automated testing tools and model evaluation frameworks.
  • Master's degree in CS, AI Engineering, ML Engineering, Data Science, or a STEM field.
  • AI/ML, Cloud, or Solution Architecture Industry Certifications.
Clearance

Applicants selected will be subject to a security investigation and may need to meet eligibility requirements for access to classified information; TS/SCI clearance is required.

Compensation

At Booz Allen, we celebrate your contributions, provide you with opportunities and choices, and support your total wellโ€‘being. Our offerings include health, life, disability, financial, and retirement benefits, as well as paid leave, professional development, tuition assistance, workโ€‘life programs, and dependent care. Our recognition awards program acknowledges employees for exceptional performance and superior demonstration of our values. Fullโ€‘time and partโ€‘time employees working at least 20 hours a week on a regular basis are eligible to participate in Booz Allen's benefit programs. Individuals that do not meet the threshold are only eligible for select offerings, not inclusive of health benefits. We encourage you to learn more about our total benefits by visiting the Resource page on our Careers site and reviewing Our Employee Benefits page.

Salary at Booz Allen is determined by various factors, including but not limited to location, the individual's particular combination of education, knowledge, skills, competencies, and experience, as well as contractโ€‘specific affordability and organizational requirements. The projected compensation range for this position is $99,000.00 to $225,000.00 (annualized USD). The estimate displayed represents the typical salary range for this position and is just one component of Booz Allen's total compensation package for employees. This posting will close within 90 days from the Posting Date.

All qualified applicants will receive consideration for employment without regard to disability, status as a protected veteran or any other status protected by applicable federal, state, local, or international law.

#J-18808-Ljbffr