ZipRecruiter

Log In

1

Generative Ai Testing Jobs in Baltimore, MD (NOW HIRING)

Dcode Talent LLC

GenAI Engineer

Woodlawn, MD · On-site

Incorporating generative AI models into existing software applications and products. · Research ... control, and testing. · Problem-solving, analytical, and critical thinking skills. · Strong ...

PB consulting

GenAI Test Automation Engineer

Silver Spring, MD · On-site

$34.75 - $45.75/hr

The ideal candidate will design AI-powered testing solutions, build reusable automation frameworks, and integrate Generative AI capabilities into software quality processes. Required Qualifications ...

PB consulting

GenAI Test Automation Engineer

Silver Spring, MD · On-site

$47.50 - $62.75/hr

The ideal candidate will design AI-powered testing solutions, build reusable automation frameworks, and integrate Generative AI capabilities into software quality processes. Required Qualifications ...

Omm IT Solutions

GenAI Engineer

Ellicott City, MD · On-site

Incorporating generative AI models into existing software applications and products. \n * Research ... and testing. \n * Problem\-solving, analytical, and critical thinking skills. \n * Strong ...

Parsons Services Company

AI/ML Engineer

Aberdeen, MD · On-site

  • Medical

  • Dental

  • Vision

  • Life

  • Retirement

  • PTO

Oversees model testing, validation, and quality assurance activities to ensure solutions meet ... Experience with Generative AI, Large Language Models (LLMs), Retrieval-Augmented Generation (RAG ...

New

Parsons

AI/ML Engineer

Aberdeen, MD

  • Medical

  • Dental

  • Vision

  • Life

  • Retirement

  • PTO

Oversees model testing, validation, and quality assurance activities to ensure solutions meet ... Experience with Generative AI, Large Language Models (LLMs), Retrieval-Augmented Generation (RAG ...

Parsons Corporation

AI/ML Engineer

Aberdeen, MD · On-site

  • Medical

  • Dental

  • Vision

  • Life

  • Retirement

  • PTO

Oversees model testing, validation, and quality assurance activities to ensure solutions meet ... Experience with Generative AI, Large Language Models (LLMs), Retrieval-Augmented Generation (RAG ...

eSimplicity Inc.

Data Engineer II

Columbia, MD · On-site

$112K - $135K/yr

  • Medical

  • Dental

  • Vision

  • Life

  • Retirement

  • PTO

... generative AI. Requirements Required Qualifications: * All candidates must pass public trust ... Strong Python programming skills with experience building, testing, and deploying AI/ML ...

eSimplicity

Data Engineer II

Columbia, MD · On-site +1

$93K - $100K/yr

  • Medical

  • Dental

  • Vision

  • Life

  • Retirement

  • PTO

... generative AI. Requirements Required Qualifications: * All candidates must pass public trust ... Strong Python programming skills with experience building, testing, and deploying AI/ML ...

eSimplicity

Data Engineer II

Columbia, MD · On-site +1

$100K/mo

  • Medical

  • Dental

  • Vision

  • Life

  • Retirement

  • PTO

... generative AI. Requirements Required Qualifications: * All candidates must pass public trust ... Strong Python programming skills with experience building, testing, and deploying AI/ML ...

eSimplicity

Data Engineer II

Columbia, MD · On-site

$93K - $100K/yr

  • Medical

  • Dental

  • Vision

  • Life

  • Retirement

  • PTO

... generative AI. Requirements: Required Qualifications: * All candidates must pass public trust ... Strong Python programming skills with experience building, testing, and deploying AI/ML ...

eSimplicity

Data Engineer II

Columbia, MD · On-site

$93K - $100K/yr

  • Medical

  • Dental

  • Vision

  • Life

  • Retirement

  • PTO

... generative AI. Requirements Required Qualifications: * All candidates must pass public trust ... Strong Python programming skills with experience building, testing, and deploying AI/ML ...

previous pagenext page

Showing results 21-40

All JobsGenerative Ai Testing JobsGenerative Ai Testing Jobs in Baltimore, MD

Generative Ai Testing information

See Baltimore, MD salary details

$31

$53

$75

How much do generative ai testing jobs pay per hour?

As of Aug 17, 2026, the average hourly pay for generative ai testing in Baltimore, MD is $53.38, according to ZipRecruiter salary data. Most workers in this role earn between $43.94 and $61.15 per hour, depending on experience, location, and employer.

What is generative AI testing?

Generative AI Testing refers to the process of evaluating and validating AI systems, particularly those that generate content such as text, images, or code. This type of testing focuses on assessing the accuracy, reliability, fairness, and safety of generative models to ensure they function as intended and avoid producing harmful or biased outputs. Testers use various methods, including automated and manual techniques, to check for issues like hallucinations, inappropriate content, or security vulnerabilities. The goal is to build trust in generative AI systems and ensure they meet quality and ethical standards before deployment.

What are some common challenges faced when testing generative AI models, and how can I prepare to address them in this role?

Testing generative AI models often involves unique challenges such as evaluating the quality and relevance of generated content, detecting bias or inappropriate outputs, and ensuring model consistency across various prompts. You may work closely with data scientists and engineers to create robust evaluation frameworks and develop automated as well as manual testing strategies. Familiarity with prompt engineering, statistical evaluation techniques, and domain-specific knowledge will help you address these challenges effectively. Proactively staying updated on industry best practices and collaborating with cross-functional teams are key to success in this dynamic field.

What are the key skills and qualifications needed to thrive as a generative AI testing specialist, and why are they important?

To thrive as a Generative AI Testing Specialist, you need a robust understanding of machine learning principles, model evaluation techniques, and a background in computer science or a related field. Familiarity with tools such as Python, TensorFlow, PyTorch, and model evaluation frameworks, as well as experience with automated testing platforms, is typically required. Analytical thinking, attention to detail, and strong communication skills help you identify model weaknesses and collaborate effectively with development teams. These skills are crucial to ensure the reliability, safety, and ethical deployment of generative AI solutions.

What is the difference between Generative Ai Testing vs Data Scientist?

AspectGenerative Ai TestingData Scientist
Required CredentialsKnowledge of AI models, testing tools, programming skillsStatistics, programming, data analysis certifications
Work EnvironmentAI development teams, testing labs, tech companiesResearch labs, tech firms, finance, healthcare
Employer & Industry UsageAI product testing, quality assurance in techData analysis, predictive modeling across industries

Generative Ai Testing focuses on evaluating and validating AI-generated content and models, ensuring quality and accuracy. Data Scientists analyze data, build models, and derive insights. While both roles require programming and AI knowledge, Generative Ai Testing emphasizes testing processes, whereas Data Scientists focus on data analysis and model development.

How do I become a Generative AI Testing?

To become a Generative AI Tester, develop skills in machine learning, natural language processing, and programming languages like Python. Gain experience with AI frameworks such as TensorFlow or PyTorch and understand data quality and model evaluation techniques. Relevant certifications and hands-on projects can enhance your qualifications for roles in AI testing environments.

Is Generative AI Testing a good career?

Generative AI Testing is a growing field within AI development, focusing on evaluating the quality and safety of AI-generated content. It requires skills in machine learning, programming, and understanding AI models, often involving tools like Python and TensorFlow. The role offers opportunities in tech companies and research labs, with demand expected to increase as AI applications expand.

What are popular job titles related to Generative Ai Testing jobs in Baltimore, MD?

For Generative Ai Testing jobs in Baltimore, MD, the most frequently searched job titles are:

What job categories do people searching Generative Ai Testing jobs in Baltimore, MD look for?

The top searched job categories for Generative Ai Testing jobs in Baltimore, MD are:

Generative Ai Testing jobs near you

GenAI Engineer

Dcode Talent LLC

Woodlawn, MD • On-site

Contractor

Re-posted 2 days ago

Job description

Must be local - full onsite role
No sponsorships available for this role
Final in-person interview
Location: Woodlawn, MD

Key Required Skills: Machine Learning, Deep Learning, Neural Networks, Python, Natural Language Processing, Prompt Engineering, and Data Management and Preprocessing.

Position Description:

· Design and develop generative models: This includes working with architectures like GANs (Generative Adversarial Networks), VAEs (Variational Autoencoders), and especially transformer-based models (like those behind LLMs).

· Fine-tuning and optimization: Adapting pre-trained generative models for specific tasks and datasets, optimizing their performance, efficiency, and the quality of their generated output.

· Prompt engineering: Crafting and refining prompts to guide generative models to produce desired outputs, often for specific applications (e.g., content creation, code generation, design).

· Build AI pipelines: Creating the infrastructure and workflows for data preparation, model training, deployment, and ongoing monitoring of generative AI systems.

· Integration: Incorporating generative AI models into existing software applications and products.

· Research and experimentation: Staying up to date with the latest research in generative AI and experimenting with new algorithms and techniques.

· Ethical considerations: Understanding and addressing potential biases, misuse, and ethical implications of generative AI.

· All other duties as assigned or directed.

FOUNDATION FOR SUCCESS (Basic Qualifications)

· Bachelor's Degree in Computer Science, Mathematics, Engineering or a related field.

· Masters or Doctorate degree may substitute for required experience

· Minimum 12 years of overall experience in an IT related field (development background preferred)

· Minimum 5 years of hands-on experience designing, developing, and implementing AI models (Generative AI experience preferred)

· Must be able to obtain and maintain a Public Trust. Contract requirement.

FACTORS TO HELP YOU SHINE (Required Skills) These skills will help you succeed in this position:

· Strong foundation in Machine Learning, Deep Learning, and neural networks (GANs, VAEs, Transformers, LLMs).

· Proficiency in programming languages, especially Python, and relevant libraries (Scikit-Learn, TensorFlow, PyTorch, Keras).

· Expertise in Natural Language Processing (NLP) for text and language generation.

· Data management, preprocessing, and feature engineering skills.

· Expertise with prompt engineering techniques for guiding AI models.

· Experience with cloud-based AI platforms (AWS, Azure).

· Knowledge of software development best practices, including CI/CD pipelines, version control, and testing.

· Problem-solving, analytical, and critical thinking skills.

· Strong communication and collaboration abilities.

· Understanding of AI ethics and responsible AI development.

HOW TO STAND OUT FROM THE CROWD (Desired Skills) Showcase your knowledge of modern development through the following experience or skills:

· Prior experience with federal or state governments IT projects.

· Familiarity with various LLM models available in the market

· Working knowledge of Retrieval Augmented Generation (RAG) to enhance LLM responses

· Experience integrating GenAI models and services into existing applications using APIs

Education:

· Bachelor's Degree in Computer Science, Mathematics, Engineering or a related field.

· Masters or Doctorate degree may substitute for required experience

· Minimum 12 years of overall experience in an IT related field (development background preferred)

· Minimum 5 years of hands-on experience designing, developing, and implementing AI models (Generative AI experience preferred)

· Must be able to obtain and maintain a Public Trust.