ZipRecruiter

Log In

1

Generative Ai Testing Jobs in Boston, MA (NOW HIRING)

Xometry

Mechanical Engineer, AI Integration

Waltham, MA · Hybrid

$82K - $97K/yr

Xometry is seeking a talented Mechanical Engineer to join our Generative AI and Geometric ... Integration Support: Assist in testing and validating the real-time manufacturability (DFM) and ...

InvoiceCloud

AI Security Engineer

Boston, MA · On-site

Conducts structured Threat Modeling & Risk Assessment exercises for generative AI, RAG, and agent ... Builds and scales AI Security Testing & Red Teaming workflows by creating repeatable adversarial ...

Analysis Group, Inc.

AI Operations Analyst

Boston, MA · On-site

... testing, documentation, and feedback tracking; handle sensitive AI Operations materials with ... High level of fluency with generative AI tools, such as ChatGPT, Claude, Copilot, Harvey, custom ...

Analysis Group, Inc.

AI Operations Analyst

Boston, MA · On-site

... testing, documentation, and feedback tracking; handle sensitive AI Operations materials with ... High level of fluency with generative AI tools, such as ChatGPT, Claude, Copilot, Harvey, custom ...

Xometry

Mechanical Engineer, AI Integration

Waltham, MA · On-site

$82K - $97K/yr

Xometry is seeking a talented Mechanical Engineer to join our Generative AI and Geometric ... Integration Support: Assist in testing and validating the real-time manufacturability (DFM) and ...

Entegris

Specialist, AI Engineer

Bedford, MA · On-site

... generative AI patterns (e.g., retrieval-augmented generation, tool calling, and workflow ... Quality & operations: testing, logging/metrics, and basic monitoring for services in development ...

Real Chemistry

AI Business Partner

Boston, MA · On-site +1

This role is ideal for someone who can move fluidly from ambiguity to action - working with stakeholders to define problems, rapidly testing ideas using modern generative AI tools, and helping the ...

Entegris

Specialist, AI Engineer

Bedford, MA · On-site

... generative AI patterns (e.g., retrieval-augmented generation, tool calling, and workflow ... Quality & operations: testing, logging/metrics, and basic monitoring for services in development ...

KPMG

Manager, AI Engineer

Boston, MA

... LLMs, generative AI, and traditional ML with enterprise platforms * Manage AI projects including architecture design, model development, integration, and testing, and ensure projects follow best ...

previous pagenext page

Showing results 21-40

All JobsGenerative Ai Testing JobsGenerative Ai Testing Jobs in Boston, MA

Generative Ai Testing information

See Boston, MA salary details

$34

$58

$83

How much do generative ai testing jobs pay per hour?

As of Aug 10, 2026, the average hourly pay for generative ai testing in Boston, MA is $58.37, according to ZipRecruiter salary data. Most workers in this role earn between $48.03 and $66.88 per hour, depending on experience, location, and employer.

What is the difference between Generative Ai Testing vs Data Scientist?

AspectGenerative Ai TestingData Scientist
Required CredentialsKnowledge of AI models, testing tools, programming skillsStatistics, programming, data analysis certifications
Work EnvironmentAI development teams, testing labs, tech companiesResearch labs, tech firms, finance, healthcare
Employer & Industry UsageAI product testing, quality assurance in techData analysis, predictive modeling across industries

Generative Ai Testing focuses on evaluating and validating AI-generated content and models, ensuring quality and accuracy. Data Scientists analyze data, build models, and derive insights. While both roles require programming and AI knowledge, Generative Ai Testing emphasizes testing processes, whereas Data Scientists focus on data analysis and model development.

How do I become a Generative AI Testing?

To become a Generative AI Tester, develop skills in machine learning, natural language processing, and programming languages like Python. Gain experience with AI frameworks such as TensorFlow or PyTorch and understand data quality and model evaluation techniques. Certifications in AI or data science can enhance your qualifications and improve job prospects.

Is Generative AI Testing a good career?

Generative AI Testing is a growing field within AI development that involves evaluating the quality and safety of AI-generated content. It requires skills in machine learning, programming, and understanding AI models, making it a promising career path with increasing demand as AI technologies expand. Professionals in this area can find opportunities in tech companies, research labs, and startups focused on AI innovation.

What are the key skills and qualifications needed to thrive as a generative AI testing specialist, and why are they important?

To thrive as a Generative AI Testing Specialist, you need a robust understanding of machine learning principles, model evaluation techniques, and a background in computer science or a related field. Familiarity with tools such as Python, TensorFlow, PyTorch, and model evaluation frameworks, as well as experience with automated testing platforms, is typically required. Analytical thinking, attention to detail, and strong communication skills help you identify model weaknesses and collaborate effectively with development teams. These skills are crucial to ensure the reliability, safety, and ethical deployment of generative AI solutions.

What are some common challenges faced when testing generative AI models, and how can I prepare to address them in this role?

Testing generative AI models often involves unique challenges such as evaluating the quality and relevance of generated content, detecting bias or inappropriate outputs, and ensuring model consistency across various prompts. You may work closely with data scientists and engineers to create robust evaluation frameworks and develop automated as well as manual testing strategies. Familiarity with prompt engineering, statistical evaluation techniques, and domain-specific knowledge will help you address these challenges effectively. Proactively staying updated on industry best practices and collaborating with cross-functional teams are key to success in this dynamic field.

What is generative AI testing?

Generative AI Testing refers to the process of evaluating and validating AI systems, particularly those that generate content such as text, images, or code. This type of testing focuses on assessing the accuracy, reliability, fairness, and safety of generative models to ensure they function as intended and avoid producing harmful or biased outputs. Testers use various methods, including automated and manual techniques, to check for issues like hallucinations, inappropriate content, or security vulnerabilities. The goal is to build trust in generative AI systems and ensure they meet quality and ethical standards before deployment.
What are popular job titles related to Generative Ai Testing jobs in Boston, MA? For Generative Ai Testing jobs in Boston, MA, the most frequently searched job titles are:
What job categories do people searching Generative Ai Testing jobs in Boston, MA look for? The top searched job categories for Generative Ai Testing jobs in Boston, MA are:
What cities near Boston, MA are hiring for Generative Ai Testing jobs? Cities near Boston, MA with the most Generative Ai Testing job openings:
Generative Ai Testing jobs near you
Infographic showing various Generative Ai Testing job openings in Boston, MA as of August 2026, with employment types broken down into 2% Internship, 92% Full Time, 2% Part Time, and 4% Contract. Highlights an 80% In-person, 11% Hybrid, and 9% Remote job distribution, with an average salary of $121,406 per year, or $58.4 per hour.

Artificial Intelligence (AI) Engineer

Wilmerhale

Boston, MA • On-site

Full-time

Re-posted 2 days ago

Job description

WilmerHale is a leading, full-service international law firm with 1,000 lawyers located throughout 12 offices in the United States and Europe. Our lawyers work at the intersection of government, technology and business, and we remain committed to our guiding principles of providing quality, excellent legal and client services; developing diversity among our lawyers and staff and cultivating an environment that promotes an ambitious spirit, collaboration and collegiality by drawing on the extraordinary talents and dynamic experience of our lawyers. Our goal is to reflect the diversity of our clients and the communities in which we practice.

About the Role

The Artificial Intelligence Engineer is responsible for developing and implementing cutting-edge AI solutions and models to solve complex problems and drive innovation at the firm. This includes working with the legal practices and business departments to support and improve their delivery of services by conceptualizing, developing, delivering, and supporting innovative solutions with a focus on AI and related technologies. The Artificial Intelligence Software Engineer works closely with other technical resources across Information Services (IS) to successfully manage the execution of AI projects, including project definition, requirements gathering, task planning, technical solution development, testing, support, and stakeholder management.  Also responsible for supporting the creation of best practices for the development, maintenance, and use of AI solutions, assessing AI-related COTS solutions, as well as assisting end users to create prompts to optimize the effectiveness of the Large Language Models (LLM) solutions.

What You Will Be Doing

       Collaborates with cross-functional teams to define AI project use cases, requirements, and objectives, ensuring alignment with overall business goals.

       Conducts research to stay up to date with the latest advancements in generative AI, machine learning, and deep learning techniques and identifies opportunities to integrate them into our products and services.  Provides updates and recommendations to Director, Application Services.

       Optimizes existing generative AI models for improved performance, scalability, and efficiency.

       Develops clear and concise documentation, including technical specifications, user guides, and presentations, to communicate complex AI and related concepts to both technical and non-technical stakeholders.

       Contributes to the establishment of best practices and standards for AI development within the organization.

       Interacts with business stakeholders and explaining technical issues and approaches to a non-technical audience.

       Provides functional and technical support and enhancements for the firm's AI solutions.

       Provides technical mentorship and guidance to other team members.

       Creates and delivers end-user training and documentation and provides second-line support to other users.

       Displays professionalism, quality service and a positive "can do" attitude to internal members/departments of the Firm.

       Initiates building and maintaining strong relationships with team members across functions and more senior client stakeholders. Uses conflict-resolution skills to facilitate strong team dynamics.

       Participates in special projects and performs other duties as assigned.

Apply