ZipRecruiter

Log In

1

Generative Ai Testing Jobs in Massachusetts (NOW HIRING)

MSD

Sr. Scientist, Generative Protein Design

Cambridge, MA · On-site

$100K - $136K/yr

Integrate AI/ML protein design methods with structural biology and high-throughput experimental ... Testing, Therapeutic Proteins, Workflow Optimization Preferred Skills: Current Employees apply HERE ...

Salesforce, Inc.

Director, AI & Tooling

Boston, MA

Generative AI Strategy Drive the strategic roadmap for generative AI capabilities within the Help ... The Testing Center is fully onboarded in production, with evaluation coverage scaled well beyond ...

Socket.dev

Director, AI & Tooling

Braintree Highlands, MA · On-site

$164 - $305/hr

Generative AI Strategy Drive the strategic roadmap for generative AI capabilities within the Help ... The Testing Center is fully onboarded in production, with evaluation coverage scaled well beyond ...

Xometry

Mechanical Engineer, AI Integration

Waltham, MA · Hybrid

$82K - $97K/yr

Xometry is seeking a talented Mechanical Engineer to join our Generative AI and Geometric ... Integration Support: Assist in testing and validating the real-time manufacturability (DFM) and ...

Analysis Group, Inc.

AI Operations Analyst

Boston, MA · On-site

... testing, documentation, and feedback tracking; handle sensitive AI Operations materials with ... High level of fluency with generative AI tools, such as ChatGPT, Claude, Copilot, Harvey, custom ...

Analysis Group, Inc.

AI Operations Analyst

Boston, MA · On-site

... testing, documentation, and feedback tracking; handle sensitive AI Operations materials with ... High level of fluency with generative AI tools, such as ChatGPT, Claude, Copilot, Harvey, custom ...

Xometry

Mechanical Engineer, AI Integration

Waltham, MA · On-site

$82K - $97K/yr

Xometry is seeking a talented Mechanical Engineer to join our Generative AI and Geometric ... Integration Support: Assist in testing and validating the real-time manufacturability (DFM) and ...

previous pagenext page

Showing results 21-40

All JobsGenerative Ai Testing JobsGenerative Ai Testing Jobs in Massachusetts

Generative Ai Testing information

What is generative AI testing?

Generative AI Testing refers to the process of evaluating and validating AI systems, particularly those that generate content such as text, images, or code. This type of testing focuses on assessing the accuracy, reliability, fairness, and safety of generative models to ensure they function as intended and avoid producing harmful or biased outputs. Testers use various methods, including automated and manual techniques, to check for issues like hallucinations, inappropriate content, or security vulnerabilities. The goal is to build trust in generative AI systems and ensure they meet quality and ethical standards before deployment.

What are some common challenges faced when testing generative AI models, and how can I prepare to address them in this role?

Testing generative AI models often involves unique challenges such as evaluating the quality and relevance of generated content, detecting bias or inappropriate outputs, and ensuring model consistency across various prompts. You may work closely with data scientists and engineers to create robust evaluation frameworks and develop automated as well as manual testing strategies. Familiarity with prompt engineering, statistical evaluation techniques, and domain-specific knowledge will help you address these challenges effectively. Proactively staying updated on industry best practices and collaborating with cross-functional teams are key to success in this dynamic field.

What are the key skills and qualifications needed to thrive as a generative AI testing specialist, and why are they important?

To thrive as a Generative AI Testing Specialist, you need a robust understanding of machine learning principles, model evaluation techniques, and a background in computer science or a related field. Familiarity with tools such as Python, TensorFlow, PyTorch, and model evaluation frameworks, as well as experience with automated testing platforms, is typically required. Analytical thinking, attention to detail, and strong communication skills help you identify model weaknesses and collaborate effectively with development teams. These skills are crucial to ensure the reliability, safety, and ethical deployment of generative AI solutions.

What is the difference between Generative Ai Testing vs Data Scientist?

AspectGenerative Ai TestingData Scientist
Required CredentialsKnowledge of AI models, testing tools, programming skillsStatistics, programming, data analysis certifications
Work EnvironmentAI development teams, testing labs, tech companiesResearch labs, tech firms, finance, healthcare
Employer & Industry UsageAI product testing, quality assurance in techData analysis, predictive modeling across industries

Generative Ai Testing focuses on evaluating and validating AI-generated content and models, ensuring quality and accuracy. Data Scientists analyze data, build models, and derive insights. While both roles require programming and AI knowledge, Generative Ai Testing emphasizes testing processes, whereas Data Scientists focus on data analysis and model development.

How do I become a Generative AI Testing?

To become a Generative AI Tester, develop skills in machine learning, natural language processing, and programming languages like Python. Gain experience with AI frameworks such as TensorFlow or PyTorch and understand data quality and model evaluation techniques. Certifications in AI or data science can enhance your qualifications and improve job prospects.

Is Generative AI Testing a good career?

Generative AI Testing is a growing field within AI development that involves evaluating the quality and safety of AI-generated content. It requires skills in machine learning, programming, and understanding AI models, making it a promising career path with increasing demand as AI technologies expand. Professionals in this area can find opportunities in tech companies, research labs, and startups focused on AI innovation.

What are popular job titles related to Generative Ai Testing jobs in Massachusetts?

For Generative Ai Testing jobs in Massachusetts, the most frequently searched job titles are:

What job categories do people searching Generative Ai Testing jobs in Massachusetts look for?

The top searched job categories for Generative Ai Testing jobs in Massachusetts are:

What cities in Massachusetts are hiring for Generative Ai Testing jobs?

Cities in Massachusetts with the most Generative Ai Testing job openings:

Generative Ai Testing jobs near you
Infographic showing various Generative Ai Testing job openings in Massachusetts as of August 2026, with employment types broken down into 1% As Needed, 86% Full Time, 9% Part Time, 3% Contract, and 1% Nights. Highlights an 88% Physical, 3% Hybrid, and 9% Remote job distribution.

Data Scientist III - Insurance & Generative AI (Hybrid- Webster or Boston)

American Commerce Insurance Company

Webster, MA • On-site

Other

Medical, Retirement, PTO

Posted 2 days ago

New

Job description

*This position is not eligable for sponsorship now or in the future.*
Summary
We are looking for a forward-thinking analytics leader to design, build, and scale advanced analytical solutions that solve complex, high-impact business problems. This role combines deep technical expertise in predictive modeling and machine learning with strong business acumen and insurance domain knowledge.
You will play a critical role in shaping strategy by delivering actionable insights, presenting to senior leadership, and owning the long-term success of models and analytics products. You'll also help drive innovation through the application of cutting-edge techniques, including Generative AI, while mentoring others and advancing best practices across the organization.
What You'll Do
  • Lead the development and deployment of advanced predictive models, machine learning solutions, and Generative AI use cases for complex business challenges
  • Translate analytics into actionable insights that drive decision-making and align with company strategy
  • Build and automate sophisticated reports, dashboards, and model outputs for business and executive stakeholders
  • Present model performance, lift, and impact analyses to senior leadership
  • Own the full lifecycle of models, including development, validation, deployment, monitoring, and continuous improvement
  • Conduct research into innovative algorithms and GenAI approaches to unlock new opportunities and use cases
  • Develop, test, and refine prompts, and support the design of agent-based GenAI workflows
  • Work with complex datasets, including sparse, high-dimensional, and time-series data
  • Measure economic impact and partner with business teams to define KPIs and ensure value realization
  • Design processes and tools to monitor model performance, reliability, and stability in production
  • Develop internal tools and programs to accelerate deployment, retraining, and scaling of models (MLOps), supporting both batch and real-time environments
  • Collaborate cross-functionally and serve as the key liaison with IT to implement and scale solutions
  • Lead end-to-end project execution, prioritizing high-impact initiatives and managing timelines
  • Create executive-ready presentations and detailed technical documentation to communicate results and best practices
  • Mentor and guide junior team members while promoting best-in-class modeling and statistical techniques
  • Partner with data governance and business teams to improve data quality, feature engineering, and overall data strategy
  • Identify and evaluate new data sources and emerging analytical techniques to maintain competitive advantage
  • Advocate for a data-driven culture and continuous innovation across the organization

What You'll Bring
  • Bachelor's degree in Statistics, Mathematics, Data Science, Economics, Finance, Engineering, or a related quantitative field (required), with either 8+ years of relevant experience, or a Master's degree with 2+ years of relevant experience

  • Deep expertise in predictive modeling, machine learning, and statistical analysis
  • Strong experience working with complex data structures (sparse, high-dimensional, and time-series data)
  • Solid insurance domain knowledge is required, with claims experience highly preferred
  • Experience with Generative AI, including prompt engineering, testing/refinement, and agent-based solution design
  • Proven ability to solve ambiguous, complex problems with minimal direction and high autonomy
  • Strong communication skills, with the ability to translate complex analytics into clear business insights for senior stakeholders
  • Experience owning and managing models in production environments, including monitoring and MLOps practices
  • Demonstrated ability to innovate, research new techniques, and apply them to real-world business problems
  • Experience mentoring team members and influencing best practices across teams
  • Strong organizational and project management skills, with the ability to prioritize high-value work

Why Mapfre?
As a global insurance leader with a strong local presence, we offer more than a job - we provide a purpose-driven career where your growth, well-being, and impact truly matter.
Purpose & Culture: Join a company built on trust, collaboration, and inclusion. Our values guide everything we do, creating a workplace where people feel respected and empowered.
Comprehensive Benefits: Enjoy competitive health coverage, retirement plans, paid time off, flexible work options, and lifestyle perks like employee discounts.
Career Growth: Advance your skills through tuition reimbursement, leadership programs, and internal mobility opportunities. Your development is our priority.
Social Responsibility: Contribute to meaningful initiatives through Fundacin Mapfre, supporting communities and sustainability worldwide.
Pay Philosophy: The typical starting salary range for this role is determined by several factors including skills, experience, education, certifications, and location. Some roles at Mapfre are eligible for commission and/or bonus earnings, in addition to salary, calculated based upon factors set forth in the compensation plan for the role.
Salary Range $100,900 - $159,500
If you require an accommodation for a disability so that you may participate in the selection process, you are encouraged to contact the Mapfre Insurance Talent Acquisition team at
We are proud to be an equal opportunity employer.

Apply