1

Ai Tester Jobs in Springfield, MA (NOW HIRING)

SDET

East Hartford, CT ยท On-site

$49.75 - $64/hr

Support AI/LLM testing, response validation, and overall platform reliability. Minimum Years of Experience Required 8+ Years Must Have Skills Java and/or Node.js Playwright/Selenium Automation ...

Job Title AI Deployment Engineer The AI Deployment Engineer will support the AI and automation ... Provide strong, hands-on guidance as users participate in solution design, prototyping, testing ...

New

At the Hartford, we are seeking a Principal AI Engineer who is responsible for building our AI ... Experience with CI/CD pipelines, Automated Testing, Automated Deployments, Agile methodologies ...

AI Integrator

Chicopee, MA ยท On-site

$167K - $196K/yr

NDi is seeking a Senior AI Integrator to lead the end-to-end lifecycle of AI/ML solutions for Civil ... Implement CI/CD pipelines, version control, and automated testing; manage containerization (Docker ...

Ability to compare and select AI models (for example, A/B testing two models on a task). * Interpersonal, oral, and written communication skills. * Knowledge of secure development practices and ...

AI Engineer

Hartford, CT ยท On-site

$115K - $138K/yr

... model testing and validation, selecting the best-performing algorithms based on statistical and ... We do it by enabling the enterprise with an AI-powered core that helps prioritize the execution of ...

Showing results 21-40

Ai Tester information

See Springfield, MA salary details

$10

$38

$62

How much do ai tester jobs pay per hour?

As of Sep 6, 2026, the average hourly pay for ai tester in Springfield, MA is $38.23, according to ZipRecruiter salary data. Most workers in this role earn between $21.30 and $50.53 per hour, depending on experience, location, and employer.

What is an AI tester?

An AI Tester is responsible for evaluating artificial intelligence systems to ensure they function correctly, efficiently, and ethically. They design and execute test cases, identify flaws or biases, and verify that AI models meet performance standards. AI Testers work with developers and data scientists to improve AI reliability and user experience. Their role is crucial in preventing errors, reducing risks, and ensuring AI models make accurate and fair decisions.

What are the key skills and qualifications needed to thrive as an AI tester?

To thrive as an AI Tester, you need a background in computer science, experience with software testing methodologies, and a solid understanding of artificial intelligence technologies. Familiarity with testing tools (such as Selenium, Jupyter notebooks, or TensorFlow testing frameworks), programming languages like Python, and relevant certifications (e.g., ISTQB) are highly advantageous. Attention to detail, problem-solving abilities, and strong communication skills help AI Testers identify and articulate issues effectively. These skills ensure AI systems are reliable, accurate, and deliver expected outcomes in real-world applications.

What are some typical challenges faced by AI testers in their daily work?

AI Testers often encounter challenges such as managing and testing large, complex datasets, handling rapidly evolving algorithms, and ensuring consistent test coverage across various real-world scenarios. They must also validate that AI models are free from bias and produce accurate, reproducible results under different conditions. Overcoming these challenges requires both technical proficiency and adaptability. Collaboration with data scientists, developers, and product managers is common, and testers frequently update their testing approaches to keep pace with the fast changes in AI technology.

Can I get an AI Tester job with no experience?

Entry-level AI Tester positions often do not require prior experience, but having basic knowledge of programming, testing tools, and AI concepts can improve your chances. Many employers offer training or are willing to hire candidates with relevant skills or certifications, such as in software testing or machine learning fundamentals.

How do you become an AI tester?

To become an AI tester, you typically need a background in computer science, software testing, or related fields, along with knowledge of machine learning and AI concepts. Gaining experience with programming languages like Python and familiarity with testing tools and frameworks are also important. Certifications in software testing or AI can enhance your qualifications and job prospects.

How much do AI testers make?

AI testers typically earn between $50,000 and $100,000 annually, depending on experience, location, and the complexity of the projects. Entry-level positions may start lower, while experienced testers with skills in automation tools and programming can earn higher salaries.

What job categories do people searching Ai Tester jobs in Springfield, MA look for?

The top searched job categories for Ai Tester jobs in Springfield, MA are:

What cities near Springfield, MA are hiring for Ai Tester jobs?

Cities near Springfield, MA with the most Ai Tester job openings:

Infographic showing various Ai Tester job openings in Springfield, MA as of August 2026, with employment types broken down into 54% Full Time, 18% Part Time, and 28% Contract. Highlights an 67% In-person, and 33% Remote job distribution, with an average salary of $79,512 per year, or $38.2 per hour.

Senior Consultant - AI Product / Business Analyst - UX Engineering

Long Finch Technologies

East Hartford, CT

Full-time

Posted 16 days ago


Job description

Job Summary

We are seeking an experienced Senior Consultant โ€“ AI Product / Business Analyst  to support the development and validation of AI-powered products and solutions . The ideal candidate will have strong experience working as a Business Analyst, Product Analyst, Product Owner, or similar role , along with hands-on experience in AI/LLM evaluation, prompt engineering, AI testing, and product validation .

The candidate will work closely with Business Stakeholders, Engineering, UX, and Data Science teams  to translate business and AI requirements into actionable product features, user stories, workflows, and acceptance criteria. Experience in the Healthcare domain  is highly preferred, along with hands-on AI experience.

Key Responsibilities

  • Gather and analyze business requirements for AI-powered products and solutions.
  • Translate business requirements into detailed Jira user stories, acceptance criteria, workflows, and product requirements .
  • Manage and prioritize product backlogs in collaboration with Product Owners and stakeholders.
  • Design and execute specialized AI/LLM test cases and evaluation scenarios .
  • Validate LLM-generated outputs for accuracy, quality, completeness, relevance, consistency, and reliability .
  • Evaluate different prompt variations and identify opportunities for prompt optimization.
  • Develop and execute test scenarios for AI agents and agentic workflows .
  • Perform AI model/product validation and analyze AI performance metrics.
  • Identify defects, inconsistencies, and quality gaps in AI-generated content and workflows.
  • Collaborate with Engineering, UX, Data Science, and Business teams to define and prioritize AI capabilities.
  • Support Agile ceremonies including backlog refinement, sprint planning, reviews, and retrospectives.
  • Drive continuous improvement of AI product quality and user experience.
  • Document requirements, test results, evaluation findings, and product recommendations.
  • Partner with stakeholders to ensure AI solutions meet business objectives and user needs.

Required Skills & Qualifications

  • 8โ€“10+ years of experience  as a Business Analyst, Product Analyst, Product Owner, Product Consultant, or equivalent role.
  • Hands-on experience working with AI-powered products, Generative AI, LLMs, or AI/ML solutions .
  • Strong experience creating Jira user stories, acceptance criteria, product requirements, and workflows .
  • Hands-on experience with AI/LLM testing and evaluation .
  • Experience evaluating LLM outputs and comparing prompt variations.
  • Strong understanding of prompt engineering and prompt optimization .
  • Experience validating AI-generated content for accuracy, completeness, consistency, and quality.
  • Experience testing or evaluating AI agents and agentic workflows .
  • Strong Agile/Scrum experience.
  • Excellent communication and stakeholder management skills.
  • Ability to work effectively with Engineering, UX, Data Science, Product, and Business teams .

Preferred / Nice-to-Have Skills

  • Healthcare domain experience is highly preferred.
  • Experience in HR technology, learning technology, content creation platforms, or knowledge management solutions .
  • Experience working with AI-powered enterprise applications.
  • Knowledge of AI evaluation methodologies and performance metrics.
  • Experience with Jira and Agile product development environments.
  • Experience contributing to UX/product discovery and user journey analysis.

Top 3 Responsibilities

  1. Requirements & Product Management:  Gather business requirements, create detailed Jira user stories, define acceptance criteria, and manage product backlogs while translating AI product requirements into actionable features and workflows.
  2. AI/LLM Evaluation & Testing:  Plan, execute, and monitor AI/LLM evaluations by designing test scenarios, validating model outputs, evaluating prompts and agentic workflows, analyzing metrics, and driving continuous product quality improvements.
  3. Cross-Functional Collaboration:  Collaborate with Engineering, UX, Data Science, Product, and Business stakeholders to prioritize AI capabilities and ensure successful delivery of AI-powered products.