1

Ai Automation Testing Jobs in Massachusetts (NOW HIRING)

Experience leveraging AI tools for QA automation, documentation generation, validation workflows, and delivery acceleration * Applied AI-driven development and testing practices to improve ...

AI Solutions Engineer

Cambridge, MA · On-site

$107 - $170/hr

... automation, and data‑driven solutions across Philips. Responsibilities * Design, develop, and ... Own solutions throughout their lifecycle, including testing, deployment, monitoring, and continuous ...

The Automation Engineer will own, extend, and scale automated testing frameworks to ensure the performance of AI-generated applications in production environments. Responsibilities : • You expand ...

Automation Engineer

Cambridge, MA · On-site

$120 - $145/hr

Automation Engineer About Blitzy Blitzy is a Cambridge, MA based AI software development platform ... Own the evolution and expansion of our automated testing frameworks for AI-generated code ...

Conversational AI Testing experience is required * Hammer On Demand OR Cyara required; Selenium required Title: Quality Assurance Automation Engineer Location: Wellesley, MA; hybrid 3 days/week; open ...

Conversational AI Testing experience is required * Hammer On Demand OR Cyara required; Selenium required Title: Quality Assurance Automation Engineer Location: Wellesley, MA; hybrid 3 days/week; open ...

AI Solutions Engineer

Cambridge, MA · On-site

$107K - $170K/yr

... automation, and data-driven solutions across Philips. Your role: * Design, develop, and deploy ... Own solutions throughout their lifecycle, including testing, deployment, monitoring, and continuous ...

About the Role We are looking for an Automation Engineer to own, extend, and scale our automated ... the testing solutions that validate AI-generated applications during actual execution.

Senior Automation Engineer

Boston, MA · On-site

$92K - $136K/yr

Design and build testing tools dedicated to the automated validation of a robust healthcare system ... Experience with agentic AI development * Experience with cloud platforms (AWS, Azure, GCP) and ...

API testing knowledge (REST fundamentals) * Experience from academic projects or labs involving automation or CI/CD * Passion for innovation and learning new tooling * Early experience using AI for ...

API testing knowledge (REST fundamentals) * Experience from academic projects or labs involving automation or CI/CD * Passion for innovation and learning new tooling * Early experience using AI for ...

Showing results 21-40

Ai Automation Testing information

What is AI automation testing?

AI automation testing refers to the use of artificial intelligence technologies to automate the process of testing software applications. This approach enhances traditional automated testing by using machine learning and data analysis to identify test cases, detect defects, and optimize test coverage. AI-driven testing tools can adapt to changes in the application, reduce manual effort, and improve the accuracy and speed of testing processes. As a result, organizations can deliver higher-quality software more efficiently.

What are the key skills and qualifications needed to thrive as an AI automation testing professional?

To thrive as an AI Automation Testing professional, you need a solid understanding of software testing principles, programming languages (such as Python or Java), and AI/ML concepts, often supported by a degree in computer science or a related field. Familiarity with automation tools like Selenium, Appium, and AI-powered testing frameworks, as well as certifications like ISTQB, is highly valued. Strong analytical thinking, attention to detail, and effective communication skills help professionals excel in diagnosing issues and collaborating with development teams. These skills ensure the delivery of robust, efficient, and reliable AI-driven software products in a competitive technology landscape.

What are some common challenges faced by AI automation testing professionals when validating machine learning models?

AI Automation Testing professionals often encounter challenges such as ensuring that test cases comprehensively cover the unique behaviors of machine learning models, dealing with non-deterministic outputs, and handling large datasets efficiently. It's also common to face difficulties in setting up reliable test environments that simulate real-world data scenarios. Collaboration with data scientists and developers is crucial to define meaningful metrics and effectively interpret test results, ensuring the AI system meets both functional and ethical standards.

What is the difference between Ai Automation Testing vs Software Test Engineer?

AspectAi Automation TestingSoftware Test Engineer
Required CredentialsCertifications in AI, automation tools, programming languagesSoftware testing certifications (ISTQB, CSTE), programming skills
Work EnvironmentFocus on automation frameworks, AI integration, scriptingManual and automated testing, test case design, bug tracking
Employer & Industry UsageTech companies, AI-driven projects, software development firmsSoftware development companies, IT departments, QA teams

Ai Automation Testing and Software Test Engineer roles overlap in testing skills and programming knowledge. However, Ai Automation Testing emphasizes AI integration and automation frameworks, while Software Test Engineers focus more on manual testing, test case creation, and bug identification. Both roles are essential in software quality assurance but serve different aspects of the testing process.

How to become an AI automation tester?

To become an AI automation tester, you should have a strong understanding of software testing principles, programming languages such as Python or Java, and experience with automation tools like Selenium or TestComplete. Familiarity with AI and machine learning concepts can be beneficial, along with certifications in testing or automation. Gaining hands-on experience through internships or projects is also valuable for this role.

Is AI automation testing a good career?

AI automation testing is a growing field within software quality assurance that involves using AI tools and scripting to automate test cases, increasing efficiency and coverage. It requires knowledge of programming, testing frameworks, and AI concepts, making it a valuable skill set with strong job prospects and competitive salaries.

What are popular job titles related to Ai Automation Testing jobs in Massachusetts?

For Ai Automation Testing jobs in Massachusetts, the most frequently searched job titles are:

Infographic showing various Ai Automation Testing job openings in Massachusetts as of August 2026, with employment types broken down into 1% As Needed, 80% Full Time, 14% Part Time, 4% Contract, and 1% Nights. Highlights an 87% Physical, 3% Hybrid, and 10% Remote job distribution.

Application Engineer - AI and Python

IBM

Boston, MA • On-site

$100 - $150/hr

Other

Posted 8 days ago


Key responsibilities

  • Collaborate with clients to translate business requirements into AI-first technical designs and develop utilities, templates, and scaffolding using generative and agentic AI.

  • Validate AI specifications, generate code and transformation logic with AI-based development assistants, and perform testing activities including unit, module, functional, SIT, and UAT testing using AI-enabled agents.

  • Build DevOps scripts and pipelines, integrate automated security testing into DevSecOps pipelines, and ensure smooth deployment and production readiness.


IBM rating

8.0

Company rating: 8.0 out of 10

Based on 76 frontline employees who took The Breakroom Quiz

125th of 247 rated software companies


Job description

The Application Engineer designs, builds, tests, deploys and evolves software applications that deliver value to users and support IBM’s mission to lead in hybrid cloud and AI space. Applies AI-First engineering principles and Agentic AI capabilities to create scalable, secure, and user-centric products, perform testing activities, integrate with DevSecOps toolchains and collaborate across disciplines to continuously evolve digital product performance and experience to meet the client’s need.

In this role, you'll work in one of our IBM Consulting Client Innovation Centers (Delivery Centers), where we deliver deep technical and industry expertise to a wide range of public and private sector clients around the world. Our delivery centers offer our clients locally based skills and technical expertise to drive innovation and adoption of new technology.

Your role and responsibilities

Key Responsibilities

  • Collaborate with clients to translate business requirements into AIfirst technical designs, defining utilities, templates, and scaffolding using generative and agentic AI aligned to client use cases
  • Validate OpenAI specifications, model context, and generated stubs; generate clean, modular, maintainable code and implement transformation logic and services with AIbased development assistants following IBM and industry standards.
  • Apply AI enabled peer review agents plus Testing Agents and synthetic data for unit, module, functional, SIT, and UAT testing, using pattern recognition to locate defect origins and support triage and resolution.
  • Build DevOps scripts and pipelines with Deployment Agents and integrate automated SAST/DAST security testing into DevSecOps pipelines to meet compliance and governance requirements.
  • Ensure production readiness and smooth deployment cutover.

Required education

Bachelor's Degree

Required technical and professional expertise

Required skills

  • Good ES6/ES7 knowledge
  • HTML5/CSS3 or CSS preprocessor relevant experience (at least 3 years)
  • Experience with Typescript
  • Experience with Python (min 3 years)
  • Experience with React (min 3 years)
  • Good understanding of SQL/NoSQL database design and usage
  • Knowledge of a testing library: Mocha/Jasmine/Chai etc.
  • Good understanding of DevOps strategies and Cloud products
  • Good understanding of full stack application architecture
  • Experience with RESTAPIs/GraphQL and Swagger
  • Experience with implementing and using Design System(s)
  • Experience in Scrum and Agile development methodologies
  • Good command of English
  • Teamwork and collaborate with colleagues, third party collaborators and clients

Preferred technical and professional experience

Agentic Tools & AI-Assisted Development Experience

  • Amazon Q Developer for code generation, debugging, refactoring, and cloud-native development support
  • GitHub Copilot for pair programming, unit test generation, and accelerated software delivery
  • Claude Code for code analysis, debugging, documentation, and developer workflow automation
  • Experience integrating AI-assisted development practices into Agile SDLC workflows

Agentic AI & Automation Frameworks

  • CrewAI for building and orchestrating autonomous AI agents and workflow automation
  • Experience designing agent-based workflows for development, testing, and engineering productivity use cases

AI-Assisted QA & SDLC Enablement

  • AI-assisted test case generation and test strategy development
  • Experience leveraging AI tools for QA automation, documentation generation, validation workflows, and delivery acceleration
  • Applied AI-driven development and testing practices to improve engineering productivity and software quality
ABOUT BUSINESS UNIT

IBM Consulting is IBM’s consulting and global professional services business, with market leading capabilities in business and technology transformation. With deep expertise in many industries, we offer strategy, experience, technology, and operations services to many of the most innovative and valuable companies in the world. Our people are focused on accelerating our clients’ businesses through the power of collaboration. We believe in the power of technology responsibly used to help people, partners and the planet.

YOUR LIFE @ IBM

In a world where technology never stands still, we understand that, dedication to our clients success, innovation that matters, and trust and personal responsibility in all our relationships, lives in what we do as IBMers as we strive to be the catalyst that makes the world work better.

Being an IBMer means you’ll be able to learn and develop yourself and your career, you’ll be encouraged to be courageous and experiment everyday, all whilst having continuous trust and support in an environment where everyone can thrive whatever their personal or professional background.

Our IBMers are growth minded, always staying curious, open to feedback and learning new information and skills to constantly transform themselves and our company. They are trusted to provide on-going feedback to help other IBMers grow, as well as collaborate with colleagues keeping in mind a team focused approach to include different perspectives to drive exceptional outcomes for our customers. The courage our IBMers have to make critical decisions everyday is essential to IBM becoming the catalyst for progress, always embracing challenges with resources they have to hand, a can-do attitude and always striving for an outcome focused approach within everything that they do.

Are you ready to be an IBMer?

ABOUT IBM

IBM’s greatest invention is the IBMer. We believe that through the application of intelligence, reason and science, we can improve business, society and the human condition, bringing the power of an open hybrid cloud and AI strategy to life for our clients and partners around the world.

Restlessly reinventing since 1911, we are not only one of the largest corporate organizations in the world, we’re also one of the biggest technology and consulting employers, with many of the Fortune 500 companies relying on the IBM Cloud to run their business.

At IBM, we pride ourselves on being an early adopter of artificial intelligence, quantum computing and blockchain. Now it’s time for you to join us on our journey to being a responsible technology innovator and a force for good in the world.

IBM is proud to be an equal-opportunity employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, gender, gender identity or expression, sexual orientation, national origin, genetics, pregnancy, disability, neurodivergence, age, or other characteristics protected by the applicable law. IBM is also committed to compliance with all fair employment practices regarding citizenship and immigration status.

OTHER RELEVANT JOB DETAILS

IBM wants you to bring your whole self to work and for you this might mean the ability to work flexibly. If you are interested in a flexible working pattern, please talk to our recruitment team to find out if this is possible in the current working environment.

Job Title

Application Engineer - AI and Python

Job ID

129858

City / Township / Village

State / Province

Country

Work arrangement

Hybrid

Area of work

Software Engineering

Employment type

Regular

Position type

Professional

Some travel may be required based on business demand

Company

Shift

General (daytime)

Is this role a commissionable/sales incentive based position?

#J-18808-Ljbffr

What IBM employees say

Pay

Benefits

Hours and flexibility

Workplace

Get the full story on Breakroom


IBM logo

About IBM

Sourced by ZipRecruiter

At IBM, work is more than a job - it's a calling: To build. To design. To code. To consult. To think along with clients and sell. To make markets. To invent. To collaborate. Not just to do something better, but to attempt things you've never thought possible. Are you ready to lead in this new era of technology and solve some of the world's most challenging problems? If so, lets talk.

Industry

It services

Company size

10,000+ Employees

Headquarters location

Armonk, NY, US

Year founded

1911

Social media