1

Ai Automation Testing Jobs in Ohio (NOW HIRING)

As an Automation Test Lead, you will be instrumental in developing frameworks for automated testing ... Drive the adoption and effective use of AI and GenAI tools to improve testing efficiency ...

Automation Test Lead

Columbus, OH ยท Hybrid

$127K - $191K/yr

As an Automation Test Lead, you will be instrumental in developing frameworks for automated testing ... Drive the adoption and effective use of AI and GenAI tools to improve testing efficiency ...

Experience with tools such as Digital.ai or qTest * Testing Tools: WebdriverIO, ReadyAPI, Visual Studio Code, Postman * Test Automation Frameworks: Expertise in POM, Data-Driven frameworks, Selenium ...

New

Validate AI/ML-enabled GxP systems and automation testing frameworks, including development of validation approaches for non-deterministic outputs and documentation of AI governance requirements A ...

Validate AI/ML-enabled GxP systems and automation testing frameworks, including development of validation approaches for non-deterministic outputs and documentation of AI governance requirements A ...

Validate AI/ML-enabled GxP systems and automation testing frameworks, including development of validation approaches for non-deterministic outputs and documentation of AI governance requirements A ...

Validate AI/ML-enabled GxP systems and automation testing frameworks, including development of validation approaches for non-deterministic outputs and documentation of AI governance requirements A ...

Validate AI/ML-enabled GxP systems and automation testing frameworks, including development of validation approaches for non-deterministic outputs and documentation of AI governance requirements A ...

Validate AI/ML-enabled GxP systems and automation testing frameworks, including development of validation approaches for non-deterministic outputs and documentation of AI governance requirements A ...

Validate AI/ML-enabled GxP systems and automation testing frameworks, including development of validation approaches for non-deterministic outputs and documentation of AI governance requirements A ...

Validate AI/ML-enabled GxP systems and automation testing frameworks, including development of validation approaches for non-deterministic outputs and documentation of AI governance requirements A ...

Validate AI/ML-enabled GxP systems and automation testing frameworks, including development of validation approaches for non-deterministic outputs and documentation of AI governance requirements A ...

... AI-assisted development and testing tools to improve efficiency and productivity where appropriate. โ€ข Contribute to continuous improvement initiatives across testing and automation practices.

Validate AI/ML-enabled GxP systems and automation testing frameworks, including development of validation approaches for non-deterministic outputs and documentation of AI governance requirements A ...

Showing results 21-40

Ai Automation Testing information

What is AI automation testing?

AI automation testing refers to the use of artificial intelligence technologies to automate the process of testing software applications. This approach enhances traditional automated testing by using machine learning and data analysis to identify test cases, detect defects, and optimize test coverage. AI-driven testing tools can adapt to changes in the application, reduce manual effort, and improve the accuracy and speed of testing processes. As a result, organizations can deliver higher-quality software more efficiently.

What are the key skills and qualifications needed to thrive as an AI automation testing professional?

To thrive as an AI Automation Testing professional, you need a solid understanding of software testing principles, programming languages (such as Python or Java), and AI/ML concepts, often supported by a degree in computer science or a related field. Familiarity with automation tools like Selenium, Appium, and AI-powered testing frameworks, as well as certifications like ISTQB, is highly valued. Strong analytical thinking, attention to detail, and effective communication skills help professionals excel in diagnosing issues and collaborating with development teams. These skills ensure the delivery of robust, efficient, and reliable AI-driven software products in a competitive technology landscape.

What are some common challenges faced by AI automation testing professionals when validating machine learning models?

AI Automation Testing professionals often encounter challenges such as ensuring that test cases comprehensively cover the unique behaviors of machine learning models, dealing with non-deterministic outputs, and handling large datasets efficiently. It's also common to face difficulties in setting up reliable test environments that simulate real-world data scenarios. Collaboration with data scientists and developers is crucial to define meaningful metrics and effectively interpret test results, ensuring the AI system meets both functional and ethical standards.

What is the difference between Ai Automation Testing vs Software Test Engineer?

AspectAi Automation TestingSoftware Test Engineer
Required CredentialsCertifications in AI, automation tools, programming languagesSoftware testing certifications (ISTQB, CSTE), programming skills
Work EnvironmentFocus on automation frameworks, AI integration, scriptingManual and automated testing, test case design, bug tracking
Employer & Industry UsageTech companies, AI-driven projects, software development firmsSoftware development companies, IT departments, QA teams

Ai Automation Testing and Software Test Engineer roles overlap in testing skills and programming knowledge. However, Ai Automation Testing emphasizes AI integration and automation frameworks, while Software Test Engineers focus more on manual testing, test case creation, and bug identification. Both roles are essential in software quality assurance but serve different aspects of the testing process.

How to become an AI automation tester?

To become an AI automation tester, you should have a strong understanding of software testing principles, programming languages such as Python or Java, and experience with automation tools like Selenium or TestComplete. Familiarity with AI and machine learning concepts can be beneficial, along with certifications in testing or automation. Gaining hands-on experience through internships or projects is also valuable for this role.

Is AI automation testing a good career?

AI automation testing is a growing field within software quality assurance that involves using AI tools and scripting to automate test cases, increasing efficiency and coverage. It requires knowledge of programming, testing frameworks, and AI concepts, making it a valuable skill set with strong job prospects and competitive salaries.

What job categories do people searching Ai Automation Testing jobs in Ohio look for?

The top searched job categories for Ai Automation Testing jobs in Ohio are:

What cities in Ohio are hiring for Ai Automation Testing jobs?

Cities in Ohio with the most Ai Automation Testing job openings:

Infographic showing various Ai Automation Testing job openings in Ohio as of August 2026, with employment types broken down into 1% As Needed, 88% Full Time, 8% Part Time, 2% Contract, and 1% Nights. Highlights an 87% Physical, 3% Hybrid, and 10% Remote job distribution.

Distinguished Engineer - AI Security

Cleveland, OH โ€ข On-site

Full-time

Medical, Dental, Vision, Retirement, PTO

Re-posted 25 days ago


Job description

Description

DISTINGUISHED ENGINEER, AI TOOLING & SECURITY

Why This Role Matters

This role will help define and secure the future of AI at Citizens. The Distinguished Engineer, AI Tooling & Security will shape enterprise engineering practices, accelerate responsible AI adoption, and ensure that AI driven capabilities are developed, deployed, and operated securely at scale while enabling innovation and business growth.

Role Summary

Citizens is seeking a highly accomplished Distinguished Engineer, AI Tooling & Security to drive the design, engineering, and security of AI powered platforms and applications across the enterprise. This role combines deep software engineering expertise with advanced security knowledge to ensure AI solutions are scalable, resilient, secure, and aligned with business objectives.

As a Distinguished Engineer, you will serve as a hands on technical leader and peer mentor, partnering with engineering, architecture, security, data, and business teams to shape the future of AI adoption at Citizens. You will lead the development of innovative solutions, establish engineering standards, influence strategic technology decisions, and advance secure AI capabilities across the organization.

Key Responsibilities

  • Lead the design, development, and implementation of innovative software solutions, platforms, and tools that support enterprise AI initiatives.
  • Collaborate with engineering and architecture teams to define scalable, secure, and maintainable technology solutions aligned with enterprise standards.
  • Build modern, cloud native applications and reusable components that accelerate business outcomes and technology innovation.
  • Incorporate scalability, reliability, performance, observability, and maintainability into distributed systems and platform designs.
  • Champion engineering excellence through code quality, automation, testing, and continuous improvement practices.
  • Serve as a senior technical leader and mentor, fostering a culture of innovation, accountability, and continuous learning.
  • Build and operationalize security controls that protect AI applications, models, agents, prompts, and outputs from misuse and abuse.
  • Secure the full AI and machine learning lifecycle, including data ingestion, model development, training, deployment, monitoring, and runtime operations.
  • Design safeguards against emerging AI threats, including prompt injection, data poisoning, model inversion, adversarial attacks, and unauthorized data exposure.
  • Strengthen identity, authentication, authorization, and access management controls for AI systems, APIs, services, and cloud environments.
  • Secure integrations between AI platforms and enterprise applications, databases, APIs, and SaaS solutions to prevent unauthorized access and data exfiltration.
  • Implement encryption, tokenization, data masking, and privacy preserving controls to protect sensitive information used by AI systems.
  • Develop monitoring, logging, detection, and alerting capabilities to identify anomalous AI behaviors, policy violations, and security threats.
  • Harden cloud platforms, containers, orchestration environments, and infrastructure supporting AI workloads.
  • Evaluate security risks associated with third party AI platforms and services, ensuring appropriate governance and control frameworks.
  • Integrate automated security validation, adversarial testing, and model robustness assessments into engineering and deployment pipelines.
  • Lead technical investigations and response activities related to AI security incidents, model misuse, and data exposure events.
  • Collaborate with architecture, governance, risk, compliance, and engineering teams to align AI security practices with regulatory requirements and business objectives.

Required Qualifications

  • 10+ years of software engineering, platform engineering, security engineering, or data engineering experience.
  • Demonstrated success leading large scale engineering initiatives and influencing technical direction across multiple teams.
  • Strong understanding of AI, machine learning, generative AI, and agentic AI architectures and implementation patterns.
  • Experience developing secure, cloud based applications and services.
  • Strong programming experience in Python and proficiency in at least one additional modern programming language.
  • Experience working with large scale data platforms and analytical workloads.
  • Hands on experience with AWS cloud technologies and securing sensitive workloads.
  • Strong Linux and scripting experience, including Bash.
  • Experience building and maintaining CI/CD pipelines using Jenkins, CircleCI, GitHub Actions, or similar technologies.
  • Deep understanding of application security, cloud security, identity and access management, API security, and secure software development practices.
  • Knowledge of AI security principles, model governance, threat modeling, and secure deployment patterns.
  • Strong understanding of data structures, algorithms, and distributed systems.
  • Excellent communication, collaboration, and stakeholder management skills.
  • Proven ability to mentor and develop engineers while driving technical excellence.

Preferred Qualifications

  • Experience securing enterprise AI, machine learning, or generative AI platforms.
  • Experience within financial services, banking, fintech, or other highly regulated industries.
  • Cloud certifications such as AWS Solutions Architect, AWS Security Specialty, Azure Solutions Architect, or equivalent.
  • Experience with container platforms, Kubernetes, infrastructure as code, and platform engineering practices.
  • Familiarity with emerging AI governance, model risk management, and regulatory frameworks.

Education

  • Required: Bachelor's degree or equivalent combination of education and experience.
  • Preferred: Bachelor's or Master's degree in Computer Science, Software Engineering, Computer Engineering, Data Science, Cybersecurity, or a related technical discipline.

Pay Transparency
The salary range for this position is $175,000 to $250,000 per year, plus an opportunity to earn additional incentive earnings. Actual pay is based on various factors including, but not limited to, the budget, work location, and relevant skills and experience.

Benefits
Comprehensive benefits include medical, dental, and vision coverage, retirement plans, parental leave, flexible work arrangements, education reimbursement, wellness programs, and generous paid time off exceeding local requirements.

https://jobs.citizensbank.com/benefits.

Some job boards have started using jobseeker-reported data to estimate salary ranges for roles. If you apply and qualify for this role, a recruiter will discuss accurate pay guidance.

Equal Employment Opportunity

Citizens, its parent, subsidiaries, and related companies (Citizens) provide equal employment and advancement opportunities to all colleagues and applicants for employment without regard to age, ancestry, color, citizenship, physical or mental disability, perceived disability or history or record of a disability, ethnicity, gender, gender identity or expression, genetic information, genetic characteristic, marital or domestic partner status, victim of domestic violence, family status/parenthood, medical condition, military or veteran status, national origin, pregnancy/childbirth/lactation, colleague's or a dependent's reproductive health decision making, race, religion, sex, sexual orientation, or any other category protected by federal, state and/or local laws. At Citizens, we are committed to fostering an inclusive culture that enables all colleagues to bring their best selves to work every day and everyone is expected to be treated with respect and professionalism. Employment decisions are based solely on merit, qualifications, performance and capability.

Education:Why Work for UsEmployment Type: 1ST