1

Ai Automation Testing Jobs in New York (NOW HIRING)

AI & Automation Developer

Monsey, NY · On-site

$120 - $180/hr

Overview AI & Automation Developer Company: Dashline Location: Montebello, NY Schedule: Full-time, ... Take work from clear requirements through development, testing, deployment, documentation, and ...

New

AI/Automation Development Lead

New York, NY · On-site

  • Medical

  • Dental

  • Vision

  • Life

  • Retirement

  • PTO

Department: IT Operations - AI, Automation & Tech Ops Location: New York (Hybrid) Reports To ... testing discipline * Participate in discovery sessions and requirements gathering alongside the ...

The AI Automation Engineer is a builder and owner of the Bank's intelligent automation layer ... Conduct prompt regression testing and maintain evaluation frameworks to detect output quality ...

New

AI Automation Developer/Engineer (M365)

Manhattan, NY · Hybrid

$75 - $85/hr

  • Medical

  • Dental

  • Vision

  • Life

  • Retirement

  • PTO

... AI & Automation Engineer to design, build, and deploy intelligent automation solutions across ... testing, deployment, documentation, and continuous improvement efforts. * Partner with engineering ...

next page

Showing results 1-20

Ai Automation Testing information

What is AI automation testing?

AI automation testing refers to the use of artificial intelligence technologies to automate the process of testing software applications. This approach enhances traditional automated testing by using machine learning and data analysis to identify test cases, detect defects, and optimize test coverage. AI-driven testing tools can adapt to changes in the application, reduce manual effort, and improve the accuracy and speed of testing processes. As a result, organizations can deliver higher-quality software more efficiently.

What are the key skills and qualifications needed to thrive as an AI automation testing professional?

To thrive as an AI Automation Testing professional, you need a solid understanding of software testing principles, programming languages (such as Python or Java), and AI/ML concepts, often supported by a degree in computer science or a related field. Familiarity with automation tools like Selenium, Appium, and AI-powered testing frameworks, as well as certifications like ISTQB, is highly valued. Strong analytical thinking, attention to detail, and effective communication skills help professionals excel in diagnosing issues and collaborating with development teams. These skills ensure the delivery of robust, efficient, and reliable AI-driven software products in a competitive technology landscape.

What are some common challenges faced by AI automation testing professionals when validating machine learning models?

AI Automation Testing professionals often encounter challenges such as ensuring that test cases comprehensively cover the unique behaviors of machine learning models, dealing with non-deterministic outputs, and handling large datasets efficiently. It's also common to face difficulties in setting up reliable test environments that simulate real-world data scenarios. Collaboration with data scientists and developers is crucial to define meaningful metrics and effectively interpret test results, ensuring the AI system meets both functional and ethical standards.

What is the difference between Ai Automation Testing vs Software Test Engineer?

AspectAi Automation TestingSoftware Test Engineer
Required CredentialsCertifications in AI, automation tools, programming languagesSoftware testing certifications (ISTQB, CSTE), programming skills
Work EnvironmentFocus on automation frameworks, AI integration, scriptingManual and automated testing, test case design, bug tracking
Employer & Industry UsageTech companies, AI-driven projects, software development firmsSoftware development companies, IT departments, QA teams

Ai Automation Testing and Software Test Engineer roles overlap in testing skills and programming knowledge. However, Ai Automation Testing emphasizes AI integration and automation frameworks, while Software Test Engineers focus more on manual testing, test case creation, and bug identification. Both roles are essential in software quality assurance but serve different aspects of the testing process.

How to become an AI automation tester?

To become an AI automation tester, you should have a strong understanding of software testing principles, programming languages such as Python or Java, and experience with automation tools like Selenium or TestComplete. Familiarity with AI and machine learning concepts can be beneficial, along with certifications in testing or automation. Gaining hands-on experience through internships or projects is also valuable for this role.

Is AI automation testing a good career?

AI automation testing is a growing field within software quality assurance that involves using AI tools and scripting to automate test cases, increasing efficiency and coverage. It requires knowledge of programming, testing frameworks, and AI concepts, making it a valuable skill set with strong job prospects and competitive salaries.

What job categories do people searching Ai Automation Testing jobs in New York look for?

The top searched job categories for Ai Automation Testing jobs in New York are:

What cities in New York are hiring for Ai Automation Testing jobs?

Cities in New York with the most Ai Automation Testing job openings:

Infographic showing various Ai Automation Testing job openings in New York as of August 2026, with employment types broken down into 1% As Needed, 83% Full Time, 12% Part Time, 3% Contract, and 1% Nights. Highlights an 88% Physical, 3% Hybrid, and 9% Remote job distribution.

$120K - $135K/yr

Full-time

Medical, Dental, Vision, Retirement, PTO

Re-posted 11 days ago


Job description

Must Have Technical/Functional Skills
Must have:
Strong Python Development Skills
Hands on experience on Continue.dev, Microsoft Copilot Studio, and Claude Code
• Proven experience designing and implementing end-to-end AI-driven business process automation solutions, including workflow orchestration, API integrations, and enterprise system connectivity (Agentic AI)
• Strong hands-on expertise with AI-assisted development tools and frameworks such as Continue.dev, Microsoft Copilot Studio, and Claude Code, with the ability to accelerate development, testing, and deployment cycles.
• Advanced software engineering and automation skills across Python, JavaScript/TypeScript, REST APIs, cloud platforms, CI/CD pipelines, and modern application architecture, with a focus on scalable and secure enterprise solutions.
• Ability to work directly with business stakeholders to translate operational requirements into AI-enabled automation use cases, while ensuring strong governance, documentation, risk controls, and measurable business outcomes.
• Initial use cases:
o Leverage the tools in AI that we have available (primarily Co-Pilot Studio) to create agents connecting to mailboxes, One Drive, SharePoint
o Transactions Foreign Central Banks transactions finding anomalies and summarizing findings
o Connectors to MS Dynamics to parse emails to update CRM
• Need someone that knows integrations and leverage Studio and agents. Databricks nice to have
• Machine Learning algorithms, AWS Bedrock API, Domino
• We want to operate in learning environment
Roles & Responsibilities
Bachelors in IT related field, Computer science preferred or equivalent.
We are seeking a highly skilled AI Automation Engineer to design, build, and scale AI-driven enterprise automation solutions leveraging Agentic AI frameworks. The role requires deep expertise in Python-based development, AI-assisted engineering, and end-to-end automation architecture, enabling measurable business transformation through intelligent workflows.
• Design and implement end-to-end AI-driven automation solutions, including workflow orchestration, API integrations, and enterprise system connectivity using
Agentic AI paradigms
• Develop and deploy Python-centric automation frameworks and services, ensuring high performance, scalability, and security across enterprise environments
• Leverage AI-assisted development tools (e.g., Microsoft Copilot Studio, Continue.dev, Claude Code) to accelerate development cycles, testing, and
• Build and integrate RESTful APIs, microservices, and event-driven architectures to enable seamless data and system interoperability
• Collaborate with business stakeholders to translate operational needs into AI-enabled automation use cases with clear ROI and measurable outcomes
• Ensure strong governance, documentation, compliance, and risk controls across all automation initiatives
• Implement and manage CI/CD pipelines and cloud-native deployments for continuous delivery of AI-powered solutions
• Drive adoption of best practices in software engineering, AI automation, and enterprise architecture
Required Skills & Qualifications
Core Technica l Skills
• Strong programming expertise in Python (mandatory), with experience in automation, scripting, and backend development • Proficiency in JavaScript/TypeScript and modern application development frameworks
TCS Employee Benefits Summary:
Discretionary Annual Incentive.
Comprehensive Medical Coverage: Medical & Health, Dental & Vision, Disability Planning & Insurance, Pet Insurance Plans.
Family Support: Maternal & Parental Leaves.
Insurance Options: Auto & Home Insurance, Identity Theft Protection.
Convenience & Professional Growth: Commuter Benefits & Certification & Training Reimbursement.
Time Off: Vacation, Time Off, Sick Leave & Holidays.
Legal & Financial Assistance: Legal Assistance, 401K Plan, Performance Bonus, College Fund, Student Loan Refinancing.
Salary Range: $120,000-$135,000 a year