1

Ai Test Engineer Jobs in Quebec (NOW HIRING)

... The Test Engineering Specialist will be responsible for developing and maintaining system ... We may use artificial intelligence (AI) tools to support parts of the hiring process, such as ...

Generative AI EngineerAbout Apertera Apertera is leading the evolution of language solutions for ... Work closely with machine learning engineers and data engineers to design, build, and test models.

Integrate AI tooling into CI/CD pipelines to improve deployment reliability, automate test ... Collaborate with senior engineers and leadership to evolve and execute the infrastructure AI ...

... AI solutions or LLM based systems Experience working in complex enterprise environments or large ... test automation and quality engineering in senior or lead roles Demonstrated ability to drive ...

$90 - $130/hr

MaintainX is the world's leading AI-powered maintenance and asset management platform, serving 13 ... ) au sein de l'équipe Plateforme Qualité , vous concevrez et développerez l'infrastructure de ...

next page

Showing results 1-20

Ai Test Engineer information

What is the difference between Ai Test Engineer vs Data Scientist?

AspectAi Test EngineerData Scientist
Required CredentialsBachelor's in CS, AI, or related field; knowledge of testing toolsBachelor's or higher in CS, Statistics, or related; proficiency in data analysis
Work EnvironmentSoftware testing teams, AI development projectsData analysis teams, AI research projects
Employer & Industry UsageTech companies, AI startups, software firmsTech companies, finance, healthcare, research institutions
Common Search & ComparisonOften compared for roles in AI testing and quality assuranceCompared for data analysis and AI model development roles

While both roles work within AI and tech environments, Ai Test Engineers focus on testing and validating AI systems, ensuring quality and performance. Data Scientists analyze data to develop models and insights. The roles are complementary but distinct in their core responsibilities.

What are AI Test Engineers?

AI Test Engineers are professionals who design, develop, and execute tests to evaluate the performance, accuracy, and reliability of artificial intelligence systems and machine learning models. They work closely with data scientists and software developers to ensure AI solutions function as intended, identifying bugs, biases, and potential risks in algorithms. Their responsibilities often include creating test cases, automating test processes, and analyzing results to improve AI system quality and compliance.

What are some common challenges AI Test Engineers face when validating machine learning models?

AI Test Engineers often encounter challenges such as ensuring the quality and fairness of machine learning models, identifying edge cases that the model may not handle well, and working with limited labeled data for testing. Additionally, interpreting test results can be complex due to the probabilistic nature of AI outputs, requiring close collaboration with data scientists to understand model behaviors. Effective communication and a strong foundation in both software testing and AI concepts are essential to address these challenges and ensure reliable AI solutions.

What are the key skills and qualifications needed to thrive as an AI Test Engineer, and why are they important?

To thrive as an AI Test Engineer, you need a strong background in computer science, software testing methodologies, and a good understanding of machine learning concepts, often supported by a relevant degree. Familiarity with programming languages like Python, testing frameworks such as pytest, and tools like TensorFlow or PyTorch, along with certifications in software testing or AI, are typically required. Analytical thinking, attention to detail, and effective communication set top performers apart in this role. These skills and qualities are crucial for ensuring the reliability, accuracy, and ethical deployment of AI systems.
What job categories do people searching Ai Test Engineer jobs in Quebec look for? The top searched job categories for Ai Test Engineer jobs in Quebec are:
Infographic showing various Ai Test Engineer job openings in Quebec as of July 2026, with employment types broken down into 100% Full Time. Highlights an 33% In-person, 34% Hybrid, and 33% Remote job distribution.
Software Development Engineer in Test

Software Development Engineer in Test

Sun Life Financial

Montreal, QC • On-site, Remote

Full-time

This job post has expired today. Applications are no longer accepted.


Sun Life Assurance Company of Canada rating

8.6

Company rating: 8.6 out of 10

Based on 18 frontline employees who took The Breakroom Quiz

82nd of 281 rated insurance


Job description

You are as unique as your background, experience and point of view. Here, you'll be encouraged, empowered and challenged to be your best self. You'll work with dynamic colleagues - experts in their fields - who are eager to share their knowledge with you. Your leaders will inspire and help you reach your potential and soar to new heights. Every day, you'll have new and exciting opportunities to make life brighter for our Clients - who are at the heart of everything we do. Discover how you can make a difference in the lives of individuals, families and communities around the world.

Job Description:

As a member of the AOSQE, the Software Development Engineer in Test will provide automated testing services and quality assurance activities throughout the systems development life cycle for agile projects. This role is focused on Mainframe and backend application delivery in an Agile team - specifically backend services and requires an experienced candidate who can design and develop Automated testing for functional, regression and technical tests.
What will you do?

  • Contribute to the analysis of complex business requirements and creating automated test scripts to ensure thorough coverage
  • Design, develop detailed test cases to thoroughly test complex use cases and scenarios covering functional requirements with an automation first mindset
  • Execute manual and/or automated test cases to validate business application logic and identify software defects
  • Collaborate within cross-functional agile team on shift-left testing and automation reuse
  • Document and track product defects, providing detailed reproduction steps, expected and actual results
  • Contribute to the automation and quality engineering best practices within the Agile team
  • Provide timely and effective communication to management, relating to quality, resource and project issues & concerns
  • Navigate effectively through complex challenges, involving others to solve problems and achieve goals

What will you need to succeed?

  • 3-5 years of relevant work experience, including development and/or quality automation experience
  • Strong experience in execution of both manual and automated test cases, ensuring thorough validation of business application logic against defined requirements
  • Demonstrated ability to troubleshoot and work collaboratively with cross functional team members to analyze and resolve issues
  • Experience in functional, non-functional, regression, integration and end-to-end testing of Mainframe, backend web services applications
  • Hands on automation experience in test automation frameworks and tools like ReadyAPI, Bruno, Postman, Tricentis Tosca, Cucumber, Selenium
  • Experience in Agile methodologies, DevOps, shift-left and in-sprint testing, CI/CD pipeline integration and tools such as Jenkins, Jira/Confluence, qTest
  • Software engineering expertise combined with testing knowledge
  • Experience in Java, Groovy, Python or C#
  • Knowledge in MongoDB, SQL, DB2, IMS
  • Ability to create testing tools and utilities
  • Demonstrated knowledge in test automation frameworks and testing infrastructure, tools and ecosystems
  • Experience in prompt engineering in generative AI chatbots and agentic AI for testing
  • Excellent communications skills, able to convey complex technical concepts to business partners
  • High attention to detail, strong analytical skills, quick learner and autonomous
  • As this position is posted in several locations, we specify that bilingualism (French, English, both oral and written) is required for Quebec only for the frequent interactions with English and French-speaking colleagues or internal partners across Canada or worldwide.

The Base Pay range is for the primary location for which the job is posted. It may vary depending on the work location of the successful candidate or other factors. In addition to Base Pay, eligible Sun Life employees participate in various incentive plans, payment under which is discretionary and subject to individual and company performance. Certain sales focused roles have sales incentive plans based on individual or group sales results.

Diversity and inclusion have always been at the core of our values at Sun Life. A diverse workforce with wide perspectives and creative ideas benefits our Clients, the communities where we operate and all of us as colleagues. We welcome applications from qualified individuals from all backgrounds.

Persons with disabilities who need accommodation in the application process, or those needing job postings in an alternative format, may e-mail a request to thebrightside@sunlife.com.

We are proud to be a hybrid organization that offers our employees the choice and flexibility to work from both the office and virtually based on the needs of the business, our Clients and you! Several work options are available and can be discussed throughout the selection process depending on the role requirements and individual needs.

We may use artificial intelligence to support candidate sourcing, screening, interview scheduling.

We thank all applicants for showing an interest in this position. Only those selected for an interview will be contacted.

Salary Range:

65,000/65 000 - 105,000/105 000

Job Category:

IT - Application Development

Posting End Date:

09/07/2026

What Sun Life Assurance Company of Canada employees say

Pay

Benefits

Hours and flexibility

Workplace

Get the full story on Breakroom