1

Ai Test Engineer Jobs in Quebec (NOW HIRING)

As an AI Controls Engineer & Integrator, you will play a pivotal role in the delivery of the BBAI ... Test and deploy different algorithms for project deployment and share the report to different ...

New

Effectuer les tests et la validation des AI skills avant la revision finale et le deploiement ... Experience avec les LLMs, le prompt engineering ou les outils AI workflows * A l'aise dans un ...

Calibrating control parameters based on test data * Documenting control logic, state machines, and ... Ability to leverage AI tools to enhance and support engineering work Preferred Skills * Experience ...

Use AI-assisted test prioritization and selective execution to reduce cycle time while keeping ... Developer enablement & platform toolingBuild internal delivery tooling, self-service pipeline ...

Use AI-assisted test prioritization and selective execution to reduce cycle time while keeping ... Developer enablement & platform tooling * Build internal delivery tooling, self-service pipeline ...

As a Junior Machine Learning Engineer on the Global AI Team, you will support the design ... Develop, train, test, and evaluate conventional machine learning and deep learning models. * Work ...

New

Showing results 21-40

Ai Test Engineer information

What is the difference between Ai Test Engineer vs Data Scientist?

AspectAi Test EngineerData Scientist
Required CredentialsBachelor's in CS, AI, or related field; knowledge of testing toolsBachelor's or higher in CS, Statistics, or related; proficiency in data analysis
Work EnvironmentSoftware testing teams, AI development projectsData analysis teams, AI research projects
Employer & Industry UsageTech companies, AI startups, software firmsTech companies, finance, healthcare, research institutions
Common Search & ComparisonOften compared for roles in AI testing and quality assuranceCompared for data analysis and AI model development roles

While both roles work within AI and tech environments, Ai Test Engineers focus on testing and validating AI systems, ensuring quality and performance. Data Scientists analyze data to develop models and insights. The roles are complementary but distinct in their core responsibilities.

What is an AI test engineer?

AI Test Engineers are professionals who design, develop, and execute tests to evaluate the performance, accuracy, and reliability of artificial intelligence systems and machine learning models. They work closely with data scientists and software developers to ensure AI solutions function as intended, identifying bugs, biases, and potential risks in algorithms. Their responsibilities often include creating test cases, automating test processes, and analyzing results to improve AI system quality and compliance.

What are some common challenges AI test engineers face when validating machine learning models?

AI Test Engineers often encounter challenges such as ensuring the quality and fairness of machine learning models, identifying edge cases that the model may not handle well, and working with limited labeled data for testing. Additionally, interpreting test results can be complex due to the probabilistic nature of AI outputs, requiring close collaboration with data scientists to understand model behaviors. Effective communication and a strong foundation in both software testing and AI concepts are essential to address these challenges and ensure reliable AI solutions.

What are the key skills and qualifications needed to thrive as an AI test engineer?

To thrive as an AI Test Engineer, you need a strong background in computer science, software testing methodologies, and a good understanding of machine learning concepts, often supported by a relevant degree. Familiarity with programming languages like Python, testing frameworks such as pytest, and tools like TensorFlow or PyTorch, along with certifications in software testing or AI, are typically required. Analytical thinking, attention to detail, and effective communication set top performers apart in this role. These skills and qualities are crucial for ensuring the reliability, accuracy, and ethical deployment of AI systems.
What job categories do people searching Ai Test Engineer jobs in Quebec look for? The top searched job categories for Ai Test Engineer jobs in Quebec are:
Infographic showing various Ai Test Engineer job openings in Quebec as of August 2026, with employment types broken down into 8% Internship, 76% Full Time, and 16% Contract. Highlights an 87% In-person, and 13% Remote job distribution.

Manager, Software Delivery Developer - Gen AI and AI-Accelerated Modernization

KPMG

Montreal, QC

Full-time

Re-posted 12 days ago


Job description

Overview

At KPMG in Canada, our people bring their unique perspectives to Canada’s most important challenges. Here, you can build momentum that reaches beyond our business, develop skills for the future, and take ownership of your career with support at every stage. Join a firm where your career can make a difference.

Our Gen AI and Software Delivery team helps clients modernize applications, accelerate delivery, and introduce responsible AI practices across the software development lifecycle. 

As a Manager, Software Delivery Developer, you will combine hands-on technical leadership with team management and client delivery. You will lead development workstreams, guide architecture and engineering decisions, mentor developers, and help clients adopt modern software delivery practices supported by automation and Gen AI. 


What you will do
  • Lead software delivery workstreams for custom applications, cloud-native platforms, integrations, APIs, and modernization programs. 
  • Provide hands-on technical direction across design, development, testing, deployment, and production readiness. 
  • Translate business needs into practical technical solutions, delivery plans, estimates, and team backlogs. 
  • Review architecture, code, test strategies, release plans, and technical deliverables. 
  • Coach and mentor senior consultants and consultants on engineering practices, technical problem solving, and client delivery. 
  • Help teams use AI-assisted engineering practices responsibly across requirements, design, coding, testing, documentation, and support. 
  • Collaborate with project managers, architects, product owners, designers, data teams, security teams, and client stakeholders. 
  • Support proposal development, solution shaping, estimation, and statements of work. 
  • Identify technical risks and drive mitigation plans with the team and client stakeholders. 

What you bring to the role
  • 7+ years of experience designing, building, and delivering software solutions. 
  • Experience leading developers or technical delivery workstreams in consulting, enterprise, or product environments. 
  • Strong development experience with C# and .NET, plus one or more modern languages or frameworks such as Java, JavaScript/TypeScript, Python, or similar. 
  • Experience designing and delivering solutions on Microsoft Azure, including Azure application, integration, data, DevOps, or cloud-native services. 
  • Experience with Next.js is a nice-to-have. 
  • Knowledge of APIs, microservices, event-driven architecture, integration patterns, databases, and secure development practices. 
  • Experience with DevOps, CI/CD, automated testing, version control, observability, and release management. 
  • Familiarity with AI-assisted development tools, Gen AI patterns, prompt engineering for delivery tasks, or AI-accelerated SDLC practices is an asset. 
  • Strong communication skills with the ability to explain technical concepts to business and technical audiences. 
  • Entrepreneurial spirit, strong sense of ownership, and ability to work in a fast-paced environment. 
  • Fluency in French and english is required. 
  • University degree in computer science, engineering, information systems, science, or a related field, or equivalent experience. 

Applications must include 

  • Resume
  • Cover letter

This position requires written and oral fluency in English because it involves interpretation and application of English standards, guidance, laws and regulations, servicing of English-speaking clients located across Canada and collaboration with English Speaking colleagues located outside of Quebec.

Providing you with the support you need to be at your best


Our Values, The KPMG Way

Integrity, we do what is right | Excellence, we never stop learning and improving | Courage, we think and act boldly | Together, we respect each other and draw strength from our differences | For Better, we do what matters

KPMG in Canada is a proud equal opportunities employer and we are committed to creating a respectful, inclusive and barrier-free workplace that allows all of our people to reach their full potential. A diverse workforce is key to our success and we believe in bringing your whole self to work. We welcome all qualified candidates to apply and hope you will choose KPMG in Canada as your employer of choice.

Adjustments and accommodations throughout the recruitment process

At KPMG, we are committed to fostering an inclusive recruitment process where all candidates can be themselves and excel. We aim to provide a positive experience and are prepared to offer adjustments or accommodations to help you perform at your best. Adjustments (informal requests), such as extra preparation time or the option for micro breaks during interviews, and accommodations (formal requests), such as accessible communication supports or technology aids, are tailored to individual needs and role requirements. You will have an opportunity to request an adjustment or accommodation at any point throughout the recruitment process. If you require support, please contact KPMG’s Employee Relations Service team by calling 1-888-466-4778.

AI Usage

Weembrace the use of artificial intelligence (AI) to enhance the candidate experience and streamline our recruitment processes. AI tools may help with organizing applications or surfacing relevant qualifications. However, no hiring decisions are made using AI. Every hiring decision is made by our hiring managers and recruitment professionals, who are equipped with training that empowers them to use these tools responsibly. AI technologies used in our recruitment process undergo detailed risk assessments, including security and privacy requirements, that align with KPMG’s Trusted AI framework.

We believe technology should empower human judgment, not replace it. It’s one of the many ways we’re delivering on our vision of being a technology-first, people-driven firm.

Qualifications:
  • 7+ years of experience designing, building, and delivering software solutions. 
  • Experience leading developers or technical delivery workstreams in consulting, enterprise, or product environments. 
  • Strong development experience with C# and .NET, plus one or more modern languages or frameworks such as Java, JavaScript/TypeScript, Python, or similar. 
  • Experience designing and delivering solutions on Microsoft Azure, including Azure application, integration, data, DevOps, or cloud-native services. 
  • Experience with Next.js is a nice-to-have. 
  • Knowledge of APIs, microservices, event-driven architecture, integration patterns, databases, and secure development practices. 
  • Experience with DevOps, CI/CD, automated testing, version control, observability, and release management. 
  • Familiarity with AI-assisted development tools, Gen AI patterns, prompt engineering for delivery tasks, or AI-accelerated SDLC practices is an asset. 
  • Strong communication skills with the ability to explain technical concepts to business and technical audiences. 
  • Entrepreneurial spirit, strong sense of ownership, and ability to work in a fast-paced environment. 
  • Fluency in French and english is required. 
  • University degree in computer science, engineering, information systems, science, or a related field, or equivalent experience. 

Applications must include 

  • Resume
  • Cover letter

This position requires written and oral fluency in English because it involves interpretation and application of English standards, guidance, laws and regulations, servicing of English-speaking clients located across Canada and collaboration with English Speaking colleagues located outside of Quebec.

Providing you with the support you need to be at your best

Education:UNAVAILABLEEmployment Type: FULL_TIME