... testing, release, and sustainment * Strong communication skills with the ability to engage business ... Exposure to AI agent tools and generative AI capabilities such as Copilot Studio, Azure AI, Azure ...
New
... testing, release, and sustainment * Strong communication skills with the ability to engage business ... Exposure to AI agent tools and generative AI capabilities such as Copilot Studio, Azure AI, Azure ...
New
... testing, release, and sustainment * Strong communication skills with the ability to engage business ... Exposure to AI agent tools and generative AI capabilities such as Copilot Studio, Azure AI, Azure ...
New
... testing, release, and sustainment * Strong communication skills with the ability to engage business ... Exposure to AI agent tools and generative AI capabilities such as Copilot Studio, Azure AI, Azure ...
New
... testing, release, and sustainment * Strong communication skills with the ability to engage business ... Exposure to AI agent tools and generative AI capabilities such as Copilot Studio, Azure AI, Azure ...
New
... testing, release, and sustainment * Strong communication skills with the ability to engage business ... Exposure to AI agent tools and generative AI capabilities such as Copilot Studio, Azure AI, Azure ...
New
... testing, release, and sustainment * Strong communication skills with the ability to engage business ... Exposure to AI agent tools and generative AI capabilities such as Copilot Studio, Azure AI, Azure ...
New
... testing, release, and sustainment * Strong communication skills with the ability to engage business ... Exposure to AI agent tools and generative AI capabilities such as Copilot Studio, Azure AI, Azure ...
New
Conversational AI | Prompt Engineer
Montreal, QC · On-site +1
... MEDFAR's generative AI features -- most notably CoeurWay, our AI-powered clinical scribe, and ... testing for prompt changes, and documentation of known limitations. * Design and implement new ...
Quick apply
Conversational AI | Prompt Engineer
Montreal, QC · On-site +1
... MEDFAR's generative AI features -- most notably CoeurWay, our AI-powered clinical scribe, and ... testing for prompt changes, and documentation of known limitations. * Design and implement new ...
... MEDFAR's generative AI features -- most notably CoeurWay, our AI-powered clinical scribe, and ... testing for prompt changes, and documentation of known limitations. * Design and implement new ...
Quick apply
... MEDFAR's generative AI features -- most notably CoeurWay, our AI-powered clinical scribe, and ... testing for prompt changes, and documentation of known limitations. * Design and implement new ...
Senior Advisor - HR Innovation and AI
Quebec, QC · Hybrid
CA$80K - CA$115K/yr
Designing, prototyping, and testing AI solutions applied to HR (assistants, automations, decision ... Demonstrates a strong understanding of generative AI, automation, and intelligent assistants. * Is ...
Senior Advisor - HR Innovation and AI
Quebec, QC · Hybrid
CA$80K - CA$115K/yr
Designing, prototyping, and testing AI solutions applied to HR (assistants, automations, decision ... Demonstrates a strong understanding of generative AI, automation, and intelligent assistants. * Is ...
Senior Advisor - HR Innovation and AI
Montreal, QC · Hybrid
CA$80K - CA$115K/yr
Designing, prototyping, and testing AI solutions applied to HR (assistants, automations, decision ... Demonstrates a strong understanding of generative AI, automation, and intelligent assistants. * Is ...
Senior Advisor - HR Innovation and AI
Montreal, QC · Hybrid
CA$80K - CA$115K/yr
Designing, prototyping, and testing AI solutions applied to HR (assistants, automations, decision ... Demonstrates a strong understanding of generative AI, automation, and intelligent assistants. * Is ...
Senior Advisor - HR Innovation and AI
Montreal, QC · Hybrid
CA$80K - CA$115K/yr
Designing, prototyping, and testing AI solutions applied to HR (assistants, automations, decision ... Demonstrates a strong understanding of generative AI, automation, and intelligent assistants. * Is ...
Senior Advisor - HR Innovation and AI
Montreal, QC · Hybrid
CA$80K - CA$115K/yr
Designing, prototyping, and testing AI solutions applied to HR (assistants, automations, decision ... Demonstrates a strong understanding of generative AI, automation, and intelligent assistants. * Is ...
Senior Advisor - HR Innovation and AI
Quebec, QC · Hybrid
CA$80K - CA$115K/yr
Designing, prototyping, and testing AI solutions applied to HR (assistants, automations, decision ... Demonstrates a strong understanding of generative AI, automation, and intelligent assistants. * Is ...
Senior Advisor - HR Innovation and AI
Quebec, QC · Hybrid
CA$80K - CA$115K/yr
Designing, prototyping, and testing AI solutions applied to HR (assistants, automations, decision ... Demonstrates a strong understanding of generative AI, automation, and intelligent assistants. * Is ...
QA Lead - Capital Markets
Montreal, QC · On-site
Job Summary Location: Halifax or Montreal AI Systems and Models Testing Design and execute ... Apply evaluation metrics specific to generative AI and establish appropriate thresholds. Test AI ...
QA Lead - Capital Markets
Montreal, QC · On-site
Job Summary Location: Halifax or Montreal AI Systems and Models Testing Design and execute ... Apply evaluation metrics specific to generative AI and establish appropriate thresholds. Test AI ...
QA Lead - Capital Markets
Montreal, QC · On-site
Job Summary Location: Halifax or Montreal AI Systems and Models Testing Design and execute ... Apply evaluation metrics specific to generative AI and establish appropriate thresholds. Test AI ...
Quick apply
QA Lead - Capital Markets
Montreal, QC · On-site
Job Summary Location: Halifax or Montreal AI Systems and Models Testing Design and execute ... Apply evaluation metrics specific to generative AI and establish appropriate thresholds. Test AI ...
Tech Analyst, Data and AI
Dorval, QC · On-site
Scramble and generate mock data for testing purposes. * Identify and document technical debt ... Experience with prompt engineering and leveraging Generative AI (GenAI) to accelerate development ...
Tech Analyst, Data and AI
Dorval, QC · On-site
Scramble and generate mock data for testing purposes. * Identify and document technical debt ... Experience with prompt engineering and leveraging Generative AI (GenAI) to accelerate development ...
Misinformation is a critical societal challenge, especially as we enter the generative AI era. As ... Experience with testing and version control * Experience with APIs, web services and RESTFul ...
Quick apply
Misinformation is a critical societal challenge, especially as we enter the generative AI era. As ... Experience with testing and version control * Experience with APIs, web services and RESTFul ...
Participate in testing strategy and functional validation \n * Collaborate with BI, AI, Data ... Generative AI and NLP (fine\-tuning, prompt engineering, model integration) \n * Python (required ...
Participate in testing strategy and functional validation \n * Collaborate with BI, AI, Data ... Generative AI and NLP (fine\-tuning, prompt engineering, model integration) \n * Python (required ...
Misinformation is a critical societal challenge, especially as we enter the generative AI era. As ... Experience with testing and version control * Experience with APIs, web services and RESTFul ...
Misinformation is a critical societal challenge, especially as we enter the generative AI era. As ... Experience with testing and version control * Experience with APIs, web services and RESTFul ...
... design, testing phases, training, and updating documentation; * using AI tools on a daily basis (e.g., copilots, generative AI) to: -assist in drafting and reviewing functional and technical ...
... design, testing phases, training, and updating documentation; * using AI tools on a daily basis (e.g., copilots, generative AI) to: -assist in drafting and reviewing functional and technical ...
... design, testing phases, training, and updating documentation; using AI tools on a daily basis (e.g., copilots, generative AI) to: -assist in drafting and reviewing functional and technical ...
... design, testing phases, training, and updating documentation; using AI tools on a daily basis (e.g., copilots, generative AI) to: -assist in drafting and reviewing functional and technical ...
... design, testing phases, training, and updating documentation; * using AI tools on a daily basis (e.g., copilots, generative AI) to: -assist in drafting and reviewing functional and technical ...
... design, testing phases, training, and updating documentation; * using AI tools on a daily basis (e.g., copilots, generative AI) to: -assist in drafting and reviewing functional and technical ...
Leverage Generative AI tools and coding assistants to enhance development velocity and solution ... Testing: Ability to write thorough unit tests covering all major logic components, preferably using ...
Leverage Generative AI tools and coding assistants to enhance development velocity and solution ... Testing: Ability to write thorough unit tests covering all major logic components, preferably using ...
Generative Ai Testing information
What is the difference between Generative Ai Testing vs Data Scientist?
| Aspect | Generative Ai Testing | Data Scientist |
|---|---|---|
| Required Credentials | Knowledge of AI models, testing tools, programming skills | Statistics, programming, data analysis certifications |
| Work Environment | AI development teams, testing labs, tech companies | Research labs, tech firms, finance, healthcare |
| Employer & Industry Usage | AI product testing, quality assurance in tech | Data analysis, predictive modeling across industries |
Generative Ai Testing focuses on evaluating and validating AI-generated content and models, ensuring quality and accuracy. Data Scientists analyze data, build models, and derive insights. While both roles require programming and AI knowledge, Generative Ai Testing emphasizes testing processes, whereas Data Scientists focus on data analysis and model development.
What are the key skills and qualifications needed to thrive as a Generative AI Testing Specialist, and why are they important?
To thrive as a Generative AI Testing Specialist, you need a robust understanding of machine learning principles, model evaluation techniques, and a background in computer science or a related field. Familiarity with tools such as Python, TensorFlow, PyTorch, and model evaluation frameworks, as well as experience with automated testing platforms, is typically required. Analytical thinking, attention to detail, and strong communication skills help you identify model weaknesses and collaborate effectively with development teams. These skills are crucial to ensure the reliability, safety, and ethical deployment of generative AI solutions.
What are some common challenges faced when testing generative AI models, and how can I prepare to address them in this role?
Testing generative AI models often involves unique challenges such as evaluating the quality and relevance of generated content, detecting bias or inappropriate outputs, and ensuring model consistency across various prompts. You may work closely with data scientists and engineers to create robust evaluation frameworks and develop automated as well as manual testing strategies. Familiarity with prompt engineering, statistical evaluation techniques, and domain-specific knowledge will help you address these challenges effectively. Proactively staying updated on industry best practices and collaborating with cross-functional teams are key to success in this dynamic field.
What is Generative AI Testing?
Generative AI Testing refers to the process of evaluating and validating AI systems, particularly those that generate content such as text, images, or code. This type of testing focuses on assessing the accuracy, reliability, fairness, and safety of generative models to ensure they function as intended and avoid producing harmful or biased outputs. Testers use various methods, including automated and manual techniques, to check for issues like hallucinations, inappropriate content, or security vulnerabilities. The goal is to build trust in generative AI systems and ensure they meet quality and ethical standards before deployment.
What job categories do people searching Generative Ai Testing jobs in Quebec look for? The top searched job categories for Generative Ai Testing jobs in Quebec are:
Full-time
Posted yesterday
Job description
Overview
What you will do
What you bring to the role
Our Values, The KPMG Way
At KPMG in Canada, our people bring their unique perspectives to Canada’s most important challenges. Here, you can build momentum that reaches beyond our business, develop skills for the future, and take ownership of your career with support at every stage. Join a firm where your career can make a difference.
We are seeking an AI Agent and Application Development Delivery Lead to join our ITS Application Development team. This role is designed for someone with prior hands-on experience in application, automation, or AI agent development who is ready to move into a delivery leadership role supporting developers and contractors.
The role focuses on keeping technical delivery moving: managing the delivery backlog, aligning work to available capacity, supporting contractor onboarding and utilization, resolving blockers, and helping solutions progress from intake through build, release, and sustainment.
What you will do
- Lead day-to-day delivery of AI agent, automation, and application development work across internal developers and contractors
- Maintain and prioritize the development delivery backlog, ensuring work items are clear, sequenced, and assigned to the right technical owners
- Manage developer and contractor capacity, including availability, skill alignment, onboarding status, forecasted demand, utilization, and delivery throughput
- Guide intake, triage, and assignment of new AI agent, Power Platform, and application development requests based on business value, complexity, risk, and available capacity
- Provide practical technical oversight by reviewing solution approaches, dependencies, quality expectations, and release readiness with developers
- Partner with architects, security, infrastructure, product owners, business stakeholders, and development teams to remove blockers and maintain delivery momentum
- Support agile delivery routines, including backlog refinement, planning, stand-ups, retrospectives, acceptance criteria, and release coordination
- Oversee contractor-related activities such as onboarding requests, work allocation, timesheet and invoice validation, budget burn, and spend visibility in partnership with internal teams
- Maintain lightweight delivery documentation, handoffs, and decision records to improve consistency, knowledge transfer, and sustainment
- Identify recurring delivery friction points and recommend practical improvements to intake, resource allocation, tracking, and communication
What you bring to the role
- Bachelor’s degree in Computer Science, Information Technology, Engineering, or equivalent practical experience
- Prior hands-on experience in enterprise application development, AI agent development, intelligent automation, integrations, or Microsoft Power Platform solutions
- Experience guiding developers, contractors, or technical delivery teams while staying close enough to the work to understand effort, blockers, and quality risks
- Strong understanding of agile software delivery and backlog management in a technical development environment
- Ability to translate business needs into clear technical work items and help teams move from intake through build, testing, release, and sustainment
- Strong communication skills with the ability to engage business users, developers, architects, security partners, and senior stakeholders
- Ability to manage multiple delivery priorities, balance capacity, and make practical trade-offs in a fast-paced environment
- Comfort with ambiguity and a willingness to take ownership of outcomes, unblock teams, and improve delivery practices
- Working knowledge of AI agent and application development concepts, with hands-on background to guide developers and assess delivery risks
- Experience with Microsoft Power Platform, including Power Apps, Power Automate,Power BI,Dataverse, and related solution delivery practices
- Exposure to AI agent tools and generative AI capabilities such as Copilot Studio, Azure AI, Azure OpenAI, or similar platforms
- Understanding of integrations, APIs, SharePoint Online, ServiceNow, Moveworks Agent Studio, or comparable enterprise platforms
- Familiarity with agile delivery methods, DevOps basics, backlog management, testing expectations, and release readiness
- Ability to evaluate estimates, sequencing, dependencies, risks, and trade-offs for AI agent and application development work
- Relevant Microsoft, Azure, Power Platform, or AI certifications are considered an asset
This position requires written and oral fluency in English. The successful candidate will be required to support or collaborate with English-speaking colleagues or stakeholders nationally in our English speaking provinces while at KPMG.
KPMG BC Region Pay Range Information
The expected base salary range for this position is $75,600 to $114,600 and may be eligible for bonus awards. The determination of an applicant’s base salary within this range is based on the individual’s location, skills & competencies, and unique qualifications. In addition, KPMG offers a comprehensive and competitive Total Rewards program.
KPMG Ontario Region Pay Range Information
The expected base salary range for this position is $75,600 to $114,600 and may be eligible for bonus awards. The determination of an applicant’s base salary within this range is based on the individual’s location, skills & competencies, and unique qualifications. In addition, KPMG offers a comprehensive and competitive Total Rewards program.
Providing you with the support you need to be at your best
Our Values, The KPMG Way
Integrity, we do what is right | Excellence, we never stop learning and improving | Courage, we think and act boldly | Together, we respect each other and draw strength from our differences | For Better, we do what matters
KPMG in Canada is a proud equal opportunities employer and we are committed to creating a respectful, inclusive and barrier-free workplace that allows all of our people to reach their full potential. A diverse workforce is key to our success and we believe in bringing your whole self to work. We welcome all qualified candidates to apply and hope you will choose KPMG in Canada as your employer of choice.
Adjustments and accommodations throughout the recruitment process
At KPMG, we are committed to fostering an inclusive recruitment process where all candidates can be themselves and excel. We aim to provide a positive experience and are prepared to offer adjustments or accommodations to help you perform at your best. Adjustments (informal requests), such as extra preparation time or the option for micro breaks during interviews, and accommodations (formal requests), such as accessible communication supports or technology aids, are tailored to individual needs and role requirements. You will have an opportunity to request an adjustment or accommodation at any point throughout the recruitment process. If you require support, please contact KPMG’s Employee Relations Service team by calling 1-888-466-4778.
AI Usage
Weembrace the use of artificial intelligence (AI) to enhance the candidate experience and streamline our recruitment processes. AI tools may help with organizing applications or surfacing relevant qualifications. However, no hiring decisions are made using AI. Every hiring decision is made by our hiring managers and recruitment professionals, who are equipped with training that empowers them to use these tools responsibly. AI technologies used in our recruitment process undergo detailed risk assessments, including security and privacy requirements, that align with KPMG’s Trusted AI framework.
We believe technology should empower human judgment, not replace it. It’s one of the many ways we’re delivering on our vision of being a technology-first, people-driven firm.
Qualifications:- Bachelor’s degree in Computer Science, Information Technology, Engineering, or equivalent practical experience
- Prior hands-on experience in enterprise application development, AI agent development, intelligent automation, integrations, or Microsoft Power Platform solutions
- Experience guiding developers, contractors, or technical delivery teams while staying close enough to the work to understand effort, blockers, and quality risks
- Strong understanding of agile software delivery and backlog management in a technical development environment
- Ability to translate business needs into clear technical work items and help teams move from intake through build, testing, release, and sustainment
- Strong communication skills with the ability to engage business users, developers, architects, security partners, and senior stakeholders
- Ability to manage multiple delivery priorities, balance capacity, and make practical trade-offs in a fast-paced environment
- Comfort with ambiguity and a willingness to take ownership of outcomes, unblock teams, and improve delivery practices
- Working knowledge of AI agent and application development concepts, with hands-on background to guide developers and assess delivery risks
- Experience with Microsoft Power Platform, including Power Apps, Power Automate,Power BI,Dataverse, and related solution delivery practices
- Exposure to AI agent tools and generative AI capabilities such as Copilot Studio, Azure AI, Azure OpenAI, or similar platforms
- Understanding of integrations, APIs, SharePoint Online, ServiceNow, Moveworks Agent Studio, or comparable enterprise platforms
- Familiarity with agile delivery methods, DevOps basics, backlog management, testing expectations, and release readiness
- Ability to evaluate estimates, sequencing, dependencies, risks, and trade-offs for AI agent and application development work
- Relevant Microsoft, Azure, Power Platform, or AI certifications are considered an asset
This position requires written and oral fluency in English. The successful candidate will be required to support or collaborate with English-speaking colleagues or stakeholders nationally in our English speaking provinces while at KPMG.
KPMG BC Region Pay Range Information
The expected base salary range for this position is $75,600 to $114,600 and may be eligible for bonus awards. The determination of an applicant’s base salary within this range is based on the individual’s location, skills & competencies, and unique qualifications. In addition, KPMG offers a comprehensive and competitive Total Rewards program.
KPMG Ontario Region Pay Range Information
The expected base salary range for this position is $75,600 to $114,600 and may be eligible for bonus awards. The determination of an applicant’s base salary within this range is based on the individual’s location, skills & competencies, and unique qualifications. In addition, KPMG offers a comprehensive and competitive Total Rewards program.
Providing you with the support you need to be at your best
Education:UNAVAILABLEEmployment Type: FULL_TIME