Contribute to the design and implementation of generative AI architectures, including RAG ... by contributing to testing strategies, continuous deployment, and continuous improvement ...
Contribute to the design and implementation of generative AI architectures, including RAG ... by contributing to testing strategies, continuous deployment, and continuous improvement ...
Contribute to the design and implementation of generative AI architectures, including RAG ... by contributing to testing strategies, continuous deployment, and continuous improvement ...
Contribute to the design and implementation of generative AI architectures, including RAG ... by contributing to testing strategies, continuous deployment, and continuous improvement ...
Contribute to the design and implementation of generative AI architectures, including RAG ... by contributing to testing strategies, continuous deployment, and continuous improvement ...
Contribute to the design and implementation of generative AI architectures, including RAG ... by contributing to testing strategies, continuous deployment, and continuous improvement ...
Prepayment, LCR and NCCF models, including economic capital calculations and stress testing ... Knowledge of generative AI, natural language processing and speech recognition models, including ...
Prepayment, LCR and NCCF models, including economic capital calculations and stress testing ... Knowledge of generative AI, natural language processing and speech recognition models, including ...
As part of our growing AI team, you'll develop intelligent agents, generative AI applications, and ... Implement development best practices, including testing, CI/CD, observability, monitoring, and ...
As part of our growing AI team, you'll develop intelligent agents, generative AI applications, and ... Implement development best practices, including testing, CI/CD, observability, monitoring, and ...
Experience with generative AI platforms and tools beyond Microsoft, such as ChatGPT Enterprise ... testing, version control, documentation, and deployment. * Strong understanding of security ...
Experience with generative AI platforms and tools beyond Microsoft, such as ChatGPT Enterprise ... testing, version control, documentation, and deployment. * Strong understanding of security ...
... of generative and agentic AI solutions. The successful candidate will combine significant ... engineering, testing, and integration with existing systems. * Mentor and develop a ...
... of generative and agentic AI solutions. The successful candidate will combine significant ... engineering, testing, and integration with existing systems. * Mentor and develop a ...
You'll define the GEO and AI content development and distribution strategy, architect the operating ... Run continuous testing across prompts, formats, and content pillars to improve model and business ...
You'll define the GEO and AI content development and distribution strategy, architect the operating ... Run continuous testing across prompts, formats, and content pillars to improve model and business ...
You'll define the GEO and AI content development and distribution strategy, architect the operating ... Run continuous testing across prompts, formats, and content pillars to improve model and business ...
You'll define the GEO and AI content development and distribution strategy, architect the operating ... Run continuous testing across prompts, formats, and content pillars to improve model and business ...
... testing. * Provide security architecture guidance for cloud-native, AI/ML, data-driven, and ... Monitor emerging technologies including AI, generative AI, connected infrastructure, digital twins ...
... testing. * Provide security architecture guidance for cloud-native, AI/ML, data-driven, and ... Monitor emerging technologies including AI, generative AI, connected infrastructure, digital twins ...
... testing. * Provide security architecture guidance for cloud-native, AI/ML, data-driven, and ... Monitor emerging technologies including AI, generative AI, connected infrastructure, digital twins ...
... testing. * Provide security architecture guidance for cloud-native, AI/ML, data-driven, and ... Monitor emerging technologies including AI, generative AI, connected infrastructure, digital twins ...
Testing, refining, and continuously improving internal AI systems as tools evolve. * Helping ... Strong understanding of current generative AI tools for writing, research, image generation, and ...
Testing, refining, and continuously improving internal AI systems as tools evolve. * Helping ... Strong understanding of current generative AI tools for writing, research, image generation, and ...
Design, develop, and deploy AI models and services, with a focus on LLMs and generative AI ... Apply DevOps/MLOps practices for continuous integration, automated testing, and model deployment
Design, develop, and deploy AI models and services, with a focus on LLMs and generative AI ... Apply DevOps/MLOps practices for continuous integration, automated testing, and model deployment
Agentic Engineer, Innovation
Montreal, QC · On-site
Build predictive, generative, and agentic AI solutions using sound machine learning, evaluation ... Operationalize AI solutions with testing, observability, monitoring, reliability controls ...
Agentic Engineer, Innovation
Montreal, QC · On-site
Build predictive, generative, and agentic AI solutions using sound machine learning, evaluation ... Operationalize AI solutions with testing, observability, monitoring, reliability controls ...
Java Spark Developer
Montreal, QC · On-site
Participate in testing and validation of AI-enabled workflows and solutions. Collaborate with teams exploring generative AI and intelligent automation use cases. Collaboration & Leadership ...
Java Spark Developer
Montreal, QC · On-site
Participate in testing and validation of AI-enabled workflows and solutions. Collaborate with teams exploring generative AI and intelligent automation use cases. Collaboration & Leadership ...
... testing, machine learning and deep learning techniques. * Work with the Analytics team to support ... Demonstrated experience using AI (e.g. generative AI, large language models) for solving problems.
New
... testing, machine learning and deep learning techniques. * Work with the Analytics team to support ... Demonstrated experience using AI (e.g. generative AI, large language models) for solving problems.
New
SAP BTP Developer/ Developpeur SAP BTP
Montreal, QC · On-site +1
... testing, and deploying solutions with the SAP BTP. * Familiarity with SAP Cloud, HANA, and other SAP cloud platforms. * Proven experience in developing solutions using Python and Generative AI.
SAP BTP Developer/ Developpeur SAP BTP
Montreal, QC · On-site +1
... testing, and deploying solutions with the SAP BTP. * Familiarity with SAP Cloud, HANA, and other SAP cloud platforms. * Proven experience in developing solutions using Python and Generative AI.
... testing, and deploying solutions with the SAP BTP. * Familiarity with SAP Cloud, HANA, and other SAP cloud platforms. * Proven experience in developing solutions using Python and Generative AI.
Quick apply
... testing, and deploying solutions with the SAP BTP. * Familiarity with SAP Cloud, HANA, and other SAP cloud platforms. * Proven experience in developing solutions using Python and Generative AI.
AI/ML DevOps Developer
Montreal, QC · Hybrid
... generative artificial intelligence (GenAI) solutions and large language models (LLMs) used by our ... Ensure the management, evolution, and reliability of production, testing and development ...
AI/ML DevOps Developer
Montreal, QC · Hybrid
... generative artificial intelligence (GenAI) solutions and large language models (LLMs) used by our ... Ensure the management, evolution, and reliability of production, testing and development ...
AI/ML DevOps Developer
Levis, QC · Hybrid
... generative artificial intelligence (GenAI) solutions and large language models (LLMs) used by our ... Ensure the management, evolution, and reliability of production, testing and development ...
AI/ML DevOps Developer
Levis, QC · Hybrid
... generative artificial intelligence (GenAI) solutions and large language models (LLMs) used by our ... Ensure the management, evolution, and reliability of production, testing and development ...
Generative Ai Testing information
What is generative AI testing?
Generative AI Testing refers to the process of evaluating and validating AI systems, particularly those that generate content such as text, images, or code. This type of testing focuses on assessing the accuracy, reliability, fairness, and safety of generative models to ensure they function as intended and avoid producing harmful or biased outputs. Testers use various methods, including automated and manual techniques, to check for issues like hallucinations, inappropriate content, or security vulnerabilities. The goal is to build trust in generative AI systems and ensure they meet quality and ethical standards before deployment.
What are some common challenges faced when testing generative AI models, and how can I prepare to address them in this role?
Testing generative AI models often involves unique challenges such as evaluating the quality and relevance of generated content, detecting bias or inappropriate outputs, and ensuring model consistency across various prompts. You may work closely with data scientists and engineers to create robust evaluation frameworks and develop automated as well as manual testing strategies. Familiarity with prompt engineering, statistical evaluation techniques, and domain-specific knowledge will help you address these challenges effectively. Proactively staying updated on industry best practices and collaborating with cross-functional teams are key to success in this dynamic field.
What are the key skills and qualifications needed to thrive as a generative AI testing specialist, and why are they important?
To thrive as a Generative AI Testing Specialist, you need a robust understanding of machine learning principles, model evaluation techniques, and a background in computer science or a related field. Familiarity with tools such as Python, TensorFlow, PyTorch, and model evaluation frameworks, as well as experience with automated testing platforms, is typically required. Analytical thinking, attention to detail, and strong communication skills help you identify model weaknesses and collaborate effectively with development teams. These skills are crucial to ensure the reliability, safety, and ethical deployment of generative AI solutions.
What is the difference between Generative Ai Testing vs Data Scientist?
| Aspect | Generative Ai Testing | Data Scientist |
|---|---|---|
| Required Credentials | Knowledge of AI models, testing tools, programming skills | Statistics, programming, data analysis certifications |
| Work Environment | AI development teams, testing labs, tech companies | Research labs, tech firms, finance, healthcare |
| Employer & Industry Usage | AI product testing, quality assurance in tech | Data analysis, predictive modeling across industries |
Generative Ai Testing focuses on evaluating and validating AI-generated content and models, ensuring quality and accuracy. Data Scientists analyze data, build models, and derive insights. While both roles require programming and AI knowledge, Generative Ai Testing emphasizes testing processes, whereas Data Scientists focus on data analysis and model development.
How do I become a Generative AI Testing?
To become a Generative AI Tester, develop skills in machine learning, natural language processing, and programming languages like Python. Gain experience with AI frameworks such as TensorFlow or PyTorch and understand data quality and model evaluation techniques. Relevant certifications and hands-on projects can enhance your qualifications for roles in AI testing environments.
Is Generative AI Testing a good career?
Generative AI Testing is a growing field within AI development, focusing on evaluating the quality and safety of AI-generated content. It requires skills in machine learning, programming, and understanding AI models, often involving tools like Python and TensorFlow. The role offers opportunities in tech companies and research labs, with demand expected to increase as AI applications expand.
What are popular job titles related to Generative Ai Testing jobs in Quebec?
For Generative Ai Testing jobs in Quebec, the most frequently searched job titles are:
What job categories do people searching Generative Ai Testing jobs in Quebec look for?
The top searched job categories for Generative Ai Testing jobs in Quebec are:
Senior Artificial Intelligence Solutions Designer
Quebec, QC • Hybrid
HollisWealth
Full-time
Retirement, PTO
Posted 16 days ago
Key responsibilities
Design, develop, and enhance artificial intelligence solutions, including conversational assistants, intelligent agents, and advanced automation solutions.
Design and build application components such as user interfaces, APIs, services, and integrations with existing systems.
Contribute to the design and implementation of generative AI architectures, including RAG approaches, semantic search, prompting mechanisms, conversational context management, and agent orchestration.
Job description
Job Description
Company
Build the Future with Us
Are you passionate about technological innovation and eager to contribute to the adoption of generative artificial intelligence within a leading organization? At iA Financial Group, we are accelerating the integration of AI solutions to enhance the experience of our employees, advisors, and clients while optimizing the efficiency of our operations.
As a Senior Artificial Intelligence Solutions Designer, you will play a key role in the design, development, integration, and evolution of intelligent products and agents powered by the latest AI technologies. You will transform business needs and target architectures into practical, secure, and scalable solutions, working closely with solution architects, ML engineers, data engineers, and delivery teams.
______________________________________________________________________________
What You Will Accomplish with Us
As a Senior Artificial Intelligence Solutions Designer, you will be at the heart of our mission. Your key responsibilities will include:
- Design, develop, and enhance artificial intelligence solutions, including conversational assistants, intelligent agents, and advanced automation solutions that address business needs.
- Design and build the required application components, including user interfaces, APIs, services, and integrations with existing corporate systems.
- Contribute to the design and implementation of generative AI architectures, including RAG approaches, semantic search, prompting mechanisms, conversational context management, and agent orchestration.
- Ensure the quality, performance, reliability, observability, and production readiness of solutions by contributing to testing strategies, continuous deployment, and continuous improvement initiatives.
- Integrate security, compliance, governance, and privacy requirements into solution design while helping manage risks associated with generative AI.
- Serve as a technical reference for delivery teams, support developers in adopting best practices, and contribute to architecture, planning, and estimation activities.
- Collaborate closely with stakeholders to integrate AI capabilities into business processes, optimize solution performance, and support the evolution of the organization's technology standards.
______________________________________________________________________________
What Could Help You Succeed in This Role
We are looking for someone who:
- Holds a bachelor's degree in Computer Science, Software Engineering, Computer Engineering, or a related field.
- Has a minimum of 8 years of experience in software development or technology solution design.
- Possesses significant experience in developing modern cloud-based solutions and delivering digital products in complex environments.
- Has hands-on experience delivering artificial intelligence projects.
- Demonstrates expertise in modern Full Stack development technologies, REST APIs, service-oriented architectures, and programming languages such as C#/.NET and Python.
- Has knowledge of generative AI technologies, including LLMs, Prompt Engineering, RAG architectures, intelligent agents, and AI orchestration tools.
- Stands out through intellectual curiosity, technical leadership, analytical thinking, results orientation, and strong communication and collaboration skills.
- Advanced proficiency in French and intermediate proficiency in English are required, as the successful candidate will be required to participate in meetings, collaborate with English-speaking teams and business partners, and consult or produce technical documentation on a regular basis.
______________________________________________________________________________
Why You'll Love Working with Us
- A work environment where learning and development combine with a shared pursuit of excellence.
- Artificial intelligence is in everyone's hands, empowering greater personal effectiveness and supporting organizational growth.
- A healthy, safe, equitable, and inclusive workplace where individuals can fully realize and develop their potential.
- The opportunity to work in a hybrid environment supported by flexibility and access to inspiring, innovative workspaces.
______________________________________________________________________________
Competitive Benefits
- Flexible group insurance plans
- Competitive retirement savings plan
- Employee share purchase plan
- Vacation program, wellness days, and personal development days
- Telemedicine services
- Employee and Family Assistance Program (EFAP)
- Ergonomic furniture program
- Performance bonus
- Discounts on iA products and much more!
______________________________________________________________________________
Apply now and get ahead of your career, where your talent really belongs!
______________________________________________________________________________
Not Sure About Applying?
At iA, we believe in potential and value diverse experiences. If this role inspires you, we encourage you to apply. Your place may be with us, and we would love to get to know you.
Location(s)Quebec / 1080, Grande Allee WestOther Possible Location(s)Montreal / 1981 McGill College AvenueCompany
iA Financial Group
Posting End Date2026-09-29Company OverviewiA Financial Group is the strength of a company with a human side, with its over 8,000 employees. Together, we have earned the trust of our more than four million clients and 25,000 advisors who have chosen us for their insurance, savings, and wealth management.
With over $200 billion in assets and half a billion invested in technological innovation, we're a key player in the financial services industry in Canada and the United States. The secret to our success? Investing in you, one person at a time. Because, for over 125 years, we have believed that it's by supporting our employees and surrounding ourselves with the most reputable leaders in the industry, we will continue to innovate.
At iA, we're invested in you.
iA Financial group includes the following entities: iA Services financiers, iA assurance auto et habitation, iA Gestion privee de patrimoine, PPI Management, Investia, iA Gestion de placements, Prysm, iA Clarington, Michel Rheaume et associes, Garanties Nationales, WGI Manufacturing, WGI Service Plan Division, Lubrico, iA Financement auto Our Commitment to Diversity and InclusionAt iA Financial Group, we support and celebrate diversity. We strive to provide a workplace that is recognized as inclusive for all, regardless of ethnic origin, nationality, language, religious beliefs, gender, sexual orientation, age, marital status, family situation, or physical or mental disability.
Please note that if you need help or assistance to make the recruitment process more accessible for you, please Contact us here. Someone from our team will be happy to assist you with your needs.