Apply generative AI techniques to generate synthetic data, create realistic simulations, and ... build processes, testing, and operations. * Strong collaboration and elaboration skills ...
Apply generative AI techniques to generate synthetic data, create realistic simulations, and ... build processes, testing, and operations. * Strong collaboration and elaboration skills ...
... testing, documentation, and continuous improvement. Enough about us, let's talk about you You are an enthusiastic technology professional with a passion for Generative AI, platform operations, and ...
New
... testing, documentation, and continuous improvement. Enough about us, let's talk about you You are an enthusiastic technology professional with a passion for Generative AI, platform operations, and ...
New
Senior Director, AI Research
Toronto, ON · On-site
... generative AI applications. As a member of RBC Borealis AI, you'll leverage RBC's unique data ... Evaluate new areas for AI investment, complete proof of concept testing and evaluation. Applied ...
Senior Director, AI Research
Toronto, ON · On-site
... generative AI applications. As a member of RBC Borealis AI, you'll leverage RBC's unique data ... Evaluate new areas for AI investment, complete proof of concept testing and evaluation. Applied ...
Senior Software Engineer
Toronto, ON · Hybrid
CA$142K - CA$158K/yr
New Relic, DataDog) Experience with automated testing frameworks (e.g. Selenium, Cypress ... Github Copilot) and knowledge of latest Generative AI Model capabilities would be an asset Bonus ...
Senior Software Engineer
Toronto, ON · Hybrid
CA$142K - CA$158K/yr
New Relic, DataDog) Experience with automated testing frameworks (e.g. Selenium, Cypress ... Github Copilot) and knowledge of latest Generative AI Model capabilities would be an asset Bonus ...
Intermediate Software Engineer
Mississauga, ON · Hybrid
CA$112K - CA$125K/yr
New Relic, DataDog) Experience with automated testing frameworks (e.g. Selenium, Cypress ... Github Copilot) and knowledge of latest Generative AI Model capabilities would be an asset Bonus ...
Intermediate Software Engineer
Mississauga, ON · Hybrid
CA$112K - CA$125K/yr
New Relic, DataDog) Experience with automated testing frameworks (e.g. Selenium, Cypress ... Github Copilot) and knowledge of latest Generative AI Model capabilities would be an asset Bonus ...
Senior Software Engineer (java/react)
Mississauga, ON · Hybrid
CA$142K - CA$158K/yr
New Relic, DataDog) Experience with automated testing frameworks (e.g. Selenium, Cypress ... Github Copilot) and knowledge of latest Generative AI Model capabilities would be an asset Bonus ...
Senior Software Engineer (java/react)
Mississauga, ON · Hybrid
CA$142K - CA$158K/yr
New Relic, DataDog) Experience with automated testing frameworks (e.g. Selenium, Cypress ... Github Copilot) and knowledge of latest Generative AI Model capabilities would be an asset Bonus ...
SDET Architect
Toronto, ON · On-site
Apply an agent-first methodology using Generative AI. Create structured, behavior-oriented prompts ... Integrate AI tools like Claude Code, Kiro and Cursor into development and testing workflows. Evolve ...
SDET Architect
Toronto, ON · On-site
Apply an agent-first methodology using Generative AI. Create structured, behavior-oriented prompts ... Integrate AI tools like Claude Code, Kiro and Cursor into development and testing workflows. Evolve ...
Sr Software Developer
Toronto, ON · On-site
... applying generative AI tools to improve developer productivity and solution delivery. Design ... successful testing and release of software changes Provide L2 (2nd line) support as required ...
Sr Software Developer
Toronto, ON · On-site
... applying generative AI tools to improve developer productivity and solution delivery. Design ... successful testing and release of software changes Provide L2 (2nd line) support as required ...
In this role, you will guide the design and delivery of generative AI solutions, shape the ... Establish and promote best practices in AI engineering, covering testing, guardrails, responsible ...
In this role, you will guide the design and delivery of generative AI solutions, shape the ... Establish and promote best practices in AI engineering, covering testing, guardrails, responsible ...
Establish evaluation, research, regression testing, and observability frameworks to continuously ... Demonstrated experience architecting, developing, and deploying production-grade Generative AI and ...
Establish evaluation, research, regression testing, and observability frameworks to continuously ... Demonstrated experience architecting, developing, and deploying production-grade Generative AI and ...
... generative AI concepts, including prompts, context, tool use, structured outputs, hallucination risk and the need for human review and operational guardrails. * Experience testing configured ...
... generative AI concepts, including prompts, context, tool use, structured outputs, hallucination risk and the need for human review and operational guardrails. * Experience testing configured ...
Establish evaluation, research, regression testing, and observability frameworks to continuously ... Demonstrated experience architecting, developing, and deploying production-grade Generative AI and ...
Establish evaluation, research, regression testing, and observability frameworks to continuously ... Demonstrated experience architecting, developing, and deploying production-grade Generative AI and ...
Associate AI Engineer / AI Engineer
Toronto, ON · On-site
CA$80K - CA$120K/yr
Exhibit behaviors that exemplify Applied Systems' Values in ActionSupport development of generative ... Basic knowledge of CI/CD and use cases for automated testing * Basic knowledge of Agile frameworks ...
Associate AI Engineer / AI Engineer
Toronto, ON · On-site
CA$80K - CA$120K/yr
Exhibit behaviors that exemplify Applied Systems' Values in ActionSupport development of generative ... Basic knowledge of CI/CD and use cases for automated testing * Basic knowledge of Agile frameworks ...
Associate AI Engineer / AI Engineer
CA$80K - CA$120K/yr
Exhibit behaviors that exemplify Applied Systems' Values in ActionSupport development of generative ... Basic knowledge of CI/CD and use cases for automated testing * Basic knowledge of Agile frameworks ...
Associate AI Engineer / AI Engineer
CA$80K - CA$120K/yr
Exhibit behaviors that exemplify Applied Systems' Values in ActionSupport development of generative ... Basic knowledge of CI/CD and use cases for automated testing * Basic knowledge of Agile frameworks ...
Associate AI Engineer / AI Engineer
CA$80K - CA$120K/yr
Exhibit behaviors that exemplify Applied Systems' Values in ActionSupport development of generative ... Basic knowledge of CI/CD and use cases for automated testing * Basic knowledge of Agile frameworks ...
Associate AI Engineer / AI Engineer
CA$80K - CA$120K/yr
Exhibit behaviors that exemplify Applied Systems' Values in ActionSupport development of generative ... Basic knowledge of CI/CD and use cases for automated testing * Basic knowledge of Agile frameworks ...
Lead the planning and execution of system, integration, and user acceptance testing (UAT ... Familiarity with AI, Generative AI, automation technologies and concepts * Strong knowledge with AI ...
Lead the planning and execution of system, integration, and user acceptance testing (UAT ... Familiarity with AI, Generative AI, automation technologies and concepts * Strong knowledge with AI ...
... used to advance generative AI technologies. This opportunity is ideal for experienced Lua ... Familiarity with software testing, debugging, and code optimization techniques. * Experience ...
Quick apply
... used to advance generative AI technologies. This opportunity is ideal for experienced Lua ... Familiarity with software testing, debugging, and code optimization techniques. * Experience ...
This is a hands-on role for an engineer who is deeply engaged in using Generative and Agentic AI ... testing, deployment, and release Coach teams on best practices for leveraging AI across the SDLC ...
This is a hands-on role for an engineer who is deeply engaged in using Generative and Agentic AI ... testing, deployment, and release Coach teams on best practices for leveraging AI across the SDLC ...
... B testing, guardrail metrics, and rigorous measurement of incremental business impact - as a ... Own the strategy for applying LLMs and generative AI across the Experiences product ...
... B testing, guardrail metrics, and rigorous measurement of incremental business impact - as a ... Own the strategy for applying LLMs and generative AI across the Experiences product ...
Senior AI Platform Developer
Toronto, ON · On-site
CA$80K - CA$130K/yr
Develop automation and CI/CD patterns for building, testing, deploying, and operating AI based ... Generative AI solutions. * Strong experience with Python, APIs, cloud native development ...
New
Senior AI Platform Developer
Toronto, ON · On-site
CA$80K - CA$130K/yr
Develop automation and CI/CD patterns for building, testing, deploying, and operating AI based ... Generative AI solutions. * Strong experience with Python, APIs, cloud native development ...
New
Generative Ai Testing information
What is the difference between Generative Ai Testing vs Data Scientist?
| Aspect | Generative Ai Testing | Data Scientist |
|---|---|---|
| Required Credentials | Knowledge of AI models, testing tools, programming skills | Statistics, programming, data analysis certifications |
| Work Environment | AI development teams, testing labs, tech companies | Research labs, tech firms, finance, healthcare |
| Employer & Industry Usage | AI product testing, quality assurance in tech | Data analysis, predictive modeling across industries |
Generative Ai Testing focuses on evaluating and validating AI-generated content and models, ensuring quality and accuracy. Data Scientists analyze data, build models, and derive insights. While both roles require programming and AI knowledge, Generative Ai Testing emphasizes testing processes, whereas Data Scientists focus on data analysis and model development.
How do I become a Generative AI Testing?
Is Generative AI Testing a good career?
What are the key skills and qualifications needed to thrive as a generative AI testing specialist, and why are they important?
What are some common challenges faced when testing generative AI models, and how can I prepare to address them in this role?
What is generative AI testing?

Full-time
Medical, Dental, Vision, Life, Retirement, PTO
Re-posted 24 days ago
Job description
We are seeking a highly skilled and motivated Senior Data Scientist to join our Group Functions Advanced Analytics team. As a Senior Data Scientist - GenAI, you will develop and implement robust analytical solutions for various parts of Manulife and JH by applying traditional and emerging ML and AI techniques including but not limited to generative AI techniques, such as applying prompt engineering, working with RAG applications, fine-tuning LLM models, and deploying applications on cloud platforms like Azure. Your expertise in these areas will play a crucial role in driving data-driven decision-making and enhancing our business processes.
Position Responsibilities:
- Develop and lead machine learning and AI driven projects that span the breadth of Group Functions (Corporate Functions) with high business impact
- Apply generative AI techniques to generate synthetic data, create realistic simulations, and enhance data analysis capabilities.
- Apply prompt engineering techniques, build with RAG (Retrieval-Augmented Generation) applications, and fine-tune language models and improve their performance in specific tasks.
- Design and complete experiments to validate and optimize machine learning models, ensuring accuracy, efficiency, and scalability.
- Deploy machine learning models and applications on cloud platforms like Azure ML or Databricks, ensuring flawless integration and scalability.
- Stay up-to-date with the latest advancements in machine learning, generative AI, prompt engineering, RAG applications, and cloud technologies, and apply them to enhance our data science capabilities.
- Collaborate with data engineers and ML engineers to integrate data science solutions into existing systems and workflows.
- Communicate sophisticated technical concepts and findings to both technical and non-technical partners, ensuring clear understanding and agreement
- Peer review other Data Scientists' work and participate in model and code reviews
- Clean, preprocess, and analyze large datasets to extract meaningful insights and patterns.
- Collaborate with multi-functional teams to identify and define business requirements, ensuring alignment with data science objectives.
Required Qualifications:
- Bachelor', Master's degree, or Ph.D. in Computer Science, Data Science, Statistics, Engineering, or a related field.
- 5+ years of experience in developing probabilistic models, data mining, and machine learning algorithms, including real world experience of applying analytics models, with a strong focus on machine learning, generative AI, prompt engineering, and RAG applications
- Proficiency in programming languages such as Python and experience with machine learning libraries/frameworks, e.g., PyTorch, scikit-learn, Hugging Face, SQL, graph databases (Neo4j/Cypher, Cosmos DB/Gremlin).
Preferred Qualifications:
- Knowledge of professional software engineering practices & standard methodologies for the full software development process, including coding standards, code reviews, source control management, build processes, testing, and operations.
- Strong collaboration and elaboration skills; demonstrates a strong commitment to organizational success; shares resources and demonstrates knowledge across the organization.
- Strong problem-solving skills and the ability to think critically and creatively to develop innovative solutions.
- Excellent communication and collaboration skills, with the ability to work optimally in multi-functional teams.
When you join our team:
- We'll empower you to learn and grow the career you want.
- We'll recognize and support you in a flexible environment where well-being and inclusion are more than just words.
- As part of our global team, we'll support you in shaping the future you want to see.
#LI-Hybrid
The role being advertised is an existing vacancy.
About Manulife and John Hancock
Manulife Financial Corporation is a leading international financial services provider, helping people make their decisions easier and lives better. To learn more about us, visit https://www.manulife.com/en/about/our-story.html.
Manulife is an Equal Opportunity Employer
At Manulife/John Hancock, we embrace our diversity. We strive to attract, develop and retain a workforce that is as diverse as the customers we serve and to foster an inclusive work environment that embraces the strength of cultures and individuals. We are committed to fair recruitment, retention, advancement and compensation, and we administer all of our practices and programs without discrimination on the basis of race, ancestry, place of origin, colour, ethnic origin, citizenship, religion or religious beliefs, creed, sex (including pregnancy and pregnancy-related conditions), sexual orientation, genetic characteristics, veteran status, gender identity, gender expression, age, marital status, family status, disability, or any other ground protected by applicable law.
It is our priority to remove barriers to provide equal access to employment. A Human Resources representative will work with applicants who request a reasonable accommodation during the application process. All information shared during the accommodation request process will be stored and used in a manner that is consistent with applicable laws and Manulife/John Hancock policies. To request a reasonable accommodation in the application process, contact hr@manulife.com.
Referenced Salary Location
Toronto, OntarioWorking Arrangement
Salary range is expected to be between
$129,400.00 CAD - $179,400.00 CADEmployees also have the opportunity to participate in incentive programs and earn incentive compensation tied to business and individual performance. The actual salary will vary depending on local market conditions, geography and relevant job-related factors such as knowledge, skills, qualifications, experience, and education/training. If you are applying for this role outside of the primary location, please contact hr@manulife.com for the salary range for your location.
Manulife offers eligible employees a wide array of customizable benefits, including health, dental, mental health, vision, short- and long-term disability, life and AD&D insurance coverage, adoption/surrogacy and wellness benefits, and employee/family assistance plans. We also offer eligible employees various retirement savings plans (including pension and a global share ownership plan with employer matching contributions) and financial education and counseling resources. Our generous paid time off program in Canada includes holidays, vacation, personal, and sick days, and we offer the full range of statutory leaves of absence. If you are applying for this role in the U.S., please contact hr@manulife.com for more information about U.S.-specific paid time off provisions.
We use data and analytics technologies, such as artificial intelligence (AI), and automated processing tools, to analyze and process the information you provide to us or third parties in the application process. For more information, please refer to our personal information collection statement.