Experience with generative AI safety and evaluation practices, including prompt injection testing, jailbreak resilience, hallucination measurement, toxicity scoring, harm scoring, and grounding ...
Experience with generative AI safety and evaluation practices, including prompt injection testing, jailbreak resilience, hallucination measurement, toxicity scoring, harm scoring, and grounding ...
... robust automated testing and monitoring systems for AI services * Champion experimentation ... Participate in prompt engineering, search optimization, and generative AI model tuning for various ...
... robust automated testing and monitoring systems for AI services * Champion experimentation ... Participate in prompt engineering, search optimization, and generative AI model tuning for various ...
AI Search Strategist
Fort Lauderdale, FL · On-site
Support QA testing and implementation of SEO and AI-search-related initiatives Required ... Familiarity with generative search experiences and AI-powered answer engines * Experience in SEO, ...
AI Search Strategist
Fort Lauderdale, FL · On-site
Support QA testing and implementation of SEO and AI-search-related initiatives Required ... Familiarity with generative search experiences and AI-powered answer engines * Experience in SEO, ...
... generative AI, and related techniques. * Deploy and integrate AI/ML algorithms to CPUs, GPUs, and ... Evaluate system performance in realistic scenarios, conduct HWIL (HardwareInTheLoop) testing, and ...
... generative AI, and related techniques. * Deploy and integrate AI/ML algorithms to CPUs, GPUs, and ... Evaluate system performance in realistic scenarios, conduct HWIL (HardwareInTheLoop) testing, and ...
AI Search Strategist
Fort Lauderdale, FL · On-site
Support QA testing and implementation of SEO and AI-search-related initiatives Required ... Familiarity with generative search experiences and AI-powered answer engines * Experience in SEO, ...
AI Search Strategist
Fort Lauderdale, FL · On-site
Support QA testing and implementation of SEO and AI-search-related initiatives Required ... Familiarity with generative search experiences and AI-powered answer engines * Experience in SEO, ...
... generative AI, and related techniques. * Deploy and integrate AI/ML algorithms to CPUs, GPUs, and ... Evaluate system performance in realistic scenarios, conduct HWIL (HardwareInTheLoop) testing, and ...
... generative AI, and related techniques. * Deploy and integrate AI/ML algorithms to CPUs, GPUs, and ... Evaluate system performance in realistic scenarios, conduct HWIL (HardwareInTheLoop) testing, and ...
Drive DevOps Best Practices: Implement robust CI/CD pipelines, automated testing, and ... Deep experience with AI/ML frameworks (e.g., Langchain) and hands-on experience with Generative AI ...
Drive DevOps Best Practices: Implement robust CI/CD pipelines, automated testing, and ... Deep experience with AI/ML frameworks (e.g., Langchain) and hands-on experience with Generative AI ...
Stay on the leading edge of the AI tooling landscape--continuously scouting, testing, and integrating new platforms, APIs, and workflows that make the team faster and smarter. * Evaluate generative ...
Quick apply
Stay on the leading edge of the AI tooling landscape--continuously scouting, testing, and integrating new platforms, APIs, and workflows that make the team faster and smarter. * Evaluate generative ...
... User Acceptance Testing (UAT), validate test scenarios, and ensure delivered solutions meet ... Experience with AI, Generative AI, Machine Learning, Intelligent Automation, or Data Analytics ...
... User Acceptance Testing (UAT), validate test scenarios, and ensure delivered solutions meet ... Experience with AI, Generative AI, Machine Learning, Intelligent Automation, or Data Analytics ...
... Generative AI tools and applications in personalization • Experience in travel, hospitality, or e-commerce domains • Exposure to: o Experimentation frameworks (A/B testing) o Personalization ...
... Generative AI tools and applications in personalization • Experience in travel, hospitality, or e-commerce domains • Exposure to: o Experimentation frameworks (A/B testing) o Personalization ...
Principal Software Engineer - Tampa FL
Tampa, FL · On-site
$60K - $75K/yr
Lead the end-to-end design, development, and delivery of machine learning and Generative AI (GenAI ... Drive experimentation strategy, including A/B testing, prompt optimization, and iterative ...
Principal Software Engineer - Tampa FL
Tampa, FL · On-site
$60K - $75K/yr
Lead the end-to-end design, development, and delivery of machine learning and Generative AI (GenAI ... Drive experimentation strategy, including A/B testing, prompt optimization, and iterative ...
... User Acceptance Testing (UAT), validate test scenarios, and ensure delivered solutions meet ... Experience with AI, Generative AI, Machine Learning, Intelligent Automation, or Data Analytics ...
... User Acceptance Testing (UAT), validate test scenarios, and ensure delivered solutions meet ... Experience with AI, Generative AI, Machine Learning, Intelligent Automation, or Data Analytics ...
Principal Software Engineer - Tampa FL
Thonotosassa, FL · On-site
$60K - $75K/yr
Lead the end-to-end design, development, and delivery of machine learning and Generative AI (GenAI ... Drive experimentation strategy, including A/B testing, prompt optimization, and iterative ...
Principal Software Engineer - Tampa FL
Thonotosassa, FL · On-site
$60K - $75K/yr
Lead the end-to-end design, development, and delivery of machine learning and Generative AI (GenAI ... Drive experimentation strategy, including A/B testing, prompt optimization, and iterative ...
Expertise in designing, developing, validating, and deploying Generative AI solutions. * Experience ... AI/ML validation (LLM testing, model accuracy, hallucination detection) * Proficiency in API ...
Expertise in designing, developing, validating, and deploying Generative AI solutions. * Experience ... AI/ML validation (LLM testing, model accuracy, hallucination detection) * Proficiency in API ...
Director GenAI Engineering and Transformation Senior Manager
Tampa, FL · On-site
$170K - $300K/yr
... Generative AI domain. * Adopt a product-focused approach, ensuring the development of robust, scalable, and user-friendly solutions. * Thrive in a fast-paced environment by continuously testing ...
Director GenAI Engineering and Transformation Senior Manager
Tampa, FL · On-site
$170K - $300K/yr
... Generative AI domain. * Adopt a product-focused approach, ensuring the development of robust, scalable, and user-friendly solutions. * Thrive in a fast-paced environment by continuously testing ...
Principal Software Engineer - Tampa FL
Tampa, FL · On-site
$127K - $171K/yr
Lead the end-to-end design, development, and delivery of machine learning and Generative AI (GenAI ... Drive experimentation strategy, including A/B testing, prompt optimization, and iterative ...
Principal Software Engineer - Tampa FL
Tampa, FL · On-site
$127K - $171K/yr
Lead the end-to-end design, development, and delivery of machine learning and Generative AI (GenAI ... Drive experimentation strategy, including A/B testing, prompt optimization, and iterative ...
Generative AI & LLM Expertise: * Extensive hands-on experience with leading LLMs such as Google ... testing, and deployments. * Cloud & Containerization: * Proven experience with container ...
Generative AI & LLM Expertise: * Extensive hands-on experience with leading LLMs such as Google ... testing, and deployments. * Cloud & Containerization: * Proven experience with container ...
PM Scrum Master
Tampa, FL · On-site
$48.75 - $65/hr
... Testing (Postman, SOAP UI and OpenAPI) AWS Azure ServiceNow SharePoint Database Management Generative AI Agentic AI and workflows leverage AI/ML NLP and LLM Applications Good knowledge of Java and ...
PM Scrum Master
Tampa, FL · On-site
$48.75 - $65/hr
... Testing (Postman, SOAP UI and OpenAPI) AWS Azure ServiceNow SharePoint Database Management Generative AI Agentic AI and workflows leverage AI/ML NLP and LLM Applications Good knowledge of Java and ...
PM Scrum Master
Tampa, FL · On-site
$48.75 - $65/hr
... Testing (Postman, SOAP UI and OpenAPI) AWS Azure ServiceNow SharePoint Database Management Generative AI Agentic AI and workflows leverage AI/ML NLP and LLM Applications Good knowledge of Java and ...
PM Scrum Master
Tampa, FL · On-site
$48.75 - $65/hr
... Testing (Postman, SOAP UI and OpenAPI) AWS Azure ServiceNow SharePoint Database Management Generative AI Agentic AI and workflows leverage AI/ML NLP and LLM Applications Good knowledge of Java and ...
PM Scrum Master
Tampa, FL · On-site
$48.75 - $65/hr
... Testing (Postman, SOAP UI and OpenAPI) AWS Azure ServiceNow SharePoint Database Management Generative AI Agentic AI and workflows leverage AI/ML NLP and LLM Applications Good knowledge of Java and ...
PM Scrum Master
Tampa, FL · On-site
$48.75 - $65/hr
... Testing (Postman, SOAP UI and OpenAPI) AWS Azure ServiceNow SharePoint Database Management Generative AI Agentic AI and workflows leverage AI/ML NLP and LLM Applications Good knowledge of Java and ...
Generative Ai Testing information
What is the difference between Generative Ai Testing vs Data Scientist?
| Aspect | Generative Ai Testing | Data Scientist |
|---|---|---|
| Required Credentials | Knowledge of AI models, testing tools, programming skills | Statistics, programming, data analysis certifications |
| Work Environment | AI development teams, testing labs, tech companies | Research labs, tech firms, finance, healthcare |
| Employer & Industry Usage | AI product testing, quality assurance in tech | Data analysis, predictive modeling across industries |
Generative Ai Testing focuses on evaluating and validating AI-generated content and models, ensuring quality and accuracy. Data Scientists analyze data, build models, and derive insights. While both roles require programming and AI knowledge, Generative Ai Testing emphasizes testing processes, whereas Data Scientists focus on data analysis and model development.
How much do AI testers get paid?
Is AI testing a good career?
What are the key skills and qualifications needed to thrive as a Generative AI Testing Specialist, and why are they important?
What are some common challenges faced when testing generative AI models, and how can I prepare to address them in this role?
What is a $900,000 AI job?
How do I become an AI tester?
What is Generative AI Testing?

Deloitte rating
8.1
Based on 86 frontline employees who took The Breakroom Quiz
58th of 138 rated financial services
Job description
We are seeking an AI Governance and Privacy Specialist who can operationalize responsible AI in real systems-especially agentic AI and LLM-enabled applications. This role blends governance and privacy expertise with enough software development fluency to create developer-ready guidance, implement controls-as-code patterns, and stand up measurable evaluation and monitoring workflows.
As a Senior Consultant, you will help clients and internal delivery teams move from AI principles to practices: risk tiering, model and agent inventories, technical guardrails, governance workflows integrated into the SDLC, and evidence artifacts suitable for audits and regulators.
Recruiting for this role ends on 12/31/2026.
Work you'll do
As a Senior Consultant, Strategy, Growth and Transformation on the Cyber team, you will be responsible for:
- Designing and implementing AI governance operating models, intake workflows, risk tiering, approvals, documentation standards, exception handling, and audit-ready evidence processes for generative AI and agentic AI deployments.
- Building and maintaining inventories for models, agents, tools, data sources, and integrations, with defined ownership, intended use, risk classification, and change-control requirements.
- Conducting risk assessments across privacy, security, model risk, and misuse scenarios, including prompt injection, sensitive data exposure, excessive agency, and overreliance, and translating findings into implementable mitigations.
- Establishing technical control guidance for teams building agentic AI solutions, including human-in-the-loop patterns, tool access controls, retrieval and grounding practices, logging, monitoring, token and data minimization, and incident response playbooks.
- Integrating governance checkpoints into product and engineering delivery through architecture reviews, release gates, evaluation requirements, documentation automation, evidence capture, dashboards, and cross-functional collaboration with Cybersecurity, Privacy, Legal, Risk, Engineering, and Data Science teams.
A successful candidate would possess these skills:
- Ability to work independently and collaborate as part of a team
- Effective written and verbal communication skills
- Meticulous attention to detail and quality of work product
- Ability to build and sustain professional relationships
- Ability to lead projects or workstreams
- Ability to manage and prioritize multiple tasks in a fast-paced and dynamic environment
- Strong interpersonal skills and professional demeanor
- Ability to meet deadlines
- Ability to provide clear guidance to others
The team
You will join a cross-functional group working at the intersection of cyber, privacy, governance, and emerging AI delivery. The team helps organizations scale AI responsibly by combining governance and engineering patterns so teams can innovate faster without compromising trust.
Qualifications
Required:
- Bachelor's degree or equivalent practical experience.
- 4+ years of experience in AI governance, data privacy, security risk management, compliance and controls, AI product risk, model risk management, or technology risk consulting.
- Experience translating policies and regulatory expectations into operational workflows and artifacts, including intake processes, inventories, decision logs, risk registers, responsibility assignment matrices, playbooks, privacy impact assessments, and data protection impact assessments.
- Experience assessing AI, machine learning, and LLM deployment patterns, including training, retrieval-augmented generation, fine-tuning, tool use, data dependencies, and integration patterns, and defining mitigations for privacy, security, model risk, and misuse.
- Experience prototyping or automating governance workflows using Python or Structured Query Language and working with continuous integration and continuous deployment pipelines and cloud deployment basics.
- Ability to travel 0-50%, on average, based on the work you do and the clients and industries/sectors you serve.
- Limited immigration sponsorship may be available.
Preferred:
- Experience in consulting or a Big 4 environment.
- Experience operationalizing AI governance aligned to the National Institute of Standards and Technology AI Risk Management Framework or ISO/IEC 42001.
- Experience with generative AI safety and evaluation practices, including prompt injection testing, jailbreak resilience, hallucination measurement, toxicity scoring, harm scoring, and grounding effectiveness.
- Experience with governance, workflow, or ticketing platforms, including OneTrust and governance, risk, and compliance systems, and integrating those platforms into engineering delivery processes.
- Certifications such as Certified Information Privacy Professional/United States, Certified Information Privacy Manager, International Association of Privacy Professionals AI Governance Professional, Certified Information Security Manager, or Certified Information Systems Security Professional.
- Experience in cyber or enterprise security environments, including data security, identity, audit logging, secure software development lifecycle practices, human-in-the-loop escalation pathways, exception handling, and automated safety protocols for autonomous systems.
The wage range for this role takes into account the wide range of factors that are considered in making compensation decisions including but not limited to skill sets; experience and training; licensure and certifications; and other business and organizational needs. The disclosed range estimate has not been adjusted for the applicable geographic differential associated with the location at which the position may be filled. At Deloitte, it is not typical for an individual to be hired at or near the top of the range for their role and compensation decisions are dependent on the facts and circumstances of each case. A reasonable estimate of the current range is $105,400 to $207,800.
You may also be eligible to participate in a discretionary annual incentive program, subject to the rules governing the program, whereby an award, if any, depends on various factors, including, without limitation, individual and organizational performance.
#CyberDTP27
We are seeking an AI Governance and Privacy Specialist who can operationalize responsible AI in real systems-especially agentic AI and LLM-enabled applications. This role blends governance and privacy expertise with enough software development fluency to create developer-ready guidance, implement controls-as-code patterns, and stand up measurable evaluation and monitoring workflows.
As a Senior Consultant, you will help clients and internal delivery teams move from AI principles to practices: risk tiering, model and agent inventories, technical guardrails, governance workflows integrated into the SDLC, and evidence artifacts suitable for audits and regulators.
Recruiting for this role ends on 12/31/2026.
Work you'll do
As a Senior Consultant, Strategy, Growth and Transformation on the Cyber team, you will be responsible for:
- Designing and implementing AI governance operating models, intake workflows, risk tiering, approvals, documentation standards, exception handling, and audit-ready evidence processes for generative AI and agentic AI deployments.
- Building and maintaining inventories for models, agents, tools, data sources, and integrations, with defined ownership, intended use, risk classification, and change-control requirements.
- Conducting risk assessments across privacy, security, model risk, and misuse scenarios, including prompt injection, sensitive data exposure, excessive agency, and overreliance, and translating findings into implementable mitigations.
- Establishing technical control guidance for teams building agentic AI solutions, including human-in-the-loop patterns, tool access controls, retrieval and grounding practices, logging, monitoring, token and data minimization, and incident response playbooks.
- Integrating governance checkpoints into product and engineering delivery through architecture reviews, release gates, evaluation requirements, documentation automation, evidence capture, dashboards, and cross-functional collaboration with Cybersecurity, Privacy, Legal, Risk, Engineering, and Data Science teams.
A successful candidate would possess these skills:
- Ability to work independently and collaborate as part of a team
- Effective written and verbal communication skills
- Meticulous attention to detail and quality of work product
- Ability to build and sustain professional relationships
- Ability to lead projects or workstreams
- Ability to manage and prioritize multiple tasks in a fast-paced and dynamic environment
- Strong interpersonal skills and professional demeanor
- Ability to meet deadlines
- Ability to provide clear guidance to others
The team
You will join a cross-functional group working at the intersection of cyber, privacy, governance, and emerging AI delivery. The team helps organizations scale AI responsibly by combining governance and engineering patterns so teams can innovate faster without compromising trust.
Qualifications
Required:
- Bachelor's degree or equivalent practical experience.
- 4+ years of experience in AI governance, data privacy, security risk management, compliance and controls, AI product risk, model risk management, or technology risk consulting.
- Experience translating policies and regulatory expectations into operational workflows and artifacts, including intake processes, inventories, decision logs, risk registers, responsibility assignment matrices, playbooks, privacy impact assessments, and data protection impact assessments.
- Experience assessing AI, machine learning, and LLM deployment patterns, including training, retrieval-augmented generation, fine-tuning, tool use, data dependencies, and integration patterns, and defining mitigations for privacy, security, model risk, and misuse.
- Experience prototyping or automating governance workflows using Python or Structured Query Language and working with continuous integration and continuous deployment pipelines and cloud deployment basics.
- Ability to travel 0-50%, on average, based on the work you do and the clients and industries/sectors you serve.
- Limited immigration sponsorship may be available.
Preferred:
- Experience in consulting or a Big 4 environment.
- Experience operationalizing AI governance aligned to the National Institute of Standards and Technology AI Risk Management Framework or ISO/IEC 42001.
- Experience with generative AI safety and evaluation practices, including prompt injection testing, jailbreak resilience, hallucination measurement, toxicity scoring, harm scoring, and grounding effectiveness.
- Experience with governance, workflow, or ticketing platforms, including OneTrust and governance, risk, and compliance systems, and integrating those platforms into engineering delivery processes.
- Certifications such as Certified Information Privacy Professional/United States, Certified Information Privacy Manager, International Association of Privacy Professionals AI Governance Professional, Certified Information Security Manager, or Certified Information Systems Security Professional.
- Experience in cyber or enterprise security environments, including data security, identity, audit logging, secure software development lifecycle practices, human-in-the-loop escalation pathways, exception handling, and automated safety protocols for autonomous systems.
The wage range for this role takes into account the wide range of factors that are considered in making compensation decisions including but not limited to skill sets; experience and training; licensure and certifications; and other business and organizational needs. The disclosed range estimate has not been adjusted for the applicable geographic differential associated with the location at which the position may be filled. At Deloitte, it is not typical for an individual to be hired at or near the top of the range for their role and compensation decisions are dependent on the facts and circumstances of each case. A reasonable estimate of the current range is $105,400 to $207,800.
You may also be eligible to participate in a discretionary annual incentive program, subject to the rules governing the program, whereby an award, if any, depends on various factors, including, without limitation, individual and organizational performance.
#CyberDTP27