Designing and executing testing scenarios to identify how prompts or user inputs could be manipulated to generate harmful, misleading, or misaligned generative artificial intelligence outputs.
Designing and executing testing scenarios to identify how prompts or user inputs could be manipulated to generate harmful, misleading, or misaligned generative artificial intelligence outputs.
Designing and executing testing scenarios to identify how prompts or user inputs could be manipulated to generate harmful, misleading, or misaligned generative artificial intelligence outputs.
Designing and executing testing scenarios to identify how prompts or user inputs could be manipulated to generate harmful, misleading, or misaligned generative artificial intelligence outputs.
Cyber Intelligence Analyst with Security Clearance
Mead, CO · On-site
$99K - $225K/yr
Experience as a team lead or project manager, coordinating and directing task activities or test ... As part of this commitment, the use of artificial intelligence (AI) or other tools to assist with ...
Cyber Intelligence Analyst with Security Clearance
Mead, CO · On-site
$99K - $225K/yr
Experience as a team lead or project manager, coordinating and directing task activities or test ... As part of this commitment, the use of artificial intelligence (AI) or other tools to assist with ...
Senior Security AI Architect
Littleton, CO · On-site
$127K - $181K/yr
Lead threat intelligence and adversarial testing initiatives to defend against evolving artificial ... direct threat of substantial harm to others, or is otherwise not required by law. EchoStar has a ...
Quick apply
Senior Security AI Architect
Littleton, CO · On-site
$127K - $181K/yr
Lead threat intelligence and adversarial testing initiatives to defend against evolving artificial ... direct threat of substantial harm to others, or is otherwise not required by law. EchoStar has a ...
Senior Security AI Architect
Littleton, CO · On-site
$127K - $181K/yr
Lead threat intelligence and adversarial testing initiatives to defend against evolving artificial ... direct threat of substantial harm to others, or is otherwise not required by law. EchoStar has a ...
Quick apply
Senior Security AI Architect
Littleton, CO · On-site
$127K - $181K/yr
Lead threat intelligence and adversarial testing initiatives to defend against evolving artificial ... direct threat of substantial harm to others, or is otherwise not required by law. EchoStar has a ...
Senior Security AI Architect
Littleton, CO · On-site
$127K - $181K/yr
Lead threat intelligence and adversarial testing initiatives to defend against evolving artificial ... direct threat of substantial harm to others, or is otherwise not required by law. EchoStar has a ...
Quick apply
Senior Security AI Architect
Littleton, CO · On-site
$127K - $181K/yr
Lead threat intelligence and adversarial testing initiatives to defend against evolving artificial ... direct threat of substantial harm to others, or is otherwise not required by law. EchoStar has a ...
Director of AI & ML
Denver, CO · On-site
Director of Artificial Intelligence & Machine Learning About Us: We are seeking a visionary Director of AI & ML to lead our talented team in developing groundbreaking solutions. Position Overview: As ...
Director of AI & ML
Denver, CO · On-site
Director of Artificial Intelligence & Machine Learning About Us: We are seeking a visionary Director of AI & ML to lead our talented team in developing groundbreaking solutions. Position Overview: As ...
Director of Artificial Intelligence & Machine Learning About Us: We are seeking a visionary Director of AI & ML to lead our talented team in developing groundbreaking solutions. Position Overview: As ...
Director of Artificial Intelligence & Machine Learning About Us: We are seeking a visionary Director of AI & ML to lead our talented team in developing groundbreaking solutions. Position Overview: As ...
Staff Engineer, FW & Product Test Eng
Longmont, CO · On-site
$137 - $232/hr
Experience using Artificial Intelligence, applying Artificial Intelligence, or leveraging Artificial Intelligence to improve software testing, data analytics, or engineering productivity. * Exposure ...
Staff Engineer, FW & Product Test Eng
Longmont, CO · On-site
$137 - $232/hr
Experience using Artificial Intelligence, applying Artificial Intelligence, or leveraging Artificial Intelligence to improve software testing, data analytics, or engineering productivity. * Exposure ...
Experience using Artificial Intelligence, applying Artificial Intelligence, or leveraging Artificial Intelligence to improve software testing, data analytics, or engineering productivity. * Exposure ...
Experience using Artificial Intelligence, applying Artificial Intelligence, or leveraging Artificial Intelligence to improve software testing, data analytics, or engineering productivity. * Exposure ...
Experience using Artificial Intelligence, applying Artificial Intelligence, orleveragingArtificial Intelligence to improve software testing, data analytics, or engineering productivity. * Exposure to ...
Experience using Artificial Intelligence, applying Artificial Intelligence, orleveragingArtificial Intelligence to improve software testing, data analytics, or engineering productivity. * Exposure to ...
Special Operations Planner - J2
Colorado Springs, CO · On-site
$130 - $180/hr
... artificial intelligence (AI), machine learning (ML), and augmented reality (AR). QinetiQ US ... The ideal candidate brings direct experience in SOF and/or Cyber collection environments ...
Special Operations Planner - J2
Colorado Springs, CO · On-site
$130 - $180/hr
... artificial intelligence (AI), machine learning (ML), and augmented reality (AR). QinetiQ US ... The ideal candidate brings direct experience in SOF and/or Cyber collection environments ...
Testing Lead
Almont, CO · On-site
$80 - $90/hr
Remote Our client seeks a senior Testing Lead to elevate the Workday HCM testing function. The ... Please be advised that Eliassen Group utilizes artificial intelligence (AI) tools as part of its ...
Testing Lead
Almont, CO · On-site
$80 - $90/hr
Remote Our client seeks a senior Testing Lead to elevate the Workday HCM testing function. The ... Please be advised that Eliassen Group utilizes artificial intelligence (AI) tools as part of its ...
Director, Sr Corporate Counsel
Denver, CO · On-site
... JLD) as a Director, Senior Corporate Counsel. Within the JLD, you will be a key member of the ... Familiarity with software development, artificial intelligence/machine learning, and ...
Director, Sr Corporate Counsel
Denver, CO · On-site
... JLD) as a Director, Senior Corporate Counsel. Within the JLD, you will be a key member of the ... Familiarity with software development, artificial intelligence/machine learning, and ...
Sr Engineer, FW & Product Test
Longmont, CO · On-site
$111 - $189/hr
... artificial intelligence, helping drive innovative and scalable testing solutions. Department ... If you are selected to interview for a position, you must notify your direct supervisor before ...
Sr Engineer, FW & Product Test
Longmont, CO · On-site
$111 - $189/hr
... artificial intelligence, helping drive innovative and scalable testing solutions. Department ... If you are selected to interview for a position, you must notify your direct supervisor before ...
... artificial intelligence opportunities into scalable business solutions. As a Senior Consultant ... the judgment to direct, review, and correct AI-generated output and to maintain engineering ...
... artificial intelligence opportunities into scalable business solutions. As a Senior Consultant ... the judgment to direct, review, and correct AI-generated output and to maintain engineering ...
Our AI-powered spatial intelligence platform fuses data from the world's highest-resolution ... Experience with spacecraft and/oropticalpayload environmental testing (e.g., thermal vacuum ...
Our AI-powered spatial intelligence platform fuses data from the world's highest-resolution ... Experience with spacecraft and/oropticalpayload environmental testing (e.g., thermal vacuum ...
This is an early-career opportunity for someone interested in artificial intelligence, data ... Support the deployment and testing of applications in containerized, virtualized, Kubernetes, GPU ...
This is an early-career opportunity for someone interested in artificial intelligence, data ... Support the deployment and testing of applications in containerized, virtualized, Kubernetes, GPU ...
This is an early-career opportunity for someone interested in artificial intelligence, data ... Support the deployment and testing of applications in containerized, virtualized, Kubernetes, GPU ...
This is an early-career opportunity for someone interested in artificial intelligence, data ... Support the deployment and testing of applications in containerized, virtualized, Kubernetes, GPU ...
This is an early-career opportunity for someone interested in artificial intelligence, data ... Support the deployment and testing of applications in containerized, virtualized, Kubernetes, GPU ...
This is an early-career opportunity for someone interested in artificial intelligence, data ... Support the deployment and testing of applications in containerized, virtualized, Kubernetes, GPU ...
Director Artificial Intelligence Testing information
What does a director of artificial intelligence testing do?
What are the key skills and qualifications needed to thrive as a director of artificial intelligence testing?
What are the common challenges faced by a director of artificial intelligence testing, and how can they be addressed?
What are the most commonly searched types of Artificial Intelligence Testing jobs in Colorado?
The most popular types of Artificial Intelligence Testing jobs in Colorado are:
Deloitte rating
8.2
Based on 93 frontline employees who took The Breakroom Quiz
48th of 154 rated financial services
Job description
Cyber Digital Trust and Online Safety Manager
The Digital Trust & Online Protection Professional will advise clients in developing, managing, and implementing policies, procedures, and strategies to ensure a safe, compliant, and trustworthy environment for our users. This individual will scale and mature digital trust and safety processes, including content compliance, user protection, and regulatory adherence across our platforms for our clients. Working closely with cross-functional stakeholders, this role will monitor regulatory changes, manage risks, and enhance our organization's approach to content safety, user trust, and online integrity.
Recruiting for this role ends on 12/31/3026.
Work you'll do
As a Manager, Strategy, Growth, and Transformation on the Deloitte Cyber team, you will be responsible for:
- Designing and executing testing scenarios to identify how prompts or user inputs could be manipulated to generate harmful, misleading, or misaligned generative artificial intelligence outputs.
- Researching emerging prompt injection, jailbreak, and adversarial testing techniques to evaluate model weaknesses, bias, factual inaccuracy, and misalignment with user intent.
- Assessing the effectiveness of content moderation systems in detecting unsafe outputs and documenting vulnerabilities, failure patterns, and potential misuse impacts.
- Recommending improvements to moderation policies, flagging mechanisms, training data, and governance controls based on testing findings.
- Collaborating with generative artificial intelligence development, content moderation, and cross-functional stakeholders to strengthen security, trust, safety, and responsible use outcomes.
- Developing multimodal test content and novel prompt manipulation methods to identify failure modes across text and other model inputs.
A successful candidate would possess these skills:
- Ability to work independently and collaborate as part of a team
- Effective written and verbal communication skills
- Meticulous attention to detail and quality of work product
- Ability to build and sustain professional relationships
- Ability to lead projects or workstreams
- Ability to manage and prioritize multiple tasks in a fast-paced and dynamic environment
- Strong interpersonal skills and professional demeanor
- Ability to meet deadlines
- Ability to mentor and provide clear guidance to others
The team
Enables trust and safety of online communications and digital products, protecting users, consumers, and patients from harm. Enables clients to provide consumer confidence in knowing with whom they are dealing and ensuring the integrity of access to data.
Qualifications
Required:
- Master's degree in Computer Science, Artificial Intelligence, Machine Learning, Data Science, Cybersecurity, Linguistics, Psychology, or a related field, or equivalent professional experience
- 10+ years of experience in threat modeling and simulation, prompt generation and analysis, novel testing, and reporting and improvement
- Demonstrated hands-on experience, portfolio work, publications, or research in prompt injection, jailbreak testing, model evaluation, adversarial machine learning, multimodal artificial intelligence safety, or generative artificial intelligence vulnerability assessment
- Ability to travel 25-50%, on average, based on the work you do and the clients and industries/sectors you serve.
- Limited immigration sponsorship may be available.
Preferred:
- Doctor of Philosophy (PhD) in Computer Science, Artificial Intelligence, Machine Learning, Data Science, Cybersecurity, Linguistics, Psychology, or a related field, or equivalent professional experience
- Specialized training or certifications in generative artificial intelligence red teaming, adversarial machine learning, artificial intelligence security, cybersecurity, responsible artificial intelligence, or artificial intelligence governance
- Experience designing and operationalizing trust and safety testing programs for large-scale consumer platforms, including escalation workflows, issue triage, and remediation tracking
- Experience working with product, legal, policy, and engineering stakeholders to translate risk findings into practical platform controls and governance improvements
The wage range for this role takes into account the wide range of factors that are considered in making compensation decisions including but not limited to skill sets; experience and training; licensure and certifications; and other business and organizational needs. The disclosed range estimate has not been adjusted for the applicable geographic differential associated with the location at which the position may be filled. At Deloitte, it is not typical for an individual to be hired at or near the top of the range for their role and compensation decisions are dependent on the facts and circumstances of each case. A reasonable estimate of the current range is $134,500 to $265,100.
You may also be eligible to participate in a discretionary annual incentive program, subject to the rules governing the program, whereby an award, if any, depends on various factors, including, without limitation, individual and organizational performance.
#CyberDTP27
Cyber Digital Trust and Online Safety Manager
The Digital Trust & Online Protection Professional will advise clients in developing, managing, and implementing policies, procedures, and strategies to ensure a safe, compliant, and trustworthy environment for our users. This individual will scale and mature digital trust and safety processes, including content compliance, user protection, and regulatory adherence across our platforms for our clients. Working closely with cross-functional stakeholders, this role will monitor regulatory changes, manage risks, and enhance our organization's approach to content safety, user trust, and online integrity.
Recruiting for this role ends on 12/31/3026.
Work you'll do
As a Manager, Strategy, Growth, and Transformation on the Deloitte Cyber team, you will be responsible for:
- Designing and executing testing scenarios to identify how prompts or user inputs could be manipulated to generate harmful, misleading, or misaligned generative artificial intelligence outputs.
- Researching emerging prompt injection, jailbreak, and adversarial testing techniques to evaluate model weaknesses, bias, factual inaccuracy, and misalignment with user intent.
- Assessing the effectiveness of content moderation systems in detecting unsafe outputs and documenting vulnerabilities, failure patterns, and potential misuse impacts.
- Recommending improvements to moderation policies, flagging mechanisms, training data, and governance controls based on testing findings.
- Collaborating with generative artificial intelligence development, content moderation, and cross-functional stakeholders to strengthen security, trust, safety, and responsible use outcomes.
- Developing multimodal test content and novel prompt manipulation methods to identify failure modes across text and other model inputs.
A successful candidate would possess these skills:
- Ability to work independently and collaborate as part of a team
- Effective written and verbal communication skills
- Meticulous attention to detail and quality of work product
- Ability to build and sustain professional relationships
- Ability to lead projects or workstreams
- Ability to manage and prioritize multiple tasks in a fast-paced and dynamic environment
- Strong interpersonal skills and professional demeanor
- Ability to meet deadlines
- Ability to mentor and provide clear guidance to others
The team
Enables trust and safety of online communications and digital products, protecting users, consumers, and patients from harm. Enables clients to provide consumer confidence in knowing with whom they are dealing and ensuring the integrity of access to data.
Qualifications
Required:
- Master's degree in Computer Science, Artificial Intelligence, Machine Learning, Data Science, Cybersecurity, Linguistics, Psychology, or a related field, or equivalent professional experience
- 10+ years of experience in threat modeling and simulation, prompt generation and analysis, novel testing, and reporting and improvement
- Demonstrated hands-on experience, portfolio work, publications, or research in prompt injection, jailbreak testing, model evaluation, adversarial machine learning, multimodal artificial intelligence safety, or generative artificial intelligence vulnerability assessment
- Ability to travel 25-50%, on average, based on the work you do and the clients and industries/sectors you serve.
- Limited immigration sponsorship may be available.
Preferred:
- Doctor of Philosophy (PhD) in Computer Science, Artificial Intelligence, Machine Learning, Data Science, Cybersecurity, Linguistics, Psychology, or a related field, or equivalent professional experience
- Specialized training or certifications in generative artificial intelligence red teaming, adversarial machine learning, artificial intelligence security, cybersecurity, responsible artificial intelligence, or artificial intelligence governance
- Experience designing and operationalizing trust and safety testing programs for large-scale consumer platforms, including escalation workflows, issue triage, and remediation tracking
- Experience working with product, legal, policy, and engineering stakeholders to translate risk findings into practical platform controls and governance improvements
The wage range for this role takes into account the wide range of factors that are considered in making compensation decisions including but not limited to skill sets; experience and training; licensure and certifications; and other business and organizational needs. The disclosed range estimate has not been adjusted for the applicable geographic differential associated with the location at which the position may be filled. At Deloitte, it is not typical for an individual to be hired at or near the top of the range for their role and compensation decisions are dependent on the facts and circumstances of each case. A reasonable estimate of the current range is $134,500 to $265,100.
You may also be eligible to participate in a discretionary annual incentive program, subject to the rules governing the program, whereby an award, if any, depends on various factors, including, without limitation, individual and organizational performance.
#CyberDTP27
About Deloitte
Sourced by ZipRecruiter
Industry
Finance and insurance and business management consulting
Company size
10,000+ Employees
Headquarters location
Orlando, FL, US