1

Director Artificial Intelligence Testing Jobs in Colorado

Lead threat intelligence and adversarial testing initiatives to defend against evolving artificial ... direct threat of substantial harm to others, or is otherwise not required by law. EchoStar has a ...

Lead threat intelligence and adversarial testing initiatives to defend against evolving artificial ... direct threat of substantial harm to others, or is otherwise not required by law. EchoStar has a ...

Lead threat intelligence and adversarial testing initiatives to defend against evolving artificial ... direct threat of substantial harm to others, or is otherwise not required by law. EchoStar has a ...

Director of Artificial Intelligence & Machine Learning About Us: We are seeking a visionary Director of AI & ML to lead our talented team in developing groundbreaking solutions. Position Overview: As ...

Director of Artificial Intelligence & Machine Learning About Us: We are seeking a visionary Director of AI & ML to lead our talented team in developing groundbreaking solutions. Position Overview: As ...

Testing Lead

Almont, CO · On-site

$80 - $90/hr

Remote Our client seeks a senior Testing Lead to elevate the Workday HCM testing function. The ... Please be advised that Eliassen Group utilizes artificial intelligence (AI) tools as part of its ...

Our AI-powered spatial intelligence platform fuses data from the world's highest-resolution ... Experience with spacecraft and/oropticalpayload environmental testing (e.g., thermal vacuum ...

Showing results 21-40

Director Artificial Intelligence Testing information

What does a director of artificial intelligence testing do?

A Director of Artificial Intelligence (AI) Testing oversees the development, implementation, and management of strategies to test and validate AI systems. This role ensures that AI models and solutions are reliable, ethical, and perform as intended before deployment. Responsibilities include leading teams of testers and engineers, establishing testing protocols, identifying potential biases, and ensuring compliance with regulations. The director also collaborates with other departments to integrate quality assurance throughout the AI development lifecycle.

What are the key skills and qualifications needed to thrive as a director of artificial intelligence testing?

To thrive as a Director of Artificial Intelligence Testing, you need deep expertise in AI/ML concepts, test methodologies, and a strong background in computer science or a related field, often supported by advanced degrees. Familiarity with AI testing tools, automation frameworks, and experience with cloud platforms and regulatory compliance systems is essential. Exceptional leadership, strategic thinking, and communication skills enable effective team management and stakeholder collaboration. These skills ensure robust AI system validation, risk mitigation, and the delivery of reliable, ethical AI solutions.

What are the common challenges faced by a director of artificial intelligence testing, and how can they be addressed?

A Director of Artificial Intelligence Testing often faces challenges such as ensuring the reliability and fairness of AI models, keeping up with rapidly evolving technologies, and managing cross-functional teams with diverse expertise. Addressing these challenges requires a strong framework for continuous testing, effective communication across data science, engineering, and QA teams, and staying updated on the latest AI validation tools and best practices. Proactively fostering a collaborative culture and investing in ongoing staff development can also help mitigate risks and drive successful AI deployments.

What are the most commonly searched types of Artificial Intelligence Testing jobs in Colorado?

The most popular types of Artificial Intelligence Testing jobs in Colorado are:

Cyber Digital Trust & Online Safety Manager

Deloitte

Denver, CO

Full-time

Re-posted 17 days ago


Deloitte rating

8.2

Company rating: 8.2 out of 10

Based on 93 frontline employees who took The Breakroom Quiz

48th of 154 rated financial services


Job description

Cyber Digital Trust and Online Safety Manager

The Digital Trust & Online Protection Professional will advise clients in developing, managing, and implementing policies, procedures, and strategies to ensure a safe, compliant, and trustworthy environment for our users. This individual will scale and mature digital trust and safety processes, including content compliance, user protection, and regulatory adherence across our platforms for our clients. Working closely with cross-functional stakeholders, this role will monitor regulatory changes, manage risks, and enhance our organization's approach to content safety, user trust, and online integrity.

Recruiting for this role ends on 12/31/3026.

Work you'll do

As a Manager, Strategy, Growth, and Transformation on the Deloitte Cyber team, you will be responsible for:

  • Designing and executing testing scenarios to identify how prompts or user inputs could be manipulated to generate harmful, misleading, or misaligned generative artificial intelligence outputs.
  • Researching emerging prompt injection, jailbreak, and adversarial testing techniques to evaluate model weaknesses, bias, factual inaccuracy, and misalignment with user intent.
  • Assessing the effectiveness of content moderation systems in detecting unsafe outputs and documenting vulnerabilities, failure patterns, and potential misuse impacts.
  • Recommending improvements to moderation policies, flagging mechanisms, training data, and governance controls based on testing findings.
  • Collaborating with generative artificial intelligence development, content moderation, and cross-functional stakeholders to strengthen security, trust, safety, and responsible use outcomes.
  • Developing multimodal test content and novel prompt manipulation methods to identify failure modes across text and other model inputs.

A successful candidate would possess these skills:

  • Ability to work independently and collaborate as part of a team
  • Effective written and verbal communication skills
  • Meticulous attention to detail and quality of work product
  • Ability to build and sustain professional relationships
  • Ability to lead projects or workstreams
  • Ability to manage and prioritize multiple tasks in a fast-paced and dynamic environment
  • Strong interpersonal skills and professional demeanor
  • Ability to meet deadlines
  • Ability to mentor and provide clear guidance to others

The team

Enables trust and safety of online communications and digital products, protecting users, consumers, and patients from harm. Enables clients to provide consumer confidence in knowing with whom they are dealing and ensuring the integrity of access to data.

Qualifications

Required:

  • Master's degree in Computer Science, Artificial Intelligence, Machine Learning, Data Science, Cybersecurity, Linguistics, Psychology, or a related field, or equivalent professional experience
  • 10+ years of experience in threat modeling and simulation, prompt generation and analysis, novel testing, and reporting and improvement
  • Demonstrated hands-on experience, portfolio work, publications, or research in prompt injection, jailbreak testing, model evaluation, adversarial machine learning, multimodal artificial intelligence safety, or generative artificial intelligence vulnerability assessment
  • Ability to travel 25-50%, on average, based on the work you do and the clients and industries/sectors you serve.
  • Limited immigration sponsorship may be available.

Preferred:

  • Doctor of Philosophy (PhD) in Computer Science, Artificial Intelligence, Machine Learning, Data Science, Cybersecurity, Linguistics, Psychology, or a related field, or equivalent professional experience
  • Specialized training or certifications in generative artificial intelligence red teaming, adversarial machine learning, artificial intelligence security, cybersecurity, responsible artificial intelligence, or artificial intelligence governance
  • Experience designing and operationalizing trust and safety testing programs for large-scale consumer platforms, including escalation workflows, issue triage, and remediation tracking
  • Experience working with product, legal, policy, and engineering stakeholders to translate risk findings into practical platform controls and governance improvements

The wage range for this role takes into account the wide range of factors that are considered in making compensation decisions including but not limited to skill sets; experience and training; licensure and certifications; and other business and organizational needs. The disclosed range estimate has not been adjusted for the applicable geographic differential associated with the location at which the position may be filled. At Deloitte, it is not typical for an individual to be hired at or near the top of the range for their role and compensation decisions are dependent on the facts and circumstances of each case. A reasonable estimate of the current range is $134,500 to $265,100.

You may also be eligible to participate in a discretionary annual incentive program, subject to the rules governing the program, whereby an award, if any, depends on various factors, including, without limitation, individual and organizational performance.

#CyberDTP27

Qualifications:

Cyber Digital Trust and Online Safety Manager

The Digital Trust & Online Protection Professional will advise clients in developing, managing, and implementing policies, procedures, and strategies to ensure a safe, compliant, and trustworthy environment for our users. This individual will scale and mature digital trust and safety processes, including content compliance, user protection, and regulatory adherence across our platforms for our clients. Working closely with cross-functional stakeholders, this role will monitor regulatory changes, manage risks, and enhance our organization's approach to content safety, user trust, and online integrity.

Recruiting for this role ends on 12/31/3026.

Work you'll do

As a Manager, Strategy, Growth, and Transformation on the Deloitte Cyber team, you will be responsible for:

  • Designing and executing testing scenarios to identify how prompts or user inputs could be manipulated to generate harmful, misleading, or misaligned generative artificial intelligence outputs.
  • Researching emerging prompt injection, jailbreak, and adversarial testing techniques to evaluate model weaknesses, bias, factual inaccuracy, and misalignment with user intent.
  • Assessing the effectiveness of content moderation systems in detecting unsafe outputs and documenting vulnerabilities, failure patterns, and potential misuse impacts.
  • Recommending improvements to moderation policies, flagging mechanisms, training data, and governance controls based on testing findings.
  • Collaborating with generative artificial intelligence development, content moderation, and cross-functional stakeholders to strengthen security, trust, safety, and responsible use outcomes.
  • Developing multimodal test content and novel prompt manipulation methods to identify failure modes across text and other model inputs.

A successful candidate would possess these skills:

  • Ability to work independently and collaborate as part of a team
  • Effective written and verbal communication skills
  • Meticulous attention to detail and quality of work product
  • Ability to build and sustain professional relationships
  • Ability to lead projects or workstreams
  • Ability to manage and prioritize multiple tasks in a fast-paced and dynamic environment
  • Strong interpersonal skills and professional demeanor
  • Ability to meet deadlines
  • Ability to mentor and provide clear guidance to others

The team

Enables trust and safety of online communications and digital products, protecting users, consumers, and patients from harm. Enables clients to provide consumer confidence in knowing with whom they are dealing and ensuring the integrity of access to data.

Qualifications

Required:

  • Master's degree in Computer Science, Artificial Intelligence, Machine Learning, Data Science, Cybersecurity, Linguistics, Psychology, or a related field, or equivalent professional experience
  • 10+ years of experience in threat modeling and simulation, prompt generation and analysis, novel testing, and reporting and improvement
  • Demonstrated hands-on experience, portfolio work, publications, or research in prompt injection, jailbreak testing, model evaluation, adversarial machine learning, multimodal artificial intelligence safety, or generative artificial intelligence vulnerability assessment
  • Ability to travel 25-50%, on average, based on the work you do and the clients and industries/sectors you serve.
  • Limited immigration sponsorship may be available.

Preferred:

  • Doctor of Philosophy (PhD) in Computer Science, Artificial Intelligence, Machine Learning, Data Science, Cybersecurity, Linguistics, Psychology, or a related field, or equivalent professional experience
  • Specialized training or certifications in generative artificial intelligence red teaming, adversarial machine learning, artificial intelligence security, cybersecurity, responsible artificial intelligence, or artificial intelligence governance
  • Experience designing and operationalizing trust and safety testing programs for large-scale consumer platforms, including escalation workflows, issue triage, and remediation tracking
  • Experience working with product, legal, policy, and engineering stakeholders to translate risk findings into practical platform controls and governance improvements

The wage range for this role takes into account the wide range of factors that are considered in making compensation decisions including but not limited to skill sets; experience and training; licensure and certifications; and other business and organizational needs. The disclosed range estimate has not been adjusted for the applicable geographic differential associated with the location at which the position may be filled. At Deloitte, it is not typical for an individual to be hired at or near the top of the range for their role and compensation decisions are dependent on the facts and circumstances of each case. A reasonable estimate of the current range is $134,500 to $265,100.

You may also be eligible to participate in a discretionary annual incentive program, subject to the rules governing the program, whereby an award, if any, depends on various factors, including, without limitation, individual and organizational performance.

#CyberDTP27

Education:Bachelor's DegreeEmployment Type:

What Deloitte employees say

Pay

Benefits

Hours and flexibility

Workplace

Get the full story on Breakroom