Designing and executing testing scenarios to identify how prompts or user inputs could be manipulated to generate harmful, misleading, or misaligned generative artificial intelligence outputs.
Designing and executing testing scenarios to identify how prompts or user inputs could be manipulated to generate harmful, misleading, or misaligned generative artificial intelligence outputs.
Designing and executing testing scenarios to identify how prompts or user inputs could be manipulated to generate harmful, misleading, or misaligned generative artificial intelligence outputs.
Designing and executing testing scenarios to identify how prompts or user inputs could be manipulated to generate harmful, misleading, or misaligned generative artificial intelligence outputs.
Designing and executing testing scenarios to identify how prompts or user inputs could be manipulated to generate harmful, misleading, or misaligned generative artificial intelligence outputs.
Designing and executing testing scenarios to identify how prompts or user inputs could be manipulated to generate harmful, misleading, or misaligned generative artificial intelligence outputs.
Artificial Intelligence/Machine Learning Engineer (AI/ML)
Chantilly, VA · On-site
$100K - $200K/yr
Analyze model performance and identify opportunities for improvement by leveraging testing ... Our robust portfolio of offerings across the defense, space, intelligence, and civilian markets ...
Artificial Intelligence/Machine Learning Engineer (AI/ML)
Chantilly, VA · On-site
$100K - $200K/yr
Analyze model performance and identify opportunities for improvement by leveraging testing ... Our robust portfolio of offerings across the defense, space, intelligence, and civilian markets ...
Artificial Intelligence/Machine Learning Engineer (AI/ML)
Chantilly, VA · On-site
$100K - $200K/yr
Analyze model performance and identify opportunities for improvement by leveraging testing ... Our robust portfolio of offerings across the defense, space, intelligence, and civilian markets ...
Artificial Intelligence/Machine Learning Engineer (AI/ML)
Chantilly, VA · On-site
$100K - $200K/yr
Analyze model performance and identify opportunities for improvement by leveraging testing ... Our robust portfolio of offerings across the defense, space, intelligence, and civilian markets ...
Artificial Intelligence/Machine Learning Engineer (AI/ML)
Chantilly, VA · On-site
$100K - $200K/yr
Analyze model performance and identify opportunities for improvement by leveraging testing ... Our robust portfolio of offerings across the defense, space, intelligence, and civilian markets ...
Artificial Intelligence/Machine Learning Engineer (AI/ML)
Chantilly, VA · On-site
$100K - $200K/yr
Analyze model performance and identify opportunities for improvement by leveraging testing ... Our robust portfolio of offerings across the defense, space, intelligence, and civilian markets ...
... Artificial Intelligence/Machine Learning (AI/ML) based solutions into operational pipelines to ... testing, system design, and technical documentation. Clearance Requirements: * Must be a U.S.
... Artificial Intelligence/Machine Learning (AI/ML) based solutions into operational pipelines to ... testing, system design, and technical documentation. Clearance Requirements: * Must be a U.S.
Artificial Intelligence/Machine Learning Engineer (AI/ML)
Chantilly, VA · On-site
$100K - $200K/yr
Analyze model performance and identify opportunities for improvement by leveraging testing ... engineering, intelligence, and enterprise information technology markets. SAIC is Redefining ...
Artificial Intelligence/Machine Learning Engineer (AI/ML)
Chantilly, VA · On-site
$100K - $200K/yr
Analyze model performance and identify opportunities for improvement by leveraging testing ... engineering, intelligence, and enterprise information technology markets. SAIC is Redefining ...
Geospatial AI Data Annotator
Falls Church, VA · On-site
$20 - $24/hr
... artificial intelligence technologies. We leverage the unique talents of veterans, people with ... testing and evaluation. At EI we respect and celebrate individuals from all walks of life. Our ...
Geospatial AI Data Annotator
Falls Church, VA · On-site
$20 - $24/hr
... artificial intelligence technologies. We leverage the unique talents of veterans, people with ... testing and evaluation. At EI we respect and celebrate individuals from all walks of life. Our ...
Penetration Tester
Herndon, VA · On-site
$86K - $198K/yr
Conduct testing and analysis to identify vulnerabilities and potential threat vectors in systems ... Knowledge of tools, tactics, and techniques targeting Artificial Intelligence (AI) systems and ...
Penetration Tester
Herndon, VA · On-site
$86K - $198K/yr
Conduct testing and analysis to identify vulnerabilities and potential threat vectors in systems ... Knowledge of tools, tactics, and techniques targeting Artificial Intelligence (AI) systems and ...
Geospatial AI Data Annotator
Falls Church, VA · On-site
$20 - $24/hr
... artificial intelligence technologies. We leverage the unique talents of veterans, people with ... testing and evaluation. At EI we respect and celebrate individuals from all walks of life. Our ...
Quick apply
Geospatial AI Data Annotator
Falls Church, VA · On-site
$20 - $24/hr
... artificial intelligence technologies. We leverage the unique talents of veterans, people with ... testing and evaluation. At EI we respect and celebrate individuals from all walks of life. Our ...
... artificial intelligence technologies. We leverage the unique talents of veterans, people with ... testing and evaluation. At EI we respect and celebrate individuals from all walks of life. Our ...
... artificial intelligence technologies. We leverage the unique talents of veterans, people with ... testing and evaluation. At EI we respect and celebrate individuals from all walks of life. Our ...
Penetration Tester
Herndon, VA · On-site
$86K - $198K/yr
Conduct testing and analysis to identify vulnerabilities and potential threat vectors in systems ... Knowledge of tools, tactics, and techniques targeting Artificial Intelligence (AI) systems and ...
Penetration Tester
Herndon, VA · On-site
$86K - $198K/yr
Conduct testing and analysis to identify vulnerabilities and potential threat vectors in systems ... Knowledge of tools, tactics, and techniques targeting Artificial Intelligence (AI) systems and ...
All-Source Intelligence Analyst with Security Clearance
Reston, VA · On-site
$77K - $176K/yr
... development, and testing * Experience reviewing analytical products for cogent arguments ... As part of this commitment, the use of artificial intelligence (AI) or other tools to assist with ...
All-Source Intelligence Analyst with Security Clearance
Reston, VA · On-site
$77K - $176K/yr
... development, and testing * Experience reviewing analytical products for cogent arguments ... As part of this commitment, the use of artificial intelligence (AI) or other tools to assist with ...
Open-Source Intelligence Analyst with Security Clearance
Charlottesville, VA · On-site
$61K - $141K/yr
Your responsibilities include testing and evaluating new OSINT tools and techniques, writing and ... As part of this commitment, the use of artificial intelligence (AI) or other tools to assist with ...
Open-Source Intelligence Analyst with Security Clearance
Charlottesville, VA · On-site
$61K - $141K/yr
Your responsibilities include testing and evaluating new OSINT tools and techniques, writing and ... As part of this commitment, the use of artificial intelligence (AI) or other tools to assist with ...
All-Source Intelligence Analyst
Reston, VA · On-site
$77K - $176K/yr
... development, and testing * Experience reviewing analytical products for cogent arguments ... As part of this commitment, the use of artificial intelligence (AI) or other tools to assist with ...
All-Source Intelligence Analyst
Reston, VA · On-site
$77K - $176K/yr
... development, and testing * Experience reviewing analytical products for cogent arguments ... As part of this commitment, the use of artificial intelligence (AI) or other tools to assist with ...
All-Source Intelligence Analyst
$77K - $176K/yr
... development, and testing * Experience reviewing analytical products for cogent arguments ... As part of this commitment, the use of artificial intelligence (AI) or other tools to assist with ...
All-Source Intelligence Analyst
$77K - $176K/yr
... development, and testing * Experience reviewing analytical products for cogent arguments ... As part of this commitment, the use of artificial intelligence (AI) or other tools to assist with ...
All-Source Intelligence Analyst
Reston, VA · On-site +1
$77K - $176K/yr
... development, and testing * Experience reviewing analytical products for cogent arguments ... As part of this commitment, the use of artificial intelligence (AI) or other tools to assist with ...
All-Source Intelligence Analyst
Reston, VA · On-site +1
$77K - $176K/yr
... development, and testing * Experience reviewing analytical products for cogent arguments ... As part of this commitment, the use of artificial intelligence (AI) or other tools to assist with ...
Penetration Tester, Mid (TS/SCI Clearance)
Arlington, VA · On-site
$90K - $130K/yr
The WDP is an enterprise-wide, multi-domain data, analytics, and Artificial Intelligence (AI ... Comprehensive Security Testing: Perform various types of penetration tests, including network, web ...
Penetration Tester, Mid (TS/SCI Clearance)
Arlington, VA · On-site
$90K - $130K/yr
The WDP is an enterprise-wide, multi-domain data, analytics, and Artificial Intelligence (AI ... Comprehensive Security Testing: Perform various types of penetration tests, including network, web ...
Penetration Tester, Senior (TS/SCI Clearance)
Arlington, VA · On-site
$110K - $160K/yr
The WDP is an enterprise-wide, multi-domain data, analytics, and Artificial Intelligence (AI ... Comprehensive Security Testing: Perform various types of penetration tests, including network, web ...
Penetration Tester, Senior (TS/SCI Clearance)
Arlington, VA · On-site
$110K - $160K/yr
The WDP is an enterprise-wide, multi-domain data, analytics, and Artificial Intelligence (AI ... Comprehensive Security Testing: Perform various types of penetration tests, including network, web ...
Overnight Artificial Intelligence Testing information
What is overnight artificial intelligence testing?
What are the typical challenges faced in overnight artificial intelligence testing, and how can they be managed?
What are the key skills and qualifications needed to thrive in overnight artificial intelligence testing, and why are they important?
What is the difference between Overnight Artificial Intelligence Testing vs Data Scientist?
| Aspect | Overnight Artificial Intelligence Testing | Data Scientist |
|---|---|---|
| Credentials | Typically requires knowledge of AI tools, programming, and testing protocols | Requires degrees in data science, statistics, or related fields, often with certifications |
| Work Environment | Primarily in labs or testing facilities, often overnight shifts | Office or remote, with data analysis and modeling tasks |
| Industry Usage | Used in AI development, quality assurance, and validation processes | Applied in data analysis, predictive modeling, and business insights |
Overnight Artificial Intelligence Testing focuses on evaluating AI systems during overnight shifts, emphasizing testing protocols and quality assurance. Data Scientists analyze data, build models, and generate insights. While both roles involve technical skills, AI Testing is more specialized in validation processes, whereas Data Scientists focus on data analysis and modeling.
How do I become an overnight artificial intelligence testing?
What are the most commonly searched types of Artificial Intelligence Testing jobs in Virginia?
The most popular types of Artificial Intelligence Testing jobs in Virginia are:
What cities in Virginia are hiring for Overnight Artificial Intelligence Testing jobs?
Cities in Virginia with the most Overnight Artificial Intelligence Testing job openings:
Deloitte rating
8.2
Based on 92 frontline employees who took The Breakroom Quiz
45th of 151 rated financial services
Job description
Cyber Digital Trust and Online Safety Manager
The Digital Trust & Online Protection Professional will advise clients in developing, managing, and implementing policies, procedures, and strategies to ensure a safe, compliant, and trustworthy environment for our users. This individual will scale and mature digital trust and safety processes, including content compliance, user protection, and regulatory adherence across our platforms for our clients. Working closely with cross-functional stakeholders, this role will monitor regulatory changes, manage risks, and enhance our organization's approach to content safety, user trust, and online integrity.
Recruiting for this role ends on 12/31/3026.
Work you'll do
As a Manager, Strategy, Growth, and Transformation on the Deloitte Cyber team, you will be responsible for:
- Designing and executing testing scenarios to identify how prompts or user inputs could be manipulated to generate harmful, misleading, or misaligned generative artificial intelligence outputs.
- Researching emerging prompt injection, jailbreak, and adversarial testing techniques to evaluate model weaknesses, bias, factual inaccuracy, and misalignment with user intent.
- Assessing the effectiveness of content moderation systems in detecting unsafe outputs and documenting vulnerabilities, failure patterns, and potential misuse impacts.
- Recommending improvements to moderation policies, flagging mechanisms, training data, and governance controls based on testing findings.
- Collaborating with generative artificial intelligence development, content moderation, and cross-functional stakeholders to strengthen security, trust, safety, and responsible use outcomes.
- Developing multimodal test content and novel prompt manipulation methods to identify failure modes across text and other model inputs.
A successful candidate would possess these skills:
- Ability to work independently and collaborate as part of a team
- Effective written and verbal communication skills
- Meticulous attention to detail and quality of work product
- Ability to build and sustain professional relationships
- Ability to lead projects or workstreams
- Ability to manage and prioritize multiple tasks in a fast-paced and dynamic environment
- Strong interpersonal skills and professional demeanor
- Ability to meet deadlines
- Ability to mentor and provide clear guidance to others
The team
Enables trust and safety of online communications and digital products, protecting users, consumers, and patients from harm. Enables clients to provide consumer confidence in knowing with whom they are dealing and ensuring the integrity of access to data.
Qualifications
Required:
- Master's degree in Computer Science, Artificial Intelligence, Machine Learning, Data Science, Cybersecurity, Linguistics, Psychology, or a related field, or equivalent professional experience
- 10+ years of experience in threat modeling and simulation, prompt generation and analysis, novel testing, and reporting and improvement
- Demonstrated hands-on experience, portfolio work, publications, or research in prompt injection, jailbreak testing, model evaluation, adversarial machine learning, multimodal artificial intelligence safety, or generative artificial intelligence vulnerability assessment
- Ability to travel 25-50%, on average, based on the work you do and the clients and industries/sectors you serve.
- Limited immigration sponsorship may be available.
Preferred:
- Doctor of Philosophy (PhD) in Computer Science, Artificial Intelligence, Machine Learning, Data Science, Cybersecurity, Linguistics, Psychology, or a related field, or equivalent professional experience
- Specialized training or certifications in generative artificial intelligence red teaming, adversarial machine learning, artificial intelligence security, cybersecurity, responsible artificial intelligence, or artificial intelligence governance
- Experience designing and operationalizing trust and safety testing programs for large-scale consumer platforms, including escalation workflows, issue triage, and remediation tracking
- Experience working with product, legal, policy, and engineering stakeholders to translate risk findings into practical platform controls and governance improvements
The wage range for this role takes into account the wide range of factors that are considered in making compensation decisions including but not limited to skill sets; experience and training; licensure and certifications; and other business and organizational needs. The disclosed range estimate has not been adjusted for the applicable geographic differential associated with the location at which the position may be filled. At Deloitte, it is not typical for an individual to be hired at or near the top of the range for their role and compensation decisions are dependent on the facts and circumstances of each case. A reasonable estimate of the current range is $134,500 to $265,100.
You may also be eligible to participate in a discretionary annual incentive program, subject to the rules governing the program, whereby an award, if any, depends on various factors, including, without limitation, individual and organizational performance.
#CyberDTP27
Cyber Digital Trust and Online Safety Manager
The Digital Trust & Online Protection Professional will advise clients in developing, managing, and implementing policies, procedures, and strategies to ensure a safe, compliant, and trustworthy environment for our users. This individual will scale and mature digital trust and safety processes, including content compliance, user protection, and regulatory adherence across our platforms for our clients. Working closely with cross-functional stakeholders, this role will monitor regulatory changes, manage risks, and enhance our organization's approach to content safety, user trust, and online integrity.
Recruiting for this role ends on 12/31/3026.
Work you'll do
As a Manager, Strategy, Growth, and Transformation on the Deloitte Cyber team, you will be responsible for:
- Designing and executing testing scenarios to identify how prompts or user inputs could be manipulated to generate harmful, misleading, or misaligned generative artificial intelligence outputs.
- Researching emerging prompt injection, jailbreak, and adversarial testing techniques to evaluate model weaknesses, bias, factual inaccuracy, and misalignment with user intent.
- Assessing the effectiveness of content moderation systems in detecting unsafe outputs and documenting vulnerabilities, failure patterns, and potential misuse impacts.
- Recommending improvements to moderation policies, flagging mechanisms, training data, and governance controls based on testing findings.
- Collaborating with generative artificial intelligence development, content moderation, and cross-functional stakeholders to strengthen security, trust, safety, and responsible use outcomes.
- Developing multimodal test content and novel prompt manipulation methods to identify failure modes across text and other model inputs.
A successful candidate would possess these skills:
- Ability to work independently and collaborate as part of a team
- Effective written and verbal communication skills
- Meticulous attention to detail and quality of work product
- Ability to build and sustain professional relationships
- Ability to lead projects or workstreams
- Ability to manage and prioritize multiple tasks in a fast-paced and dynamic environment
- Strong interpersonal skills and professional demeanor
- Ability to meet deadlines
- Ability to mentor and provide clear guidance to others
The team
Enables trust and safety of online communications and digital products, protecting users, consumers, and patients from harm. Enables clients to provide consumer confidence in knowing with whom they are dealing and ensuring the integrity of access to data.
Qualifications
Required:
- Master's degree in Computer Science, Artificial Intelligence, Machine Learning, Data Science, Cybersecurity, Linguistics, Psychology, or a related field, or equivalent professional experience
- 10+ years of experience in threat modeling and simulation, prompt generation and analysis, novel testing, and reporting and improvement
- Demonstrated hands-on experience, portfolio work, publications, or research in prompt injection, jailbreak testing, model evaluation, adversarial machine learning, multimodal artificial intelligence safety, or generative artificial intelligence vulnerability assessment
- Ability to travel 25-50%, on average, based on the work you do and the clients and industries/sectors you serve.
- Limited immigration sponsorship may be available.
Preferred:
- Doctor of Philosophy (PhD) in Computer Science, Artificial Intelligence, Machine Learning, Data Science, Cybersecurity, Linguistics, Psychology, or a related field, or equivalent professional experience
- Specialized training or certifications in generative artificial intelligence red teaming, adversarial machine learning, artificial intelligence security, cybersecurity, responsible artificial intelligence, or artificial intelligence governance
- Experience designing and operationalizing trust and safety testing programs for large-scale consumer platforms, including escalation workflows, issue triage, and remediation tracking
- Experience working with product, legal, policy, and engineering stakeholders to translate risk findings into practical platform controls and governance improvements
The wage range for this role takes into account the wide range of factors that are considered in making compensation decisions including but not limited to skill sets; experience and training; licensure and certifications; and other business and organizational needs. The disclosed range estimate has not been adjusted for the applicable geographic differential associated with the location at which the position may be filled. At Deloitte, it is not typical for an individual to be hired at or near the top of the range for their role and compensation decisions are dependent on the facts and circumstances of each case. A reasonable estimate of the current range is $134,500 to $265,100.
You may also be eligible to participate in a discretionary annual incentive program, subject to the rules governing the program, whereby an award, if any, depends on various factors, including, without limitation, individual and organizational performance.
#CyberDTP27
About Deloitte
Sourced by ZipRecruiter
Industry
Finance and insurance and business management consulting
Company size
10,000+ Employees
Headquarters location
Orlando, FL, US