... testing, and maintenance. * Help update production guidelines and workflows to grow audience ... Experience in Generative AI platforms for video production. * Demonstrated ability to deliver ...
... testing, and maintenance. * Help update production guidelines and workflows to grow audience ... Experience in Generative AI platforms for video production. * Demonstrated ability to deliver ...
... testing, and maintenance. * Help update production guidelines and workflows to grow audience ... Experience in Generative AI platforms for video production. * Demonstrated ability to deliver ...
... testing, and maintenance. * Help update production guidelines and workflows to grow audience ... Experience in Generative AI platforms for video production. * Demonstrated ability to deliver ...
AI Architect
Chantilly, VA · On-site
Experience with AI testing, validation, benchmarking, and evaluation frameworks for both traditional ML and generative AI systems. * Experience implementing practical MLOps pipelines and AI ...
AI Architect
Chantilly, VA · On-site
Experience with AI testing, validation, benchmarking, and evaluation frameworks for both traditional ML and generative AI systems. * Experience implementing practical MLOps pipelines and AI ...
... testing, and maintenance. * Help update production guidelines and workflows to grow audience ... Experience in Generative AI platforms for video production. * Demonstrated ability to deliver ...
... testing, and maintenance. * Help update production guidelines and workflows to grow audience ... Experience in Generative AI platforms for video production. * Demonstrated ability to deliver ...
AI Architect
Chantilly, VA · On-site
Experience with AI testing, validation, benchmarking, and evaluation frameworks for both traditional ML and generative AI systems. * Experience implementing practical MLOps pipelines and AI ...
AI Architect
Chantilly, VA · On-site
Experience with AI testing, validation, benchmarking, and evaluation frameworks for both traditional ML and generative AI systems. * Experience implementing practical MLOps pipelines and AI ...
... code, testing techniques, and support activities to enrich the knowledge base and assist other ... and generative AI. • Experience in Optimizing and adapting prompt engineering strategies to ...
... code, testing techniques, and support activities to enrich the knowledge base and assist other ... and generative AI. • Experience in Optimizing and adapting prompt engineering strategies to ...
... AI testing, validation, benchmarking, and evaluation frameworks for both traditional ML and generative AI systems. Experience implementing practical MLOps pipelines and AI operationalization ...
... AI testing, validation, benchmarking, and evaluation frameworks for both traditional ML and generative AI systems. Experience implementing practical MLOps pipelines and AI operationalization ...
CDAO - Enterprise - Generative AI Program Manager, Cybersecurity
Arlington, VA · On-site
$148K - $180K/yr
As a Program Manager for Generative AI Cybersecurity, you will lead initiatives to secure AI ... testing. • We may use this announcement to fill additional vacancies within 90 days of the ...
CDAO - Enterprise - Generative AI Program Manager, Cybersecurity
Arlington, VA · On-site
$148K - $180K/yr
As a Program Manager for Generative AI Cybersecurity, you will lead initiatives to secure AI ... testing. • We may use this announcement to fill additional vacancies within 90 days of the ...
Manager, Generative AI Advisory and Oversight As the Manager, Generative AI Advisory and Oversight ... and testing, ensuring that non-deterministic outputs and autonomous actions remain within risk ...
Manager, Generative AI Advisory and Oversight As the Manager, Generative AI Advisory and Oversight ... and testing, ensuring that non-deterministic outputs and autonomous actions remain within risk ...
Manager, Generative AI Advisory and Oversight
Richmond, VA · On-site
$115K/yr
Manager, Generative AI Advisory and Oversight As the Manager, Generative AI Advisory and Oversight ... and testing, ensuring that non-deterministic outputs and autonomous actions remain within risk ...
Manager, Generative AI Advisory and Oversight
Richmond, VA · On-site
$115K/yr
Manager, Generative AI Advisory and Oversight As the Manager, Generative AI Advisory and Oversight ... and testing, ensuring that non-deterministic outputs and autonomous actions remain within risk ...
Manager, Generative AI Advisory and Oversight
Mclean, VA · On-site
$117K/yr
Manager, Generative AI Advisory and Oversight As the Manager, Generative AI Advisory and Oversight ... and testing, ensuring that non-deterministic outputs and autonomous actions remain within risk ...
Manager, Generative AI Advisory and Oversight
Mclean, VA · On-site
$117K/yr
Manager, Generative AI Advisory and Oversight As the Manager, Generative AI Advisory and Oversight ... and testing, ensuring that non-deterministic outputs and autonomous actions remain within risk ...
The Generative AI Program Manager, Acquisition will lead the acquisition lifecycle for advanced ... testing. • This position requires a Top Secret/ Sensitive Compartmented Information (SCI ...
The Generative AI Program Manager, Acquisition will lead the acquisition lifecycle for advanced ... testing. • This position requires a Top Secret/ Sensitive Compartmented Information (SCI ...
Developer - Generative AI Platform and Mission Support
Herndon, VA · On-site
$86K - $138K/yr
Contribute to broader Generative AI Platform and AI PMO development tasks, including shared ... Familiarity with testing practices, including unit testing and basic integration testing * Strong ...
Developer - Generative AI Platform and Mission Support
Herndon, VA · On-site
$86K - $138K/yr
Contribute to broader Generative AI Platform and AI PMO development tasks, including shared ... Familiarity with testing practices, including unit testing and basic integration testing * Strong ...
Contribute to broader Generative AI Platform and AI PMO development tasks, including shared ... Familiarity with testing practices, including unit testing and basic integration testing * Strong ...
Contribute to broader Generative AI Platform and AI PMO development tasks, including shared ... Familiarity with testing practices, including unit testing and basic integration testing * Strong ...
Contribute to broader Generative AI Platform and AI PMO development tasks, including shared ... Familiarity with testing practices, including unit testing and basic integration testing * Strong ...
Contribute to broader Generative AI Platform and AI PMO development tasks, including shared ... Familiarity with testing practices, including unit testing and basic integration testing * Strong ...
Additionally, this role will support cross-cutting Generative AI Platform and AI PMO development ... Help establish and maintain engineering best practices including code quality standards, testing ...
Additionally, this role will support cross-cutting Generative AI Platform and AI PMO development ... Help establish and maintain engineering best practices including code quality standards, testing ...
Senior Developer - Generative AI Platform and Mission Support
Herndon, VA · On-site
$56 - $74/hr
Additionally, this role will support cross-cutting Generative AI Platform and AI PMO development ... Help establish and maintain engineering best practices including code quality standards, testing ...
Senior Developer - Generative AI Platform and Mission Support
Herndon, VA · On-site
$56 - $74/hr
Additionally, this role will support cross-cutting Generative AI Platform and AI PMO development ... Help establish and maintain engineering best practices including code quality standards, testing ...
Senior Developer - Generative AI Platform and Mission Support
Herndon, VA · On-site
$135K - $216K/yr
Additionally, this role will support cross-cutting Generative AI Platform and AI PMO development ... Help establish and maintain engineering best practices including code quality standards, testing ...
Senior Developer - Generative AI Platform and Mission Support
Herndon, VA · On-site
$135K - $216K/yr
Additionally, this role will support cross-cutting Generative AI Platform and AI PMO development ... Help establish and maintain engineering best practices including code quality standards, testing ...
Contribute to AI productization through governance, telemetry, automated testing, and adversarial ... Demonstrated experience applying generative and agentic AI capabilities to intelligence ...
Quick apply
Contribute to AI productization through governance, telemetry, automated testing, and adversarial ... Demonstrated experience applying generative and agentic AI capabilities to intelligence ...
Contribute to AI productization through governance, telemetry, automated testing, and adversarial ... Demonstrated experience applying generative and agentic AI capabilities to intelligence ...
Contribute to AI productization through governance, telemetry, automated testing, and adversarial ... Demonstrated experience applying generative and agentic AI capabilities to intelligence ...
Generative Ai Testing information
What is the difference between Generative Ai Testing vs Data Scientist?
| Aspect | Generative Ai Testing | Data Scientist |
|---|---|---|
| Required Credentials | Knowledge of AI models, testing tools, programming skills | Statistics, programming, data analysis certifications |
| Work Environment | AI development teams, testing labs, tech companies | Research labs, tech firms, finance, healthcare |
| Employer & Industry Usage | AI product testing, quality assurance in tech | Data analysis, predictive modeling across industries |
Generative Ai Testing focuses on evaluating and validating AI-generated content and models, ensuring quality and accuracy. Data Scientists analyze data, build models, and derive insights. While both roles require programming and AI knowledge, Generative Ai Testing emphasizes testing processes, whereas Data Scientists focus on data analysis and model development.
What are the key skills and qualifications needed to thrive as a Generative AI Testing Specialist, and why are they important?
What are some common challenges faced when testing generative AI models, and how can I prepare to address them in this role?
What is Generative AI Testing?

Other
Medical, Dental, Vision, Retirement
Posted 13 days ago
Job description
IntroductionSHRM is a member-driven catalyst for creating better workplaces where people and businesses thrive together. As the trusted authority on all things work, SHRM is the foremost expert, researcher, advocate, and thought leader on issues and innovations impacting todays evolving workplaces. With nearly 340,000 members in 180 countries, SHRM touches the lives of more than 362 million workers and their families globally.
OverviewThe Specialist is a key member of the SHRM Multimedia team, responsible for the creation, execution, and delivery of engaging video and audio content. Leveraging both traditional and Generative AI methods, this role drives original storytelling, live-streaming, on-site production, and event support. The position primarily engages in thoughtful pre-production recommendations, executes on project delivery while incorporating feedback and supports multimedia efforts with broader organizational objectives, positioning SHRM as a thought leader.
Work Environment
Hybrid Position (3 Days In-Office, 2 Days Remote):
- This position follows a hybrid work schedule, with Tuesday through Thursday in office and Monday and Friday remote. Employees must be available during standard business hours, with core hours beginning between 8:00AM – 9:00AM and concluding between 5:00PM – 6:00PM.
Travel: 20% - 35% to SHRM events/conferences throughout the year, typically 3-5 nights per trip.
Responsibilities
Multimedia Content Creation
- Develop, script, and produce high-quality multimedia content (audio/video/still photography) for internal communications, marketing, product launches, recruiting, training, webinars, and enterprise-wide initiatives.
- Manage all aspects of production: storyboarding, editing, graphics integration, titling, music/voice-over, sound effects, and media archiving.
Generative AI Integration
- Use Generative AI platforms for video and animation production for full video production or to use as elements within the traditional production process.
- Support and answer questions from content production team members on GenAI tools and workflows.
- Monitor emerging digital and AI technologies, proactively sharing relevant tools and practices with the Multimedia team.
- Utilize AI to enhance workflows and train on latest production innovations to develop editing abilities.
Project & Stakeholder Management
- Collaborate with internal stakeholders and other Multimedia team members to coordinate project intake, requirements gathering, and deliverables.
- Review assigned multimedia requests and project details via Monday.com, ensuring all information is complete for efficient assignment and execution.
- Connect daily project work to team objectives and suggest process enhancements to improve efficiency and quality.
Live Event Production
- Set up, operate, and troubleshoot audiovisual equipment for live and on-demand streaming events, both onsite and in studio.
- Oversee technical arrangements, conduct tests, coordinate teleconferences, and ensure seamless event execution.
Team Operations Support
- Support on the management and organization of video libraries in Vimeo.
- Assist in overseeing equipment storage, testing, and maintenance.
- Help update production guidelines and workflows to grow audience engagement and response.
Requirements
Education:
- Bachelor’s degree in communications, marketing or related field. Experience in lieu of a degree may be considered.
Experience:
- Minimum 3 years progressive editing and production experience, utilizing branding and strategy in execution.
- Experience in Generative AI platforms for video production.
- Demonstrated ability to deliver multimedia projects from concept to completion, including live production.
- Proficiency in digital cinema, DSLR and other camera operations, lighting, audio engineering (studio/field), and chroma keying.
- Advanced skills in Adobe Premiere, After Effects, Photoshop, Illustrator.
- Experience with digital content management and video platforms (Riverside, Vimeo, DropBox).
- Strong understanding of live production workflows: video codecs, streaming bandwidths, encoding, graphics integration, live switching.
- Experience using Generative AI tools (OpenArt/Sora, Eleven Labs, Firefly, Descript, Veo, Canva, ChatGPT, Claude, Gemini).
- Skilled in Microsoft Office and project management tools (Monday.com, Jira).
- Explore industry trends and translate them into actionable recommendations.
- Creative, collaborative, and effective communicator across all organizational levels.
- Thrives in dynamic, high-volume environments; adept at managing multiple priorities and responding professionally to feedback.
- Self-motivated, proactive, and accountable for outcomes.
This position operates in a typical office environment and requires the ability to perform essential job functions with or without reasonable accommodation. Physical requirements may include:
- Prolonged periods of sitting at a desk and working on a computer.
- Frequent use of hands and fingers for typing, handling documents, and using office equipment.
- Occasional standing, walking, bending, and reaching.
- Ability to lift and carry up to 30 pounds as needed.
- Clear verbal and written communication skills for effective interaction with colleagues and stakeholders.
The hiring range for this position is $70,000 to $85,000 per year. This range is an estimate, and the actual salary may vary based on the candidate's experience, skills, and qualifications. SHRM offers a competitive and comprehensive total rewards package. The benefits for this position include professional growth and development, health, dental, vision, well-being, health savings, flexible spending, retirement, open leave, and annual discretionary bonus and incentives.
About SHRM
Sourced by ZipRecruiter
SHRM, the Society for Human Resource Management, creates better workplaces where employers and employees thrive together. As the voice of all things work, workers and the workplace, SHRM is the foremost expert, convener and thought leader on issues impacting today's evolving workplaces. With nearly 325,000 members in 165 countries, SHRM impacts the lives of more than 235 million workers and families globally.
Industry
Human resources consulting services
Company size
201 - 500 Employees
Headquarters location
Alexandria, VA, US
Year founded
1948