Digital Marketing Specialist
Irvine, CA · On-site
Apply AI prompt best practices and critically evaluate AI-generated content for quality, clarity ... Support A/B and multivariate testing initiatives across email, landing pages, and campaign assets.
Irvine, CA · On-site
Apply AI prompt best practices and critically evaluate AI-generated content for quality, clarity ... Support A/B and multivariate testing initiatives across email, landing pages, and campaign assets.
Irvine, CA · On-site
Apply AI prompt best practices and critically evaluate AI-generated content for quality, clarity ... Support A/B and multivariate testing initiatives across email, landing pages, and campaign assets.
$140K - $175K/yr
... prompt injection, and other unintended side effects. 2. Engineering & Automation (The "Builder") * Automate adversarial testing: Build AI-driven frameworks to scale our Red Teaming and vulnerability ...
$140K - $175K/yr
... prompt injection, and other unintended side effects. 2. Engineering & Automation (The "Builder") * Automate adversarial testing: Build AI-driven frameworks to scale our Red Teaming and vulnerability ...
Lake Forest, CA · Hybrid
$103K - $172K/yr
Must be able to use prompt engineering to carry out multiple development tasks. * Familiar with AI ... Experience with tools for automated testing and evaluation of AI outputs * Excellent problem ...
New
Lake Forest, CA · Hybrid
$103K - $172K/yr
Must be able to use prompt engineering to carry out multiple development tasks. * Familiar with AI ... Experience with tools for automated testing and evaluation of AI outputs * Excellent problem ...
New
Diamond Bar, CA · On-site
$145K - $198K/yr
... with prompt engineering and the development of automated legal workflows. * Serve as the primary ... Have a solid understanding of product management concepts (scoping, UI/UX basics, and user testing ...
Diamond Bar, CA · On-site
$145K - $198K/yr
... with prompt engineering and the development of automated legal workflows. * Serve as the primary ... Have a solid understanding of product management concepts (scoping, UI/UX basics, and user testing ...
Irvine, CA · Remote
$159K - $165K/yr
Own the reference architecture for the AI platform, including API abstractions, prompt and version ... to enable reproducible model testing and safe AI adoption by product teams. * Establish ...
Irvine, CA · Remote
$159K - $165K/yr
Own the reference architecture for the AI platform, including API abstractions, prompt and version ... to enable reproducible model testing and safe AI adoption by product teams. * Establish ...
Irvine, CA · On-site
$159K - $165K/yr
Own the reference architecture for the AI platform, including API abstractions, prompt and version ... to enable reproducible model testing and safe AI adoption by product teams. * Establish ...
Quick apply
Irvine, CA · On-site
$159K - $165K/yr
Own the reference architecture for the AI platform, including API abstractions, prompt and version ... to enable reproducible model testing and safe AI adoption by product teams. * Establish ...
Irvine, CA · On-site
$50K - $112K/yr
... prompt engineering, LLM evaluation, and fine-tuning, to develop production-ready applications ... testing, and adversarial benchmarking, to assess reasoning, tool-calling reliability, and output ...
Irvine, CA · On-site
$50K - $112K/yr
... prompt engineering, LLM evaluation, and fine-tuning, to develop production-ready applications ... testing, and adversarial benchmarking, to assess reasoning, tool-calling reliability, and output ...
$55K - $187K/yr
Responsibilities - Apply automated testing and governance controls effectively - Analyze complex ... prompt engineering concepts - Understanding enterprise data patterns and quality frameworks ...
$55K - $187K/yr
Responsibilities - Apply automated testing and governance controls effectively - Analyze complex ... prompt engineering concepts - Understanding enterprise data patterns and quality frameworks ...
$110K - $144K/yr
... testing, validation, and operational excellence - Establish and drive consistent quality control ... and prompt engineering - Proven specialization with major cloud platforms such as AWS, Azure, or ...
$110K - $144K/yr
... testing, validation, and operational excellence - Establish and drive consistent quality control ... and prompt engineering - Proven specialization with major cloud platforms such as AWS, Azure, or ...
$214K - $267K/yr
Lead the design and implementation of advanced AI solutions, primarily utilizing LLMs for natural ... and A/B testing for prompt optimization * Understanding of context engineering principles ...
$214K - $267K/yr
Lead the design and implementation of advanced AI solutions, primarily utilizing LLMs for natural ... and A/B testing for prompt optimization * Understanding of context engineering principles ...
Irvine, CA · On-site +1
$130K - $145K/yr
... AI and LLM features including golden datasets, eval suites, and regression detection for prompt and ... Experience testing complex multi-system integrations including mocking, contract testing, and test ...
Irvine, CA · On-site +1
$130K - $145K/yr
... AI and LLM features including golden datasets, eval suites, and regression detection for prompt and ... Experience testing complex multi-system integrations including mocking, contract testing, and test ...
Role Summary Rivian's AI team sits within the Analytics function of the Customer organization-the ... Behavioral Prompt Engineering: Continuously iterate on complex system prompting, structured output ...
Role Summary Rivian's AI team sits within the Analytics function of the Customer organization-the ... Behavioral Prompt Engineering: Continuously iterate on complex system prompting, structured output ...
Role Summary Rivian's AI team sits within the Analytics function of the Customer organization-the ... Behavioral Prompt Engineering: Continuously iterate on complex system prompting, structured output ...
Role Summary Rivian's AI team sits within the Analytics function of the Customer organization-the ... Behavioral Prompt Engineering: Continuously iterate on complex system prompting, structured output ...
Role Summary Rivian's AI team sits within the Analytics function of the Customer organization--the ... Behavioral Prompt Engineering: Continuously iterate on complex system prompting, structured output ...
Role Summary Rivian's AI team sits within the Analytics function of the Customer organization--the ... Behavioral Prompt Engineering: Continuously iterate on complex system prompting, structured output ...
$140K - $160K/yr
Contribute to the team's AI Governance practices, including prompt version control, agent testing, and compliance with the Axos AI Governance Management Directive. Operational Excellence & Continuous ...
$140K - $160K/yr
Contribute to the team's AI Governance practices, including prompt version control, agent testing, and compliance with the Axos AI Governance Management Directive. Operational Excellence & Continuous ...
Irvine, CA · Remote
$60 - $70/hr
Set the standard for AI-assisted development: use modern AI tooling in your own work, and establish the practices (review, testing, security, prompt and context discipline) that make it safe and ...
Quick apply
Irvine, CA · Remote
$60 - $70/hr
Set the standard for AI-assisted development: use modern AI tooling in your own work, and establish the practices (review, testing, security, prompt and context discipline) that make it safe and ...
Irvine, CA · On-site +1
$144K - $194K/yr
... testing of complex software systems and applications. This senior-level position is responsible for ... AI landscape, including SLM success areas, prompt engineering, and synthetic data generation.
Irvine, CA · On-site +1
$144K - $194K/yr
... testing of complex software systems and applications. This senior-level position is responsible for ... AI landscape, including SLM success areas, prompt engineering, and synthetic data generation.
Irvine, CA · On-site
$144K - $194K/yr
... testing of complex software systems and applications. This senior-level position is responsible for ... AI landscape, including SLM success areas, prompt engineering, and synthetic data generation.
Irvine, CA · On-site
$144K - $194K/yr
... testing of complex software systems and applications. This senior-level position is responsible for ... AI landscape, including SLM success areas, prompt engineering, and synthetic data generation.
Irvine, CA · On-site
$60 - $70/hr
Set the standard for AI-assisted development: use modern AI tooling in your own work, and establish the practices (review, testing, security, prompt and context discipline) that make it safe and ...
Irvine, CA · On-site
$60 - $70/hr
Set the standard for AI-assisted development: use modern AI tooling in your own work, and establish the practices (review, testing, security, prompt and context discipline) that make it safe and ...
Irvine, CA · On-site +1
Practical experience deploying AI/ML models in production, prompt engineering, fine-tuning, and ... testing, and observability. * Mentorship: Act as a force multiplier by mentoring Senior Engineers ...
Irvine, CA · On-site +1
Practical experience deploying AI/ML models in production, prompt engineering, fine-tuning, and ... testing, and observability. * Mentorship: Act as a force multiplier by mentoring Senior Engineers ...
$14.80 - $15.55
4% of jobs
$15.55 - $16.30
13% of jobs
$16.88 is the 25th percentile. Wages below this are outliers.
$16.30 - $17.05
11% of jobs
$17.05 - $17.81
7% of jobs
$17.81 - $18.56
7% of jobs
The median wage is $19.03 / hr.
$18.56 - $19.31
13% of jobs
$19.31 - $20.06
13% of jobs
$20.61 is the 75th percentile. Wages above this are outliers.
$20.06 - $20.81
11% of jobs
$20.81 - $21.57
8% of jobs
$21.57 - $22.32
7% of jobs
$22.32 - $23.07
6% of jobs
$14
$19
$23
AI Prompt Testers often encounter challenges such as ensuring prompt accuracy across diverse contexts, identifying subtle biases or inconsistencies in AI-generated outputs, and adapting to frequent software updates or changes in model behavior. They may need to balance thorough testing with efficiency under tight deadlines, and clearly communicate feedback to developers or product teams. Tackling these challenges requires strong analytical skills, adaptability, and close collaboration with cross-functional teams to help improve product quality and user experience.
To thrive as an AI Prompt Tester, you need a strong grasp of language comprehension, analytical thinking, and familiarity with AI-driven content generation platforms. Experience using tools like GPT-based interfaces, prompt management systems, and possibly certifications in machine learning or natural language processing can be advantageous. Attention to detail, problem-solving, and effective communication are valuable soft skills in this role. These skills are crucial for ensuring high-quality, relevant AI outputs and facilitating continuous improvements in AI prompt performance.
An AI Prompt Tester evaluates and refines AI-generated responses by testing different prompts to ensure accuracy, relevance, and coherence. They analyze outputs, identify inconsistencies, and provide feedback to improve AI models. This role requires critical thinking, attention to detail, and a strong understanding of AI behavior. It is commonly used in AI development, chatbots, and content generation systems.
Full-time
Medical, Dental, Vision, Life, Retirement, PTO
Re-posted 12 hours ago
8.8
Based on 14 frontline employees who took The Breakroom Quiz
Sourced by ZipRecruiter
Construction and construction
10,000+ Employees
The Woodlands, TX, US
1889