You will be actively involved with designing, testing and delivering next generation AI ... Knowledge of Generative AI concepts and techniques * Excellent problem-solving and analytical ...
You will be actively involved with designing, testing and delivering next generation AI ... Knowledge of Generative AI concepts and techniques * Excellent problem-solving and analytical ...
Applied AI Engineer
San Diego, CA · On-site
Implement end-to-end generative AI solutions, including model fine-tuning, deployment, and testing in production environments. * Collaborate with cloud engineering, AI, and ML Ops teams to ...
Applied AI Engineer
San Diego, CA · On-site
Implement end-to-end generative AI solutions, including model fine-tuning, deployment, and testing in production environments. * Collaborate with cloud engineering, AI, and ML Ops teams to ...
... Generative AI concepts and techniques • Excellent problem-solving and analytical skills • ... testing tools and frameworks (Pytest, JUnit) • Experience working with Linux and Windows ...
... Generative AI concepts and techniques • Excellent problem-solving and analytical skills • ... testing tools and frameworks (Pytest, JUnit) • Experience working with Linux and Windows ...
Senior Software Engineer, Generative AI, gUP
Sunnyvale, CA · On-site
$143K - $188K/yr
... Generative AI ... The role involves designing, developing, testing, and maintaining software solutions while managing ...
Senior Software Engineer, Generative AI, gUP
Sunnyvale, CA · On-site
$143K - $188K/yr
... Generative AI ... The role involves designing, developing, testing, and maintaining software solutions while managing ...
We're looking for a Generative Creative Technologist to join Intuit's Marketing Futures Team, a ... Design and execute rapid A/B/C testing programs for AI-generated creative, measuring lift in CTR ...
We're looking for a Generative Creative Technologist to join Intuit's Marketing Futures Team, a ... Design and execute rapid A/B/C testing programs for AI-generated creative, measuring lift in CTR ...
Generative Creative Technologist, Marketing Futures
San Diego, CA · On-site
$154K - $209K/yr
You will push the boundaries of what's possible in marketing creative by harnessing generative AI ... Design and execute rapid A/B/C testing programs for AI‑generated creative, measuring lift in CTR ...
Generative Creative Technologist, Marketing Futures
San Diego, CA · On-site
$154K - $209K/yr
You will push the boundaries of what's possible in marketing creative by harnessing generative AI ... Design and execute rapid A/B/C testing programs for AI‑generated creative, measuring lift in CTR ...
You will push the boundaries of what's possible in marketing creative by harnessing generative AI ... Design and execute rapid A/B/C testing programs for AIgenerated creative, measuring lift in CTR ...
You will push the boundaries of what's possible in marketing creative by harnessing generative AI ... Design and execute rapid A/B/C testing programs for AIgenerated creative, measuring lift in CTR ...
You will push the boundaries of what's possible in marketing creative by harnessing generative AI ... Design and execute rapid A/B/C testing programs for AI‑generated creative, measuring lift in CTR ...
You will push the boundaries of what's possible in marketing creative by harnessing generative AI ... Design and execute rapid A/B/C testing programs for AI‑generated creative, measuring lift in CTR ...
You will push the boundaries of what's possible in marketing creative by harnessing generative AI ... Design and execute rapid A/B/C testing programs for AIgenerated creative, measuring lift in CTR ...
You will push the boundaries of what's possible in marketing creative by harnessing generative AI ... Design and execute rapid A/B/C testing programs for AIgenerated creative, measuring lift in CTR ...
Staff AI Engineer
Menlo Park, CA · On-site
About Us Hippocratic AI is the leading generative AI company in healthcare. We have the only system ... Own the safety and evaluation bar across model evaluation, safety testing, and observability.
Staff AI Engineer
Menlo Park, CA · On-site
About Us Hippocratic AI is the leading generative AI company in healthcare. We have the only system ... Own the safety and evaluation bar across model evaluation, safety testing, and observability.
AI Architect
San Jose, CA · On-site
This role focuses on creating advanced AI applications, including Generative AI systems like ... Ensure code quality and maintainability through unit testing, code reviews, and adherence to best ...
Quick apply
AI Architect
San Jose, CA · On-site
This role focuses on creating advanced AI applications, including Generative AI systems like ... Ensure code quality and maintainability through unit testing, code reviews, and adherence to best ...
Principal Engineer, Software (R5285)
San Diego, CA · On-site
$143K - $192K/yr
... I testing • Experience with Electron (or similar). • Building debugging/inspection UIs for generative AI systems • Experience with user experience design video games • Experience designing ...
Principal Engineer, Software (R5285)
San Diego, CA · On-site
$143K - $192K/yr
... I testing • Experience with Electron (or similar). • Building debugging/inspection UIs for generative AI systems • Experience with user experience design video games • Experience designing ...
AI Architect
San Jose, CA · On-site
This role focuses on creating advanced AI applications, including Generative AI systems like ... Ensure code quality and maintainability through unit testing, code reviews, and adherence to best ...
Quick apply
AI Architect
San Jose, CA · On-site
This role focuses on creating advanced AI applications, including Generative AI systems like ... Ensure code quality and maintainability through unit testing, code reviews, and adherence to best ...
... Generative AI (e.g., misuse of generative models, generation of harmful or biased content, etc ... A/B testing, deployment, and operational monitoring. • Exceptional problem-solving abilities ...
... Generative AI (e.g., misuse of generative models, generation of harmful or biased content, etc ... A/B testing, deployment, and operational monitoring. • Exceptional problem-solving abilities ...
The Generative AI Applications Engineer will develop secure and scalable GenAI applications ... authoring/testing, A/B experimentation, and LLM Ops. • Responsible AI expertise (privacy ...
The Generative AI Applications Engineer will develop secure and scalable GenAI applications ... authoring/testing, A/B experimentation, and LLM Ops. • Responsible AI expertise (privacy ...
The Generative AI Applications Engineer will be responsible for developing secure and scalable ... authoring/testing, A/B experimentation, and LLM Ops. • Responsible AI expertise (privacy ...
The Generative AI Applications Engineer will be responsible for developing secure and scalable ... authoring/testing, A/B experimentation, and LLM Ops. • Responsible AI expertise (privacy ...
AI Engineer (AI Accelerator Program)
San Francisco, CA · On-site
$62.25 - $85.25/hr
Responsibilities include building robust data pipelines, deploying machine learning and generative ... Performs or directs highly complex data modeling, performance and integration testing and builds ...
AI Engineer (AI Accelerator Program)
San Francisco, CA · On-site
$62.25 - $85.25/hr
Responsibilities include building robust data pipelines, deploying machine learning and generative ... Performs or directs highly complex data modeling, performance and integration testing and builds ...
Software Engineer, Backend/Applied ML (Safety & Integrity)
Redwood City, CA · On-site
$150K - $300K/yr
... Generative AI (e.g., misuse of generative models, generation of harmful or biased content, etc ... testing, deployment, and operational monitoring. * Exceptional problem-solving abilities, with a ...
Software Engineer, Backend/Applied ML (Safety & Integrity)
Redwood City, CA · On-site
$150K - $300K/yr
... Generative AI (e.g., misuse of generative models, generation of harmful or biased content, etc ... testing, deployment, and operational monitoring. * Exceptional problem-solving abilities, with a ...
AI Engineer with Java background
Sunnyvale, CA · On-site
$61.75 - $84.50/hr
Design, develop, and deploy AI-powered applications and solutions using modern LLMs and Generative ... Participate in architecture discussions, code reviews, testing, deployment, and ongoing support ...
AI Engineer with Java background
Sunnyvale, CA · On-site
$61.75 - $84.50/hr
Design, develop, and deploy AI-powered applications and solutions using modern LLMs and Generative ... Participate in architecture discussions, code reviews, testing, deployment, and ongoing support ...
Senior AI Engineer
Dublin, CA · On-site
$117K - $161K/yr
Build and productionize ML and Generative AI workflows , including prompt engineering, retrieval ... Implement prompt versioning, experimentation, and A/B testing to support rapid iteration and data ...
Senior AI Engineer
Dublin, CA · On-site
$117K - $161K/yr
Build and productionize ML and Generative AI workflows , including prompt engineering, retrieval ... Implement prompt versioning, experimentation, and A/B testing to support rapid iteration and data ...
Generative Ai Testing information
What is the difference between Generative Ai Testing vs Data Scientist?
| Aspect | Generative Ai Testing | Data Scientist |
|---|---|---|
| Required Credentials | Knowledge of AI models, testing tools, programming skills | Statistics, programming, data analysis certifications |
| Work Environment | AI development teams, testing labs, tech companies | Research labs, tech firms, finance, healthcare |
| Employer & Industry Usage | AI product testing, quality assurance in tech | Data analysis, predictive modeling across industries |
Generative Ai Testing focuses on evaluating and validating AI-generated content and models, ensuring quality and accuracy. Data Scientists analyze data, build models, and derive insights. While both roles require programming and AI knowledge, Generative Ai Testing emphasizes testing processes, whereas Data Scientists focus on data analysis and model development.
How much do AI testers get paid?
AI testers, involved in evaluating and validating generative AI models, typically earn salaries ranging from $60,000 to $120,000 annually depending on experience, location, and company size. Entry-level positions may start lower, while experienced testers with specialized skills in machine learning and data analysis can earn higher wages.
Is AI testing a good career?
AI testing, including roles like Generative AI Testing, is a growing field with increasing demand for skills in machine learning, data analysis, and software quality assurance. It offers opportunities in tech companies, research labs, and startups, often requiring knowledge of AI frameworks and testing tools. The career can be stable and rewarding for those with technical expertise and an interest in AI development.
What are the key skills and qualifications needed to thrive as a Generative AI Testing Specialist, and why are they important?
To thrive as a Generative AI Testing Specialist, you need a robust understanding of machine learning principles, model evaluation techniques, and a background in computer science or a related field. Familiarity with tools such as Python, TensorFlow, PyTorch, and model evaluation frameworks, as well as experience with automated testing platforms, is typically required. Analytical thinking, attention to detail, and strong communication skills help you identify model weaknesses and collaborate effectively with development teams. These skills are crucial to ensure the reliability, safety, and ethical deployment of generative AI solutions.
What is the salary of generative AI tester?
The salary of a generative AI tester typically ranges from $70,000 to $120,000 annually, depending on experience, location, and company size. Entry-level positions may start lower, while experienced testers with specialized skills in AI and machine learning can earn higher salaries. Certifications in AI or related fields can also influence compensation.
What are some common challenges faced when testing generative AI models, and how can I prepare to address them in this role?
Testing generative AI models often involves unique challenges such as evaluating the quality and relevance of generated content, detecting bias or inappropriate outputs, and ensuring model consistency across various prompts. You may work closely with data scientists and engineers to create robust evaluation frameworks and develop automated as well as manual testing strategies. Familiarity with prompt engineering, statistical evaluation techniques, and domain-specific knowledge will help you address these challenges effectively. Proactively staying updated on industry best practices and collaborating with cross-functional teams are key to success in this dynamic field.
How do I become an AI tester?
To become an AI tester, you should have a strong understanding of machine learning concepts, programming skills in languages like Python, and experience with data annotation and model evaluation. Familiarity with AI tools, testing frameworks, and quality assurance processes is also important. Gaining relevant certifications or training in AI and software testing can enhance your qualifications.
What is Generative AI Testing?
Generative AI Testing refers to the process of evaluating and validating AI systems, particularly those that generate content such as text, images, or code. This type of testing focuses on assessing the accuracy, reliability, fairness, and safety of generative models to ensure they function as intended and avoid producing harmful or biased outputs. Testers use various methods, including automated and manual techniques, to check for issues like hallucinations, inappropriate content, or security vulnerabilities. The goal is to build trust in generative AI systems and ensure they meet quality and ethical standards before deployment.
What are popular job titles related to Generative Ai Testing jobs in California? For Generative Ai Testing jobs in California, the most frequently searched job titles are:
What job categories do people searching Generative Ai Testing jobs in California look for? The top searched job categories for Generative Ai Testing jobs in California are:
What cities in California are hiring for Generative Ai Testing jobs? Cities in California with the most Generative Ai Testing job openings:
Other
Re-posted 23 days ago
Esri rating
9.5
Based on 7 frontline employees who took The Breakroom Quiz
6th of 209 rated software companies
Job description
Overview
Join our team in building the next generation of AI capabilities in ArcGIS Enterprise, a suite of products delivering state-of-the-art mapping and analytics capabilities to millions of users worldwide. Our team builds cutting-edge, highly scalable, and reliable distributed software for on-premises and cloud environments. Our software is used to make maps, geographic information, and analyses available on any device, anywhere, at any time.
As a product engineer, you are integral to delivering high-quality software working with our cross-functional global team of product engineers and developers. You will be actively involved with designing, testing and delivering next generation AI capabilities in ArcGIS Enterprise using software development and quality assurance practices.
If you are passionate about software quality, geospatial technology, AI and can develop a deep understanding of our products and customer needs, this is the place to be.
Responsibilities
- Contribute to the development, deployment and maintenance of AI frameworks, services, applications and models
- Collaborate with cross-functional teams to deliver AI based services and servers in ArcGIS Online, Enterprise and cloud platforms
- Triage, troubleshoot and address reported issues in the software
- Ensure software quality and participate in software security reviews
- Communicate project status regularly to the team
Requirements
- 2+ years of Python or Java programming experience
- Experience with SDLC, source control and agile practices for project management
- Experience with containers, Kubernetes, and cloud environments (AWS/Azure/GCP)
- Knowledge of Generative AI concepts and techniques
- Excellent problem-solving and analytical skills
- Effective time management, and organizational skills
- Good written and verbal communication skills
- Bachelor's degree in GIS, geography, engineering, computer science, or related fields
Recommended Qualifications
- Experience with ArcGIS Enterprise, ArcGIS Online or other geospatial technology
- Familiarity with performance monitoring (JMeter), testing tools and frameworks (Pytest, JUnit)
- Experience working with Linux and Windows operating systems
#LI-TA1
#LI-Onsite
About ESRI
Sourced by ZipRecruiter
Our passion for improving quality of life through geography is at the heart of everything we do. Esri's geographic information system (GIS) technology inspires and enables governments, universities, and businesses worldwide to save money, lives, and our environment through a deeper understanding of the changing world around them.
Industry
Scientific research and development services
Company size
1,001 - 5,000 Employees
Headquarters location
Redlands, CA, US
Year founded
1969