1

Generative Ai Testing Jobs in Pasadena, CA (NOW HIRING)

Minimum 2 years of hands‑on experience working with Generative AI technologies. * Experience designing, testing, and optimizing prompts for Large Language Models. * Strong understanding of AI model ...

New

AI Architect

Los Angeles, CA · On-site +1

$68 - $89.50/hr

This role is ideal for someone who understands enterprise architecture, Generative AI, AI agents ... Integrate AI capabilities with source control, work management, CI/CD, testing, security scanning ...

New

Senior AI Engineer

Pasadena, CA · On-site

$114K - $156K/yr

Design, develop, and deploy enterprise AI and Generative AI applications for prioritized banking ... Establish engineering practices for CI/CD, testing, model evaluation, observability, performance ...

New

Senior AI Engineering

Pasadena, CA · On-site

$150 - $275/hr

Design, develop, and deploy enterprise AI and Generative AI applications for prioritized banking ... Establish engineering practices for CI/CD, testing, model evaluation, observability, performance ...

Design, develop, and deploy enterprise AI and Generative AI applications for prioritized banking ... Establish engineering practices for CI/CD, testing, model evaluation, observability, performance ...

Support a team of CG and Generative AI experts to develop unique content for animated shorts and ... Help testing and expanding upon new GenAI/traditional hybrid workflows developed by other artists ...

Support a team of CG and Generative AI experts to develop unique content for animated shorts and ... Help testing and expanding upon new GenAI/traditional hybrid workflows developed by other artists ...

Key Responsibilities Support a team of CG and Generative AI experts to develop unique content for ... Help testing and expanding upon new GenAI/traditional hybrid workflows developed by other artists ...

Familiarity with generative-AI tools and platforms, including hands-on prompting and testing of AI APIs. * Ability to quickly learn new domains and translate complex workflows into product ...

next page

Showing results 1-20

Generative Ai Testing information

See Pasadena, CA salary details

$34

$58

$83

How much do generative ai testing jobs pay per hour?

As of Aug 23, 2026, the average hourly pay for generative ai testing in Pasadena, CA is $58.60, according to ZipRecruiter salary data. Most workers in this role earn between $48.27 and $67.12 per hour, depending on experience, location, and employer.

What is generative AI testing?

Generative AI Testing refers to the process of evaluating and validating AI systems, particularly those that generate content such as text, images, or code. This type of testing focuses on assessing the accuracy, reliability, fairness, and safety of generative models to ensure they function as intended and avoid producing harmful or biased outputs. Testers use various methods, including automated and manual techniques, to check for issues like hallucinations, inappropriate content, or security vulnerabilities. The goal is to build trust in generative AI systems and ensure they meet quality and ethical standards before deployment.

What are some common challenges faced when testing generative AI models, and how can I prepare to address them in this role?

Testing generative AI models often involves unique challenges such as evaluating the quality and relevance of generated content, detecting bias or inappropriate outputs, and ensuring model consistency across various prompts. You may work closely with data scientists and engineers to create robust evaluation frameworks and develop automated as well as manual testing strategies. Familiarity with prompt engineering, statistical evaluation techniques, and domain-specific knowledge will help you address these challenges effectively. Proactively staying updated on industry best practices and collaborating with cross-functional teams are key to success in this dynamic field.

What are the key skills and qualifications needed to thrive as a generative AI testing specialist, and why are they important?

To thrive as a Generative AI Testing Specialist, you need a robust understanding of machine learning principles, model evaluation techniques, and a background in computer science or a related field. Familiarity with tools such as Python, TensorFlow, PyTorch, and model evaluation frameworks, as well as experience with automated testing platforms, is typically required. Analytical thinking, attention to detail, and strong communication skills help you identify model weaknesses and collaborate effectively with development teams. These skills are crucial to ensure the reliability, safety, and ethical deployment of generative AI solutions.

What is the difference between Generative Ai Testing vs Data Scientist?

AspectGenerative Ai TestingData Scientist
Required CredentialsKnowledge of AI models, testing tools, programming skillsStatistics, programming, data analysis certifications
Work EnvironmentAI development teams, testing labs, tech companiesResearch labs, tech firms, finance, healthcare
Employer & Industry UsageAI product testing, quality assurance in techData analysis, predictive modeling across industries

Generative Ai Testing focuses on evaluating and validating AI-generated content and models, ensuring quality and accuracy. Data Scientists analyze data, build models, and derive insights. While both roles require programming and AI knowledge, Generative Ai Testing emphasizes testing processes, whereas Data Scientists focus on data analysis and model development.

How do I become a Generative AI Testing?

To become a Generative AI Tester, develop skills in machine learning, natural language processing, and programming languages like Python. Gain experience with AI frameworks such as TensorFlow or PyTorch and understand data quality and model evaluation techniques. Relevant certifications and hands-on projects can enhance your qualifications for roles in AI testing environments.

Is Generative AI Testing a good career?

Generative AI Testing is a growing field within AI development, focusing on evaluating the quality and safety of AI-generated content. It requires skills in machine learning, programming, and understanding AI models, often involving tools like Python and TensorFlow. The role offers opportunities in tech companies and research labs, with demand expected to increase as AI applications expand.

What are popular job titles related to Generative Ai Testing jobs in Pasadena, CA?

For Generative Ai Testing jobs in Pasadena, CA, the most frequently searched job titles are:

What job categories do people searching Generative Ai Testing jobs in Pasadena, CA look for?

The top searched job categories for Generative Ai Testing jobs in Pasadena, CA are:

What cities near Pasadena, CA are hiring for Generative Ai Testing jobs?

Cities near Pasadena, CA with the most Generative Ai Testing job openings:

Infographic showing various Generative Ai Testing job openings in Pasadena, CA as of August 2026, with employment types broken down into 1% As Needed, 82% Full Time, 14% Part Time, 2% Contract, and 1% Nights. Highlights an 87% Physical, 3% Hybrid, and 10% Remote job distribution, with an average salary of $121,898 per year, or $58.6 per hour.

$85 - $110/hr

Other

Medical, Dental, Vision, Retirement, PTO

Posted 5 days ago


Job description

Johnson Controls is a global leader in thermal management, mission‑critical building systems, and energy efficiency. The company leverages advanced technology, lifecycle services, and a field‑centric organization to help customers reduce carbon emissions and improve operational resilience across a range of industries, including data centers, healthcare, and advanced manufacturing.

Job Overview

As an AI Engineer on the Data Science and Analytics team, you will own end‑to‑end delivery of AI projects—from data pipeline design to deployed applications. You will partner with cross‑functional stakeholders, guide junior engineers, and deliver measurable business value through Generative AI and LLM‑powered solutions.

Responsibilities
  • Generative AI Systems & Applications: Design, develop, and deploy Generative AI and LLM applications (e.g., GPT, Claude, LLaMA) for use cases such as enterprise search, document summarization, and conversational AI. Apply prompt engineering, fine‑tuning, and orchestration to adapt foundation models to domain‑specific needs. Build agentic workflows and task‑specific AI agents using Palantir AIP or the Microsoft Agent Framework. Evaluate and improve model outputs for accuracy, relevance, latency, and cost.
  • Data, ML & Software Engineering: Build and maintain data pipelines that feed AI systems—ingestion, transformation, and ETL across structured and unstructured sources (Snowflake, Azure). Develop and operate ML pipelines and MLOps workflows—training, evaluation, deployment, and monitoring—using CI/CD, Docker, and model serving. Create reusable components, services, and APIs around AI models. Implement retrieval and embedding workflows (RAG, vector databases) for scalable knowledge retrieval. Apply software engineering best practices—testing, version control, and code review.
  • Business Impact & Stakeholder Communication: Translate business challenges into AI solutions and lead workshops and proof‑of‑concepts that demonstrate the value of LLM and agent use cases. Communicate model outputs, data findings, and technical trade‑offs to non‑technical audiences.
  • Mentorship & Collaboration: Guide junior engineers on technical problems and code quality. Contribute to design discussions and technical decisions. Share knowledge and elevate engineering and data science practices within the team.
Qualifications & Experience
  • Education in Computer Science, Software Engineering, Data Engineering, Data Science, or related quantitative discipline.
  • 2–5 years of experience in software, data, ML engineering, or data science, including hands‑on work with LLMs or generative AI.
  • Demonstrated success delivering production data or ML pipelines and AI/ML solutions.
  • Experience with cloud AI platforms (Azure OpenAI/Azure ML, AWS SageMaker/Bedrock, Google Vertex AI).
  • Strong proficiency in Python and SQL with solid software engineering habits—testing, version control, clean code.
  • Hands‑on experience with the generative AI stack: prompt engineering, fine‑tuning (LoRA), LLM orchestration, and agent frameworks (LangChain, Semantic Kernel, Microsoft Agent Framework).
  • Experience building ETL and ML pipelines and applying MLOps practices (CI/CD, Docker, model serving).
  • Familiarity with data science libraries and workflows—pandas, scikit‑learn, and model evaluation.
  • Experience with JCI’s stack—or similar platforms—including Palantir AIP, Azure ML, Microsoft Agent Framework, Power Automate, and Snowflake.
  • Working knowledge of embeddings, vector databases, and retrieval systems.
  • Ability to own projects, communicate progression, risks, and trade‑offs clearly; strong collaboration skills; self‑directed problem solver.
  • Preferred: IoT or smart building systems experience; familiarity with LLMOps, LangChain, Semantic Kernel, or similar frameworks; data science depth (statistical modeling, experimentation, deep learning); Microsoft ecosystem proficiency; knowledge of data privacy and governance for enterprise LLM usage.
Benefits
  • Competitive salary ($85,000‑$110,000, commensurate with education, experience, and skills)
  • Paid vacation, holidays, and sick time
  • Comprehensive benefits package—including 401K, medical, dental, and vision care
  • On‑the‑job and cross‑training opportunities
  • Collaborative and encouraging team environment
  • Zero Harm policy focusing on safety
Job Details
  • Location: Glendale, WI (hybrid)
  • Work Visa Sponsorship: Not offered
  • Salary Range: $85,000 – $110,000
  • Technology Stack: Azure, Snowflake, Docker, CI/CD, Palantir AIP, Microsoft Agent Framework, Power Automate
EEO Statement

Johnson Controls International plc. is an equal employment opportunity and affirmative action employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, national origin, age, protected veteran status, genetic information, sexual orientation, gender identity, status as a qualified individual with a disability, or any other characteristic protected by law. For more information on your equal opportunity and non‑discrimination rights, please visit EEO is the Law. If you are an individual with a disability and require an accommodation during the application process, please visit the Johnson Controls career site.

#J-18808-Ljbffr