1

Generative Ai Testing Jobs in Riverside, NJ (NOW HIRING)

Design and execute adversarial evaluations of generative AI and agentic systems, probing for safety ... testing, and the ability to identify confounds and methodological flaws in existing analyses

Design and execute adversarial evaluations of generative AI and agentic systems, probing for safety ... testing, and the ability to identify confounds and methodological flaws in existing analyses

Design and execute adversarial evaluations of generative AI and agentic systems, probing for safety ... testing, and the ability to identify confounds and methodological flaws in existing analyses

Design and execute adversarial evaluations of generative AI and agentic systems, probing for safety ... testing, and the ability to identify confounds and methodological flaws in existing analyses

Design and execute adversarial evaluations of generative AI and agentic systems, probing for safety ... testing, and the ability to identify confounds and methodological flaws in existing analyses

US_East | Data Engineer_L3

Philadelphia, PA · On-site

$115K - $138K/yr

... Generative AI, and Knowledge Graphs. Machine Learning & AI Development • Develop and optimize ... Testing). • Experience with collaborative software engineering practices (Agile, DevOps). • ...

Innovation Analyst

Philadelphia, PA · On-site

  • Medical

  • Dental

  • Vision

  • Life

  • Retirement

Develop, test and deploy complex prompts, prompt chains, workflows, and automation to improve the accuracy, consistency, and usability of generative AI outputs. * Conduct prompt testing and quality ...

AI Engineer

Philadelphia, PA · On-site

$50K - $112K/yr

  • Medical

  • Dental

  • Vision

  • Retirement

  • PTO

... Applying generative AI techniques, including prompt engineering, LLM evaluation, and fine-tuning ... testing, and adversarial benchmarking, to assess reasoning, tool-calling reliability, and output ...

Lead the architecture, design, and deployment of scalable Generative AI and Machine learning ... Proficiency in Python and modern software development practices (testing, code review, CI/CD)

Showing results 41-60

Generative Ai Testing information

See Riverside, NJ salary details

$32

$54

$77

How much do generative ai testing jobs pay per hour?

As of Aug 18, 2026, the average hourly pay for generative ai testing in Riverside, NJ is $54.26, according to ZipRecruiter salary data. Most workers in this role earn between $44.66 and $62.16 per hour, depending on experience, location, and employer.

What is generative AI testing?

Generative AI Testing refers to the process of evaluating and validating AI systems, particularly those that generate content such as text, images, or code. This type of testing focuses on assessing the accuracy, reliability, fairness, and safety of generative models to ensure they function as intended and avoid producing harmful or biased outputs. Testers use various methods, including automated and manual techniques, to check for issues like hallucinations, inappropriate content, or security vulnerabilities. The goal is to build trust in generative AI systems and ensure they meet quality and ethical standards before deployment.

What are some common challenges faced when testing generative AI models, and how can I prepare to address them in this role?

Testing generative AI models often involves unique challenges such as evaluating the quality and relevance of generated content, detecting bias or inappropriate outputs, and ensuring model consistency across various prompts. You may work closely with data scientists and engineers to create robust evaluation frameworks and develop automated as well as manual testing strategies. Familiarity with prompt engineering, statistical evaluation techniques, and domain-specific knowledge will help you address these challenges effectively. Proactively staying updated on industry best practices and collaborating with cross-functional teams are key to success in this dynamic field.

What are the key skills and qualifications needed to thrive as a generative AI testing specialist, and why are they important?

To thrive as a Generative AI Testing Specialist, you need a robust understanding of machine learning principles, model evaluation techniques, and a background in computer science or a related field. Familiarity with tools such as Python, TensorFlow, PyTorch, and model evaluation frameworks, as well as experience with automated testing platforms, is typically required. Analytical thinking, attention to detail, and strong communication skills help you identify model weaknesses and collaborate effectively with development teams. These skills are crucial to ensure the reliability, safety, and ethical deployment of generative AI solutions.

What is the difference between Generative Ai Testing vs Data Scientist?

AspectGenerative Ai TestingData Scientist
Required CredentialsKnowledge of AI models, testing tools, programming skillsStatistics, programming, data analysis certifications
Work EnvironmentAI development teams, testing labs, tech companiesResearch labs, tech firms, finance, healthcare
Employer & Industry UsageAI product testing, quality assurance in techData analysis, predictive modeling across industries

Generative Ai Testing focuses on evaluating and validating AI-generated content and models, ensuring quality and accuracy. Data Scientists analyze data, build models, and derive insights. While both roles require programming and AI knowledge, Generative Ai Testing emphasizes testing processes, whereas Data Scientists focus on data analysis and model development.

How do I become a Generative AI Testing?

To become a Generative AI Tester, develop skills in machine learning, natural language processing, and programming languages like Python. Gain experience with AI frameworks such as TensorFlow or PyTorch and understand data quality and model evaluation techniques. Relevant certifications and hands-on projects can enhance your qualifications for roles in AI testing environments.

Is Generative AI Testing a good career?

Generative AI Testing is a growing field within AI development, focusing on evaluating the quality and safety of AI-generated content. It requires skills in machine learning, programming, and understanding AI models, often involving tools like Python and TensorFlow. The role offers opportunities in tech companies and research labs, with demand expected to increase as AI applications expand.

What cities near Riverside, NJ are hiring for Generative Ai Testing jobs?

Cities near Riverside, NJ with the most Generative Ai Testing job openings:

Vice President, Commercial Data & AI

J&J Family of Companies

Washington Crossing, PA • On-site

Other

Medical, Dental, Vision, Life

This job post has expired today. Applications are no longer accepted.


Job description

Vice President, Commercial Data & AI

Johnson & Johnson Innovative Medicine Technology is recruiting for the Vice President, Commercial Data & AI. The primary location for this position is Titusville, NJ, with consideration given to Raritan, NJ, and Horsham, PA. This role may require up to 10% domestic and international travel.

Purpose:

Johnson & Johnson Innovative Medicine Technology is seeking an exceptional Data and AI executive to lead the Commercial Data and AI portfolio in partnership with the Innovative Medicine North America (NA) Commercial Business and the Global Commercial Strategy Organization (GCSO). Reporting to the VP, Head of Technology for IM NA Commercial & GCSO, the Vice President, Commercial Data and AI will set and execute the strategy for a prioritized portfolio of data, data science, and AI programs that power the commercial value chain, spanning launch excellence, sales and marketing, medical affairs, market access, patient engagement, and commercial operations.

This leadership role is accountable for translating the most pressing commercial business challenges into a high-impact, outcome-driven portfolio, and for building and scaling enterprise-grade AI capabilities, including generative and agentic AI, required to deliver measurable value at scale. You will be the executive sponsor for a prioritized portfolio of commercial data, digital, and AI programs, directing a team of 80+ technology, data, and AI professionals and stewarding significant annual investment across the buy/borrow/build continuum to deliver with speed and scale. Success in this role requires the rare combination of deep technical fluency, commercial pharmaceutical acumen, executive influence, servant leadership, and a disciplined focus on responsible, compliant delivery over hype.

Responsibilities:

Strategy, Portfolio, and Value Realization

  • Partner with senior business leaders across commercial, medical, patient, and technology teams to identify high-impact data & AI opportunities and translate them into clear problem statements, solution-oriented business cases, and multi-year roadmaps.
  • Shape multi-year data and AI strategies and aligned organizational operating models that blend innovation, prioritization, delivery governance, and value realization across an enterprise portfolio of data and AI products and capabilities.
  • Manage investment decisions across the product lifecycle, reallocating resources to the highest-value work and retiring redundant or underperforming efforts; review value delivery in dollars and outcomes with business peers on a quarterly cadence.

AI, Data Science, and Platform Leadership

  • Advance high value use cases ranging from predictive to agentic AI, establishing scalable delivery patterns for GenAI and agentic systems (retrieval-augmented generation, evaluation and testing, prompt/workflow engineering, and LLMOps/MLOps for monitoring, drift, reliability, and incident response).
  • Lead delivery and advancement of the commercial AI Core as a neutral, reusable control plane, including agent registry, orchestration, guardrails, and observability, connecting a diverse range of cloud, data science models, and business systems rather than being trapped in any single application.
  • Advance data as a strategic asset by maturing our core data platforms, semantic and AI-context layers, master data management, and AI-ready data products that enable insight sharing and cross-region scale.

Responsible AI, Governance, and Compliance

  • Champion responsible AI by embedding governance, security, privacy, and compliance-by-design into AI patterns and workflowshuman-in-the-loop practices, documentation, model monitoring, explainability, and auditability appropriate for a regulated environment.
  • Partner with Healthcare Compliance, Legal, Privacy, Quality, and Security to review and prioritize AI use cases, to shape the Generative AI review process.

People Leadership and Change Enablement

  • Build, lead, and develop a high-performing, AI-first organization of leaders and practitioners, including data scientists, AI, software, and data engineers, and product and solution leads through hiring, coaching, performance management, and talent development that drives retention and career growth.
  • Drive adoption and change enablement in partnership with business teams through communications, training, and ways-of-working so that AI solutions are trusted, used, and measurably improve outcomes; foster a Credo-based culture and elevate AI fluency across the organization.
  • Forge strong collaborations across Innovative Medicine Technology to share reusable assets, scale successful solutions, and stay current on emerging techniques, tools, and industry trends to inform strategy and investment.

Qualifications / Requirements:

Required

  • Education: Bachelor's degree required; advanced degree strongly preferred in Computer Science, Data Science, Artificial Intelligence/Machine Learning, Statistics, Mathematics, Engineering, or a related quantitative discipline.
  • Experience: 15+ years of progressive experience delivering data, analytics, and AI solutions at scale, including translating business problems into scaled products with measurable business impact; life sciences/healthcare experience strongly preferred.
  • Executive people leadership: 10+ years leading and scaling high-performing, multidisciplinary technical organizations (typically 50+ professionals, direct and extended/vendor), including building leaders of leaders and managing significant operating and capital investment.
  • AI/ML technical fluency: Deep understanding of modern machine learning and large language models, with the ability to set architecture and delivery direction across data, modeling, software engineering, and cloud platforms (e.g., AWS, Azure, GCP, Databricks, Snowflake).
  • Generative and agentic AI: Demonstrated success taking GenAI and agentic solutions to productionevaluation/testing, guardrails, RAG, prompt/workflow engineering, and LLMOps/MLOps (monitoring, drift, reliability, incident response).
  • Portfolio and value leadership: Proven ability to prioritize a portfolio, manage investment across the product lifecycle, and drive adoption and value realization through clear OKRs/KPIs and executive stakeholder alignment.
  • Responsible AI and compliance: Strong command of data standards, privacy regulations, and governance expectations in regulated environments, with the ability to embed controls by design in partnership with Security, Privacy, Legal, and Compliance.
  • Communication and influence: Exceptional written and verbal communication, with the ability to explain complex technical concepts to diverse audiences and influence decisions from the executive committee to delivery teams.

Preferred

  • Commercial pharmaceutical domain expertise across sales & marketing, omnichannel/customer engagement, medical affairs, market access, and/or commercial operations, including experience with commercially relevant data sets.
  • Experience leading enterprise data platforms, master data management, and AI-ready data products, and standing up reusable AI platforms and agentic ecosystems.
  • Track record partnering with, and managing, external vendors and strategic technology partners (e.g., systems integrators, hyperscalers, and consulting firms) across a buy/borrow/build model.
  • Recognized thought leadership in data science and AI through internal and external speaking, publications, or advisory roles.

Location, Travel, and Work Arrangement:

This position follows a hybrid schedule of 3 days per week on-site and 2 days remote (no fully remote option). The primary location is Titusville, NJ, with consideration given to Raritan, NJ, and Horsham, PA. This role may require up to approximately 10% domestic and international travel.

Johnson & Johnson is an Equal Opportunity Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, age, national origin, disability, protected veteran status or other characteristics protected by federal, state or local law. We actively seek qualified candidates who are protected veterans and individuals with disabilities as defined under VEVRAA and Section 503 of the Rehabilitation Act.

Johnson & Johnson is committed to providing an interview process that is inclusive of our applicants' needs. If you are an individual with a disability and would like to request an accommodation, external applicants please contact us via https://www.jnj.com/contact-us/careers, internal employees contact AskGS to be directed to your accommodation resource.

Required Skills:

Preferred Skills:

Advanced Analytics, Data Analysis, Data Privacy Standards, Data Quality, Data Science, Data Stewardship, Data Visualization, Developing Others, Digital Fluency, Fact-Based Decision Making, Inclusive Leadership, Leadership, Managing Managers, New Program Development, Policy Development, Strategic Thinking, Visualizations

The anticipated base pay range for this position is $218,000 and $401,350 USD.

Additional Description for Pay Transparency:

Subject to the terms of their respective plans, employees and/or eligible dependents are eligible to participate in the following Company sponsored employee benefit programs: medical, dental, vision, life insurance, short- and long-term disability, business accident insurance, and group legal insurance. Subject to the terms of their respective plans, employees are eligible to participate in the Company