1

Generative Ai Testing Jobs in Pennsylvania (NOW HIRING)

AI Engineers

Pittsburgh, PA ยท On-site

$94K - $129K/yr

Job Summary : eTeam is seeking a highly skilled AI Engineer with hands-on experience in Generative ... reviews, testing, and deployment activities. โ€ข Stay updated with emerging AI technologies ...

... Generative AI to transform healthcare? GE HealthCare is seeking a Senior Staff AI Engineer to ... Implement responsible AI practices, including model evaluation, robustness testing, monitoring, and ...

AI Program Manager

Philadelphia, PA ยท Hybrid

$85 - $90/hr

Lead the end-to-end delivery of multiple AI, Machine Learning, and Generative AI programs across ... Coordinate User Acceptance Testing (UAT), production readiness, deployment planning, hypercare, and ...

next page

Showing results 1-20

Generative Ai Testing information

What is generative AI testing?

Generative AI Testing refers to the process of evaluating and validating AI systems, particularly those that generate content such as text, images, or code. This type of testing focuses on assessing the accuracy, reliability, fairness, and safety of generative models to ensure they function as intended and avoid producing harmful or biased outputs. Testers use various methods, including automated and manual techniques, to check for issues like hallucinations, inappropriate content, or security vulnerabilities. The goal is to build trust in generative AI systems and ensure they meet quality and ethical standards before deployment.

What are some common challenges faced when testing generative AI models, and how can I prepare to address them in this role?

Testing generative AI models often involves unique challenges such as evaluating the quality and relevance of generated content, detecting bias or inappropriate outputs, and ensuring model consistency across various prompts. You may work closely with data scientists and engineers to create robust evaluation frameworks and develop automated as well as manual testing strategies. Familiarity with prompt engineering, statistical evaluation techniques, and domain-specific knowledge will help you address these challenges effectively. Proactively staying updated on industry best practices and collaborating with cross-functional teams are key to success in this dynamic field.

What are the key skills and qualifications needed to thrive as a generative AI testing specialist, and why are they important?

To thrive as a Generative AI Testing Specialist, you need a robust understanding of machine learning principles, model evaluation techniques, and a background in computer science or a related field. Familiarity with tools such as Python, TensorFlow, PyTorch, and model evaluation frameworks, as well as experience with automated testing platforms, is typically required. Analytical thinking, attention to detail, and strong communication skills help you identify model weaknesses and collaborate effectively with development teams. These skills are crucial to ensure the reliability, safety, and ethical deployment of generative AI solutions.

What is the difference between Generative Ai Testing vs Data Scientist?

AspectGenerative Ai TestingData Scientist
Required CredentialsKnowledge of AI models, testing tools, programming skillsStatistics, programming, data analysis certifications
Work EnvironmentAI development teams, testing labs, tech companiesResearch labs, tech firms, finance, healthcare
Employer & Industry UsageAI product testing, quality assurance in techData analysis, predictive modeling across industries

Generative Ai Testing focuses on evaluating and validating AI-generated content and models, ensuring quality and accuracy. Data Scientists analyze data, build models, and derive insights. While both roles require programming and AI knowledge, Generative Ai Testing emphasizes testing processes, whereas Data Scientists focus on data analysis and model development.

How do I become a Generative AI Testing?

To become a Generative AI Tester, develop skills in machine learning, natural language processing, and programming languages like Python. Gain experience with AI frameworks such as TensorFlow or PyTorch and understand data quality and model evaluation techniques. Relevant certifications and hands-on projects can enhance your qualifications for roles in AI testing environments.

Is Generative AI Testing a good career?

Generative AI Testing is a growing field within AI development, focusing on evaluating the quality and safety of AI-generated content. It requires skills in machine learning, programming, and understanding AI models, often involving tools like Python and TensorFlow. The role offers opportunities in tech companies and research labs, with demand expected to increase as AI applications expand.

What are popular job titles related to Generative Ai Testing jobs in Pennsylvania?

For Generative Ai Testing jobs in Pennsylvania, the most frequently searched job titles are:

What job categories do people searching Generative Ai Testing jobs in Pennsylvania look for?

The top searched job categories for Generative Ai Testing jobs in Pennsylvania are:

Infographic showing various Generative Ai Testing job openings in Pennsylvania as of August 2026, with employment types broken down into 1% As Needed, 87% Full Time, 9% Part Time, 2% Contract, and 1% Nights. Highlights an 87% Physical, 3% Hybrid, and 10% Remote job distribution.

Creative Technologist, Wharton Generative AI Labs

United, PA โ€ข On-site

The Chronicle Of Higher Education, Inc.
Newspaper Publishersย โ€ขย 201 - 500 employees

$85 - $105/hr

Other

Medical, Dental, Vision, Life, Retirement

This job post hasย expired today.ย Applications are no longer accepted.


Job description

Creative Technologist, Wharton Generative AI Labs

University Overview

The University of Pennsylvania, the largest private employer in Philadelphia, is a world-renowned leader in education, research, and innovation. This historic, Ivy League school consistently ranks among the top 10 universities in the annual U.S. News & World Report survey. Penn has 12 highly-regarded schools that provide opportunities for undergraduate, graduate and continuing education, all influenced by Penn's distinctive interdisciplinary approach to scholarship and learning. As an employer Penn has been ranked nationally on many occasions with the most recent award from Forbes who named Penn one of America's Best Large Employers in 2023.

Penn offers a unique working environment within the city of Philadelphia. The University is situated on a beautiful urban campus, with easy access to a range of educational, cultural, and recreational activities. With its historical significance and landmarks, lively cultural offerings, and wide variety of atmospheres, Philadelphia is the perfect place to call home for work and play.

The University offers a competitive benefits package that includes excellent healthcare and tuition benefits for employees and their families, generous retirement benefits, a wide variety of professional development opportunities, supportive work and family benefits, a wealth of health and wellness programs and resources, and much more.

Posted Job Title

Creative Technologist, Wharton Generative AI Labs

Job Profile Title

Application Developer Senior

Job Description Summary

Founded in 1881 as the world's first collegiate business school, the Wharton School of the University of Pennsylvania is shaping the future of business by incubating ideas, driving insights, and creating leaders who change the world. With campuses in both Philadelphia and San Francisco, Wharton has over 850 staff, a faculty population of more than 235 renowned professors, and 5,000 undergraduate, MBA, executive MBA, and doctoral students. Each year 13,000 professionals from around the world advance their careers through Wharton Executive Education's individual, company-customized, and online programs. More than 104,000 Wharton alumni form a powerful global network of leaders who transform business every day. Wharton is home to a dynamic community of staff, bringing a wide range of skills, experiences, and perspectives. To learn more, visit www.wharton.upenn.edu.

The Wharton Generative AI Labs blends academic rigor with hands-on experience in educational technology to provide valuable insights into AI's potential for enhancing how we teach, learn, and work. We create solutions that bring together pedagogical principles and technological innovation, and produce rigorous scientific research that advances our understanding of large language models through systematic testing and analysis.

Job Description Position Summary

The Creative Technologist designs and builds AI-enabled tools, systems, and experiences that advance GAIL's mission to catalyze responsible and innovative uses of AI. Working within a fast-moving and highly creative team, the Creative Technologist treats generative AI as a creative medium, one that calls for judgment, craft, and original thinking, and turns that approach into working resources that faculty, students, and external audiences can use, learn from, and build on. The role combines creative and intellectual ambition with strong technical ability, including fluency with agentic coding tools such as Claude Code and Codex and the design and use of agents and multi-agentic systems. It is well suited to an entrepreneurial, self-motivated builder who is excited to create with AI, who sees new opportunities and acts on them, and who sustains their creativity and relevance as generative AI tools continue to advance.

The ideal individual is entrepreneurial, self-directed, and thrives in a fast-moving environment. They are able to identify opportunities, define problems, establish direction, and move initiatives forward with confidence. They demonstrate creative ambition, bringing originality, sound judgment, and a high standard of quality to their work.

This position reports to the Executive Director of GAIL and requires a minimum of two days on campus per week.

This is a full-time, limited-term position that is contingent upon funding and continued business needs. The position is for up to two (2) years, with the possibility of extension, subject to review on business needs and continued funding.

Job Responsibilities
  • Build: Design and build AI-enabled tools, systems, agents, and multi-agentic systems that advance GAIL's mission, using agentic coding tools such as Claude Code and Codex.
  • Direct the web presence: Lead the creative direction and ongoing development of GAIL's web presence, working with operations staff who handle routine updates.
  • Evaluate: Evaluate and compare AI tools and models, and apply sound judgment about which emerging capabilities to build on.
  • Teach and facilitate: Support AI-enabled learning across GAIL by leading build sessions, facilitating technical work, and helping faculty and students make effective use of AI.
  • Pursue new opportunities: Initiate self-directed projects, identifying new opportunities and bringing them to working form.
  • Document: Document technical decisions, standards, and design choices so GAIL can scale its work and retain what it learns.
  • Stay current: Stay current as generative AI advances, and bring new capabilities into GAIL's work.
  • Lead/Manage: Lead individuals who have a technical scope of work. Oversee work as it relates to the technical function of the lab.
  • Collaborate: Collaborate closely with GAIL faculty and staff, helping to shape the work as well as carry it out.
Qualifications Required:
  • Bachelor's degree and 3 to 5 years of experience working in an environment of technological innovation, applied creativity, or equivalent combination of education and experience.
  • A portfolio of generative AI work that demonstrates functional tools, systems, or experiences you have built. We evaluate demonstrated ability rather than years of experience; what matters is what you have made and the judgment behind it.
  • Strong technical ability to build and ship, including fluency with generative AI tools, agentic coding tools such as Claude Code and Codex, and the design and use of agents and multi-agentic systems.
  • Clear evidence of creative ambition, with work that shows originality and a high standard for quality.
  • Demonstrated ability to adapt and remain current as generative AI tools advance.
  • Strong communication skills, with the ability to explain technical and creative ideas to both technical and nontechnical audiences.
  • Comfort working in an academic environment and a commitment to responsible AI use.
Preferred:
  • Teaching, instruction, or workshop facilitation experience. The ability to help others learn to build and create with AI is a strong asset in this role.
  • A background in a creative field such as design, art, film, music, writing, or architecture, combined with strong building ability. We welcome candidates who came to AI from a creative discipline.
  • Experience shaping a digital or web presence, with the design sensibility to keep it current and engaging.
  • Experience in higher education, research centers, innovation labs, or design studios.
  • Experience building agents, multi-agentic systems, interactive prototypes, or AI-enabled learning experiences.
Job Location - City, State

Philadelphia, Pennsylvania

Department / School

Wharton School

Pay Range

$84,961.00 - $105,000.00 Annual Rate

Salary offers are made based on the candidate's qualifications, experience, skills, and education as they directly relate to the requirements of the position, and in alignment with salary ranges based on external market data for the job's level. Internal organization and peer data at Penn are also considered.

Equal Opportunity Statement

The University of Pennsylvania is an equal opportunity employer. Candidates are considered for employment without regard to race, color, sex, sexual orientation, religion, creed, national origin (including shared ancestry or ethnic characteristics), citizenship status, age, disability, veteran status or any class protected under applicable federal, state or local law.

Special Requirements

Background checks may be required after a conditional job offer is made. Consideration of the background check will be tailored to the requirements of the job.

University Benefits
  • Health, Life, and Flexible Spending Accounts: Penn offers comprehensive medical, prescription, behavioral health, dental, vision, and life insurance benefits to protect you and your family's health and welfare. You can also use flexible spending accounts to pay for eligible health care and dependent care expenses with pre-tax dollars.
  • Tuition: Take advantage of Penn's exceptional tuition benefits. You, your spouse, and your dependent children can get tuition assistance here at Penn. Your dependent children are also eligible for tuition assistance at other institutions.
  • Retirement: Penn offers generous retirement plans to help you save for your future. Penn's Basic, Matching, and Supplemental retirement plans allow you to save for retirement on a pre-tax or Roth basis. Choose from a wide variety of investment options through TIAA and Vanguard.
  • Time Away from Work: Penn provides you with a substantial amount of time away from work during the course of the year. This allows you to relax, take vacations, attend to personal affairs, recover from illness or injury, spend time with family-whatever your personal needs may be.
  • Long-Term Care Insurance: In partnership with Genworth Financial, Penn offers faculty and staff (and your eligible family members) long-term care insurance to help you cover some of the costs of long-term care services received at home, in the community or in a nursing facility. If you apply when you're newly hired, you won't have to provide proof of good health or be subject to underwriting requirements. Eligible family members must always provide proof of good health and are subject to underwriting.
  • Wellness and Work-life Resources: Penn is committed to supporting our faculty and staff as they balance the competing demands of work and personal life. That's why we offer a wide variety of programs and resources to help you care for your health, your family, and your work-life balance.
  • Professional and Personal Development: Penn provides an array of resources to help you advance yourself personally and professionally.
  • University Resources: As a member of the Penn community, you have access to a wide range of University resources as well as cultural and recreational activities. Take advantage of the University's libraries and athletic facilities, or visit our arboretum and art galleries. There's always something going on at Penn, whether it's a new exhibit at the Penn Museum, the latest music or theater presentation at the Annenberg Center, or the Penn Relays at Franklin Field to name just a few examples. As a member of the Penn community, you're right in the middle of the excitement-and you and your family can enjoy many of these activities for free.
  • Discounts and Special Services: From arts and entertainment to transportation and mortgages, you'll find great deals for University faculty and staff. Not only do Penn arts and cultural centers and museums offer free and discounted admission and memberships to faculty and staff. You can also enjoy substantial savings on other goods and services such as new cars from Ford and General Motors, cellular phone service plans, movie tickets, and admission to theme parks.
  • Flexible Work Hours: Flexible work options offer creative approaches for completing work while promoting balance between work and personal commitments. These approaches involve use of non-traditional work hours, locations, and/or job structures.
  • Penn Home Ownership Services: Penn offers a forgivable loan for eligible employees interested in buying a home or currently residing in West Philadelphia, which can be used for closing costs or home improvements.
  • Adoption Assistance: Penn will reimburse eligible employees on qualified expenses in connection with the legal adoption of an eligible child, such as travel or court fees, for up to two adoptions in your household.

To learn more, please visit: https://www.hr.upenn.edu/PennHR/benefits-pay

Equal Employment Opportunity Statement

The University of Pennsylvania is an equal opportunity employer. Candidates are considered for employment without regard to race, color, sex, sexual orientation, religion, creed, national origin (including shared ancestry or ethnic characteristics), citizenship status, age, disability, veteran status or any class protected under applicable federal, state, or local law.

#J-18808-Ljbffr