ZipRecruiter

Log In

1

Generative Ai Testing Jobs in Pennsylvania (NOW HIRING)

eTeam

AI Engineers

Pittsburgh, PA · On-site

$94K - $129K/yr

Job Summary : eTeam is seeking a highly skilled AI Engineer with hands-on experience in Generative ... reviews, testing, and deployment activities. • Stay updated with emerging AI technologies ...

Gehc

AI Engineer

North East, PA · On-site

... Generative AI to transform healthcare? GE HealthCare is seeking a Senior Staff AI Engineer to ... Implement responsible AI practices, including model evaluation, robustness testing, monitoring, and ...

Coforge

AI Architect

Phoenixville, PA · On-site

Drive adoption of generative AI, predictive analytics, NLP, and advanced modeling techniques where ... automated testing. * Solid understanding of LLMs (prompting, function/tool calling, structured ...

Meta Resources Group

AI Program Manager

Philadelphia, PA · Hybrid

$85 - $90/hr

Lead the end-to-end delivery of multiple AI, Machine Learning, and Generative AI programs across ... Coordinate User Acceptance Testing (UAT), production readiness, deployment planning, hypercare, and ...

New

TekShapers

Sr. AI Architect

Oaks, PA · On-site

Drive adoption of generative AI, predictive analytics, NLP, and advanced modeling techniques where ... automated testing. * Solid understanding of LLMs (prompting, function/tool calling, structured ...

TekShapers

Sr. AI Architect

Oaks, PA · On-site

Drive adoption of generative AI, predictive analytics, NLP, and advanced modeling techniques where ... automated testing. * Solid understanding of LLMs (prompting, function/tool calling, structured ...

Aprio

Senior AI Product Associate, IT

Philadelphia, PA · On-site +1

$104K - $160K/yr

Familiarity with generative-AI tools and platforms, including hands-on prompting and testing of AI APIs. * Ability to quickly learn new domains and translate complex workflows into product ...

System One

Sr AI Enterprise Engineer

Pittsburgh, PA · On-site

$101K - $139K/yr

Using generative AI tools * AI assisted productivity * Understand quality engineering practices * Needs to understand security testing practices Flex Skills/Nice to Have: * Knowledge of programming ...

next page

Showing results 1-20

All JobsGenerative Ai Testing JobsGenerative Ai Testing Jobs in Pennsylvania

Generative Ai Testing information

What is the difference between Generative Ai Testing vs Data Scientist?

AspectGenerative Ai TestingData Scientist
Required CredentialsKnowledge of AI models, testing tools, programming skillsStatistics, programming, data analysis certifications
Work EnvironmentAI development teams, testing labs, tech companiesResearch labs, tech firms, finance, healthcare
Employer & Industry UsageAI product testing, quality assurance in techData analysis, predictive modeling across industries

Generative Ai Testing focuses on evaluating and validating AI-generated content and models, ensuring quality and accuracy. Data Scientists analyze data, build models, and derive insights. While both roles require programming and AI knowledge, Generative Ai Testing emphasizes testing processes, whereas Data Scientists focus on data analysis and model development.

How do I become a Generative AI Testing?

To become a Generative AI Tester, develop skills in machine learning, natural language processing, and programming languages like Python. Gain experience with AI frameworks such as TensorFlow or PyTorch and understand data quality and model evaluation techniques. Certifications in AI or data science can enhance your qualifications and improve job prospects.

Is Generative AI Testing a good career?

Generative AI Testing is a growing field within AI development that involves evaluating the quality and safety of AI-generated content. It requires skills in machine learning, programming, and understanding AI models, making it a promising career path with increasing demand as AI technologies expand. Professionals in this area can find opportunities in tech companies, research labs, and startups focused on AI innovation.

What are the key skills and qualifications needed to thrive as a generative AI testing specialist, and why are they important?

To thrive as a Generative AI Testing Specialist, you need a robust understanding of machine learning principles, model evaluation techniques, and a background in computer science or a related field. Familiarity with tools such as Python, TensorFlow, PyTorch, and model evaluation frameworks, as well as experience with automated testing platforms, is typically required. Analytical thinking, attention to detail, and strong communication skills help you identify model weaknesses and collaborate effectively with development teams. These skills are crucial to ensure the reliability, safety, and ethical deployment of generative AI solutions.

What are some common challenges faced when testing generative AI models, and how can I prepare to address them in this role?

Testing generative AI models often involves unique challenges such as evaluating the quality and relevance of generated content, detecting bias or inappropriate outputs, and ensuring model consistency across various prompts. You may work closely with data scientists and engineers to create robust evaluation frameworks and develop automated as well as manual testing strategies. Familiarity with prompt engineering, statistical evaluation techniques, and domain-specific knowledge will help you address these challenges effectively. Proactively staying updated on industry best practices and collaborating with cross-functional teams are key to success in this dynamic field.

What is generative AI testing?

Generative AI Testing refers to the process of evaluating and validating AI systems, particularly those that generate content such as text, images, or code. This type of testing focuses on assessing the accuracy, reliability, fairness, and safety of generative models to ensure they function as intended and avoid producing harmful or biased outputs. Testers use various methods, including automated and manual techniques, to check for issues like hallucinations, inappropriate content, or security vulnerabilities. The goal is to build trust in generative AI systems and ensure they meet quality and ethical standards before deployment.
What are popular job titles related to Generative Ai Testing jobs in Pennsylvania? For Generative Ai Testing jobs in Pennsylvania, the most frequently searched job titles are:
What job categories do people searching Generative Ai Testing jobs in Pennsylvania look for? The top searched job categories for Generative Ai Testing jobs in Pennsylvania are:
Generative Ai Testing jobs near you
Infographic showing various Generative Ai Testing job openings in Pennsylvania as of August 2026, with employment types broken down into 1% As Needed, 81% Full Time, 14% Part Time, and 4% Contract. Highlights an 88% Physical, 2% Hybrid, and 10% Remote job distribution.

AI Engineers

eTeam

Pittsburgh, PA • On-site

$94K - $129K/yr

Full-time

Re-posted 23 days ago

Job description

Job Summary:
eTeam is seeking a highly skilled AI Engineer with hands-on experience in Generative AI technologies and advanced engineering methodologies. The role involves designing, developing, and deploying AI-powered applications and collaborating with cross-functional teams to define AI solution strategies.
Responsibilities:
• Design, develop, and deploy AI-powered applications and copilots for enterprise use cases.
• Work on Forward Engineering initiatives to modernize applications and build scalable AI-native architectures.
• Perform Reverse/Regression Engineering activities for legacy systems, including analysis, optimization, and AI-assisted transformation.
• Develop and integrate Large Language Model (LLM)-based solutions using platforms such as Claude and Gemini.
• Build intelligent automation workflows leveraging Generative AI technologies.
• Collaborate with cross-functional teams including Product, Engineering, and Business stakeholders to define AI solution strategies.
• Fine-tune prompts, optimize AI model performance, and improve response accuracy.
• Create APIs and integrate AI services into web/mobile/cloud applications.
• Ensure AI solutions comply with security, governance, and scalability standards.
• Participate in architecture discussions, code reviews, testing, and deployment activities.
• Stay updated with emerging AI technologies, frameworks, and industry trends.
Qualifications:
Required:
• Bachelor’s or Master’s degree in Computer Science, Artificial Intelligence, Data Science, or related field.
• Strong experience in AI/ML Engineering and Generative AI solutions.
• Hands-on expertise with AI copilots and conversational AI platforms.
• Experience working with Claude and Gemini models/APIs.
• Strong understanding of Forward Engineering and Reverse/Regression Engineering concepts.
• Proficiency in Python, Java, or other modern programming languages.
• Experience with prompt engineering, RAG architectures, vector databases, and LLM integrations.
• Knowledge of cloud platforms such as AWS, Azure, or GCP.
• Familiarity with REST APIs, microservices, and enterprise application integrations.
• Strong analytical, debugging, and problem-solving skills.
• Excellent communication and stakeholder management abilities.
Preferred:
• Experience with OpenAIa, LangChain, Semantic Kernel, or similar AI frameworks.
• Exposure to DevOps, CI/CD pipelines, and containerization technologies like Docker/Kubernetes.
• Experience building AI agents or enterprise copilots.
• Certifications in AI/ML or cloud technologies are a plus.
Company:
eTeam is a staffing agency that also provides payrolling services. Founded in 1999, the company is headquartered in Somerset, USA, with a team of 501-1000 employees. The company is currently Late Stage.

Apply