We are seeking a generative AI fellow with a strong interest in public service and hands-on experience researching, building, and testing LLM tools. This fellowship will run from June 2026 - August ...
We are seeking a generative AI fellow with a strong interest in public service and hands-on experience researching, building, and testing LLM tools. This fellowship will run from June 2026 - August ...
We are seeking a generative AI fellow with a strong interest in public service and hands-on experience researching, building, and testing LLM tools. This fellowship will run from June 2026 - August ...
We are seeking a generative AI fellow with a strong interest in public service and hands-on experience researching, building, and testing LLM tools. This fellowship will run from June 2026 - August ...
Cloud Engineer- Data/AI Focused
Philadelphia, PA · On-site
$115K - $138K/yr
As a Data & AI Engineer, you'll build and deploy modern data pipelines and generative AI solutions ... Writing and testing SQL queries and stored procedures * Documenting technical solutions and ...
Quick apply
Cloud Engineer- Data/AI Focused
Philadelphia, PA · On-site
$115K - $138K/yr
As a Data & AI Engineer, you'll build and deploy modern data pipelines and generative AI solutions ... Writing and testing SQL queries and stored procedures * Documenting technical solutions and ...
Cloud Engineer- Data/AI Focused
$100K - $160K/yr
As a Data & AI Engineer, you'll build and deploy modern data pipelines and generative AI solutions ... Writing and testing SQL queries and stored procedures * Documenting technical solutions and ...
Cloud Engineer- Data/AI Focused
$100K - $160K/yr
As a Data & AI Engineer, you'll build and deploy modern data pipelines and generative AI solutions ... Writing and testing SQL queries and stored procedures * Documenting technical solutions and ...
FullStack AWS AI Engineer
Malvern, PA · On-site
$55 - $60/hr
Experience building or integrating Agentic or Generative AI solutions. * Proficiency in at least ... Design and maintain CI/CD pipelines for automated deployment and testing. * Optimize application ...
Quick apply
FullStack AWS AI Engineer
Malvern, PA · On-site
$55 - $60/hr
Experience building or integrating Agentic or Generative AI solutions. * Proficiency in at least ... Design and maintain CI/CD pipelines for automated deployment and testing. * Optimize application ...
BI Analyst/Report Developer
Malvern, PA · On-site
Exposure to AI/ML or generative AI tools and associated testing or validation frameworks * Experience in scenario-based testing, UAT, or model validation * Familiarity with financial services ...
BI Analyst/Report Developer
Malvern, PA · On-site
Exposure to AI/ML or generative AI tools and associated testing or validation frameworks * Experience in scenario-based testing, UAT, or model validation * Familiarity with financial services ...
Generative AI Development: Build LLM-based applications with RAG, structured output, and evaluation ... Solid grasp of software engineering principles including testing, version control (e.g., Git), and ...
Generative AI Development: Build LLM-based applications with RAG, structured output, and evaluation ... Solid grasp of software engineering principles including testing, version control (e.g., Git), and ...
Quality Engineer
Trenton, NJ · On-site
$83K - $97K/yr
We are looking for an innovative software quality engineer who can leverage Generative AI technologies to enhance testing effectiveness, efficiency, and coverage while maintaining human oversight and ...
Quality Engineer
Trenton, NJ · On-site
$83K - $97K/yr
We are looking for an innovative software quality engineer who can leverage Generative AI technologies to enhance testing effectiveness, efficiency, and coverage while maintaining human oversight and ...
AI/ML Engineer (AWS)
$105K - $144K/yr
... and Generative AI capabilities. * Create, evaluate, and deploy machine learning solutions, including applications powered by large language models. * Establish and maintain datasets, testing ...
AI/ML Engineer (AWS)
$105K - $144K/yr
... and Generative AI capabilities. * Create, evaluate, and deploy machine learning solutions, including applications powered by large language models. * Establish and maintain datasets, testing ...
... and generative AI pipelines for various business use cases. • Build scalable AI/ML systems ... A/B testing to validate model performance. • Deploy models using cloud platforms (Azure) and ...
Quick apply
... and generative AI pipelines for various business use cases. • Build scalable AI/ML systems ... A/B testing to validate model performance. • Deploy models using cloud platforms (Azure) and ...
AI/ML Engineer 2
Philadelphia, PA · Remote
This senior engineering role requires equal expertise in generative AI application development and ... hypothesis testing, feature engineering, model optimization, deployment, and monitoring of ...
AI/ML Engineer 2
Philadelphia, PA · Remote
This senior engineering role requires equal expertise in generative AI application development and ... hypothesis testing, feature engineering, model optimization, deployment, and monitoring of ...
GenAI Architect With Azure, Databricks
Mount Laurel, NJ · On-site
$63 - $82/hr
... and generative AI pipelines for various business use cases. • Build scalable AI/ML systems ... A/B testing to validate model performance. • Deploy models using cloud platforms (Azure) and ...
Quick apply
GenAI Architect With Azure, Databricks
Mount Laurel, NJ · On-site
$63 - $82/hr
... and generative AI pipelines for various business use cases. • Build scalable AI/ML systems ... A/B testing to validate model performance. • Deploy models using cloud platforms (Azure) and ...
Engineer Lead - Assessments Applications
Newtown, PA · On-site +1
$125K - $133K/yr
... Generative AI adoption across the engineering organization-translating emerging AI capabilities into practical, day-to-day habits for developers, testers, and product teams. You will design and run ...
Engineer Lead - Assessments Applications
Newtown, PA · On-site +1
$125K - $133K/yr
... Generative AI adoption across the engineering organization-translating emerging AI capabilities into practical, day-to-day habits for developers, testers, and product teams. You will design and run ...
Engineer Lead Prep and Driver Applications
$125K - $133K/yr
... Generative AI adoption across the engineering organization--translating emerging AI capabilities into practical, day-to-day habits for developers, testers, and product teams. You will design and run ...
Engineer Lead Prep and Driver Applications
$125K - $133K/yr
... Generative AI adoption across the engineering organization--translating emerging AI capabilities into practical, day-to-day habits for developers, testers, and product teams. You will design and run ...
Engineer Lead - Prep and Driver Applications
Newtown, PA · On-site +1
$125K - $133K/yr
... Generative AI adoption across the engineering organization-translating emerging AI capabilities into practical, day-to-day habits for developers, testers, and product teams. You will design and run ...
Engineer Lead - Prep and Driver Applications
Newtown, PA · On-site +1
$125K - $133K/yr
... Generative AI adoption across the engineering organization-translating emerging AI capabilities into practical, day-to-day habits for developers, testers, and product teams. You will design and run ...
Engineer Lead - Assessments Applications
$125K - $133K/yr
... Generative AI adoption across the engineering organization--translating emerging AI capabilities into practical, day-to-day habits for developers, testers, and product teams. You will design and run ...
Engineer Lead - Assessments Applications
$125K - $133K/yr
... Generative AI adoption across the engineering organization--translating emerging AI capabilities into practical, day-to-day habits for developers, testers, and product teams. You will design and run ...
Experience with generative AI safety and evaluation practices, including prompt injection testing, jailbreak resilience, hallucination measurement, toxicity scoring, harm scoring, and grounding ...
Experience with generative AI safety and evaluation practices, including prompt injection testing, jailbreak resilience, hallucination measurement, toxicity scoring, harm scoring, and grounding ...
... generative AI tools and associated testing or validation frameworks Experience in scenario-based testing, UAT, or model validation Familiarity with financial services, retirement, or plan sponsor ...
... generative AI tools and associated testing or validation frameworks Experience in scenario-based testing, UAT, or model validation Familiarity with financial services, retirement, or plan sponsor ...
Generative AI Architecture: Architect GenAI solutions, focusing on fine-tuning proprietary and open ... Experience with A/B testing and experimentation frameworks for AI features * Contributions to open ...
Generative AI Architecture: Architect GenAI solutions, focusing on fine-tuning proprietary and open ... Experience with A/B testing and experimentation frameworks for AI features * Contributions to open ...
Generative AI Architecture: Architect GenAI solutions, focusing on fine-tuning proprietary and open ... Experience with A/B testing and experimentation frameworks for AI features * Contributions to open ...
Generative AI Architecture: Architect GenAI solutions, focusing on fine-tuning proprietary and open ... Experience with A/B testing and experimentation frameworks for AI features * Contributions to open ...
Generative Ai Testing information
See Riverside, NJ salary details
$32.29 - $36.37
6% of jobs
$36.37 - $40.46
4% of jobs
$40.46 - $44.54
13% of jobs
$45.05 is the 25th percentile. Wages below this are outliers.
$44.54 - $48.62
15% of jobs
The median wage is $52.54 / hr.
$48.62 - $52.71
13% of jobs
$52.71 - $56.79
24% of jobs
$57.05 is the 75th percentile. Wages above this are outliers.
$56.79 - $60.87
4% of jobs
$60.87 - $64.96
3% of jobs
$64.96 - $69.04
2% of jobs
$69.04 - $73.12
11% of jobs
$73.12 - $77.21
5% of jobs
$32
$54
$77
How much do generative ai testing jobs pay per hour?
What is the difference between Generative Ai Testing vs Data Scientist?
| Aspect | Generative Ai Testing | Data Scientist |
|---|---|---|
| Required Credentials | Knowledge of AI models, testing tools, programming skills | Statistics, programming, data analysis certifications |
| Work Environment | AI development teams, testing labs, tech companies | Research labs, tech firms, finance, healthcare |
| Employer & Industry Usage | AI product testing, quality assurance in tech | Data analysis, predictive modeling across industries |
Generative Ai Testing focuses on evaluating and validating AI-generated content and models, ensuring quality and accuracy. Data Scientists analyze data, build models, and derive insights. While both roles require programming and AI knowledge, Generative Ai Testing emphasizes testing processes, whereas Data Scientists focus on data analysis and model development.
What are the key skills and qualifications needed to thrive as a Generative AI Testing Specialist, and why are they important?
What are some common challenges faced when testing generative AI models, and how can I prepare to address them in this role?
What is Generative AI Testing?
Generative AI Graduate Fellow - Technical Research and Development
New Jersey Innovation AuthorityTrenton, NJ
Other
Posted 4 days ago
Job description
We are rapidly exploring the use of generative AI in government operations to improve the delivery of services and the experience of NJ residents. This exploration is via a pilot-based approach, wherein multiple pilot projects are rapidly developed, deployed, and monitored in order to understand how to use AI effectively and responsibly in government.
There are several projects at varying stages of the pilot pipeline: some are early in development, needing background research and engineering work to get off the ground. Some are more mature, with functional prototypes being integrated into agency operations, and now requiring development and execution of evaluation plans to measure efficacy, risk, and impact. Finally, we are developing resources to communicate learnings about generative AI use for operational and policy development purposes.
The Generative AI Graduate Fellow will work on multiple projects at different stages of development, contributing to research, engineering, evaluation, project management, user research, stakeholder communication, and written and verbal communication about the projects.
Continued development and evaluation of AI products. Two projects are in a mature prototyping stage. For each of these projects, some continued development to add final features and integrate into agency systems is necessary. However, the bulk of the work will be in testing and evaluation of these tools. The fellow will work with agency partners to develop and execute testing plans that assess accuracy, completeness, bias, agency workflow impact, and other elements of tool performance.
Project one: Public comment analysis. LLMs are used via a webapp interface to analyze and organize public comments giving feedback to NJ government entities.
Project two: Interview and case summarization. LLMs are used to transcribe and summarize interviews as part of a critical agency process. Further information on cases is integrated into the LLM system so that users can easily find reliable information about a case.
Prototyping LLM products. Several projects need earlier-stage development work, including
- A tool to suggest content and design revisions for readability and accessibility
- Relevant education background: Currently pursuing or recently graduated from a graduate program in computer science, data science, engineering, and related disciplines. Strong applicants who are recently or are currently graduating with a bachelor's degree will also be considered.
- Demonstrated experience with developing, deploying, or evaluating digital tools involving large language models (LLMs), including through cloud-based APIs.
- Some experience working at all levels of the development stack, including but not limited to: frontend web applications, backend APIs and databases, and cloud infrastructure.
- Experience with technologies such as: python, modern JavaScript, React, CSS, HTML, JavaScript libraries and frameworks, Amazon Web Services (AWS), SQL and NoSQL document store persistence, and Git/GitHub version control.
- Research skills, including breaking down complex problems, creating custom evaluation plans, performing research interviews and other qualitative data collection, and data analysis for research outputs.
- Proven skill in tackling problems with curiosity, engaging in inquiry, and understanding user needs to develop optimal solutions.
- Dedicated to advancing our mission and public service, with a strong commitment to accessibility and fostering a more inclusive society.
Compensation: Paid, hourly wage of $20-30 per hour dependent upon experience.