ZipRecruiter

Log In

1

Ai Prompt Tester Jobs in Rochester, NY (NOW HIRING)

2T Consulting

Python Agentic AI Engineer

York, NY · On-site

Integrate Gemini/OpenAI models using prompt engineering, function calling, structured outputs ... Apply Domain-Driven Design (DDD), agile methodologies, testing, and code-review best practices.

2T Consulting

Python Agentic AI Engineer

Brighton, NY · On-site

Integrate Gemini/OpenAI models using prompt engineering, function calling, structured outputs ... Apply Domain-Driven Design (DDD), agile methodologies, testing, and code-review best practices.

2T Consulting

Python Agentic AI Engineer

Brighton, NY · On-site

Integrate Gemini/OpenAI models using prompt engineering, function calling, structured outputs ... Apply Domain-Driven Design (DDD), agile methodologies, testing, and code-review best practices.

2T Consulting

Python Agentic AI Engineer

York, NY · On-site

Integrate Gemini/OpenAI models using prompt engineering, function calling, structured outputs ... Apply Domain-Driven Design (DDD), agile methodologies, testing, and code-review best practices.

Pwc

AI Engineer

Rochester, NY · On-site

$50K - $112K/yr

... prompt engineering, LLM evaluation, and fine-tuning, to develop production-ready applications ... testing, and adversarial benchmarking, to assess reasoning, tool-calling reliability, and output ...

Deloitte

AI Security Engineer Manager

Rochester, NY · On-site

Integrate security across the SSDLC, including code reviews, testing, and deployment. In this role ... Strong understanding of AI/GenAI technologies and associated security risks (e.g., prompt injection ...

Pwc

AI Solutions Engineering Delivery Lead

Rochester, NY · On-site

$101K - $133K/yr

... testing, validation, and operational excellence - Establish and drive consistent quality control ... and prompt engineering - Proven specialization with major cloud platforms such as AWS, Azure, or ...

Varsity Tutors

Vibe Coding Tutor

Rochester, NY · Remote

$18 - $40/hr

Deep knowledge of AI-assisted software development using natural language prompts, iterative prompt ... Guides students through describing software requirements in natural language, reviewing and testing ...

ITX Corp.

SR Software Engineer (Data) - Remote, US

Rochester, NY · On-site +1

$120K - $159K/yr

Join Our Team as a Senior Software Engineer with Data Skills for Agentic AI Systems! We are looking ... Apply best practices around guardrails, prompt security, input sanitization, and safe handling of ...

MegazoneCloud

Sr. Full Stack Engineer

Rochester, NY · On-site

$145K - $165K/yr

Build agentic and AI-enabled capabilities * Operationalize GenAI workloads on Amazon Bedrock and ... Own testing, observability, cost efficiency, and security posture for what you deliver. Engage the ...

Megazone Cloud US

Sr. Full Stack Engineer

Rochester, NY · On-site

$120 - $180/hr

Build agentic and AI-enabled capabilities * Operationalize GenAI workloads on Amazon Bedrock and ... Own testing, observability, cost efficiency, and security posture for what you deliver. Engage the ...

All JobsAi Prompt Tester JobsAi Prompt Tester Jobs in Rochester, NY

Ai Prompt Tester information

See Rochester, NY salary details

$13

$18

$21

How much do ai prompt tester jobs pay per hour?

As of Sep 4, 2026, the average hourly pay for ai prompt tester in Rochester, NY is $18.04, according to ZipRecruiter salary data. Most workers in this role earn between $16.11 and $19.66 per hour, depending on experience, location, and employer.

What is an AI prompt tester?

An AI Prompt Tester evaluates and refines AI-generated responses by testing different prompts to ensure accuracy, relevance, and coherence. They analyze outputs, identify inconsistencies, and provide feedback to improve AI models. This role requires critical thinking, attention to detail, and a strong understanding of AI behavior. It is commonly used in AI development, chatbots, and content generation systems.

What are the key skills and qualifications needed to thrive as an AI prompt tester?

To thrive as an AI Prompt Tester, you need a strong grasp of language comprehension, analytical thinking, and familiarity with AI-driven content generation platforms. Experience using tools like GPT-based interfaces, prompt management systems, and possibly certifications in machine learning or natural language processing can be advantageous. Attention to detail, problem-solving, and effective communication are valuable soft skills in this role. These skills are crucial for ensuring high-quality, relevant AI outputs and facilitating continuous improvements in AI prompt performance.

What are some typical challenges an AI prompt tester faces on the job?

AI Prompt Testers often encounter challenges such as ensuring prompt accuracy across diverse contexts, identifying subtle biases or inconsistencies in AI-generated outputs, and adapting to frequent software updates or changes in model behavior. They may need to balance thorough testing with efficiency under tight deadlines, and clearly communicate feedback to developers or product teams. Tackling these challenges requires strong analytical skills, adaptability, and close collaboration with cross-functional teams to help improve product quality and user experience.

How do I become an AI prompt tester?

To become an AI prompt tester, you should have strong language skills, an understanding of AI and machine learning concepts, and experience with writing or editing prompts. Familiarity with AI tools and platforms, along with attention to detail, is essential for evaluating and improving AI responses. Gaining relevant experience through online courses or freelance projects can also help establish credibility in this role.

How do you become an AI prompt tester?

To become an AI prompt tester, you typically need strong language skills, familiarity with AI language models, and attention to detail. Gaining experience through online courses, practicing prompt creation, and understanding AI behavior can improve your chances. Some roles may require basic knowledge of programming or specific tools used in AI development.

What are popular job titles related to Ai Prompt Tester jobs in Rochester, NY?

For Ai Prompt Tester jobs in Rochester, NY, the most frequently searched job titles are:

What job categories do people searching Ai Prompt Tester jobs in Rochester, NY look for?

The top searched job categories for Ai Prompt Tester jobs in Rochester, NY are:

What cities near Rochester, NY are hiring for Ai Prompt Tester jobs?

Cities near Rochester, NY with the most Ai Prompt Tester job openings:

Ai Prompt Tester jobs near you

Python Agentic AI Engineer

2T Consulting

York, NY • On-site

Full-time

This job post has expired today. Applications are no longer accepted.

Job description

We are seeking a Python Agentic AI Engineer to design, build, and deploy scalable AI agent and backend solutions. The role combines Python, agentic AI, LLMs, RAG, AWS, APIs, microservices, and event-driven architectures to deliver production-ready AI applications.

Roles and Responsibilities

  • Design and develop autonomous and multi-agent solutions using Google ADK or Agent SDK.
  • Build agent workflows, tool calling, orchestration, and context management capabilities.
  • Integrate Gemini/OpenAI models using prompt engineering, function calling, structured outputs, grounding, and evaluation techniques.
  • Develop RAG solutions using embeddings and vector databases.
  • Build and integrate REST APIs, microservices, and event-driven architectures.
  • Develop scalable backend applications using Python, Django, GraphQL, and PostgreSQL.
  • Deploy and manage cloud-native applications on AWS.
  • Support data pipelines/ETL, application security, scalability, and resilience.
  • Implement AI observability, evaluation, security, governance, and guardrails.
  • Apply Domain-Driven Design (DDD), agile methodologies, testing, and code-review best practices.
  • Collaborate with product, engineering, data science, design, and business teams.

Required Skills & Experience

  • 7+ years of professional software engineering/system architecture experience.
  • Strong expertise in Python, particularly Django and GraphQL.
  • Hands-on experience with AI agent development using Google ADK or Agent SDK.
  • Strong experience with LLM integration, prompt engineering, and agent orchestration.
  • Experience with Gemini/OpenAI models, tool calling, function calling, structured outputs, and grounding.
  • Hands-on experience building RAG applications, vector databases, and embeddings.
  • Strong experience with AWS cloud-native application development.
  • Experience with REST APIs, microservices, SOA, and event-driven architectures.
  • Experience with PostgreSQL and data pipelines/ETL.
  • Knowledge of AI observability, evaluation, security, governance, and guardrails.
  • Strong understanding of scalable, resilient, and production-ready system architecture.
  • Strong collaboration and communication skills.

Preferred Skills

  • React and Apollo GraphQL
  • Domain-Driven Design (DDD)
  • Agile methodologies
  • AI evaluation frameworks
  • CI/CD and automated testing
  • Experience working in collaborative, in-person engineering environments

Apply