ZipRecruiter

Log In

1

Llm Prompt Engineer Jobs in Rochester, NY (NOW HIRING)

ITX Corp

SR Software Engineer (Data) - Remote, US

Rochester, NY · Remote

$125K - $165K/yr

Join Our Team as a Senior Software Engineer with Data Skills for Agentic AI Systems! We are looking ... Experience writing system prompts and designing prompt interactions for LLM applications, including ...

Pwc

AI Solutions Engineering Delivery Lead

Rochester, NY · On-site

$101K - $133K/yr

... LLM applications - Proven specialization in Python, Pandas, Scikit-learn, PyTorch, Langchain, Semantic Kernel, SQL, vector DBs, LLMs, and prompt engineering - Proven specialization with major cloud ...

MegazoneCloud

Sr. Full Stack Engineer

Rochester, NY · On-site

$145K - $165K/yr

LLM-backed workflows that generate code, validate outputs, compare results across languages and ... Operationalize GenAI workloads on Amazon Bedrock and comparable services - retrieval, prompt and ...

MegazoneCloud US

Sr. AI FDE

Rochester, NY · On-site

$54.50 - $70.25/hr

... LLM-powered applications -- including RAG pipelines, agentic workflows, and orchestration ... Gemini) -- prompt engineering, RAG, and agentic systems. • Hands-on experience with agentic ...

MegazoneCloud Global

Sr. AI FDE

Rochester, NY · On-site

$54.50 - $70.25/hr

... LLM-powered applications -- including RAG pipelines, agentic workflows, and orchestration ... Gemini) -- prompt engineering, RAG, and agentic systems. • Hands-on experience with agentic ...

MegazoneCloud

Sr. AI FDE

Rochester, NY · On-site

$145K - $165K/yr

... deploy LLM-powered applications - including RAG pipelines, agentic workflows, and orchestration ... OpenAI, Gemini) - prompt engineering, RAG, and agentic systems. • Hands-on experience with ...

All JobsLlm Prompt Engineer JobsLlm Prompt Engineer Jobs in Rochester, NY

Llm Prompt Engineer information

See Rochester, NY salary details

$36

$57

$84

How much do llm prompt engineer jobs pay per hour?

As of Aug 8, 2026, the average hourly pay for llm prompt engineer in Rochester, NY is $57.44, according to ZipRecruiter salary data. Most workers in this role earn between $44.81 and $70.19 per hour, depending on experience, location, and employer.

What are some common challenges faced by LLM Prompt Engineers when designing effective prompts for large language models?

LLM Prompt Engineers often encounter challenges such as ensuring prompts are both clear and unambiguous to elicit accurate model responses, as well as avoiding bias or unintended outputs. Balancing creativity and specificity in prompt design can be tricky, especially when tailoring prompts for diverse user intents or specialized domains. Additionally, prompt engineers must frequently iterate and test their prompts, collaborating closely with data scientists and product teams to continually refine them based on observed model behavior and user feedback.

What is an LLM Prompt Engineer?

An LLM Prompt Engineer is a professional who specializes in designing, testing, and optimizing prompts for large language models (LLMs) such as GPT-4. Their role involves crafting effective instructions and queries to guide the model's output for specific applications, ensuring accuracy, relevance, and reliability. They may also analyze model behavior, implement prompt-based workflows, and collaborate with developers to integrate LLMs into products or services. The goal is to maximize the performance and efficiency of language models in various real-world contexts.

What are the key skills and qualifications needed to thrive as an LLM Prompt Engineer?

To thrive as an LLM Prompt Engineer, you need a deep understanding of natural language processing, prompt engineering strategies, and proficiency in programming languages such as Python, often supported by a degree in computer science or a related field. Familiarity with machine learning frameworks (like TensorFlow or PyTorch), large language model APIs, and version control systems is typically required. Strong analytical thinking, creativity, and effective communication are crucial soft skills for crafting precise prompts and collaborating with cross-functional teams. These skills ensure the development of effective, ethical, and high-performing AI-powered solutions that meet diverse user needs.

What is the difference between Llm Prompt Engineer vs Data Scientist?

AspectLlm Prompt EngineerData Scientist
Required CredentialsBachelor's in CS, AI, or related fields; familiarity with NLP and AI toolsBachelor's or higher in CS, Statistics, or related fields; strong programming and statistical skills
Work EnvironmentAI labs, tech companies, startups focusing on NLP and AI modelsData analysis, modeling, and visualization in various industries like finance, healthcare, tech
Employer & Industry UsagePrimarily in AI development, NLP projects, and machine learning teamsAcross industries for data analysis, predictive modeling, and decision support

While both roles involve working with data and AI, Llm Prompt Engineers focus on designing prompts for language models, whereas Data Scientists analyze data to derive insights. The roles share similar educational backgrounds and work environments but differ in their core tasks and industry applications.

What are popular job titles related to Llm Prompt Engineer jobs in Rochester, NY? For Llm Prompt Engineer jobs in Rochester, NY, the most frequently searched job titles are:
What job categories do people searching Llm Prompt Engineer jobs in Rochester, NY look for? The top searched job categories for Llm Prompt Engineer jobs in Rochester, NY are:
What cities near Rochester, NY are hiring for Llm Prompt Engineer jobs? Cities near Rochester, NY with the most Llm Prompt Engineer job openings:
Llm Prompt Engineer jobs near you
Infographic showing various Llm Prompt Engineer job openings in Rochester, NY as of June 2026, with employment types broken down into 84% Full Time, 11% Part Time, and 5% Contract. Highlights an 81% Physical, 4% Hybrid, and 15% Remote job distribution, with an average salary of $119,472 per year, or $57.4 per hour.

SR Software Engineer (Data) - Remote, US

ITX Corp

Rochester, NY • On-site, Remote

$96K - $129K/yr

Full-time

Re-posted 5 days ago

Job description

Join Our Team as a Senior Software Engineer with Data Skills for Agentic AI Systems!
We are looking for a Senior Software Engineer with a strong focus on Data and experience building infrastructure for LLM-powered applications and agent-based systems. In this role, you will work on RAG pipelines, agent workflows, and memory systems that allow AI agents to reason, retrieve information, and interact with complex tasks.
You will collaborate with engineers building intelligent agents and help design the data pipelines, evaluation frameworks, and orchestration workflows that support reliable and scalable AI systems.
Note: This opening is only available for candidates based in the United States of America. Applications from other locations will not be considered for the role.
What You'll Do:
  • Design and maintain ETL pipelines that process and classify unstructured data for Retrieval-Augmented Generation (RAG) systems.
  • Support the development of agent-based architectures using reasoning and acting patterns such as ReAct.
  • Build and maintain agent workflows using node-based orchestration frameworks such as LangGraph, including hierarchical and state-machine-based execution.
  • Design and implement agent memory systems, including short-term event memory and long-term memory strategies such as summarization, semantic memory, episodic memory, and user preference storage.
  • Develop system prompts and intent-handling prompts that support reliable agent interactions.
  • Create evaluation tests, datasets, and performance benchmarks to measure and improve LLM agent behavior, including ReAct-based agents.
  • Build tools that allow LLM agents to interact with external systems and services.
  • Apply best practices around guardrails, prompt security, input sanitization, and safe handling of user-generated content.
  • Collaborate closely with engineers across the team and provide guidance to less experienced developers when needed.

What We're Looking For:
  • Experience building RAG pipelines or ETL workflows for unstructured documents.
  • Experience working with LLM-based systems or AI-powered applications.
  • Familiarity with agent architectures such as ReAct.
  • Hands-on experience with workflow orchestration frameworks such as LangGraph or similar node-based systems.
  • Experience implementing agent memory systems (e.g., AgentCore Memory API or similar), including both short-term and long-term memory strategies.
  • Experience writing system prompts and designing prompt interactions for LLM applications, including intent handling.
  • Experience evaluating and performance testing LLM agents, particularly within ReAct-style workflows.
  • Ability to generate evaluation datasets and test scenarios for agent-based systems.
  • Understanding of mapping user utterances to intents using RAG and/or LLM-based approaches.
  • Understanding of guardrails and safety mechanisms for LLM and agent systems.
  • Understanding of agent-specific threat vectors, including prompt injection, tool misuse, and unsafe memory access.
  • Familiarity with AWS environments and tools such as AWS CLI and STS.
  • Strong understanding of data pipelines and document processing for AI systems.

Nice to have:
  • Experience with LangGraph or other agent orchestration frameworks.
  • Experience building tools for tool-enabled LLM agents.
  • Experience working with hierarchical state machines or complex workflow orchestration patterns.
  • Experience designing evaluation frameworks or LLM benchmarking systems.
  • Experience working with AI agent security concepts or threat modeling.

ITX's Compensation Philosophy
Equality in compensation has been our practice since ITX started, in 1997.
ITX believes that market-based pay ensures fair and equitable compensation for our worldwide team members and pay that is based on the market, not on who has the best negotiation skills. At ITX, you'll never discover that someone in the same job with the same experience makes more than you, or that there are pay gaps based on race, gender, disability, or age.
How do our team members experience market-based pay at ITX? We gather market data to benchmark each position in our candidates' and team members' locations and use these benchmarks for candidate offers and to perform regular compensation reviews for our team members. You'll never have to worry about asking for a pay raise again. At least once a year ITX automatically adjusts pay when the benchmark is higher than our team member's compensation.
In Rochester, N.Y., home to ITX's headquarters, the pay range for a Senior Software Developer with Data Skills role is $96,000 to $129,000, depending on experience, specific skills and certifications, and education. Based on your location in the United States if you are in a place where the market for your role is higher or lower, this pay range could be 13% lower or 10% higher than the Rochester, N.Y. market.
ITX has team members in many countries, and we use the same methodology for determining pay for all our teammates. For candidates outside of the United States, we use local market data to determine the benchmark range for the Senior Software Engineer with Data Skills.
Do you have questions about ITX's compensation practices? Let us know! We're proud of how we do compensation at ITX and welcome the opportunity to share more.
This role was posted by ITX on June 30th, 2026.

Apply