Llm Prompt Engineer Jobs in Rochester, NY (NOW HIRING)

Join Our Team as a Senior Software Engineer with Data Skills for Agentic AI Systems!

We are looking for a Senior Software Engineer with a strong focus onData and experience building infrastructure for LLM-powered applications and agent-based systems. In this role, you will work on RAG pipelines, agent workflows, and memory systems that allow AI agents to reason, retrieve information, and interact with complex tasks.

You will collaborate with engineers building intelligent agents and help design the data pipelines, evaluation frameworks, and orchestration workflows that support reliable and scalable AI systems.

Note: This opening is only available for candidates based in the United States of America. Applications from other locations will not be considered for the role.

What You'll Do:

• Design and maintain ETL pipelines that process and classify unstructured data for Retrieval-Augmented Generation (RAG) systems.
• Support the development of agent-based architectures using reasoning and acting patterns such as ReAct.
• Build and maintain agent workflows using node-based orchestration frameworks such as LangGraph, including hierarchical and state-machine-based execution.
• Design and implement agent memory systems, including short-term event memory and long-term memory strategies such as summarization, semantic memory, episodic memory, and user preference storage.
• Develop system prompts and intent-handling prompts that support reliable agent interactions.
• Create evaluation tests, datasets, and performance benchmarks to measure and improve LLM agent behavior, including ReAct-based agents.
• Build tools that allow LLM agents to interact with external systems and services.
• Apply best practices around guardrails, prompt security, input sanitization, and safe handling of user-generated content.
• Collaborate closely with engineers across the team and provide guidance to less experienced developers when needed.
  

What We're Looking For:

• Experience building RAG pipelines or ETL workflows for unstructured documents.
• Experience working with LLM-based systems or AI-powered applications.
• Familiarity with agent architectures such as ReAct.
• Hands-on experience with workflow orchestration frameworks such as LangGraph or similar node-based systems.
• Experience implementing agent memory systems (e.g., AgentCore Memory API or similar), including both short-term and long-term memory strategies.
• Experience writing system prompts and designing prompt interactions for LLM applications, including intent handling.
• Experience evaluating and performance testing LLM agents, particularly within ReAct-style workflows.
• Ability to generate evaluation datasets and test scenarios for agent-based systems.
• Understanding of mapping user utterances to intents using RAG and/or LLM-based approaches.
• Understanding of guardrails and safety mechanisms for LLM and agent systems.
• Understanding of agent-specific threat vectors, including prompt injection, tool misuse, and unsafe memory access.
• Familiarity with AWS environments and tools such as AWS CLI and STS.
  
• Strong understanding of data pipelines and document processing for AI systems.

Nice to have:

• Experience with LangGraph or other agent orchestration frameworks.
• Experience building tools for tool-enabled LLM agents.
  
• Experience working with hierarchical state machines or complex workflow orchestration patterns.
• Experience designing evaluation frameworks or LLM benchmarking systems.
• Experience working with AI agent security concepts or threat modeling.

ITX's Compensation Philosophy

Equality in compensation has been our practice since ITX started, in 1997.

ITX believes that market-based pay ensures fair and equitable compensation for our worldwide team members and pay that is based on the market, not on who has the best negotiation skills. At ITX, you'll never discover that someone in the same job with the same experience makes more than you, or that there are pay gaps based on race, gender, disability, or age.

How do our team members experience market-based pay at ITX? We gather market data to benchmark each position in our candidates' and team members' locations and use these benchmarks for candidate offers and to perform regular compensation reviews for our team members. You'll never have to worry about asking for a pay raise again. At least once a year ITX automatically adjusts pay when the benchmark is higher than our team member's compensation.

In Rochester, N.Y., home to ITX's headquarters, the pay range for a Senior Software Developer with Data Skills role is $96,000 to $129,000, depending on experience, specific skills and certifications, and education. Based on your location in the United States if you are in a place where the market for your role is higher or lower, this pay range could be 13% lower or 10% higher than the Rochester, N.Y. market.

ITX has team members in many countries, and we use the same methodology for determining pay for all our teammates. For candidates outside of the United States, we use local market data to determine the benchmark range for the Senior Software Engineer with Data Skills.

Do you have questions about ITX's compensation practices? Let us know! We're proud of how we do compensation at ITX and welcome the opportunity to share more.

This role was posted by ITX on June 30th, 2026.