1

Llm Developer Jobs in Rochester, NY (NOW HIRING)

AI Data Engineer - Senior Consultant

Rochester, NY · Hybrid

$103.10K - $141.60K/yr

Build and operationalize LLM-enabled capabilities (e.g., copilots, HR knowledge assistants ... DevOps/DevSecOps experience (CI/CD, IaC such as Terraform/CloudFormation, Docker/Kubernetes ...

AI Data Engineer - Senior Consultant

Rochester, NY · On-site

$104.60K - $142.10K/yr

Required : • Bachelor's degree in a STEM field (e.g., Computer Science, Engineering, Statistics, Data Science) • 4+ years building and delivering LLM/GenAI solutions with Claude/GPT(Codex)/Gemini ...

Working closely with business, solution engineers, team members and leadership to understand ... Hands-on experience building and deploying GenAI/LLM-powered solutions in client or production ...

What is The Role Developers and community matter. Our users and contributors have helped ensure ... Topics range from foundational and evergreen topics to today's LLM release. Write short‐form ...

next page

Showing results 1-20

Llm Developer information

See Rochester, NY salary details

$25

$49

$78

How much do llm developer jobs pay per hour?

As of May 30, 2026, the average hourly pay for llm developer in Rochester, NY is $49.50, according to ZipRecruiter salary data. Most workers in this role earn between $38.89 and $60.00 per hour, depending on experience, location, and employer.

What does an LLM Developer do?

An LLM Developer designs, fine-tunes, and implements large language models (LLMs) for various applications, such as chatbots, content generation, and AI-driven tools. They work with machine learning frameworks, optimize model performance, and ensure efficient deployment. This role requires expertise in natural language processing (NLP), deep learning, and programming languages like Python.

What are the key skills and qualifications needed to thrive in the Llm Developer position, and why are they important?

To excel as an LLM Developer, you need strong expertise in natural language processing (NLP), deep learning frameworks, and programming languages such as Python, typically supported by a degree in computer science or a related field. Familiarity with machine learning libraries (like TensorFlow or PyTorch), cloud computing platforms, and experience with prompt engineering or fine-tuning large language models is crucial. Excellent problem-solving abilities, collaboration, and effective communication skills help you design solutions and work efficiently within multidisciplinary teams. These qualifications are essential for successfully building, deploying, and optimizing large language models that drive impactful AI applications.

What are the typical daily tasks and responsibilities of an LLM Developer?

As an LLM Developer, your daily responsibilities often include designing, fine-tuning, and evaluating large language models to meet specific application needs. You may work on tasks such as data preprocessing, model training, performance benchmarking, and error analysis, frequently collaborating with data scientists, research engineers, and product managers. Keeping up to date with the latest advancements in NLP and integrating new techniques into production models is also a key part of the role. These tasks are usually performed in a team-oriented environment where clear communication and iterative experimentation are highly valued.

What is the salary of LLM engineer?

The salary of an LLM (Large Language Model) engineer typically ranges from $100,000 to $180,000 annually, depending on experience, location, and company size. Senior roles or those with specialized skills in deep learning and NLP can earn higher compensation, often exceeding $200,000 with bonuses and stock options.
What are popular job titles related to Llm Developer jobs in Rochester, NY? For Llm Developer jobs in Rochester, NY, the most frequently searched job titles are:
What job categories do people searching Llm Developer jobs in Rochester, NY look for? The top searched job categories for Llm Developer jobs in Rochester, NY are:
What cities near Rochester, NY are hiring for Llm Developer jobs? Cities near Rochester, NY with the most Llm Developer job openings:
AI Data Engineer - Senior Consultant

AI Data Engineer - Senior Consultant

Deloitte

Rochester, NY • Hybrid

$103.10K - $141.60K/yr

Other

Posted 13 days ago


Deloitte rating

8.1

Company rating: 8.1 out of 10

Based on 86 frontline employees who took The Breakroom Quiz

59th of 138 rated financial services


Job description

AI Engineer Senior Consultant

Our Deloitte Human Capital team transforms technology platforms, drives innovation, and helps make a significant impact on our clients' success. We are hiring an AI Engineer to build and operate the data, features, and GenAI foundations that power Human Capital AI products and analytics. You will work with an AI Data Engineer (data ingestion, curation, governance, platform foundations) and a Lead AI Solutions Architect (end-to-end solution architecture, integration patterns, non-functional requirements), partnering closely with product, data science/ML, security, and platform engineering to deliver reliable, secure, and scalable AI solutions.

This role is hands-on and delivery-oriented: you will ship production pipelines and services that support model training, real-time inference, and LLM applications using Claude-, GPT/Codex-, and Gemini-class models, and more implemented with strong governance, observability, and cost/performance discipline.

Recruiting for this role ends on August 30, 2026

Work You'll Do:

As an AI Engineer Senior Consultant, you will design, build, and run the trusted, governed data + feature + retrieval layer used by AI/ML and GenAI solutions. You will deliver reproducible datasets and features, operationalize quality and lineage, and enable secure consumption patterns for both predictive ML and LLM-based experiences.

Key Responsibilities:

  • Partner with the Lead AI Solutions Architect and AI Data Engineer to translate Human Capital product needs into secure, scalable technical designs and delivered solutions (APIs, services, pipelines, containers/serverless) meeting availability, performance, and security expectations.
  • Build and operationalize LLM-enabled capabilities (e.g., copilots, HR knowledge assistants, summarization, policy Q&A) using Claude/GPT(Codex)/Gemini, including secure endpoints, tool/function calling, and reusable prompt/context patterns.
  • Implement LLM application patterns including RAG, document ingestion/chunking, embeddings, vector/hybrid search, and retrieval/evaluation telemetry.
  • Deliver governed datasets and feature engineering/serving for ML training and real-time inference (online/offline consistency, caching, latency SLOs, backfills).
  • Implement safety, privacy, and access controls (PII handling, prompt-injection defenses, content filtering, policy-based access) with security and risk stakeholders.
  • Establish data/model reliability and cost-performance discipline (data quality, schema evolution, lineage/metadata, monitoring; right-sizing, query tuning, LLM token/cost telemetry).
  • Contribute to MLOps/LLMOps and production operations (versioning, reproducibility, CI/CD, automated testing, observability, incident response); support design reviews, deployment readiness, and runbooks.

The Team

HC Forward is a dedicated innovation partner accelerating the future of Human Capital by building market-aligned products, platforms, and services that apply AI, data, and engineering to modernize HR experiences and outcomes.

Required Qualifications:

  • Bachelor's degree in a STEM field (e.g., Computer Science, Engineering, Statistics, Data Science)
  • 4+ years building and delivering LLM/GenAI solutions with Claude/GPT(Codex)/Gemini-class models, including prompt/context design, tool/function calling, evaluation, and production integration.
  • 4+ years implementing RAG/retrieval (document processing, embeddings, vector/hybrid search) with enterprise governance controls.
  • 4+ years of modern data & AI engineering, including data modeling, batch/streaming pipelines, structured/unstructured processing, and feature engineering/serving fundamentals.
  • 4+ years building production, real-time inference services (API design, latency/performance, reliability patterns).
  • 4+ years leading platform/integration engineering across enterprise systems; strong API/integration experience (REST, GraphQL, event-driven, microservices, middleware).
  • 4+ years DevOps/DevSecOps experience (CI/CD, IaC such as Terraform/CloudFormation, Docker/Kubernetes, observability/monitoring).
  • 4+ years leading security/compliance efforts; familiarity with enterprise security controls (IAM, encryption, secrets, audit logging) and data/privacy (PII, retention, access controls); SOC 2/GDPR/HIPAA exposure a plus.
  • Ability to travel 0-25%, on average, based on client and project needs.
  • Limited immigration sponsorship may be available

Preferred Qualifications:

  • Advanced degree (MS/PhD) and/or relevant certifications (cloud and AI/ML).
  • 4+ years of experience with Human Capital platforms and integrations (e.g., Workday, SAP SuccessFactors, Oracle HCM, Salesforce) and HR data domains.
  • 4+ years of experience operationalizing LLMOps/MLOps capabilities (evaluation, monitoring, governance workflows, model/prompt/version management).
  • 4+ years of cloud experience on AWS/Azure/GCP (one or more), including managed data platforms and scalable compute patterns.
  • 4+ years of experience with structured problem solving, translating business needs into requirements, acceptance criteria, and shippable increments.
  • 4+ years of experience with stakeholder communication: ability to explain AI/GenAI trade-offs (quality vs. latency vs. cost vs. risk) and document decisions.
  • 4+ years of experience collaborating across product, data science/ML, data engineering, platform, and security.
  • 4+ years of experience with treat testing, monitoring, and operational readiness as core responsibilities.
  • 4+ years of experience with ethics and privacy awareness being able to recognize consent/PII/bias boundaries and escalate appropriately.

The wage range for this role takes into account the wide range of factors that are considered in making compensation decisions including but not limited to skill sets; experience and training; licensure and certifications; and other business and organizational needs. The disclosed range estimate has not been adjusted for the applicable geographic differential associated with the location at which the position may be filled. At Deloitte, it is not typical for an individual to be hired at or near the top of the range for their role and compensation decisions are dependent on the facts and circumstances of each case. A reasonable estimate of the current range is $113,100 to $208,300.

You may also be eligible to participate in a discretionary annual incentive program, subject to the rules governing the program, whereby an award, if any, depends on various factors, including, without limitation, individual and organizational performance.

Possible Locations: Atlanta, Austin, Baltimore, Boston, Charlotte, Chicago, Cincinnati, Cleveland, Columbus, Costa Mesa, Dallas, Denver, Detroit, Hartford, Houston, Indianapolis, Jacksonville, Kansas City, Las Vegas, Los Angeles, McLean, Miami, Milwaukee, Nashville, New Orleans, New York, Philadelphia, Pittsburgh, Portland, Raleigh, Richmond, Sacramento, San Antonio, San Diego, San Francisco, San Jose, Seattle, St. Louis, Stamford, Tampa, Tempe

Information for applicants with a need for accommodation: https://www2.deloitte.com/us/en/pages/careers/articles/join-deloitte-assistance-for-disabled-applicants.html

For more information about Human Capital, visit our landing page at: https://www2.deloitte.com/us/en/pages/careers/articles/join-deloitte-human-capital-consulting-jobs.html

#HCFY26 #IIOFY26

Qualifications:

AI Engineer Senior Consultant

Our Deloitte Human Capital team transforms technology platforms, drives innovation, and helps make a significant impact on our clients' success. We are hiring an AI Engineer to build and operate the data, features, and GenAI foundations that power Human Capital AI products and analytics. You will work with an AI Data Engineer (data ingestion, curation, governance, platform foundations) and a Lead AI Solutions Architect (end-to-end solution architecture, integration patterns, non-functional requirements), partnering closely with product, data science/ML, security, and platform engineering to deliver reliable, secure, and scalable AI solutions.

This role is hands-on and delivery-oriented: you will ship production pipelines and services that support model training, real-time inference, and LLM applications using Claude-, GPT/Codex-, and Gemini-class models, and more implemented with strong governance, observability, and cost/performance discipline.

Recruiting for this role ends on August 30, 2026

Work You'll Do:

As an AI Engineer Senior Consultant, you will design, build, and run the trusted, governed data + feature + retrieval layer used by AI/ML and GenAI solutions. You will deliver reproducible datasets and features, operationalize quality and lineage, and enable secure consumption patterns for both predictive ML and LLM-based experiences.

Key Responsibilities:

  • Partner with the Lead AI Solutions Architect and AI Data Engineer to translate Human Capital product needs into secure, scalable technical designs and delivered solutions (APIs, services, pipelines, containers/serverless) meeting availability, performance, and security expectations.
  • Build and operationalize LLM-enabled capabilities (e.g., copilots, HR knowledge assistants, summarization, policy Q&A) using Claude/GPT(Codex)/Gemini, including secure endpoints, tool/function calling, and reusable prompt/context patterns.
  • Implement LLM application patterns including RAG, document ingestion/chunking, embeddings, vector/hybrid search, and retrieval/evaluation telemetry.
  • Deliver governed datasets and feature engineering/serving for ML training and real-time inference (online/offline consistency, caching, latency SLOs, backfills).
  • Implement safety, privacy, and access controls (PII handling, prompt-injection defenses, content filtering, policy-based access) with security and risk stakeholders.
  • Establish data/model reliability and cost-performance discipline (data quality, schema evolution, lineage/metadata, monitoring; right-sizing, query tuning, LLM token/cost telemetry).
  • Contribute to MLOps/LLMOps and production operations (versioning, reproducibility, CI/CD, automated testing, observability, incident response); support design reviews, deployment readiness, and runbooks.

The Team

HC Forward is a dedicated innovation partner accelerating the future of Human Capital by building market-aligned products, platforms, and services that apply AI, data, and engineering to modernize HR experiences and outcomes.

Required Qualifications:

  • Bachelor's degree in a STEM field (e.g., Computer Science, Engineering, Statistics, Data Science)
  • 4+ years building and delivering LLM/GenAI solutions with Claude/GPT(Codex)/Gemini-class models, including prompt/context design, tool/function calling, evaluation, and production integration.
  • 4+ years implementing RAG/retrieval (document processing, embeddings, vector/hybrid search) with enterprise governance controls.
  • 4+ years of modern data & AI engineering, including data modeling, batch/streaming pipelines, structured/unstructured processing, and feature engineering/serving fundamentals.
  • 4+ years building production, real-time inference services (API design, latency/performance, reliability patterns).
  • 4+ years leading platform/integration engineering across enterprise systems; strong API/integration experience (REST, GraphQL, event-driven, microservices, middleware).
  • 4+ years DevOps/DevSecOps experience (CI/CD, IaC such as Terraform/CloudFormation, Docker/Kubernetes, observability/monitoring).
  • 4+ years leading security/compliance efforts; familiarity with enterprise security controls (IAM, encryption, secrets, audit logging) and data/privacy (PII, retention, access controls); SOC 2/GDPR/HIPAA exposure a plus.
  • Ability to travel 0-25%, on average, based on client and project needs.
  • Limited immigration sponsorship may be available

Preferred Qualifications:

  • Advanced degree (MS/PhD) and/or relevant certifications (cloud and AI/ML).
  • 4+ years of experience with Human Capital platforms and integrations (e.g., Workday, SAP SuccessFactors, Oracle HCM, Salesforce) and HR data domains.
  • 4+ years of experience operationalizing LLMOps/MLOps capabilities (evaluation, monitoring, governance workflows, model/prompt/version management).
  • 4+ years of cloud experience on AWS/Azure/GCP (one or more), including managed data platforms and scalable compute patterns.
  • 4+ years of experience with structured problem solving, translating business needs into requirements, acceptance criteria, and shippable increments.
  • 4+ years of experience with stakeholder communication: ability to explain AI/GenAI trade-offs (quality vs. latency vs. cost vs. risk) and document decisions.
  • 4+ years of experience collaborating across product, data science/ML, data engineering, platform, and security.
  • 4+ years of experience with treat testing, monitoring, and operational readiness as core responsibilities.
  • 4+ years of experience with ethics and privacy awareness being able to recognize consent/PII/bias boundaries and escalate appropriately.

The wage range for this role takes into account the wide range of factors that are considered in making compensation decisions including but not limited to skill sets; experience and training; licensure and certifications; and other business and organizational needs. The disclosed range estimate has not been adjusted for the applicable geographic differential associated with the location at which the position may be filled. At Deloitte, it is not typical for an individual to be hired at or near the top of the range for their role and compensation decisions are dependent on the facts and circumstances of each case. A reasonable estimate of the current range is $113,100 to $208,300.

You may also be eligible to participate in a discretionary annual incentive program, subject to the rules governing the program, whereby an award, if any, depends on various factors, including, without limitation, individual and organizational performance.

Possible Locations: Atlanta, Austin, Baltimore, Boston, Charlotte, Chicago, Cincinnati, Cleveland, Columbus, Costa Mesa, Dall...


What Deloitte employees say

Pay

Benefits

Hours and flexibility

Workplace

Get the full story on Breakroom