ZipRecruiter

Log In

1

Llm Developer Jobs in New York (NOW HIRING)

2T Consulting

AI/LLM Engineer

Maplewood, NJ · On-site

We are seeking a highly skilled AI/LLM Engineer to design, develop, and deploy intelligent agent-based systems capable of reasoning, planning, and executing tasks autonomously. The ideal candidate ...

2T Consulting

AI/LLM Engineer

Manhattan, NY · On-site

We are seeking a highly skilled AI/LLM Engineer to design, develop, and deploy intelligent agent-based systems capable of reasoning, planning, and executing tasks autonomously. The ideal candidate ...

2T Consulting

AI/LLM Engineer

Brooklyn, NY · On-site

We are seeking a highly skilled AI/LLM Engineer to design, develop, and deploy intelligent agent-based systems capable of reasoning, planning, and executing tasks autonomously. The ideal candidate ...

2T Consulting

AI/LLM Engineer

Elizabethport, NJ · On-site

We are seeking a highly skilled AI/LLM Engineer to design, develop, and deploy intelligent agent-based systems capable of reasoning, planning, and executing tasks autonomously. The ideal candidate ...

2T Consulting

AI/LLM Engineer

Ridgefield, NJ · On-site

We are seeking a highly skilled AI/LLM Engineer to design, develop, and deploy intelligent agent-based systems capable of reasoning, planning, and executing tasks autonomously. The ideal candidate ...

2T Consulting

AI/LLM Engineer

Harrison, NJ · On-site

We are seeking a highly skilled AI/LLM Engineer to design, develop, and deploy intelligent agent-based systems capable of reasoning, planning, and executing tasks autonomously. The ideal candidate ...

2T Consulting

AI/LLM Engineer

West Paterson, NJ · On-site

We are seeking a highly skilled AI/LLM Engineer to design, develop, and deploy intelligent agent-based systems capable of reasoning, planning, and executing tasks autonomously. The ideal candidate ...

2T Consulting

AI/LLM Engineer

Moonachie, NJ · On-site

We are seeking a highly skilled AI/LLM Engineer to design, develop, and deploy intelligent agent-based systems capable of reasoning, planning, and executing tasks autonomously. The ideal candidate ...

2T Consulting

AI/LLM Engineer

South Ozone Park, NY · On-site

We are seeking a highly skilled AI/LLM Engineer to design, develop, and deploy intelligent agent-based systems capable of reasoning, planning, and executing tasks autonomously. The ideal candidate ...

2T Consulting

AI/LLM Engineer

Rutherford, NJ · On-site

We are seeking a highly skilled AI/LLM Engineer to design, develop, and deploy intelligent agent-based systems capable of reasoning, planning, and executing tasks autonomously. The ideal candidate ...

2T Consulting

AI/LLM Engineer

Jamaica, NY · On-site

We are seeking a highly skilled AI/LLM Engineer to design, develop, and deploy intelligent agent-based systems capable of reasoning, planning, and executing tasks autonomously. The ideal candidate ...

2T Consulting

AI/LLM Engineer

Flushing, NY · On-site

We are seeking a highly skilled AI/LLM Engineer to design, develop, and deploy intelligent agent-based systems capable of reasoning, planning, and executing tasks autonomously. The ideal candidate ...

2T Consulting

AI/LLM Engineer

Jersey City, NJ · On-site

We are seeking a highly skilled AI/LLM Engineer to design, develop, and deploy intelligent agent-based systems capable of reasoning, planning, and executing tasks autonomously. The ideal candidate ...

2T Consulting

AI/LLM Engineer

Glen Ridge, NJ · On-site

We are seeking a highly skilled AI/LLM Engineer to design, develop, and deploy intelligent agent-based systems capable of reasoning, planning, and executing tasks autonomously. The ideal candidate ...

2T Consulting

AI/LLM Engineer

Brooklyn, NY · On-site

We are seeking a highly skilled AI/LLM Engineer to design, develop, and deploy intelligent agent-based systems capable of reasoning, planning, and executing tasks autonomously. The ideal candidate ...

2T Consulting

AI/LLM Engineer

Little Ferry, NJ · On-site

We are seeking a highly skilled AI/LLM Engineer to design, develop, and deploy intelligent agent-based systems capable of reasoning, planning, and executing tasks autonomously. The ideal candidate ...

2T Consulting

AI/LLM Engineer

Ridgewood, NY · On-site

We are seeking a highly skilled AI/LLM Engineer to design, develop, and deploy intelligent agent-based systems capable of reasoning, planning, and executing tasks autonomously. The ideal candidate ...

2T Consulting

AI/LLM Engineer

Woodland Park, NJ · On-site

We are seeking a highly skilled AI/LLM Engineer to design, develop, and deploy intelligent agent-based systems capable of reasoning, planning, and executing tasks autonomously. The ideal candidate ...

2T Consulting

AI/LLM Engineer

New York, NY · On-site

We are seeking a highly skilled AI/LLM Engineer to design, develop, and deploy intelligent agent-based systems capable of reasoning, planning, and executing tasks autonomously. The ideal candidate ...

2T Consulting

AI/LLM Engineer

Corona, NY · On-site

We are seeking a highly skilled AI/LLM Engineer to design, develop, and deploy intelligent agent-based systems capable of reasoning, planning, and executing tasks autonomously. The ideal candidate ...

previous pagenext page

Showing results 21-40

All JobsLlm Developer JobsLlm Developer Jobs in New York

Llm Developer information

See New York salary details

$27

$54

$87

How much do llm developer jobs pay per hour?

As of Sep 5, 2026, the average hourly pay for llm developer in New York is $54.88, according to ZipRecruiter salary data. Most workers in this role earn between $43.12 and $66.54 per hour, depending on experience, location, and employer.

What does an LLM Developer do?

An LLM Developer designs, fine-tunes, and implements large language models (LLMs) for various applications, such as chatbots, content generation, and AI-driven tools. They work with machine learning frameworks, optimize model performance, and ensure efficient deployment. This role requires expertise in natural language processing (NLP), deep learning, and programming languages like Python.

What are the key skills and qualifications needed to thrive as an LLM Developer?

To excel as an LLM Developer, you need strong expertise in natural language processing (NLP), deep learning frameworks, and programming languages such as Python, typically supported by a degree in computer science or a related field. Familiarity with machine learning libraries (like TensorFlow or PyTorch), cloud computing platforms, and experience with prompt engineering or fine-tuning large language models is crucial. Excellent problem-solving abilities, collaboration, and effective communication skills help you design solutions and work efficiently within multidisciplinary teams. These qualifications are essential for successfully building, deploying, and optimizing large language models that drive impactful AI applications.

What is the role of a large language model developer?

A large language model developer designs, trains, and fine-tunes AI models that understand and generate human language. They work with machine learning frameworks, manage large datasets, and optimize models for accuracy and efficiency, often requiring knowledge of programming, deep learning, and natural language processing techniques.

What are the most commonly searched types of Llm Developer jobs in New York?

The most popular types of Llm Developer jobs in New York are:

What are popular job titles related to Llm Developer jobs in New York?

For Llm Developer jobs in New York, the most frequently searched job titles are:

What job categories do people searching Llm Developer jobs in New York look for?

The top searched job categories for Llm Developer jobs in New York are:

What cities in New York are hiring for Llm Developer jobs?

Cities in New York with the most Llm Developer job openings:

Llm Developer jobs near you
Infographic showing various Llm Developer job openings in New York as of August 2026, with employment types broken down into 88% Full Time, 2% Part Time, and 10% Contract. Highlights an 80% Physical, 5% Hybrid, and 15% Remote job distribution, with an average salary of $114,156 per year, or $54.9 per hour.

AI/LLM Engineer

2T Consulting

Maplewood, NJ • On-site

Full-time

Posted 15 days ago

Key responsibilities

  • Design and develop AI agent systems using frameworks like LangChain or LangGraph.

  • Build intelligent components capable of reasoning, planning, and autonomous task execution.

  • Develop high-quality, scalable, and maintainable Python applications, including APIs and microservices for AI and agent-based systems.

Job description

We are seeking a highly skilled AI/LLM Engineer to design, develop, and deploy intelligent agent-based systems capable of reasoning, planning, and executing tasks autonomously. The ideal candidate will have strong Python engineering skills, hands-on experience with modern AI agent frameworks, and experience integrating LLM solutions with enterprise data platforms.

Roles and Responsibilities

Agent & AI System Development

  • Design and develop AI agent systems using LangChain, LangGraph, or similar frameworks.
  • Build intelligent components capable of reasoning, planning, and autonomous task execution.
  • Implement agentic patterns such as ReAct (Reasoning + Acting).
  • Develop multi-step LLM workflows and agent orchestration.

LLM Capabilities & Enhancements

  • Implement memory, tool usage, context management, and MCP capabilities.
  • Develop solutions using tool calling, chaining, and workflow orchestration.
  • Work with prompt engineering teams to improve LLM response quality and performance.
  • Optimize LLM applications for scalability, reliability, and cost.

Software Engineering

  • Develop high-quality, scalable, and maintainable Python applications, including asynchronous programming.
  • Build and maintain APIs and microservices for AI and agent-based applications.
  • Integrate AI services with enterprise applications and backend systems.
  • Develop production-ready solutions with appropriate testing, monitoring, and error handling.

Guardrails & Responsible AI

  • Design and implement guardrails and safety mechanisms for LLM-powered applications.
  • Handle edge cases, failures, hallucinations, and unintended model outputs.
  • Implement appropriate validation, security, and access controls for AI systems.

Data & Platform Integration

  • Integrate AI solutions with modern data platforms, including Snowflake and Databricks.
  • Work with Lakehouse architectures and enterprise data pipelines.
  • Enable LLM applications to securely access and leverage enterprise data.
  • Collaborate with Data Engineering, ML Engineering, and Cloud teams on scalable AI architectures.
Required Technical Skills
  • 5+ years of experience in software engineering, AI/ML engineering, or a related field.
  • Strong hands-on experience with Python and asynchronous programming.
  • Experience building LLM and generative AI applications.
  • Strong experience with LangChain, LangGraph, or similar agent frameworks.
  • Understanding of AI agents, ReAct, tool calling, memory, context management, and MCP.
  • Experience developing REST APIs and microservices.
  • Experience integrating AI applications with Snowflake, Databricks, or Lakehouse platforms.
  • Strong understanding of scalable, production-ready software architectures.
  • Knowledge of LLM guardrails, responsible AI, security, and failure handling.
  • Strong problem-solving, communication, and collaboration skills.
Preferred Skills
  • Experience with multi-agent systems and agent orchestration.
  • Knowledge of vector databases and RAG architectures.
  • Experience with cloud platforms such as AWS, Azure, or GCP.
  • Familiarity with LLM observability, evaluation, and performance optimization.
  • Experience deploying AI applications in enterprise production environments.

Apply