1

Llm Developer Jobs in New York (NOW HIRING)

Hiring Alert | AI/LLM Engineer Location: Edison, NY (Hybrid - 3 Days Onsite) Employment Type: Full-Time Experience Required: 8-10 Years Visa Type: USC / GC Only Interview Mode: In-person (Final Round ...

New

C. is seeking a highly skilled AI/LLM Engineer to design and build intelligent agent-based systems. The role requires strong Python engineering expertise and hands-on experience with modern agent ...

C. is looking for a highly skilled AI/LLM Engineer to design and build intelligent agent-based systems. The role involves developing advanced AI capabilities and ensuring the integration of AI ...

AI/LLM Engineer

New York, NY ยท On-site

$120K - $130K/yr

  • Medical

  • Dental

  • Vision

  • Retirement

  • PTO

Must Have Technical/Functional Skills We are looking for a highly skilled AI/LLM Engineer to design and build intelligent agent-based systems that can reason, plan, and act autonomously. The role ...

LLM Engineer (GenAI, NYC)

New York, NY ยท On-site

$150K - $230K/yr

Experience pushing the cutting-edge in LLM abilities on novel tasks with subjective outputs * Excellent software engineer with experience building highly extensible and modular codebases, as well as ...

LLM Applications Engineer

New York, NY ยท On-site

$130K - $175K/yr

  • Medical

  • Dental

  • Retirement

As an LLM Applications Engineer, you will be the architect of our LLM infrastructure. You won't just be building interfaces; you will be designing the retrieval systems, agentic workflows, and data ...

AWS Solutions Architect

Berkeley Heights, NJ ยท On-site

$146 - $244.80/hr

You will actively leverage modern Generative AI and Large Language Model (LLM) developer tools to accelerate engineering, refactoring, and deployment velocity. You will have a proven track record of ...

AWS Solutions Architect

Berkeley Heights, NJ ยท On-site

$67.50 - $88.75/hr

You will actively leverage modern Generative AI and Large Language Model (LLM) developer tools to accelerate engineering, refactoring, and deployment velocity. You will have a proven track record of ...

AWS Solutions Architect

Berkeley Heights, NJ ยท On-site

$67.50 - $88.75/hr

You will actively leverage modern Generative AI and Large Language Model (LLM) developer tools to accelerate engineering, refactoring, and deployment velocity. You will have a proven track record of ...

Senior DevOps Engineer

Berkeley Heights, NJ ยท On-site

$110K - $186K/yr

Experience with networking, vpc, vpce, transit gateway, IP, DNS, network load balancers and CDN * 1+ years of experience using GenAI assistants or LLM developer tools incorporating AI into daily ...

Experience with networking, vpc, vpce, transit gateway, IP, DNS, network load balancers and CDN * 1+ years of experience using GenAI assistants or LLM developer tools incorporating AI into daily ...

next page

Showing results 1-20

Llm Developer information

See New York salary details

$27

$54

$87

How much do llm developer jobs pay per hour?

As of Aug 12, 2026, the average hourly pay for llm developer in New York is $54.88, according to ZipRecruiter salary data. Most workers in this role earn between $43.12 and $66.54 per hour, depending on experience, location, and employer.

What does an LLM Developer do?

An LLM Developer designs, fine-tunes, and implements large language models (LLMs) for various applications, such as chatbots, content generation, and AI-driven tools. They work with machine learning frameworks, optimize model performance, and ensure efficient deployment. This role requires expertise in natural language processing (NLP), deep learning, and programming languages like Python.

What are the key skills and qualifications needed to thrive as an LLM Developer?

To excel as an LLM Developer, you need strong expertise in natural language processing (NLP), deep learning frameworks, and programming languages such as Python, typically supported by a degree in computer science or a related field. Familiarity with machine learning libraries (like TensorFlow or PyTorch), cloud computing platforms, and experience with prompt engineering or fine-tuning large language models is crucial. Excellent problem-solving abilities, collaboration, and effective communication skills help you design solutions and work efficiently within multidisciplinary teams. These qualifications are essential for successfully building, deploying, and optimizing large language models that drive impactful AI applications.

What is the role of a Llm developer?

A Large Language Model (LLM) developer designs, trains, and fine-tunes large-scale AI models for natural language processing tasks. They work with machine learning frameworks, handle large datasets, and optimize models for performance and accuracy, often requiring knowledge of programming languages like Python and tools such as TensorFlow or PyTorch.
What are the most commonly searched types of Llm Developer jobs in New York? The most popular types of Llm Developer jobs in New York are:
What cities in New York are hiring for Llm Developer jobs? Cities in New York with the most Llm Developer job openings:
Infographic showing various Llm Developer job openings in New York as of August 2026, with employment types broken down into 78% Full Time, 7% Part Time, 1% Temporary, and 14% Contract. Highlights an 80% Physical, 6% Hybrid, and 14% Remote job distribution, with an average salary of $114,156 per year, or $54.9 per hour.

AI/LLM Engineer

Northern Base

New York, NY โ€ข On-site

Full-time

Posted 2 days ago

New


Job description

Hiring Alert | AI/LLM Engineer
Location: Edison, NY (Hybrid – 3 Days Onsite)
Employment Type: Full-Time
Experience Required: 8–10 Years
Visa Type: USC / GC Only

Interview Mode: In-person (Final Round in New York City, NY / Edison, NJ)

Must-Have Skills:
• AI/LLM Engineering
• Python Development
• LangChain
• LangGraph
• Agent-Based AI Systems
• Autonomous AI Agents
• ReAct (Reasoning + Acting)
• LLM Reasoning, Planning & Task Execution
• Model Context Protocol (MCP)
• Tool Calling & Tool Integration
• LLM Workflow Chaining & Orchestration
• Memory & Context Management
• Prompt Engineering Collaboration
• Async Python Programming
• API & Microservices Development
• Scalable AI Application Architecture
• LLM Guardrails & Safety Mechanisms
• Responsible AI & Edge Case Handling
• Snowflake
• Databricks
• Lakehouse Architecture
• Enterprise Data Platform Integration

Preferred Experience:
• Experience designing and building production-ready agentic AI systems
• Experience with LangChain, LangGraph, or similar agent frameworks
• Experience implementing autonomous reasoning and planning capabilities
• Experience integrating LLMs with enterprise tools and data platforms
• Experience developing scalable APIs and microservices for AI applications
• Experience implementing guardrails and responsible AI practices
• Experience with Snowflake and Databricks data platforms
• Experience with Lakehouse architectures and enterprise data pipelines
• Strong understanding of LLM orchestration patterns and agent workflows
• Strong problem-solving and communication skills
• Willingness to work from the Edison office 3 days per week
• Ability to attend an in-person F2F interview in Edison

Education:
Bachelor’s Degree in Computer Science or related field preferred.

Tech Stack:
Python | LangChain | LangGraph | LLMs | Agentic AI | AI Agents | ReAct | MCP | Tool Calling | LLM Orchestration | Prompt Engineering | Async Python | APIs | Microservices | AI Guardrails | Responsible AI | Snowflake | Databricks | Lakehouse | Data Pipelines | Enterprise AI | AI System Architecture