ZipRecruiter

Log In

1

Python Llm Jobs in New York, NY (NOW HIRING)

Northern Base

AI/LLM Engineer

New York, NY · On-site

Python Development * LangChain * LangGraph * Agent-Based AI Systems * Autonomous AI Agents * ReAct (Reasoning + Acting) * LLM Reasoning, Planning & Task Execution * Model Context Protocol (MCP)

Scalence L.L.C.

AI/LLM Engineer

Manhattan, NY · On-site

L.C. is seeking a highly skilled AI/LLM Engineer to design and build intelligent agent-based ... The role requires strong Python engineering expertise and hands-on experience with modern agent ...

Jefferies

SVP, Network Security Engineering Lead

Jersey City, NJ · On-site

$200K - $275K/yr

  • Medical

  • Dental

  • Vision

  • Life

  • Retirement

  • PTO

The ideal candidate will be knowledgeable with Integrating Automation (Python, LLM's) into the Network Security stack of tools and services. They will also have experience in: Management of Next ...

Jefferies

SVP, Network Security Engineering Lead

Jersey City, NJ · On-site

$200K - $275K/yr

  • Medical

  • Dental

  • Vision

  • Life

  • Retirement

  • PTO

The ideal candidate will be knowledgeable with Integrating Automation (Python, LLM's) into the Network Security stack of tools and services. They will also have experience in: Management of Next ...

Jefferies

VP, Network Security Engineer

Jersey City, NJ

$185K - $200K/yr

  • Medical

  • Dental

  • Vision

  • Life

  • Retirement

  • PTO

The ideal candidate will be knowledgeable with Integrating Automation (Python, LLM's) into the Network Security stack of tools and services. They will also have experience in: Management of Next ...

Jefferies

SVP, Network Security Engineering Lead

Jersey City, NJ · On-site

$200K - $275K/yr

  • Medical

  • Dental

  • Vision

  • Life

  • Retirement

  • PTO

The ideal candidate will be knowledgeable with Integrating Automation (Python, LLM's) into the Network Security stack of tools and services. They will also have experience in: Management of Next ...

Pyramid Consulting, Inc.

Python AI Developer

Jersey City, NJ · On-site

$60 - $65/hr

  • Medical

  • Dental

  • Vision

  • Retirement

Skills- Python, AI, LLM/RAG * Python with AI experience. Strong Python with Agentic AI, LLM, RAG, MCP. * Some travel to NYC * In person interview is a must- coding test is required. Our client is a ...

Photon

GenAI Developer / Python

Manhattan, NY · On-site

$55.50 - $76.25/hr

Role: GenAI Developer / Python Location: New York (Onsite) Role Summary: We are seeking a ... Deployment: Docker, Production API management, and LLM monitoring. Tools: Prompt Engineering ...

Uncountable

LLM Applications Engineer

New York, NY · On-site

$130K - $175K/yr

  • Medical

  • Dental

  • Retirement

As an LLM Applications Engineer, you will be the architect of our LLM infrastructure. You won't ... Proficiency in Python and JavaScript/TypeScript: Ability to work across the AI backend and the ...

Precision Technologies Corp

Python GenAI

Jersey City, NJ · On-site

$52.50 - $72.25/hr

Role - Python GenAI Location - Jersey City, NJ/Charlotte, NC / Dallas, TX / NYC Type: W2-Contract ... LLM Models (Llama, Mixtral, Mistral) * Various inferencing mechanisms - transformer/pipeline, vllm

Tata Consultancy Service Limited

AI/LLM Engineer

New York, NY · On-site

$120K - $130K/yr

  • Medical

  • Dental

  • Vision

  • Retirement

  • PTO

The role requires strong Python engineering expertise and hands-on experience with modern agent ... LLM Capabilities & Enhancements • Develop and integrate memory, tool usage, and context ...

ApplyMint

Senior AI Engineer (Python)

Manhattan, NY · On-site

$120 - $150/hr

You will build, evaluate, and deploy LLM-driven features like deep document analysis and interactive chat, working with models from OpenAI, Anthropic, and Gemini. Expect hands‑on Python, ML system ...

Photon

Python + Gen AI Developer - New York

Manhattan, NY · On-site

$55 - $76/hr

  • Medical

  • Dental

  • Vision

  • Retirement

  • PTO

Python, FastAPI, and Asynchronous Programming. RAG & Data: PostgreSQL, Vector Databases, and ... Deployment: Docker, Production API management, and LLM monitoring. Tools: Prompt Engineering ...

next page

Showing results 1-20

All JobsPython Llm JobsPython Llm Jobs in New York, NY

Python Llm information

See New York, NY salary details

$14

$64

$94

How much do python llm jobs pay per hour?

As of Aug 19, 2026, the average hourly pay for python llm in New York, NY is $64.13, according to ZipRecruiter salary data. Most workers in this role earn between $52.88 and $72.84 per hour, depending on experience, location, and employer.

What is a Python LLM?

A Python LLM job involves working with Large Language Models (LLMs) using Python to develop, fine-tune, and deploy AI models. Responsibilities may include data preprocessing, prompt engineering, model optimization, and integration with applications. Professionals in this role often work with frameworks like TensorFlow, PyTorch, or Hugging Face Transformers. They may also contribute to improving model efficiency, reducing bias, and ensuring ethical AI usage.

What are the key skills and qualifications needed to thrive in the Python LLM position, and why are they important?

To excel as a Python LLM (Large Language Model) Engineer, you need strong skills in Python programming, machine learning, and natural language processing, typically supported by a degree in computer science or a related field. Proficiency with libraries such as TensorFlow, PyTorch, Hugging Face Transformers, and experience with model deployment platforms are often essential, alongside certifications in AI or data science. Effective communication, problem-solving abilities, and collaboration are important soft skills for working in interdisciplinary teams and delivering results in dynamic environments. These skills ensure the development, fine-tuning, and deployment of advanced language models that meet both technical and business objectives.

What are some common challenges faced by Python LLM engineers in their daily work?

Python LLM Engineers often encounter challenges related to optimizing model performance, managing large datasets, and adapting models to specific business needs. Working with large-scale language models requires balancing computational resource limitations with the need for high accuracy and efficiency. Collaboration with data scientists, product managers, and DevOps engineers is routine to ensure seamless model integration and deployment. Staying updated on the latest advancements in NLP and continuously improving models based on user feedback are also important aspects of the role.

What are the most commonly searched types of Python Llm jobs in New York, NY?

The most popular types of Python Llm jobs in New York, NY are:

What are popular job titles related to Python Llm jobs in New York, NY?

For Python Llm jobs in New York, NY, the most frequently searched job titles are:

What job categories do people searching Python Llm jobs in New York, NY look for?

The top searched job categories for Python Llm jobs in New York, NY are:

What cities near New York, NY are hiring for Python Llm jobs?

Cities near New York, NY with the most Python Llm job openings:

Python Llm jobs near you
Infographic showing various Python Llm job openings in New York, NY as of August 2026, with employment types broken down into 1% Internship, 86% Full Time, 7% Part Time, and 6% Contract. Highlights an 78% Physical, 7% Hybrid, and 15% Remote job distribution, with an average salary of $133,398 per year, or $64.1 per hour.

AI/LLM Engineer

Northern Base

New York, NY • On-site

Full-time

Posted 8 days ago

Job description

Hiring Alert | AI/LLM Engineer
Location: Edison, NY (Hybrid – 3 Days Onsite)
Employment Type: Full-Time
Experience Required: 8–10 Years
Visa Type: USC / GC Only

Interview Mode: In-person (Final Round in New York City, NY / Edison, NJ)

Must-Have Skills:
• AI/LLM Engineering
• Python Development
• LangChain
• LangGraph
• Agent-Based AI Systems
• Autonomous AI Agents
• ReAct (Reasoning + Acting)
• LLM Reasoning, Planning & Task Execution
• Model Context Protocol (MCP)
• Tool Calling & Tool Integration
• LLM Workflow Chaining & Orchestration
• Memory & Context Management
• Prompt Engineering Collaboration
• Async Python Programming
• API & Microservices Development
• Scalable AI Application Architecture
• LLM Guardrails & Safety Mechanisms
• Responsible AI & Edge Case Handling
• Snowflake
• Databricks
• Lakehouse Architecture
• Enterprise Data Platform Integration

Preferred Experience:
• Experience designing and building production-ready agentic AI systems
• Experience with LangChain, LangGraph, or similar agent frameworks
• Experience implementing autonomous reasoning and planning capabilities
• Experience integrating LLMs with enterprise tools and data platforms
• Experience developing scalable APIs and microservices for AI applications
• Experience implementing guardrails and responsible AI practices
• Experience with Snowflake and Databricks data platforms
• Experience with Lakehouse architectures and enterprise data pipelines
• Strong understanding of LLM orchestration patterns and agent workflows
• Strong problem-solving and communication skills
• Willingness to work from the Edison office 3 days per week
• Ability to attend an in-person F2F interview in Edison

Education:
Bachelor’s Degree in Computer Science or related field preferred.

Tech Stack:
Python | LangChain | LangGraph | LLMs | Agentic AI | AI Agents | ReAct | MCP | Tool Calling | LLM Orchestration | Prompt Engineering | Async Python | APIs | Microservices | AI Guardrails | Responsible AI | Snowflake | Databricks | Lakehouse | Data Pipelines | Enterprise AI | AI System Architecture