ZipRecruiter

Log In

1

Ml Llm Engineer Jobs (NOW HIRING)

2T Consulting

AI/LLM Engineer

Little Neck, NY · On-site

Collaborate with Data Engineering, ML Engineering, and Cloud teams on scalable AI architectures ... Experience building LLM and generative AI applications. * Strong experience with LangChain ...

Agoda

Technical Product Manager, LLM/ML Domain

Seattle, WA · On-site

$190K - $219K/yr

Required : • 5+ years of experience in ML engineering, data science, platform engineering, or a ... with ML Ops and/or LLM Ops concepts (model lifecycle, evaluation, monitoring, versioning ...

Agoda

Technical Product Manager, LLM/ML Domain

Boston, MA · On-site

$181K - $209K/yr

Required : • 5+ years of experience in ML engineering, data science, platform engineering, or a ... with ML Ops and/or LLM Ops concepts (model lifecycle, evaluation, monitoring, versioning ...

2T Consulting

NY · On-site

Collaborate with Data Engineering, ML Engineering, and Cloud teams on scalable AI architectures ... Experience building LLM and generative AI applications. * Strong experience with LangChain ...

2T Consulting

AI/LLM Engineer

Bronx, NY · On-site

Collaborate with Data Engineering, ML Engineering, and Cloud teams on scalable AI architectures ... Experience building LLM and generative AI applications. * Strong experience with LangChain ...

2T Consulting

AI/LLM Engineer

Oradell, NJ · On-site

Collaborate with Data Engineering, ML Engineering, and Cloud teams on scalable AI architectures ... Experience building LLM and generative AI applications. * Strong experience with LangChain ...

2T Consulting

AI/LLM Engineer

East Rutherford, NJ · On-site

Collaborate with Data Engineering, ML Engineering, and Cloud teams on scalable AI architectures ... Experience building LLM and generative AI applications. * Strong experience with LangChain ...

2T Consulting

AI/LLM Engineer

Rosedale, NY · On-site

Collaborate with Data Engineering, ML Engineering, and Cloud teams on scalable AI architectures ... Experience building LLM and generative AI applications. * Strong experience with LangChain ...

2T Consulting

AI/LLM Engineer

Lyndhurst, NJ · On-site

Collaborate with Data Engineering, ML Engineering, and Cloud teams on scalable AI architectures ... Experience building LLM and generative AI applications. * Strong experience with LangChain ...

2T Consulting

AI/LLM Engineer

Bronx, NY · On-site

Collaborate with Data Engineering, ML Engineering, and Cloud teams on scalable AI architectures ... Experience building LLM and generative AI applications. * Strong experience with LangChain ...

2T Consulting

AI/LLM Engineer

Weehawken, NJ · On-site

Collaborate with Data Engineering, ML Engineering, and Cloud teams on scalable AI architectures ... Experience building LLM and generative AI applications. * Strong experience with LangChain ...

2T Consulting

AI/LLM Engineer

Jersey City, NJ · On-site

Collaborate with Data Engineering, ML Engineering, and Cloud teams on scalable AI architectures ... Experience building LLM and generative AI applications. * Strong experience with LangChain ...

2T Consulting

AI/LLM Engineer

Saddle Brook, NJ · On-site

Collaborate with Data Engineering, ML Engineering, and Cloud teams on scalable AI architectures ... Experience building LLM and generative AI applications. * Strong experience with LangChain ...

2T Consulting

AI/LLM Engineer

Woodhaven, NY · On-site

Collaborate with Data Engineering, ML Engineering, and Cloud teams on scalable AI architectures ... Experience building LLM and generative AI applications. * Strong experience with LangChain ...

2T Consulting

AI/LLM Engineer

Union City, NJ · On-site

Collaborate with Data Engineering, ML Engineering, and Cloud teams on scalable AI architectures ... Experience building LLM and generative AI applications. * Strong experience with LangChain ...

2T Consulting

AI/LLM Engineer

Staten Island, NY · On-site

Collaborate with Data Engineering, ML Engineering, and Cloud teams on scalable AI architectures ... Experience building LLM and generative AI applications. * Strong experience with LangChain ...

2T Consulting

AI/LLM Engineer

Woodland Park, NJ · On-site

Collaborate with Data Engineering, ML Engineering, and Cloud teams on scalable AI architectures ... Experience building LLM and generative AI applications. * Strong experience with LangChain ...

2T Consulting

AI/LLM Engineer

Elizabeth, NJ · On-site

Collaborate with Data Engineering, ML Engineering, and Cloud teams on scalable AI architectures ... Experience building LLM and generative AI applications. * Strong experience with LangChain ...

2T Consulting

AI/LLM Engineer

Montclair, NJ · On-site

Collaborate with Data Engineering, ML Engineering, and Cloud teams on scalable AI architectures ... Experience building LLM and generative AI applications. * Strong experience with LangChain ...

2T Consulting

AI/LLM Engineer

Newark, NJ · On-site

Collaborate with Data Engineering, ML Engineering, and Cloud teams on scalable AI architectures ... Experience building LLM and generative AI applications. * Strong experience with LangChain ...

previous pagenext page

Showing results 21-40

All JobsMl Llm Engineer Jobs

Ml Llm Engineer information

See salary details

$59.5K

$111.6K

$203K

How much do ml llm engineer jobs pay per year?

As of Sep 9, 2026, the average yearly pay for ml llm engineer in the United States is $111,632.00, according to ZipRecruiter salary data. Most workers in this role earn between $80,500.00 and $132,500.00 per year, depending on experience, location, and employer.

What are popular job titles related to Ml Llm Engineer jobs?

For Ml Llm Engineer jobs, the most frequently searched job titles are:

Infographic showing various Ml Llm Engineer job openings in the United States as of August 2026, with employment types broken down into 94% Full Time, 2% Part Time, and 4% Contract. Highlights an 85% Physical, 5% Hybrid, and 10% Remote job distribution, with an average salary of $111,632 per year, or $53.7 per hour.

AI/LLM Engineer

Little Neck, NY • On-site

2T Consulting
IT Services • 51 - 200 employees
Learn more about 2T Consultingexternal

Full-time

This job post has expired today. Applications are no longer accepted.

Key responsibilities

  • Design, develop, and deploy AI agent systems using frameworks like LangChain or LangGraph.

  • Implement multi-step LLM workflows, agent orchestration, and capabilities such as memory, tool usage, and context management.

  • Develop and maintain APIs, microservices, and integrate AI solutions with enterprise data platforms and backend systems.

Job description

We are seeking a highly skilled AI/LLM Engineer to design, develop, and deploy intelligent agent-based systems capable of reasoning, planning, and executing tasks autonomously. The ideal candidate will have strong Python engineering skills, hands-on experience with modern AI agent frameworks, and experience integrating LLM solutions with enterprise data platforms.

Roles and Responsibilities

Agent & AI System Development

  • Design and develop AI agent systems using LangChain, LangGraph, or similar frameworks.
  • Build intelligent components capable of reasoning, planning, and autonomous task execution.
  • Implement agentic patterns such as ReAct (Reasoning + Acting).
  • Develop multi-step LLM workflows and agent orchestration.

LLM Capabilities & Enhancements

  • Implement memory, tool usage, context management, and MCP capabilities.
  • Develop solutions using tool calling, chaining, and workflow orchestration.
  • Work with prompt engineering teams to improve LLM response quality and performance.
  • Optimize LLM applications for scalability, reliability, and cost.

Software Engineering

  • Develop high-quality, scalable, and maintainable Python applications, including asynchronous programming.
  • Build and maintain APIs and microservices for AI and agent-based applications.
  • Integrate AI services with enterprise applications and backend systems.
  • Develop production-ready solutions with appropriate testing, monitoring, and error handling.

Guardrails & Responsible AI

  • Design and implement guardrails and safety mechanisms for LLM-powered applications.
  • Handle edge cases, failures, hallucinations, and unintended model outputs.
  • Implement appropriate validation, security, and access controls for AI systems.

Data & Platform Integration

  • Integrate AI solutions with modern data platforms, including Snowflake and Databricks.
  • Work with Lakehouse architectures and enterprise data pipelines.
  • Enable LLM applications to securely access and leverage enterprise data.
  • Collaborate with Data Engineering, ML Engineering, and Cloud teams on scalable AI architectures.
Required Technical Skills
  • 5+ years of experience in software engineering, AI/ML engineering, or a related field.
  • Strong hands-on experience with Python and asynchronous programming.
  • Experience building LLM and generative AI applications.
  • Strong experience with LangChain, LangGraph, or similar agent frameworks.
  • Understanding of AI agents, ReAct, tool calling, memory, context management, and MCP.
  • Experience developing REST APIs and microservices.
  • Experience integrating AI applications with Snowflake, Databricks, or Lakehouse platforms.
  • Strong understanding of scalable, production-ready software architectures.
  • Knowledge of LLM guardrails, responsible AI, security, and failure handling.
  • Strong problem-solving, communication, and collaboration skills.
Preferred Skills
  • Experience with multi-agent systems and agent orchestration.
  • Knowledge of vector databases and RAG architectures.
  • Experience with cloud platforms such as AWS, Azure, or GCP.
  • Familiarity with LLM observability, evaluation, and performance optimization.
  • Experience deploying AI applications in enterprise production environments.

Apply