ZipRecruiter

Log In

1

Ml Llm Engineer Jobs (NOW HIRING)

2T Consulting

AI/LLM Engineer

Ozone Park, NY · On-site

Collaborate with Data Engineering, ML Engineering, and Cloud teams on scalable AI architectures ... Experience building LLM and generative AI applications. * Strong experience with LangChain ...

2T Consulting

AI/LLM Engineer

Moonachie, NJ · On-site

Collaborate with Data Engineering, ML Engineering, and Cloud teams on scalable AI architectures ... Experience building LLM and generative AI applications. * Strong experience with LangChain ...

2T Consulting

AI/LLM Engineer

Wallington, NJ · On-site

Collaborate with Data Engineering, ML Engineering, and Cloud teams on scalable AI architectures ... Experience building LLM and generative AI applications. * Strong experience with LangChain ...

2T Consulting

AI/LLM Engineer

Closter, NJ · On-site

Collaborate with Data Engineering, ML Engineering, and Cloud teams on scalable AI architectures ... Experience building LLM and generative AI applications. * Strong experience with LangChain ...

2T Consulting

AI/LLM Engineer

Belleville, NJ · On-site

Collaborate with Data Engineering, ML Engineering, and Cloud teams on scalable AI architectures ... Experience building LLM and generative AI applications. * Strong experience with LangChain ...

2T Consulting

AI/LLM Engineer

Maywood, NJ · On-site

Collaborate with Data Engineering, ML Engineering, and Cloud teams on scalable AI architectures ... Experience building LLM and generative AI applications. * Strong experience with LangChain ...

2T Consulting

Collaborate with Data Engineering, ML Engineering, and Cloud teams on scalable AI architectures ... Experience building LLM and generative AI applications. * Strong experience with LangChain ...

2T Consulting

AI/LLM Engineer

Union, NJ · On-site

Collaborate with Data Engineering, ML Engineering, and Cloud teams on scalable AI architectures ... Experience building LLM and generative AI applications. * Strong experience with LangChain ...

2T Consulting

AI/LLM Engineer

Brooklyn, NY · On-site

Collaborate with Data Engineering, ML Engineering, and Cloud teams on scalable AI architectures ... Experience building LLM and generative AI applications. * Strong experience with LangChain ...

2T Consulting

AI/LLM Engineer

Kew Gardens, NY · On-site

Collaborate with Data Engineering, ML Engineering, and Cloud teams on scalable AI architectures ... Experience building LLM and generative AI applications. * Strong experience with LangChain ...

2T Consulting

AI/LLM Engineer

Glen Ridge, NJ · On-site

Collaborate with Data Engineering, ML Engineering, and Cloud teams on scalable AI architectures ... Experience building LLM and generative AI applications. * Strong experience with LangChain ...

2T Consulting

AI/LLM Engineer

Haworth, NJ · On-site

Collaborate with Data Engineering, ML Engineering, and Cloud teams on scalable AI architectures ... Experience building LLM and generative AI applications. * Strong experience with LangChain ...

2T Consulting

Collaborate with Data Engineering, ML Engineering, and Cloud teams on scalable AI architectures ... Experience building LLM and generative AI applications. * Strong experience with LangChain ...

2T Consulting

AI/LLM Engineer

North Arlington, NJ · On-site

Collaborate with Data Engineering, ML Engineering, and Cloud teams on scalable AI architectures ... Experience building LLM and generative AI applications. * Strong experience with LangChain ...

2T Consulting

AI/LLM Engineer

Staten Island, NY · On-site

Collaborate with Data Engineering, ML Engineering, and Cloud teams on scalable AI architectures ... Experience building LLM and generative AI applications. * Strong experience with LangChain ...

2T Consulting

AI/LLM Engineer

Garfield, NJ · On-site

Collaborate with Data Engineering, ML Engineering, and Cloud teams on scalable AI architectures ... Experience building LLM and generative AI applications. * Strong experience with LangChain ...

2T Consulting

AI/LLM Engineer

Fair Lawn, NJ · On-site

Collaborate with Data Engineering, ML Engineering, and Cloud teams on scalable AI architectures ... Experience building LLM and generative AI applications. * Strong experience with LangChain ...

2T Consulting

Collaborate with Data Engineering, ML Engineering, and Cloud teams on scalable AI architectures ... Experience building LLM and generative AI applications. * Strong experience with LangChain ...

2T Consulting

AI/LLM Engineer

Englewood, NJ · On-site

Collaborate with Data Engineering, ML Engineering, and Cloud teams on scalable AI architectures ... Experience building LLM and generative AI applications. * Strong experience with LangChain ...

2T Consulting

AI/LLM Engineer

Bellerose, NY · On-site

Collaborate with Data Engineering, ML Engineering, and Cloud teams on scalable AI architectures ... Experience building LLM and generative AI applications. * Strong experience with LangChain ...

previous page

Showing results 41-60

All JobsMl Llm Engineer Jobs

Ml Llm Engineer information

See salary details

$59.5K

$111.6K

$203K

How much do ml llm engineer jobs pay per year?

As of Sep 9, 2026, the average yearly pay for ml llm engineer in the United States is $111,632.00, according to ZipRecruiter salary data. Most workers in this role earn between $80,500.00 and $132,500.00 per year, depending on experience, location, and employer.

What are popular job titles related to Ml Llm Engineer jobs?

For Ml Llm Engineer jobs, the most frequently searched job titles are:

Infographic showing various Ml Llm Engineer job openings in the United States as of August 2026, with employment types broken down into 94% Full Time, 2% Part Time, and 4% Contract. Highlights an 85% Physical, 5% Hybrid, and 10% Remote job distribution, with an average salary of $111,632 per year, or $53.7 per hour.

AI/LLM Engineer

Ozone Park, NY • On-site

2T Consulting
IT Services • 51 - 200 employees
Learn more about 2T Consultingexternal

Full-time

This job post has expired 2 days ago. Applications are no longer accepted.

Job description

We are seeking a highly skilled AI/LLM Engineer to design, develop, and deploy intelligent agent-based systems capable of reasoning, planning, and executing tasks autonomously. The ideal candidate will have strong Python engineering skills, hands-on experience with modern AI agent frameworks, and experience integrating LLM solutions with enterprise data platforms.

Roles and Responsibilities

Agent & AI System Development

  • Design and develop AI agent systems using LangChain, LangGraph, or similar frameworks.
  • Build intelligent components capable of reasoning, planning, and autonomous task execution.
  • Implement agentic patterns such as ReAct (Reasoning + Acting).
  • Develop multi-step LLM workflows and agent orchestration.

LLM Capabilities & Enhancements

  • Implement memory, tool usage, context management, and MCP capabilities.
  • Develop solutions using tool calling, chaining, and workflow orchestration.
  • Work with prompt engineering teams to improve LLM response quality and performance.
  • Optimize LLM applications for scalability, reliability, and cost.

Software Engineering

  • Develop high-quality, scalable, and maintainable Python applications, including asynchronous programming.
  • Build and maintain APIs and microservices for AI and agent-based applications.
  • Integrate AI services with enterprise applications and backend systems.
  • Develop production-ready solutions with appropriate testing, monitoring, and error handling.

Guardrails & Responsible AI

  • Design and implement guardrails and safety mechanisms for LLM-powered applications.
  • Handle edge cases, failures, hallucinations, and unintended model outputs.
  • Implement appropriate validation, security, and access controls for AI systems.

Data & Platform Integration

  • Integrate AI solutions with modern data platforms, including Snowflake and Databricks.
  • Work with Lakehouse architectures and enterprise data pipelines.
  • Enable LLM applications to securely access and leverage enterprise data.
  • Collaborate with Data Engineering, ML Engineering, and Cloud teams on scalable AI architectures.
Required Technical Skills
  • 5+ years of experience in software engineering, AI/ML engineering, or a related field.
  • Strong hands-on experience with Python and asynchronous programming.
  • Experience building LLM and generative AI applications.
  • Strong experience with LangChain, LangGraph, or similar agent frameworks.
  • Understanding of AI agents, ReAct, tool calling, memory, context management, and MCP.
  • Experience developing REST APIs and microservices.
  • Experience integrating AI applications with Snowflake, Databricks, or Lakehouse platforms.
  • Strong understanding of scalable, production-ready software architectures.
  • Knowledge of LLM guardrails, responsible AI, security, and failure handling.
  • Strong problem-solving, communication, and collaboration skills.
Preferred Skills
  • Experience with multi-agent systems and agent orchestration.
  • Knowledge of vector databases and RAG architectures.
  • Experience with cloud platforms such as AWS, Azure, or GCP.
  • Familiarity with LLM observability, evaluation, and performance optimization.
  • Experience deploying AI applications in enterprise production environments.

Apply