ZipRecruiter

Log In

1

Llm Backend Engineer Jobs in Edison, NJ (NOW HIRING)

Lev

Senior Backend Engineer

Manhattan, NY · On-site

The Senior Backend Engineer will be responsible for developing and maintaining the core Flask API ... Preferred : • Experience with LLM's and building agentic AI applications. • Experience with ...

Home - ARETEC

Senior AI / Backend Engineer

New York, NY · On-site +1

What We are Looking For Aretec is seeking a Senior AI / Backend Engineer to build the intelligent ... You will develop Python services, LLM integrations, retrieval pipelines, agent workflows, APIs ...

Lev

Senior Backend Engineer

New York, NY · On-site

Experience with LLM's and building agentic AI applications. * Experience with GraphQL. * Experience with projects handling complex workflows. * Worked in a high-growth company. The Nitty Gritty

Tatari

Senior Backend Engineer

New York, NY · Hybrid

$170K - $200K/yr

We are looking for Senior Backend Engineers to join Tatari and play a key role in the evolution and ... Experience evaluating and deploying LLM-based systems in production (latency, cost, reliability ...

Tatari

Senior Backend Engineer

New York, NY · On-site

$170K - $200K/yr

We are looking for Senior Backend Engineers to join Tatari and play a key role in the evolution and ... Experience evaluating and deploying LLM-based systems in production (latency, cost, reliability ...

Artian AI

Software Engineer - Backend

New York, NY · On-site

$125K - $150K/yr

About the Role Artian AI is looking for a Software Engineer - Backend to help build the platform ... Experience with AI/ML platforms, LLM applications, or agent orchestration systems. * Experience in ...

Hebbia

Backend Engineer, Growth and Data

New York, NY · On-site

$160K - $350K/yr

The Role As a Backend Software Engineer on Hebbia's Growth and Data team, you will build and ... Experience building agentic systems or LLM enabled products. * Frequent user of AI products ...

Mistral AI

Software Engineer, Backend

New York, NY · On-site

... AI/LLM integration, observability, or backend frameworks) and bring them into production when ... Engineers are assessed in their preferred language during a live coding session. • Strong ...

Traversal

AI Engineer - Backend

New York, NY · On-site

$150K - $300K/yr

The Role As a Backend AI Engineer at Traversal, you'll play a key role in designing and building ... Familiarity with AI or LLM-powered products. Compensation We offer competitive compensation ...

Rapsys Technologies

Java + AWS Backend Developers

Newark, NJ · On-site

$52.75 - $68.50/hr

CI/CD and DevOps practices AI / LLM Tools - Important Requirement Resources should have knowledge or hands-on experience with modern LLM/AI-assisted development tools, specifically: * Claude Code

New

previous pagenext page

Showing results 21-40

All JobsLlm Backend Engineer JobsLlm Backend Engineer Jobs in Edison, NJ

Llm Backend Engineer information

See Edison, NJ salary details

$62.6K

$152.9K

$206K

How much do llm backend engineer jobs pay per year?

As of Sep 6, 2026, the average yearly pay for llm backend engineer in Edison, NJ is $152,867.00, according to ZipRecruiter salary data. Most workers in this role earn between $128,400.00 and $178,100.00 per year, depending on experience, location, and employer.

What is an LLM backend engineer?

LLM Backend Engineers are software engineers who specialize in designing, building, and optimizing the backend infrastructure that supports large language models (LLMs) like GPT-4. They focus on integrating LLMs into products and services, ensuring scalable APIs, managing data pipelines, and optimizing inference performance. Their work often involves deploying models in cloud environments, monitoring system reliability, and collaborating with AI researchers to bring advancements into production. LLM Backend Engineers play a critical role in making AI-powered applications robust, efficient, and accessible to end users.

What are the key skills and qualifications needed to thrive as an LLM backend engineer?

To thrive as an LLM Backend Engineer, you need a solid foundation in software engineering, backend architecture, and experience working with large language models, typically supported by a degree in computer science or a related field. Proficiency with programming languages like Python or Java, cloud platforms (AWS, GCP, Azure), and machine learning frameworks such as TensorFlow or PyTorch is essential, along with familiarity with APIs and containerization tools like Docker or Kubernetes. Strong problem-solving, collaboration, and communication skills distinguish top performers in this role. These skills ensure robust, scalable, and efficient deployment of LLM-powered applications while enabling effective teamwork and innovation.

What are some common challenges faced by LLM backend engineers when deploying large language models in production?

LLM Backend Engineers often encounter challenges such as optimizing inference latency, managing high resource consumption, and ensuring scalability for production workloads. Balancing model performance with cost efficiency requires careful selection of hardware, batching strategies, and model quantization techniques. Additionally, they must address security and privacy concerns associated with handling sensitive data processed by the models. Collaboration with data scientists and DevOps teams is essential to streamline model updates and monitor system health.

What are popular job titles related to Llm Backend Engineer jobs in Edison, NJ?

For Llm Backend Engineer jobs in Edison, NJ, the most frequently searched job titles are:

What job categories do people searching Llm Backend Engineer jobs in Edison, NJ look for?

The top searched job categories for Llm Backend Engineer jobs in Edison, NJ are:

What cities near Edison, NJ are hiring for Llm Backend Engineer jobs?

Cities near Edison, NJ with the most Llm Backend Engineer job openings:

Llm Backend Engineer jobs near you
Infographic showing various Llm Backend Engineer job openings in Edison, NJ as of July 2026, with employment types broken down into 1% As Needed, 89% Full Time, 4% Part Time, 1% Temporary, and 5% Contract. Highlights an 77% Physical, 4% Hybrid, and 19% Remote job distribution, with an average salary of $152,867 per year, or $73.5 per hour.

Senior Backend AI Engineer

Inficare Technologies

New York, NY • On-site

Full-time

Posted yesterday

New

Job description

Job Title: Senior Backend AI Engineer
Location: New York City, NY
Job Type: Contract (Long-term)
Experience: 10+ years
Job Overview
Our client is seeking a Senior Backend AI Engineer to design, develop, and maintain scalable, high-performance backend systems powering enterprise applications. The ideal candidate brings deep experience in distributed systems, LLM infrastructure, and production-grade agentic AI systems, and is ready to drive technical direction across multiple product teams.
Key Responsibilities
  • Design, develop, and maintain high-performance backend services and APIs
  • Drive technical direction for agentic AI initiatives, including architecture patterns, autonomy boundaries, and system design
  • Own and evolve shared agentic AI capabilities: agent frameworks, orchestration layers, planning, tool use, memory strategies, RAG pipelines, LLM inference, and safety tooling
  • Optimize backend systems for performance and reliability under high load
  • Implement best practices for code quality, testing, and CI/CD automation
  • Collaborate with DevOps and frontend teams to deploy services and define API contracts
Required Skills
  • NodeJS, JavaScript, TypeScript, and/or Go (Golang)
  • REST APIs and microservices architecture
  • AWS and/or GCP, Kubernetes, Docker
  • Distributed systems: Kafka, event-driven architectures
  • LLM systems, agentic workflows, and advanced ML infrastructure
  • Orchestration frameworks: LangGraph, LangChain, Airflow
  • Databases: PostgreSQL, MongoDB, Redis
  • Git, CI/CD pipelines
Preferred Skills
  • Experience building agentic systems in fintech or regulated industries
  • Background as a founding engineer or early technical leader in AI-driven products
  • Open-source contributions to AI or agentic frameworks
  • Familiarity with fine-tuning, model optimization, and inference pipelines
Location & Work Model
New York City, NY
Engagement Details
Long-term contract | 4 openings | Bachelor's degree in Computer Science or related field required; Master's preferred

Apply