ZipRecruiter

Log In

1

Llm Backend Engineer Jobs in Edison, NJ (NOW HIRING)

Junior

Backend Engineer

New York, NY · On-site

About Junior We're building cutting-edge LLM-powered tools that supercharge investment research for ... Role Description As a Backend Engineer , you'll help build and scale the systems that power our AI ...

Junior

Senior Backend Engineer

New York, NY · On-site

Architect and scale backend systems that support high-throughput LLM interactions, vector search ... Shape our engineering culture About You We're looking for product-minded backend engineers who:

NxT Level

Senior Software Engineer, Backend

Manhattan, NY · On-site

$170K - $230K/yr

Senior Backend Engineer (GenAI / LLM Workflows) Compensation: $170,000-$230,000 base + equity Location: San Francisco, CA or (open to remote to start) About Our Client Our client has built a leading ...

NxT Level

Senior Software Engineer, Backend

Manhattan, NY · Remote

$170K - $230K/yr

Senior Backend Engineer (GenAI / LLM Workflows) Compensation: $170,000-$230,000 base + equity Location: San Francisco, CA or (open to remote to start) About Our Client Our client has built a leading ...

Braintrust

Software Engineer, Backend

New York, NY · On-site

What you'll do As a backend engineer at Braintrust, you'll help build the core platform powering LLM-native development: * Design and ship features that give users deep insight into their LLM usage ...

Veris AI

Senior Backend Engineer

Manhattan, NY · On-site

They are seeking a Senior Backend Engineer to strengthen their engineering team by building the ... LLM tooling. • Solid grasp of engineering best practices: code reviews, automated testing ...

Town.com, Inc

Staff Backend Engineer

New York, NY · On-site

$250K - $300K/yr

You'll be a foundational hire, working across the full backend -- from LLM orchestration and ... The environment is greenfield, and the problems are unlike traditional backend engineering: non ...

Town.com, Inc

Staff Backend Engineer

New York, NY · On-site

$250K - $300K/yr

You'll be a foundational hire, working across the full backend -- from LLM orchestration and ... The environment is greenfield, and the problems are unlike traditional backend engineering: non ...

Zartis

Senior Backend Engineer - Gen AI

Union, NJ · On-site

$150 - $220/hr

With engineering hubs across EMEA and LATAM, and long term partnerships in financial services ... You will design and develop scalable backend services, integrate LLM capabilities into production ...

Cambio

Backend Engineer

New York, NY · On-site

The role We're looking for a Backend Engineer to build, help teammates do their best work, and have ... LLM: AWS Bedrock, OpenAI, Claude Logistics * Work authorization: authorized to work in the US or ...

New

Eulerity

Associate Backend Engineer

New York, NY · Hybrid

$95K - $115K/yr

The Role We're looking for a Backend Developer with 1-3 years of experience to join our engineering ... Use AI agents and LLM tooling to prototype, iterate, and ship faster * Contribute product ideas and ...

Hapiko

Senior+ Backend Engineer

Brooklyn, NY · On-site

They are seeking a Senior Backend Engineer to own and evolve the real-time infrastructure behind ... LLM pipelines deployed in production • Clear communication skills; can translate technical ...

Eulerity

Associate Backend Engineer

New York, NY · On-site

$95K - $115K/yr

The Role We're looking for a Backend Developer with 1-3 years of experience to join our engineering ... Use AI agents and LLM tooling to prototype, iterate, and ship faster * Contribute product ideas and ...

Hebbia

Backend Engineer, Agents

New York, NY · On-site

The world's most powerful and scalable LLM inference engine - a distributed, asynchronous DAG ... The Role A backend engineer at Hebbia blends expertise in systems, application layer software, and ...

next page

Showing results 1-20

All JobsLlm Backend Engineer JobsLlm Backend Engineer Jobs in Edison, NJ

Llm Backend Engineer information

See Edison, NJ salary details

$62.6K

$152.9K

$206K

How much do llm backend engineer jobs pay per year?

As of Sep 6, 2026, the average yearly pay for llm backend engineer in Edison, NJ is $152,867.00, according to ZipRecruiter salary data. Most workers in this role earn between $128,400.00 and $178,100.00 per year, depending on experience, location, and employer.

What is an LLM backend engineer?

LLM Backend Engineers are software engineers who specialize in designing, building, and optimizing the backend infrastructure that supports large language models (LLMs) like GPT-4. They focus on integrating LLMs into products and services, ensuring scalable APIs, managing data pipelines, and optimizing inference performance. Their work often involves deploying models in cloud environments, monitoring system reliability, and collaborating with AI researchers to bring advancements into production. LLM Backend Engineers play a critical role in making AI-powered applications robust, efficient, and accessible to end users.

What are the key skills and qualifications needed to thrive as an LLM backend engineer?

To thrive as an LLM Backend Engineer, you need a solid foundation in software engineering, backend architecture, and experience working with large language models, typically supported by a degree in computer science or a related field. Proficiency with programming languages like Python or Java, cloud platforms (AWS, GCP, Azure), and machine learning frameworks such as TensorFlow or PyTorch is essential, along with familiarity with APIs and containerization tools like Docker or Kubernetes. Strong problem-solving, collaboration, and communication skills distinguish top performers in this role. These skills ensure robust, scalable, and efficient deployment of LLM-powered applications while enabling effective teamwork and innovation.

What are some common challenges faced by LLM backend engineers when deploying large language models in production?

LLM Backend Engineers often encounter challenges such as optimizing inference latency, managing high resource consumption, and ensuring scalability for production workloads. Balancing model performance with cost efficiency requires careful selection of hardware, batching strategies, and model quantization techniques. Additionally, they must address security and privacy concerns associated with handling sensitive data processed by the models. Collaboration with data scientists and DevOps teams is essential to streamline model updates and monitor system health.

What are popular job titles related to Llm Backend Engineer jobs in Edison, NJ?

For Llm Backend Engineer jobs in Edison, NJ, the most frequently searched job titles are:

What job categories do people searching Llm Backend Engineer jobs in Edison, NJ look for?

The top searched job categories for Llm Backend Engineer jobs in Edison, NJ are:

What cities near Edison, NJ are hiring for Llm Backend Engineer jobs?

Cities near Edison, NJ with the most Llm Backend Engineer job openings:

Llm Backend Engineer jobs near you
Infographic showing various Llm Backend Engineer job openings in Edison, NJ as of July 2026, with employment types broken down into 1% As Needed, 89% Full Time, 4% Part Time, 1% Temporary, and 5% Contract. Highlights an 77% Physical, 4% Hybrid, and 19% Remote job distribution, with an average salary of $152,867 per year, or $73.5 per hour.

Backend Engineer

Junior

New York, NY • On-site

Full-time

Re-posted 17 days ago

Job description

About Junior
We're building cutting-edge LLM-powered tools that supercharge investment research for the world's most demanding deal teams. Our clients include several of the top 10 global private equity firms, Big 4 professional services firms, and leading consulting practices: organisations responsible for deploying billions of dollars annually.
We're a profitable, bootstrapped company with a growing team of ~43 people based in London and New York. We 10x'd our revenue in 2025 and are on track to grow 2-3x again this year. Junior saves clients an average of 10 hours per week, and we're expanding fast into new verticals including investment banking, hedge funds, and research firms.
You can read more about the company mission & values here.
Role Description
As a Backend Engineer, you'll help build and scale the systems that power our AI-driven research platform. This is a systems-level role - ideal for engineers who love thinking about data flows, orchestration, and performance across complex distributed systems.
You'll have the unique opportunity to:
  • Ship quickly
  • Architect and scale backend systems that support high-throughput LLM interactions, vector search, and multi-agent orchestration.
  • Stitch together AI infrastructure across model providers, data stores, and internal APIs to create cohesive, performant systems.
  • Own reliability and observability, helping us evolve our database (Postgres / ClickHouse) and job orchestration systems.
  • Prototype new backend capabilities (retrieval pipelines, caching layers, async task queues) that let us build faster and smarter.
  • Shape our engineering culture
About You
We're looking for product-minded backend engineers who:
  • Are based in NYC and excited to work 5 days a week in person
  • Are excited by the intersection of AI infrastructure, financial systems, and backend engineering
  • Have experience owning backend projects end-to-end - from architecture through to production
  • Are strong in Python and TypeScript
  • Have worked with PostgreSQL and care about data modelling, reliability, and system design
  • Are comfortable building APIs, internal tools, workflows, and infrastructure that support real customers
  • Are eager to contribute to product decisions, not just execute tickets
  • Feel like you are never building fast enough

Bonus points for experience working on:
  • Billing, payments, usage-based pricing, or financial workflows
  • Internal infrastructure / dev tools at startups
  • Data pipelines, workflow orchestration, or event-driven systems
  • Retrieval, embeddings, or prompt orchestration

Benefits
All the usual benefits (competitive pay and equity, private healthcare etc). Unusual benefits:
  • Gym membership
  • In-office cook
  • Summers working in Greece by the beach

How to Apply
If you're excited about the opportunity to drive innovation at Junior, we'd love to hear from you! Email us at careers@myjunior.ai with your resume and a brief introduction. We can't wait to meet you!

Apply