ZipRecruiter

Log In

1

Llm Backend Engineer Jobs (NOW HIRING)

NxT Level

Senior Software Engineer, Backend

Manhattan, NY · On-site

$170K - $230K/yr

Senior Backend Engineer (GenAI / LLM Workflows) Compensation: $170,000-$230,000 base + equity Location: San Francisco, CA or (open to remote to start) About Our Client Our client has built a leading ...

Braintrust

Software Engineer, Backend

New York, NY · On-site

What you'll do As a backend engineer at Braintrust, you'll help build the core platform powering LLM-native development: * Design and ship features that give users deep insight into their LLM usage ...

Pump.co

Backend Engineer

San Francisco, CA · On-site

$120K - $200K/yr

Python, FastAPI, PostgreSQL, AWS, Docker, Kubernetes (nice to have), LLM/AI (bonus) As a Backend Engineer , you'll contribute directly to the core of our product and infrastructure. This role is ...

Pump.co

Backend Engineer

San Francisco, CA · On-site

Python, FastAPI, PostgreSQL, AWS, Docker, Kubernetes (nice to have), LLM/AI (bonus) As a Backend Engineer , you'll contribute directly to the core of our product and infrastructure. This role is ...

Clera

Backend Engineer

San Francisco, CA · On-site

$72K/yr

Experience building or operating LLM/agent systems in production (prompt engineering, agent ... Backend: TypeScript, Node.js, NestJS (monorepo) * Orchestration: Temporal (Temporal Cloud) * Data:

Clera

Backend Engineer

San Francisco, CA · On-site

$72K/yr

Experience building or operating LLM/agent systems in production (prompt engineering, agent ... Backend: TypeScript, Node.js, NestJS (monorepo) * Orchestration: Temporal (Temporal Cloud) * Data:

Arena Club

Staff Backend Engineer

San Francisco, CA · Remote

$220K - $270K/yr

About the Role We're seeking a Staff Backend Engineer to help scale the backbone of our platform ... AI Development Tools: AI-powered coding assistants (Claude Code, Cursor, etc.), LLM-based ...

Arena Club

Staff Backend Engineer

San Francisco, CA · On-site

$220K - $270K/yr

About the Role We're seeking a Staff Backend Engineer to help scale the backbone of our platform ... AI Development Tools: AI-powered coding assistants (Claude Code, Cursor, etc.), LLM-based ...

Arena Club

Staff Backend Engineer

San Francisco, CA · Remote

About the Role We're seeking a Staff Backend Engineer to help scale the backbone of our platform ... AI Development Tools: AI-powered coding assistants (Claude Code, Cursor, etc.), LLM-based ...

Arena Club

Staff Backend Engineer

Los Angeles, CA · On-site

$200K - $230K/yr

About the Role Join our fast-growing startup as a Staff Backend Engineer and help scale the ... AI Development Tools: AI-powered coding assistants (Claude Code, Cursor, etc.), LLM-based ...

next page

Showing results 1-20

All JobsLlm Backend Engineer Jobs

Llm Backend Engineer information

See salary details

$60.5K

$147.7K

$199K

How much do llm backend engineer jobs pay per year?

As of Jul 22, 2026, the average yearly pay for llm backend engineer in the United States is $147,662.00, according to ZipRecruiter salary data. Most workers in this role earn between $124,000.00 and $172,000.00 per year, depending on experience, location, and employer.

How much do LLM engineers make?

LLM backend engineers typically earn between $100,000 and $180,000 annually, depending on experience, location, and company size. Senior roles or those with specialized skills in machine learning frameworks and large language models can command higher salaries, often exceeding $200,000.

What are some common challenges faced by LLM Backend Engineers when deploying large language models in production?

LLM Backend Engineers often encounter challenges such as optimizing inference latency, managing high resource consumption, and ensuring scalability for production workloads. Balancing model performance with cost efficiency requires careful selection of hardware, batching strategies, and model quantization techniques. Additionally, they must address security and privacy concerns associated with handling sensitive data processed by the models. Collaboration with data scientists and DevOps teams is essential to streamline model updates and monitor system health.

What are LLM Backend Engineers?

LLM Backend Engineers are software engineers who specialize in designing, building, and optimizing the backend infrastructure that supports large language models (LLMs) like GPT-4. They focus on integrating LLMs into products and services, ensuring scalable APIs, managing data pipelines, and optimizing inference performance. Their work often involves deploying models in cloud environments, monitoring system reliability, and collaborating with AI researchers to bring advancements into production. LLM Backend Engineers play a critical role in making AI-powered applications robust, efficient, and accessible to end users.

Are LLM engineers in demand?

LLM backend engineers are in high demand due to the rapid growth of artificial intelligence and natural language processing applications. Companies seek professionals skilled in machine learning frameworks, programming languages like Python, and large language model deployment to develop and optimize AI systems. This demand is expected to continue as AI technology becomes more integrated into various industries.

What are the key skills and qualifications needed to thrive as an LLM Backend Engineer, and why are they important?

To thrive as an LLM Backend Engineer, you need a solid foundation in software engineering, backend architecture, and experience working with large language models, typically supported by a degree in computer science or a related field. Proficiency with programming languages like Python or Java, cloud platforms (AWS, GCP, Azure), and machine learning frameworks such as TensorFlow or PyTorch is essential, along with familiarity with APIs and containerization tools like Docker or Kubernetes. Strong problem-solving, collaboration, and communication skills distinguish top performers in this role. These skills ensure robust, scalable, and efficient deployment of LLM-powered applications while enabling effective teamwork and innovation.

What engineer makes 500,000 a year?

Senior engineers in specialized fields such as software engineering, data engineering, or machine learning engineering can earn $500,000 or more annually, especially with extensive experience, advanced skills, and working at large tech companies or in high-demand industries. These roles often require expertise in cloud platforms, programming, and system architecture, along with leadership responsibilities or stock options that contribute to total compensation.

What engineers make $300,000 a year?

Senior machine learning engineers, especially those working with large language models (LLMs) and possessing expertise in deep learning, distributed systems, and cloud infrastructure, can earn $300,000 or more annually. High compensation is often associated with experience, specialized skills, and working at top tech companies or in high-demand industries.
More about Llm Backend Engineer jobs
What cities are hiring for Llm Backend Engineer jobs? Cities with the most Llm Backend Engineer job openings:
What states have the most Llm Backend Engineer jobs? States with the most job openings for Llm Backend Engineer jobs include:
What job categories do people searching Llm Backend Engineer jobs look for? The top searched job categories for Llm Backend Engineer jobs are:
Llm Backend Engineer jobs near you
Infographic showing various Llm Backend Engineer job openings in the United States as of July 2026, with employment types broken down into 1% As Needed, 92% Full Time, 2% Part Time, and 5% Contract. Highlights an 79% Physical, 4% Hybrid, and 17% Remote job distribution, with an average salary of $147,662 per year, or $71 per hour.
Founding Backend Engineer

Founding Backend Engineer

CincyBrianHires

San Francisco, CA • On-site

Full-time

This job post has expired 1 day ago. Applications are no longer accepted.

Job description

Our client, a fast-growing AI B2B education startup, is hiring a Founding Backend Engineer to own and lead the core systems that make their AI assistant work. This is a high-ownership, high-autonomy role at a company with real paying users and strong institutional backing — where your work will have immediate and visible impact on the product.

What You'll Do
  • Context retrieval — Design and build performant systems that surface the right information at the right time across a wide range of unstructured data sources, including email, calendar, meetings, and third-party integrations. This is a nuanced retrieval problem that goes well beyond standard search.
  • Agentic systems — Architect and ship agents capable of taking real action across tools on behalf of the user. This includes building robust permission models and encoding user preferences so the assistant behaves appropriately in every context.
  • Continual learning — Develop the memory and feedback infrastructure that allows the product to improve meaningfully with every user interaction, moving the assistant closer to a true understanding of each individual over time.
You'll Thrive If

Beyond strong backend engineering fundamentals, the ideal candidate is product-minded, comfortable engaging directly with customers, and genuinely excited about the future of AI-powered productivity. You should be at ease making architectural decisions — not just executing against a spec.

What You Bring

Required:

  • 3–7 years as a product-minded backend engineer with strong early-stage experience
  • Demonstrated track record as a product-minded backend engineer at a Tier 1 venture-backed startup (ideally Series A to C but flexible)
  • Strong technical depth with TypeScript and React, LLM APIs, and Electron
  • Highly comfortable on the backend (full-stack experience also welcome)
  • Genuine interest in engaging with customers and in productivity/workflow automation

Preferred:

  • Experience at a productivity startup (e.g., Superhuman, Notion, Airtable, Slack) or workflow automation startup (e.g., legal tech working with unstructured data)
  • CS or adjacent STEM degree from a top 15 university