ZipRecruiter

Log In

1

Llm Backend Engineer Jobs (NOW HIRING)

Tolan

Backend Product Engineer

San Francisco, CA · On-site

$200K - $300K/yr

The Role We're hiring a Backend Product Engineer to build and maintain the systems that make Tolan ... Contribute to LLM engineering work that brings Tolan's AI capabilities to life. * Work cross ...

Pear

Backend Engineer - Known

San Francisco, CA · On-site

... LLM responses, batch matching jobs, payment processing, and real-time chat - while maintaining ... Design and build scalable backend services in Node.js/TypeScript, including RESTful APIs ...

Vogo

Senior Backend Engineer

Dallas, TX · On-site +1

Our backend systems are the backbone of the traveler experience, and this role plays a critical ... LLM-powered features into our platform * Tackle high-scale engineering challenges to ensure ...

xAI

Backend Engineer - API

Palo Alto, CA · On-site

They are seeking a Backend Engineer to build and maintain their API infrastructure, ensuring high ... LLM inference engines and serving frameworks (e.g., SGLang, TensorRT, vLLM) • Experience ...

Atrix AI

Senior Backend Engineer (AI Focus)

New York, NY · On-site

$140K - $190K/yr

The role You'll be a core backend engineer building the services and infrastructure that power our ... Integration with LLM frameworks (LangChain, LlamaIndex) and vector databases * Backend features ...

Hebbia

Backend Engineer, Agents

New York, NY · On-site

The world's most powerful and scalable LLM inference engine - a distributed, asynchronous DAG ... The Role A backend engineer at Hebbia blends expertise in systems, application layer software, and ...

HealthLeap

Backend Engineer

San Francisco, CA · On-site

$200K - $275K/yr

Build feature engineering pipelines for ML models What we're looking for * 5+ years backend ... Background in LLM infrastructure or applied AI systems This role is NOT for you if * Startup ...

You.com

Senior Back End Engineer

San Francisco, CA · On-site +1

$200K - $250K/yr

Our platform combines proprietary vertical indexes with LLM-optimized retrieval systems to power AI ... Backend Engineer to design and develop the foundational systems and platforms that power our LLM ...

Straia, Inc

Senior Backend Engineer

San Francisco, CA · On-site

$200K - $225K/yr

... Senior Backend Engineer to help build the technical backbone of how institutions interact with ... LLM Integration: GPT, Gemini, Claude via API * Cloud & Infra: Hosted on GCP Why Join Straia * Be ...

Tabby LLC

We're looking for a Senior Backend Engineer to help us build an internal AI agent platform. You'll ... Plus will be an experience in building or integrating LLM-based features and agent-centric ...

next page

Showing results 1-20

All JobsLlm Backend Engineer Jobs

Llm Backend Engineer information

See salary details

$60.5K

$147.7K

$199K

How much do llm backend engineer jobs pay per year?

As of Jun 30, 2026, the average yearly pay for llm backend engineer in the United States is $147,662.00, according to ZipRecruiter salary data. Most workers in this role earn between $124,000.00 and $172,000.00 per year, depending on experience, location, and employer.

How much do LLM engineers make?

LLM backend engineers typically earn between $100,000 and $180,000 annually, depending on experience, location, and company size. Senior roles or those with specialized skills in machine learning frameworks and large language models can command higher salaries, often exceeding $200,000.

What are some common challenges faced by LLM Backend Engineers when deploying large language models in production?

LLM Backend Engineers often encounter challenges such as optimizing inference latency, managing high resource consumption, and ensuring scalability for production workloads. Balancing model performance with cost efficiency requires careful selection of hardware, batching strategies, and model quantization techniques. Additionally, they must address security and privacy concerns associated with handling sensitive data processed by the models. Collaboration with data scientists and DevOps teams is essential to streamline model updates and monitor system health.

What are LLM Backend Engineers?

LLM Backend Engineers are software engineers who specialize in designing, building, and optimizing the backend infrastructure that supports large language models (LLMs) like GPT-4. They focus on integrating LLMs into products and services, ensuring scalable APIs, managing data pipelines, and optimizing inference performance. Their work often involves deploying models in cloud environments, monitoring system reliability, and collaborating with AI researchers to bring advancements into production. LLM Backend Engineers play a critical role in making AI-powered applications robust, efficient, and accessible to end users.

Are LLM engineers in demand?

LLM backend engineers are in high demand due to the rapid growth of artificial intelligence and natural language processing applications. Companies seek professionals skilled in machine learning frameworks, programming languages like Python, and large language model deployment to develop and optimize AI systems. This demand is expected to continue as AI technology becomes more integrated into various industries.

What are the key skills and qualifications needed to thrive as an LLM Backend Engineer, and why are they important?

To thrive as an LLM Backend Engineer, you need a solid foundation in software engineering, backend architecture, and experience working with large language models, typically supported by a degree in computer science or a related field. Proficiency with programming languages like Python or Java, cloud platforms (AWS, GCP, Azure), and machine learning frameworks such as TensorFlow or PyTorch is essential, along with familiarity with APIs and containerization tools like Docker or Kubernetes. Strong problem-solving, collaboration, and communication skills distinguish top performers in this role. These skills ensure robust, scalable, and efficient deployment of LLM-powered applications while enabling effective teamwork and innovation.

What engineer makes 500,000 a year?

Senior engineers in specialized fields such as software engineering, data engineering, or machine learning engineering can earn $500,000 or more annually, especially with extensive experience, advanced skills, and working at large tech companies or in high-demand industries. These roles often require expertise in cloud platforms, programming, and system architecture, along with leadership responsibilities or stock options that contribute to total compensation.

What engineers make $300,000 a year?

Senior machine learning engineers, especially those working with large language models (LLMs) and possessing expertise in deep learning, distributed systems, and cloud infrastructure, can earn $300,000 or more annually. High compensation is often associated with experience, specialized skills, and working at top tech companies or in high-demand industries.
More about Llm Backend Engineer jobs
What cities are hiring for Llm Backend Engineer jobs? Cities with the most Llm Backend Engineer job openings:
What states have the most Llm Backend Engineer jobs? States with the most job openings for Llm Backend Engineer jobs include:
What job categories do people searching Llm Backend Engineer jobs look for? The top searched job categories for Llm Backend Engineer jobs are:
Llm Backend Engineer jobs near you

Backend Product Engineer

Tolan

San Francisco, CA • On-site

$200K - $300K/yr

Full-time

Posted 10 days ago

Key responsibilities

  • Build and maintain the distributed backend systems that power Tolan's core product experience.

  • Contribute to LLM engineering work that brings Tolan's AI capabilities to life.

  • Work cross-functionally with frontend, design, and applied AI teams.

Job description

Tolan is an Embodied Companion - a cute AI alien you talk with naturally, like a friend. Tolans have their own personality and preferences, and over time form memories about you, your life, and your shared friendship.
We're an experienced team that previously founded Even, acquired for $300M in 2022. Tolan is backed by the designers and founders behind Instagram, Retro, Behance, Vimeo, and Notion. Our team works hard, with an emphasis on autonomy and ownership. We're building together in-person in downtown SF.
The Role
We're hiring a Backend Product Engineer to build and maintain the systems that make Tolan possible: a mix of backend distributed systems and LLM engineering. Our stack is built primarily with Node.js (TypeScript), Python, PostgreSQL, and Redis.
What You'll Do
  • Build and maintain the distributed backend systems that power Tolan's core product experience.
  • Contribute to LLM engineering work that brings Tolan's AI capabilities to life.
  • Work cross-functionally with our frontend, design, and applied AI teams.
Who We're Looking For
  • Relevant experience. You have at least 4 years of backend engineering experience and can hit the ground running.
  • TypeScript or Python expert. You use deep language expertise to rapidly prototype and iterate on user-facing features.
  • Systems thinker. You apply systems thinking to ensure great user experience..
  • Scale-tested. You've built low-latency systems that real users depend on at scale.
  • Small team operator. You do your best work with high ownership and minimal layers.
  • AI-native. You've deeply integrated AI into how you work and build.
  • Bias to ship. You love to ship quickly and make contact with reality as often as possible.

Compensation: $200,000-300,000 base salary + equity + benefits

Apply