ZipRecruiter

Log In

1

Llm Backend Engineer Jobs (NOW HIRING)

ProNexus

Backend Engineer

San Francisco, CA · On-site

The company is hiring a Backend Engineer to build the reliable systems behind its AI products ... Experience building AI, LLM, agent, or machine-learning infrastructure * Experience integrating ...

ProNexus

Backend Engineer

New York, NY · On-site

The company is hiring a Backend Engineer to build the reliable systems behind its AI products ... Experience building AI, LLM, agent, or machine-learning infrastructure * Experience integrating ...

ProNexus

Backend Engineer

The company is hiring a Backend Engineer to build the reliable systems behind its AI products ... Experience building AI, LLM, agent, or machine-learning infrastructure * Experience integrating ...

ProNexus

Backend Engineer

New York, NY · On-site

The company is hiring a Backend Engineer to build the reliable systems behind its AI products ... Experience building AI, LLM, agent, or machine-learning infrastructure * Experience integrating ...

Junior

Backend Engineer

New York, NY · On-site

About Junior We're building cutting-edge LLM-powered tools that supercharge investment research for ... Role Description As a Backend Engineer , you'll help build and scale the systems that power our AI ...

Nexusflow.ai Inc.

Backend Engineer

Palo Alto, CA

Our team has built the open-source LLM, NexusRaven-V2, rivaling GPT-4 in function calling with a ... Our Backend Engineers package up our technology in models and last-mile quality tooling. Our ...

Emumba

Staff Backend Engineer

Dallas, TX · On-site +1

Staff Backend Engineer Department: Backend Employment Type: Full Time Location: USA Description We ... Experience integrating LLM APIs into backend services or workflows. * Familiarity with vector ...

CloudAct Inc.

$90 - $130/hr

Extend the nRouter Backend FastAPI proxy with new guardrails and features * Own streaming, retries ... Prior work on LLM APIs, model gateways, or SSE streaming * Experience with LLM routing engines or ...

Finvest

Senior Backend Engineer

San Francisco, CA · On-site

We are looking for a senior engineer to join our team in San Francisco. As one of the founding ... Design and own the core backend infrastructure, including our multi-agent LLM architecture that ...

Junior

Senior Backend Engineer

New York, NY · On-site

About Junior We're building cutting-edge LLM-powered tools that supercharge investment research for ... Role Description As a Backend Engineer , you'll help build and scale the systems that power our AI ...

NxT Level

Senior Software Engineer, Backend

Manhattan, NY · Remote

$170K - $230K/yr

Senior Backend Engineer (GenAI / LLM Workflows) Compensation: $170,000-$230,000 base + equity Location: San Francisco, CA or (open to remote to start) About Our Client Our client has built a leading ...

NxT Level

Senior Software Engineer, Backend

Manhattan, NY · On-site

$170K - $230K/yr

Senior Backend Engineer (GenAI / LLM Workflows) Compensation: $170,000-$230,000 base + equity Location: San Francisco, CA or (open to remote to start) About Our Client Our client has built a leading ...

AnoSys Technologies, Inc

Backend Engineer

Los Angeles, CA · On-site

$100 - $140/hr

Our platform gives engineering teams end-to-end visibility into AI agents, LLM pipelines, and ML ... As a Backend Engineer, you will design, build, and operate the core infrastructure that makes this ...

Neon Redwood

Platform Backend Engineer

San Francisco, CA · On-site

$120 - $150/hr

Backend Engineer The Company Neon Redwood is a data services consulting company working on cutting ... LLM integrations. Responsibilities * Implement multi‑step agentic workflows using LLMs

next page

Showing results 1-20

All JobsTechnology JobsSoftware JobsSoftware Developer JobsLlm Backend Engineer Jobs

Llm Backend Engineer information

See salary details

$60.5K

$147.7K

$199K

How much do llm backend engineer jobs pay per year?

As of Sep 1, 2026, the average yearly pay for llm backend engineer in the United States is $147,662.00, according to ZipRecruiter salary data. Most workers in this role earn between $124,000.00 and $172,000.00 per year, depending on experience, location, and employer.

What is an LLM backend engineer?

LLM Backend Engineers are software engineers who specialize in designing, building, and optimizing the backend infrastructure that supports large language models (LLMs) like GPT-4. They focus on integrating LLMs into products and services, ensuring scalable APIs, managing data pipelines, and optimizing inference performance. Their work often involves deploying models in cloud environments, monitoring system reliability, and collaborating with AI researchers to bring advancements into production. LLM Backend Engineers play a critical role in making AI-powered applications robust, efficient, and accessible to end users.

What are the key skills and qualifications needed to thrive as an LLM backend engineer?

To thrive as an LLM Backend Engineer, you need a solid foundation in software engineering, backend architecture, and experience working with large language models, typically supported by a degree in computer science or a related field. Proficiency with programming languages like Python or Java, cloud platforms (AWS, GCP, Azure), and machine learning frameworks such as TensorFlow or PyTorch is essential, along with familiarity with APIs and containerization tools like Docker or Kubernetes. Strong problem-solving, collaboration, and communication skills distinguish top performers in this role. These skills ensure robust, scalable, and efficient deployment of LLM-powered applications while enabling effective teamwork and innovation.

What are some common challenges faced by LLM backend engineers when deploying large language models in production?

LLM Backend Engineers often encounter challenges such as optimizing inference latency, managing high resource consumption, and ensuring scalability for production workloads. Balancing model performance with cost efficiency requires careful selection of hardware, batching strategies, and model quantization techniques. Additionally, they must address security and privacy concerns associated with handling sensitive data processed by the models. Collaboration with data scientists and DevOps teams is essential to streamline model updates and monitor system health.
More about Llm Backend Engineer jobs

What cities are hiring for Llm Backend Engineer jobs?

Cities with the most Llm Backend Engineer job openings:

What states have the most Llm Backend Engineer jobs?

States with the most job openings for Llm Backend Engineer jobs include:

What job categories do people searching Llm Backend Engineer jobs look for?

The top searched job categories for Llm Backend Engineer jobs are:

Llm Backend Engineer jobs near you
Infographic showing various Llm Backend Engineer job openings in the United States as of August 2026, with employment types broken down into 93% Full Time, 3% Part Time, and 4% Contract. Highlights an 86% Physical, 5% Hybrid, and 9% Remote job distribution, with an average salary of $147,662 per year, or $71 per hour.

Backend Engineer

ProNexus

San Francisco, CA • On-site

Full-time

This job post has expired 1 day ago. Applications are no longer accepted.

Job description

We are hiring on behalf of a venture-backed AI startup building intelligent software that automates complex business workflows.

The platform uses large language models, proprietary data, and human-in-the-loop systems to complete work that previously required significant manual effort. Its backend systems power AI agents, customer integrations, data processing, evaluation infrastructure, and production workflows.

The company is hiring a Backend Engineer to build the reliable systems behind its AI products.

About the role

As a Backend Engineer, you will design and build the services, APIs, data models, and infrastructure that power the company’s product.

You will work primarily in Python and PostgreSQL while collaborating closely with product engineers, AI engineers, customers, and company leadership.

This is not a narrow API-development role. You will work on production architecture, data systems, model integrations, security, reliability, and product capabilities.

What you’ll do
  • Design, build, and maintain production backend services using Python
  • Develop APIs that support customer-facing applications and AI workflows
  • Design scalable relational data models using PostgreSQL
  • Build integrations with model providers, customer systems, and third-party platforms
  • Develop systems for asynchronous jobs, event processing, and long-running AI workflows
  • Deploy and operate services using AWS
  • Debug production issues across application, data, model, and infrastructure layers
  • Help shape backend architecture and engineering practices as the company grows
What we’re looking for
  • Approximately 2–9 years of professional software engineering experience
  • Strong professional experience with Python
  • Experience designing and operating production APIs or backend services
  • Strong understanding of relational databases, SQL, and data modeling
  • Experience with PostgreSQL or a comparable production database
  • Familiarity with AWS, GCP, or another major cloud platform
  • Understanding of application security, authentication, and authorization
  • Experience debugging and operating systems in production
  • Ability to independently own technical projects from design through deployment
  • Comfort making pragmatic engineering decisions in an early-stage environment
  • Strong communication and cross-functional collaboration skills
Nice to have (not required)
  • Experience building AI, LLM, agent, or machine-learning infrastructure
  • Experience integrating OpenAI, Anthropic, or other model providers
  • Familiarity with LLM evaluation, retrieval, embeddings, or vector databases
  • Experience with Docker, Kubernetes, Terraform, or CI/CD systems
  • Experience with Redis, Kafka, queues, or event-driven architectures
  • Experience building multi-tenant SaaS products
  • Previous experience at an early-stage startup
  • Experience with data-intensive or distributed systems