ZipRecruiter

Log In

1

Llm Backend Engineer Jobs (NOW HIRING)

Braintrust

Software Engineer, Backend

New York, NY · On-site

What you'll do As a backend engineer at Braintrust, you'll help build the core platform powering LLM-native development: * Design and ship features that give users deep insight into their LLM usage ...

Pump.co

Backend Engineer

San Francisco, CA · On-site

$120K - $200K/yr

Python, FastAPI, PostgreSQL, AWS, Docker, Kubernetes (nice to have), LLM/AI (bonus) As a Backend Engineer , you'll contribute directly to the core of our product and infrastructure. This role is ...

Pump.co

Backend Engineer

San Francisco, CA

Python, FastAPI, PostgreSQL, AWS, Docker, Kubernetes (nice to have), LLM/AI (bonus) As a Backend Engineer , you'll contribute directly to the core of our product and infrastructure. This role is ...

Judgment Labs

Senior Backend Engineer

San Francisco, CA · On-site

The Role We're looking for a Senior Backend Engineer to own the services and APIs that power the ... Experience scaling pipelines that fan out to LLM APIs and managing the rate-limit, retry, and cost ...

IntraEdge

Sr. Engineer - Backend

Woonsocket, RI

We are seeking a Senior Backend Engineer with strong experience in Functional Java , SpringBoot ... Familiarity with LLM concepts (prompt engineering, APIs for model access, basic NLP tasks)

Driver AI Inc.

Software Engineer - Backend

Austin, TX · Remote

... LLM expertise to tackle context engineering at scale. Driver builds the context layer for employees ... Software Engineer - Backend Location : Remote or Austin, TX About the Role Our core innovation, the ...

ClinDCast LLC

Python Backend Engineer

Sunnyvale, CA

$60 - $65/hr

We are seeking an experienced Python Backend Engineer to design, develop, and maintain scalable ... Knowledge of AI/LLM integration frameworks such as LangChain or LlamaIndex. Strong experience with ...

Driver AI Inc.

Software Engineer - Backend

Austin, TX · On-site +1

$175K - $275K/yr

... LLM expertise to tackle context engineering at scale. Driver builds the context layer for employees ... Software Engineer - Backend Location : Remote or Austin, TX About the Role Our core innovation, the ...

next page

Showing results 1-20

All JobsLlm Backend Engineer Jobs

Llm Backend Engineer information

See salary details

$60.5K

$147.7K

$199K

How much do llm backend engineer jobs pay per year?

As of Jun 30, 2026, the average yearly pay for llm backend engineer in the United States is $147,662.00, according to ZipRecruiter salary data. Most workers in this role earn between $124,000.00 and $172,000.00 per year, depending on experience, location, and employer.

What are some common challenges faced by LLM Backend Engineers when deploying large language models in production?

LLM Backend Engineers often encounter challenges such as optimizing inference latency, managing high resource consumption, and ensuring scalability for production workloads. Balancing model performance with cost efficiency requires careful selection of hardware, batching strategies, and model quantization techniques. Additionally, they must address security and privacy concerns associated with handling sensitive data processed by the models. Collaboration with data scientists and DevOps teams is essential to streamline model updates and monitor system health.

What are LLM Backend Engineers?

LLM Backend Engineers are software engineers who specialize in designing, building, and optimizing the backend infrastructure that supports large language models (LLMs) like GPT-4. They focus on integrating LLMs into products and services, ensuring scalable APIs, managing data pipelines, and optimizing inference performance. Their work often involves deploying models in cloud environments, monitoring system reliability, and collaborating with AI researchers to bring advancements into production. LLM Backend Engineers play a critical role in making AI-powered applications robust, efficient, and accessible to end users.

What are the key skills and qualifications needed to thrive as an LLM Backend Engineer, and why are they important?

To thrive as an LLM Backend Engineer, you need a solid foundation in software engineering, backend architecture, and experience working with large language models, typically supported by a degree in computer science or a related field. Proficiency with programming languages like Python or Java, cloud platforms (AWS, GCP, Azure), and machine learning frameworks such as TensorFlow or PyTorch is essential, along with familiarity with APIs and containerization tools like Docker or Kubernetes. Strong problem-solving, collaboration, and communication skills distinguish top performers in this role. These skills ensure robust, scalable, and efficient deployment of LLM-powered applications while enabling effective teamwork and innovation.
More about Llm Backend Engineer jobs
What cities are hiring for Llm Backend Engineer jobs? Cities with the most Llm Backend Engineer job openings:
What states have the most Llm Backend Engineer jobs? States with the most job openings for Llm Backend Engineer jobs include:
What job categories do people searching Llm Backend Engineer jobs look for? The top searched job categories for Llm Backend Engineer jobs are:
Llm Backend Engineer jobs near you
Backend Engineer (CLEARED) with Security Clearance

Backend Engineer (CLEARED) with Security Clearance

Zachary Piper Solutions, LLC

Denver, CO • On-site

$120K - $180K/yr

Other

Medical, Dental, Vision, Retirement, PTO

Posted 23 hours ago

Job description

Zachary Piper Solutions is seeking a Backend Engineer to support a next-generation federal mission-software program focused on modernizing cloud-native operations. This position is based in a hybrid environment with locations including Washington, DC, Arlington, VA, Seattle, San Francisco, Los Angeles, and Denver. The Backend Engineer will design, build, and maintain backend services, APIs, and cloud-integrated capabilities that directly support mission-critical federal operations.

This is an excellent opportunity for an engineer who wants to work with modern technologies, contribute to high-impact systems, and grow within a fast-moving, mission-driven environment. ACTIVE SECRET SECURITY CLEARANCE REQUIRED Primary Responsibilities: • Develop backend services and APIs using Python in a production environment • Integrate AWS services including EC2, Lambda, ECS/EKS, S3, RDS, CloudWatch, and Fargate • Build and maintain GraphQL or REST interfaces for mission-critical applications • Support AI/LLM integrations with platforms such as OpenAI, Anthropic, and AskSage • Implement scalable, secure, and cost-efficient cloud architectures • Troubleshoot backend issues, optimize performance, and improve system reliability • Collaborate with frontend engineers, AI engineers, and product teams in an Agile environment • Contribute to CI/CD pipelines, DevSecOps tooling, and infrastructure automation using Terraform or similar IaC tools Required Qualifications: • Bachelor's degree in Computer Science or related field (or equivalent hands-on experience) • 3+ years of professional backend or full-stack engineering experience • Strong proficiency in Python and API development (REST or GraphQL) • Experience with AWS services (Lambda, ECS/EKS, EC2, S3, RDS, CloudWatch) • Hands-on experience with Docker and containerized applications • Familiarity with Kubernetes deployments (EKS preferred) • Experience with Terraform or other Infrastructure-as-Code tools • Strong Git workflow experience (GitHub/GitLab) • U.S. Person status and ability to obtain a U.S.

Security Clearance Preferred Experience (Not Required): • Experience integrating AI/LLM APIs (OpenAI, Anthropic, AskSage) • Background in cloud-native distributed systems • Experience in startup or fast-paced engineering environments • Strong troubleshooting, debugging, and performance optimization skills Compensation & Benefits: • Competitive salary range: $120,000 - $180,000 (depending on experience) • Equity opportunities depending on program • Comprehensive benefits package including PTO, paid holidays, medical, dental, vision, 401(k), and sick leave • Hybrid work flexibility depending on location Keywords: Keywords: backend engineer, software engineer, python developer, python, graphql, rest api, api development, cloud engineer, aws engineer, amazon web services, lambda, ecs, eks, ec2, s3, rds, cloudwatch, fargate, kubernetes, docker, containers, containerization, terraform, infrastructure as code, iac, devsecops, ci/cd, git, github, gitlab, microservices, distributed systems, cloud native, ai integration, llm, openai, anthropic, asksage, generative ai, llm api, machine learning integration, startup, mission software, federal, government, clearance, us person, security clearance, secret clearance eligible, hybrid, washington dc, arlington va, seattle, san francisco, los angeles, denver, backend, software development, scalable systems, cloud architecture, high availability, performance optimization, python backend, cloud ops, platform engineering, tech startup, space tech, defense tech, modern stack, fastapi, flask, django, async python, asyncio, devops, sre, observability, logging, monitoring, cloud security, iam, vpc, networking, api gateway, serverless, mission critical systems #LI-Onsite #LI-RE1

Apply