1

Llm Backend Engineer Jobs (NOW HIRING)

Build and integrate LLM-powered workflows, AI agents, and agentic pipelines into production backend services. Collaborate with front-end developers, product managers, and cross-functional ...

Lead Back-End Engineer

Chicago, IL · On-site

$165K - $180K/yr

We're actively building our standards for LLM-assisted development, and we expect our engineers to be fluent with these tools and be ready to continue exploring. In a typical week, the Lead Back End ...

... LLM-powered workflows, AI agents, and modern AI-assisted development practices. Minimum ... backend development experience, with solid foundational programming skills (algorithms, data ...

About the Role We're looking for a strong, generalist backend engineer to help build the platform ... LLM/AI model integrations and products * Strong product instincts and a builder's mindset ...

... backend engineer excited to build new features and scale out our ingestion and AI systems ... Shipped or otherwise interested in AI/LLM-native applications. * Iterated rapidly with customers or ...

Backend AI Engineer

San Francisco, CA · On-site

$140 - $230/hr

Design, build, and maintain backend services and APIs that power GenAI, LLM, and Computer Vision ... Mentor engineers and contribute to internal backend engineering best practices. Qualifications * 4 ...

We are seeking an experienced Python Backend Engineer to design, develop, and maintain scalable ... Knowledge of AI/LLM integration frameworks such as LangChain or LlamaIndex. Strong experience with ...

We are seeking a Senior Backend Engineer with strong experience in Functional Java , SpringBoot ... Familiarity with LLM concepts (prompt engineering, APIs for model access, basic NLP tasks)

Python Backend Engineer

San Jose, CA · On-site

$100 - $150/hr

We are seeking an experienced Python Backend Engineer to design, develop, and maintain scalable ... Knowledge of AI/LLM integration frameworks such as LangChain or LlamaIndex. * Strong experience ...

Backend AI Engineer

Sunnyvale, CA · On-site

$140 - $220/hr

Design, build, and maintain backend services and APIs that power GenAI, LLM, and Computer Vision ... Mentor engineers and contribute to internal backend engineering best practices. Qualifications * 4 ...

Design, build, and maintain backend services and APIs that power GenAI, LLM, and Computer Vision ... Mentor engineers and contribute to internal backend engineering best practices. Qualifications * 4 ...

You'll be responsible for designing and implementing scalable backend systems that process ... Design and optimize LLM integration pipelines, including prompt engineering, usage monitoring, and ...

WI · On-site

$140 - $190/hr

Our backend systems are the backbone of the traveler experience, and this role plays a critical ... LLM-powered features into our platform * Tackle high-scale engineering challenges to ensure ...

... LLM responses, batch matching jobs, payment processing, and real-time chat -- while maintaining ... Design and build scalable backend services in Node.js/TypeScript, including RESTful APIs ...

Showing results 41-60

Llm Backend Engineer information

See salary details

$60.5K

$147.7K

$199K

How much do llm backend engineer jobs pay per year?

As of Sep 2, 2026, the average yearly pay for llm backend engineer in the United States is $147,662.00, according to ZipRecruiter salary data. Most workers in this role earn between $124,000.00 and $172,000.00 per year, depending on experience, location, and employer.

What is an LLM backend engineer?

LLM Backend Engineers are software engineers who specialize in designing, building, and optimizing the backend infrastructure that supports large language models (LLMs) like GPT-4. They focus on integrating LLMs into products and services, ensuring scalable APIs, managing data pipelines, and optimizing inference performance. Their work often involves deploying models in cloud environments, monitoring system reliability, and collaborating with AI researchers to bring advancements into production. LLM Backend Engineers play a critical role in making AI-powered applications robust, efficient, and accessible to end users.

What are the key skills and qualifications needed to thrive as an LLM backend engineer?

To thrive as an LLM Backend Engineer, you need a solid foundation in software engineering, backend architecture, and experience working with large language models, typically supported by a degree in computer science or a related field. Proficiency with programming languages like Python or Java, cloud platforms (AWS, GCP, Azure), and machine learning frameworks such as TensorFlow or PyTorch is essential, along with familiarity with APIs and containerization tools like Docker or Kubernetes. Strong problem-solving, collaboration, and communication skills distinguish top performers in this role. These skills ensure robust, scalable, and efficient deployment of LLM-powered applications while enabling effective teamwork and innovation.

What are some common challenges faced by LLM backend engineers when deploying large language models in production?

LLM Backend Engineers often encounter challenges such as optimizing inference latency, managing high resource consumption, and ensuring scalability for production workloads. Balancing model performance with cost efficiency requires careful selection of hardware, batching strategies, and model quantization techniques. Additionally, they must address security and privacy concerns associated with handling sensitive data processed by the models. Collaboration with data scientists and DevOps teams is essential to streamline model updates and monitor system health.
More about Llm Backend Engineer jobs

What cities are hiring for Llm Backend Engineer jobs?

Cities with the most Llm Backend Engineer job openings:

What states have the most Llm Backend Engineer jobs?

States with the most job openings for Llm Backend Engineer jobs include:

Infographic showing various Llm Backend Engineer job openings in the United States as of August 2026, with employment types broken down into 93% Full Time, 3% Part Time, and 4% Contract. Highlights an 86% Physical, 5% Hybrid, and 9% Remote job distribution, with an average salary of $147,662 per year, or $71 per hour.

Sr Python Backend Engineer, AIML

Apple

Cupertino, CA

$184K - $324K/yr

Full-time

Medical, Dental, Retirement

Re-posted 5 days ago


Apple rating

8.1

Company rating: 8.1 out of 10

Based on 680 frontline employees who took The Breakroom Quiz

6th of 30 rated technology retailers


Job description

Are you excited to tackle some of the most ambitious technical challenges in Apple Intelligence? Be involved in collaborating closely with our machine learning researchers, engineers, and data scientists? Together, you will orchestrate groundbreaking research initiatives and develop transformative products designed to build a significant impact for billions of users worldwide!
The AI and Machine Learning team is looking for Sr Python Backend Engineer to build world-class data solutions that are used by data scientists, ML engineers and researchers to power Apple Foundation Model lifecycle.
Description
We are looking for a skilled Sr Python Backend Engineer to join our development team.
In this role, you will be responsible for building and maintaining the server-side logic.
You will be tasked with developing back-end components, connecting the application with third-party web services, and supporting the front-end developers by integrating their work with the Python application.
Our ideal candidate must have demonstrated expertise in Python. Knowledge of Data Engineering & ML domain & training lifecycle is an added plus.
You are comfortable with analyzing business requirements, identifying gaps, and translating requirements into technical designs.
You are proficient and adhere to the best practices of software development, such as agile development, code reviews, continuous integration, and automated testing.
You have worked closely with project managers, UI/UX designers, and other cross functional stakeholders to deliver high quality work on-time.
You are well-versed in GenAI tools and agentic development, with hands-on experience building or integrating LLM-powered workflows, AI agents, and modern AI-assisted development practices.
","responsibilities":"Design and develop scalable, high-performance backend systems and APIs using Python frameworks such as FastAPI, Django, or Flask.
Build and integrate LLM-powered workflows, AI agents, and agentic pipelines into production backend services.
Collaborate with front-end developers, product managers, and cross-functional stakeholders to translate business requirements into robust technical solutions.
Architect and maintain data pipelines, microservices, and cloud-native applications supporting ML training lifecycle and data engineering workflows.
Implement and enforce software development best practices including code reviews, automated testing, continuous integration, and agile methodologies.
Evaluate and integrate third-party web services, LLM APIs, and GenAI frameworks (e.g. LangChain, LlamaIndex, OpenAI) to extend platform capabilities.
Monitor, debug, and optimize backend systems for reliability, scalability, and performance in production environments.
Preferred Qualifications
Experience in Data Engineering & ML domain & training lifecycle.
Experience with large-scale data processing, distributed systems , microservices, various caching strategies, and performance optimization.
Excellent problem solving skills and be able to navigate through complex technical challenges and design decisions.
Experience with cloud platforms like AWS or GCP
Experience building and productionizing GenAI applications, including LLM integration, prompt engineering, RAG pipelines, and agentic workflows using frameworks such as LangChain or similar tools.
Master or Ph.D. in a related field.
Previous experience in a high-growth tech company or similar environment.
Minimum Qualifications
Bachelor's degree in Computer Science or related field.
10+ years of extensive backend development experience, with solid foundational programming skills (algorithms, data structures, OOP, etc) and experience designing, writing, reviewing, testing and delivering software for applications and systems at scale.
Expertise in architecting and developing backend systems using Python; extensive experience in FastAPI, Django, or Flask will be great.
Proficient in REST API, Redis, VectorDB or other large scale data storage systems.
In-depth knowledge of workflow orchestration systems like Airflow, distributed systems, cloud-native applications, and containerization technologies like Docker and Kubernetes.
Pay & Benefits
At Apple, base pay is one part of our total compensation package and is determined within a range. This provides the opportunity to progress as you grow and develop within a role. The base pay range for this role is between $184,700 and $324,800, and your base pay will depend on your skills, qualifications, experience, and location.
Apple employees also have the opportunity to become an Apple shareholder through participation in Apple's discretionary employee stock programs. Apple employees are eligible for discretionary restricted stock unit awards, and can purchase Apple stock at a discount if voluntarily participating in Apple's Employee Stock Purchase Plan. You'll also receive benefits including: Comprehensive medical and dental coverage, retirement benefits, a range of discounted products and free services, and for formal education related to advancing your career at Apple, reimbursement for certain educational expenses - including tuition. Additionally, this role might be eligible for discretionary bonuses or commission payments as well as relocation. Learn more about Apple Benefits
Note: Apple benefit, compensation and employee stock programs are subject to eligibility requirements and other terms of the applicable plan or program.

What Apple employees say

Pay

Benefits

Hours and flexibility

Workplace

Get the full story on Breakroom


Apple logo

About Apple

Sourced by ZipRecruiter

Imagine what you could do here! At Apple, new ideas have a way of becoming extraordinary products, services, and customer experiences very quickly. Bring passion and dedication to your job and there's no telling what you could accomplish. Dynamic, intelligent people and inspiring, innovative technologies are the norm here. The people who work here have reinvented entire industries with all Apple Hardware products. The same real passion for innovation that goes into our products also applies to our practices strengthening our dedication to leave the world better than we found it.

Industry

Computer and electronic product manufacturing

Company size

10,000+ Employees

Headquarters location

Cupertino, CA, US

Year founded

1976