ZipRecruiter

Log In

1

Llm Backend Engineer Jobs (NOW HIRING)

Aspire Talent Solutions

Backend Engineer

Columbus, OH · On-site

Contribute to AI/LLM-enabled workflow enhancements where applicable * Mentor junior engineers and ... Strong experience building and operating backend systems in production environments * Proven ...

ExcelliSearch, Inc.

Backend Engineer

Columbus, OH · On-site

Contribute to AI/LLM-enabled workflow enhancements where applicable * Mentor junior engineers and ... Strong experience building and operating backend systems in production environments * Proven ...

Riverscape Search Agency

Backend Engineer

Columbus, OH · On-site

Contribute to AI/LLM-enabled workflow enhancements where applicable * Mentor junior engineers and ... Strong experience building and operating backend systems in production environments * Proven ...

Benji

Senior Backend Engineer

New York, NY

Backend platform engineering * Distributed systems & event-driven architecture * Partner ... Build and evolve AI-native engineering standards - agents, MCP tooling, and LLM-powered product ...

Pump.co

Backend Engineer

San Francisco, CA · On-site

$120K - $200K/yr

Python, FastAPI, PostgreSQL, AWS, Docker, Kubernetes (nice to have), LLM/AI (bonus) As a Backend Engineer , you'll contribute directly to the core of our product and infrastructure. This role is ...

Pump.co

Backend Engineer

San Francisco, CA

Python, FastAPI, PostgreSQL, AWS, Docker, Kubernetes (nice to have), LLM/AI (bonus) As a Backend Engineer , you'll contribute directly to the core of our product and infrastructure. This role is ...

Jobgether

Create and optimize AI-powered workflows, including prompt design, tool definitions, and LLM ... Familiarity with backend frameworks such as Hono, Fastify, NestJS, or Next.js API routes

twenty80.io

Backend Engineer

Columbus, OH

$175K - $185K/yr

Experience contributing to AI/LLM-enabled applications and workflow automation. * Prior experience mentoring engineers or demonstrating technical leadership capabilities. Core Competencies * Backend ...

AceStack LLC

AI Backend Engineer

Rosemead, CA · On-site

AI Backend Engineer Relevant Experience (in Yrs) 10+ Must Have Technical/Functional Skills • ... LLM APIs (e.g., Azure OpenAI via enterprise gateway), handling prompt orchestration, tool ...

next page

Showing results 1-20

People also search for

All JobsLlm Backend Engineer Jobs

Llm Backend Engineer information

See salary details

$60.5K

$147.7K

$199K

How much do llm backend engineer jobs pay per year?

As of Jun 6, 2026, the average yearly pay for llm backend engineer in the United States is $147,662.00, according to ZipRecruiter salary data. Most workers in this role earn between $124,000.00 and $172,000.00 per year, depending on experience, location, and employer.

What are some common challenges faced by LLM Backend Engineers when deploying large language models in production?

LLM Backend Engineers often encounter challenges such as optimizing inference latency, managing high resource consumption, and ensuring scalability for production workloads. Balancing model performance with cost efficiency requires careful selection of hardware, batching strategies, and model quantization techniques. Additionally, they must address security and privacy concerns associated with handling sensitive data processed by the models. Collaboration with data scientists and DevOps teams is essential to streamline model updates and monitor system health.

What are LLM Backend Engineers?

LLM Backend Engineers are software engineers who specialize in designing, building, and optimizing the backend infrastructure that supports large language models (LLMs) like GPT-4. They focus on integrating LLMs into products and services, ensuring scalable APIs, managing data pipelines, and optimizing inference performance. Their work often involves deploying models in cloud environments, monitoring system reliability, and collaborating with AI researchers to bring advancements into production. LLM Backend Engineers play a critical role in making AI-powered applications robust, efficient, and accessible to end users.

What are the key skills and qualifications needed to thrive as an LLM Backend Engineer, and why are they important?

To thrive as an LLM Backend Engineer, you need a solid foundation in software engineering, backend architecture, and experience working with large language models, typically supported by a degree in computer science or a related field. Proficiency with programming languages like Python or Java, cloud platforms (AWS, GCP, Azure), and machine learning frameworks such as TensorFlow or PyTorch is essential, along with familiarity with APIs and containerization tools like Docker or Kubernetes. Strong problem-solving, collaboration, and communication skills distinguish top performers in this role. These skills ensure robust, scalable, and efficient deployment of LLM-powered applications while enabling effective teamwork and innovation.
More about Llm Backend Engineer jobs
What cities are hiring for Llm Backend Engineer jobs? Cities with the most Llm Backend Engineer job openings:
What states have the most Llm Backend Engineer jobs? States with the most job openings for Llm Backend Engineer jobs include:
What job categories do people searching Llm Backend Engineer jobs look for? The top searched job categories for Llm Backend Engineer jobs are:
Llm Backend Engineer jobs near you
Infographic showing various Llm Backend Engineer job openings in the United States as of May 2026, with employment types broken down into 75% Full Time, 1% Part Time, 1% Temporary, 22% Contract, and 1% Nights. Highlights an 76% Physical, 5% Hybrid, and 19% Remote job distribution, with an average salary of $147,662 per year, or $71 per hour.
Backend Engineer

Backend Engineer

Crescent City Recruitment Group

Columbus, OH • On-site

Full-time

This job post has expired 1 day ago. Applications are no longer accepted.

Job description

Our client is building a state-of-the-art platform that enables financial institutions to transition commercial banking relationships by automating account switching across receivables (AR), payables (AP), and payroll systems. The platform integrates with external financial systems, processes transactional data, and supports workflows that require accuracy, auditability, and reliability.
This platform automates complex account switching across receivables (AR), payables (AP), and payroll systems, integrating with external financial platforms while ensuring accuracy, auditability, and reliability in regulated environments.
This is a senior-level engineering role for someone who can own and evolve core backend systems, operate in production environments, and make sound architectural decisions with minimal oversight.
As an Engineer III, you will design, build, and scale backend systems that power critical financial workflows. You will take ownership of services end-to-end-from architecture through production-ensuring systems are performant, reliable, and maintainable over time.
YOU MUST HAVE EXCEPTIONAL COMMUNICATION SKILLS.
What You'll Do

  • Design and build scalable backend services and APIs
  • Own critical services end-to-end, including production performance and reliability
  • Lead technical design for complex features and platform enhancements
  • Improve system performance, scalability, and fault tolerance
  • Identify and resolve bottlenecks across application, database, and infrastructure layers
  • Debug production issues and lead root cause analysis with permanent fixes
  • Contribute to CI/CD pipelines, deployment processes, and system observability
  • Implement monitoring, logging, and alerting for production systems
  • Support integrations with external financial systems and data sources
  • Contribute to AI/LLM-enabled workflow enhancements where applicable
  • Mentor junior engineers and elevate engineering standards
Technical Requirements
  • Strong experience building and operating backend systems in production environments
  • Proven ability to diagnose and resolve performance and reliability issues
  • Experience designing and developing scalable APIs
  • Hands-on experience with Python-based backend development
  • Experience with AWS (compute, storage, networking)
  • Experience with relational and/or NoSQL databases
  • Familiarity with CI/CD pipelines and deployment practices
  • Experience with monitoring, logging, and observability tools
Core Competencies:
  • System performance and scalability
  • Reliability and fault tolerance
  • Root cause analysis and production support
Data Responsibilities
  • Design and maintain application-level database schemas
  • Optimize indexing and data access patterns for performance
(Note: This role does not include enterprise data architecture or analytics modeling.) Qualifications • 8+ years of backend software engineering experience -
  • Full-stack Python/Django + React/TypeScript)
  • Proven experience designing and supporting production systems
  • Strong track record of making sound technical and architectural decisions
  • Experience resolving complex production issues independently
  • Background in fintech, payments, banking, or SaaS platforms
  • Experience working in regulated environments (PCI, SOC2, etc.)
  • Exposure to API-led architecture (REST, JSON; SOAP/XML a plus)
  • Full-stack familiarity (Python/Django + React/TypeScript) is a plus
99198299
Crescent City Recruitment Group logo

About Crescent City Recruitment Group

Sourced by ZipRecruiter

Crescent City Recruitment Group is a private, service‑disabled veteran–owned staffing agency founded in New Orleans, LA, focused on matching candidates with employers across hospitality, healthcare, and education sectors. Based at 1711 Milan Street, it specializes in temp, temp‑to‑hire, and direct hire placements across multiple industries, driven by a personalized, local‑focused recruitment strategy and rapid turnaround.

Industry

Recruiting and staffing services

Company size

11 - 50 Employees

Headquarters location

Mandeville, LA, US

Year founded

2013

Social media

FacebookTwitter

View All Crescent City Recruitment Group Jobs

Apply