ZipRecruiter

Log In

1

Llm Backend Engineer Jobs in Georgia (NOW HIRING)

Insight Global

Full Stack Developer

Atlanta, GA · On-site

Backend and Integration Engineering: Build backend services in Python or Node that orchestrate agent interactions; integrate with LLM APIs, vector databases, evaluation services, and enterprise ...

Monitise

Sr Server Software Engineer

Alpharetta, GA · On-site

$119K - $157K/yr

As a Backend Engineer on this team, you will focus on scaling and expanding our employee management ... Knowledge of or exposure to Generative AI concepts, LLM integrations, or building AI-driven ...

Fiserv, Inc.

Sr Server Software Engineer

Alpharetta, GA · On-site

$119K - $157K/yr

As a Backend Engineer on this team, you will focus on scaling and expanding our employee management ... Knowledge of or exposure to Generative AI concepts, LLM integrations, or building AI-driven ...

Fiserv, Inc.

Sr Server Software Engineer

Alpharetta, GA

$119K - $157K/yr

As a Backend Engineer on this team, you will focus on scaling and expanding our employee management ... Knowledge of or exposure to Generative AI concepts, LLM integrations, or building AI-driven ...

RIT Solutions, Inc.

Senior AI Engineer

Atlanta, GA · On-site

$100K - $138K/yr

Responsibilities : • Architect and deliver end-to-end LLM-powered applications and agentic ... backend services, and cloud platforms • Establish evaluation, reliability, and performance ...

Socket.dev

AI Engineer

Atlanta, GA · On-site

$140 - $210/hr

Contribute to decisions on backend architecture, scalability, and infrastructure. * Collaborate ... Experienced in developing and optimizing LLM applications, including Retrieval-Augmented Generation ...

Omnissa

Software Engineer, AI/ML

Atlanta, GA · On-site +1

$102K - $160K/yr

You will design and scale backend systems, integrate large language model (LLM) capabilities, and help embed globalization best practices into our engineering workflows. Here is a breakdown: * Design ...

Omnissa

Software Engineer, AI/ML

Atlanta, GA · On-site

$102K - $160K/yr

You will design and scale backend systems, integrate large language model (LLM) capabilities, and help embed globalization best practices into our engineering workflows. Here is a breakdown: * Design ...

Cox Automotive

Sr Software Engineer

North Decatur, GA · On-site

$101K - $169K/yr

React / TypeScript (web), Flutter / Dart (mobile & cross-platform), and Python / Node.js (backend ... Rapidly prototype new product concepts using Claude, Amazon Bedrock, and other LLM/GenAI platforms.

Cox Automotive

Sr Software Engineer

Austell, GA · On-site

$101K - $169K/yr

React / TypeScript (web), Flutter / Dart (mobile & cross-platform), and Python / Node.js (backend ... Rapidly prototype new product concepts using Claude, Amazon Bedrock, and other LLM/GenAI platforms.

Cox Automotive

Sr Software Engineer

Decatur, GA · On-site

$101K - $169K/yr

React / TypeScript (web), Flutter / Dart (mobile & cross-platform), and Python / Node.js (backend ... Rapidly prototype new product concepts using Claude, Amazon Bedrock, and other LLM/GenAI platforms.

Cox Automotive

Sr Software Engineer

Dunwoody, GA · On-site

$101K - $169K/yr

React / TypeScript (web), Flutter / Dart (mobile & cross-platform), and Python / Node.js (backend ... Rapidly prototype new product concepts using Claude, Amazon Bedrock, and other LLM/GenAI platforms.

Cox Automotive

Sr Software Engineer

Pine Lake, GA · On-site

$101K - $169K/yr

React / TypeScript (web), Flutter / Dart (mobile & cross-platform), and Python / Node.js (backend ... Rapidly prototype new product concepts using Claude, Amazon Bedrock, and other LLM/GenAI platforms.

Cox Automotive

Sr Software Engineer

Tucker, GA · On-site

$101K - $169K/yr

React / TypeScript (web), Flutter / Dart (mobile & cross-platform), and Python / Node.js (backend ... Rapidly prototype new product concepts using Claude, Amazon Bedrock, and other LLM/GenAI platforms.

Cox Automotive

Sr Software Engineer

Union City, GA · On-site

$101K - $169K/yr

React / TypeScript (web), Flutter / Dart (mobile & cross-platform), and Python / Node.js (backend ... Rapidly prototype new product concepts using Claude, Amazon Bedrock, and other LLM/GenAI platforms.

previous pagenext page

Showing results 21-40

All JobsLlm Backend Engineer JobsLlm Backend Engineer Jobs in Georgia

Llm Backend Engineer information

What is an LLM backend engineer?

LLM Backend Engineers are software engineers who specialize in designing, building, and optimizing the backend infrastructure that supports large language models (LLMs) like GPT-4. They focus on integrating LLMs into products and services, ensuring scalable APIs, managing data pipelines, and optimizing inference performance. Their work often involves deploying models in cloud environments, monitoring system reliability, and collaborating with AI researchers to bring advancements into production. LLM Backend Engineers play a critical role in making AI-powered applications robust, efficient, and accessible to end users.

What are the key skills and qualifications needed to thrive as an LLM backend engineer?

To thrive as an LLM Backend Engineer, you need a solid foundation in software engineering, backend architecture, and experience working with large language models, typically supported by a degree in computer science or a related field. Proficiency with programming languages like Python or Java, cloud platforms (AWS, GCP, Azure), and machine learning frameworks such as TensorFlow or PyTorch is essential, along with familiarity with APIs and containerization tools like Docker or Kubernetes. Strong problem-solving, collaboration, and communication skills distinguish top performers in this role. These skills ensure robust, scalable, and efficient deployment of LLM-powered applications while enabling effective teamwork and innovation.

What are some common challenges faced by LLM backend engineers when deploying large language models in production?

LLM Backend Engineers often encounter challenges such as optimizing inference latency, managing high resource consumption, and ensuring scalability for production workloads. Balancing model performance with cost efficiency requires careful selection of hardware, batching strategies, and model quantization techniques. Additionally, they must address security and privacy concerns associated with handling sensitive data processed by the models. Collaboration with data scientists and DevOps teams is essential to streamline model updates and monitor system health.

What are popular job titles related to Llm Backend Engineer jobs in Georgia?

For Llm Backend Engineer jobs in Georgia, the most frequently searched job titles are:

What job categories do people searching Llm Backend Engineer jobs in Georgia look for?

The top searched job categories for Llm Backend Engineer jobs in Georgia are:

What cities in Georgia are hiring for Llm Backend Engineer jobs?

Cities in Georgia with the most Llm Backend Engineer job openings:

Llm Backend Engineer jobs near you
Infographic showing various Llm Backend Engineer job openings in Georgia as of August 2026, with employment types broken down into 90% Full Time, 5% Part Time, and 5% Contract. Highlights an 85% Physical, 5% Hybrid, and 10% Remote job distribution.

Full Stack Developer

Insight Global

Atlanta, GA • On-site

Full-time

Re-posted 19 hours ago

Job description

Overview

Evergreen.AI is building enterprise-grade, end-to-end agentic AI solutions and frameworks that transform how organizations operate. As a Full Stack AI Systems Software Development Engineer, you will design and build production-grade applications that operationalize Evergreen.AI systems inside real enterprise workflows. This role focuses on creating the application layer where AI systems are observed, controlled, evaluated, and trusted by enterprise users. Your work determines whether AI systems aßre usable, governable, and scalable-not just functional.


Responsibilities
  • Application Architecture for AI Systems: Design and build full stack applications that sit on top of Evergreen.AI agents; develop APIs, services, and UI components that expose AI system behavior, state, and decisions; handle nondeterministic outputs through UX patterns such as review queues, confidence indicators, provenance views, and audit logs; design systems that support human-in-the-loop workflows without slowing delivery velocity.
  • Frontend Engineering for Trust and Control: Build enterprise-grade UIs using modern frameworks (React, Next.js, or equivalent); design interfaces that allow users to inspect, approve, correct, and override AI outputs; implement role-based access control, auditability, and compliance-friendly UX; optimize for clarity, reliability, and debuggability over visual polish.
  • Backend and Integration Engineering: Build backend services in Python or Node that orchestrate agent interactions; integrate with LLM APIs, vector databases, evaluation services, and enterprise systems; implement asynchronous workflows, event-driven processing, and state management; design APIs that remain stable under evolving AI behavior.
  • Observability, Quality, and Feedback Loops: Implement logging, tracing, and monitoring across the full stack; surface evaluation metrics, failure modes, and drift signals in the product UI; enable feedback collection from users to improve system behavior over time; partner with Forward Deployed Engineers to close the loop between usage and improvement.
  • Security and Enterprise Readiness: Implement authentication, authorization, and secure data handling; ensure applications meet enterprise security and compliance requirements; design for multi-tenant and single-tenant deployments where required.

Qualifications
  • 5+ years building production-grade full stack applications.
  • Strong experience with modern front-end frameworks (React, Next.js) and component-driven development.
  • Strong backend engineering skills in Python and Node.
  • Experience integrating with APIs, async systems, and event-driven architectures.
  • Exposure to LLM-powered systems, agent frameworks, or AI-driven applications.
  • Ability to design systems under uncertainty and evolving requirements.
  • Strong instincts around maintainability, debuggability, and failure handling.
  • Excellent collaboration and communication skills; ability to work closely with FDEs, platform engineers, and customers.
Qualifications:
  • 5+ years building production-grade full stack applications.
  • Strong experience with modern front-end frameworks (React, Next.js) and component-driven development.
  • Strong backend engineering skills in Python and Node.
  • Experience integrating with APIs, async systems, and event-driven architectures.
  • Exposure to LLM-powered systems, agent frameworks, or AI-driven applications.
  • Ability to design systems under uncertainty and evolving requirements.
  • Strong instincts around maintainability, debuggability, and failure handling.
  • Excellent collaboration and communication skills; ability to work closely with FDEs, platform engineers, and customers.
Education:UNAVAILABLEEmployment Type: FULL_TIME

Apply