1

Llm Backend Engineer Jobs (NOW HIRING)

Experience integrating with LLM/embedding providers via clean abstractions (timeouts, retries ... strong backend engineering practices. * Supportive, collaborative team culture-ideas are heard ...

... LLM expertise to tackle context engineering at scale. Driver builds the context layer for employees ... Software Engineer - Backend Location : Remote or Austin, TX About the Role Our core innovation, the ...

Experience integrating with LLM/embedding providers via clean abstractions (timeouts, retries ... strong backend engineering practices. * Supportive, collaborative team culture-ideas are heard ...

Software Engineer - Backend

Austin, TX · On-site +1

$175K - $275K/yr

... LLM expertise to tackle context engineering at scale. Driver builds the context layer for employees ... Software Engineer - Backend Location : Remote or Austin, TX About the Role Our core innovation, the ...

We are seeking a Senior Backend Engineer with strong experience in Functional Java , SpringBoot ... Familiarity with LLM concepts (prompt engineering, APIs for model access, basic NLP tasks)

The Role We're hiring a Backend Product Engineer to build and maintain the systems that make Tolan ... Contribute to LLM engineering work that brings Tolan's AI capabilities to life. * Work cross ...

... LLM responses, batch matching jobs, payment processing, and real-time chat - while maintaining ... Design and build scalable backend services in Node.js/TypeScript, including RESTful APIs ...

Our backend systems are the backbone of the traveler experience, and this role plays a critical ... LLM-powered features into our platform * Tackle high-scale engineering challenges to ensure ...

About The Role We're seeking a Senior Backend Engineer and help scale the backbone of our platform ... AI-powered coding assistants and LLM-based development enhancements The Arena Club Standard Life at ...

The role You'll be a core backend engineer building the services and infrastructure that power our ... Integration with LLM frameworks (LangChain, LlamaIndex) and vector databases * Backend features ...

Senior Backend Engineer

Los Angeles, CA · On-site

$150K - $195K/yr

About The Role We're seeking a Senior Backend Engineer and help scale the backbone of our platform ... AI-powered coding assistants and LLM-based development enhancements The Arena Club Standard Life at ...

next page

Showing results 1-20

Llm Backend Engineer information

See salary details

$60.5K

$147.7K

$199K

How much do llm backend engineer jobs pay per year?

As of Jun 7, 2026, the average yearly pay for llm backend engineer in the United States is $147,662.00, according to ZipRecruiter salary data. Most workers in this role earn between $124,000.00 and $172,000.00 per year, depending on experience, location, and employer.

What are some common challenges faced by LLM Backend Engineers when deploying large language models in production?

LLM Backend Engineers often encounter challenges such as optimizing inference latency, managing high resource consumption, and ensuring scalability for production workloads. Balancing model performance with cost efficiency requires careful selection of hardware, batching strategies, and model quantization techniques. Additionally, they must address security and privacy concerns associated with handling sensitive data processed by the models. Collaboration with data scientists and DevOps teams is essential to streamline model updates and monitor system health.

What are LLM Backend Engineers?

LLM Backend Engineers are software engineers who specialize in designing, building, and optimizing the backend infrastructure that supports large language models (LLMs) like GPT-4. They focus on integrating LLMs into products and services, ensuring scalable APIs, managing data pipelines, and optimizing inference performance. Their work often involves deploying models in cloud environments, monitoring system reliability, and collaborating with AI researchers to bring advancements into production. LLM Backend Engineers play a critical role in making AI-powered applications robust, efficient, and accessible to end users.

What are the key skills and qualifications needed to thrive as an LLM Backend Engineer, and why are they important?

To thrive as an LLM Backend Engineer, you need a solid foundation in software engineering, backend architecture, and experience working with large language models, typically supported by a degree in computer science or a related field. Proficiency with programming languages like Python or Java, cloud platforms (AWS, GCP, Azure), and machine learning frameworks such as TensorFlow or PyTorch is essential, along with familiarity with APIs and containerization tools like Docker or Kubernetes. Strong problem-solving, collaboration, and communication skills distinguish top performers in this role. These skills ensure robust, scalable, and efficient deployment of LLM-powered applications while enabling effective teamwork and innovation.
More about Llm Backend Engineer jobs
What cities are hiring for Llm Backend Engineer jobs? Cities with the most Llm Backend Engineer job openings:
What states have the most Llm Backend Engineer jobs? States with the most job openings for Llm Backend Engineer jobs include:
Infographic showing various Llm Backend Engineer job openings in the United States as of May 2026, with employment types broken down into 75% Full Time, 1% Part Time, 1% Temporary, 22% Contract, and 1% Nights. Highlights an 76% Physical, 5% Hybrid, and 19% Remote job distribution, with an average salary of $147,662 per year, or $71 per hour.
Senior Backend Engineer

Senior Backend Engineer

Meltwater

Las Vegas, NV

Other

Medical, Dental, Vision, Life, Retirement, PTO

Posted 17 days ago


Job description

Description

About the Role
We're looking for a Senior Backend Engineer to build and scale the GenAI Lens backend platform. This is a production-focused role centered on MongoDB data design and performance, scalable/durable data ingestion and processing pipelines, and operating high-throughput systems with strong observability and reliability.
You'll also help build and evolve our API layer (GraphQL and JSON-RPC). Experience with GraphQL is a strong plus, but the core focus is data systems and platform engineering. You should be comfortable working in a product that leverages modern AI technologies (embeddings, vector search, LLM integrations) and understand the practical standards that come with them-evaluation, guardrails, observability, and cost controls.What You'll Work On

  • Maintain and improve our data pipelines to keep data flowing reliably from ingestion to delivery

  • Scalable, durable data ingestion and processing pipelines (event-driven, fault-tolerant workflows; retries, idempotency, backfills, and DLQs)

  • Own data quality by implementing monitoring, alerting, and validation

  • Design MongoDB schemas and query/index strategies for scale (aggregation pipelines, Atlas Search/vector search where relevant)

  • JSON-RPC data layer service that powers GraphQL (designing/maintaining RPC methods, scaling throughput/latency, and evolving contracts safely)

  • Support AI-adjacent platform needs (embedding generation workflows, provider abstractions, prompt/model metadata, evaluation hooks)
Responsibilities:

  • Own backend services end-to-end, from design and implementation through deployment and production support

  • Deliver scalable GraphQL resolvers with performance-aware patterns (batching, caching, pagination)

  • Build and evolve the JSON-RPC data access layer for GraphQL, including method design, backward compatibility, and performance tuning.

  • Own MongoDB performance: modeling, indexing, aggregation pipelines, and measurable latency/throughput targets

  • Build reliable serverless/event-driven components (idempotency, retries, DLQs, backpressure, rate limiting)

  • Improve reliability and operational readiness (SLO-minded engineering, incident response hygiene, runbooks)

  • Partner closely with frontend, product, and UX to enable features cleanly and safely

  • Drive code quality via testing, reviews, and CI/CD improvements

  • Mentor engineers and influence engineering standards across the team
Required Skills & Experience

  • Experience building and maintaining backend services in production

  • Strong experience with GraphQL APIs (schema design, resolver patterns, authorization, performance)

  • Strong experience with MongoDB (data modeling, indexing, aggregation pipelines; Atlas Search and Vector Search, sharding experience is a plus)

  • Strong proficiency with Node.js and JavaScript / TypeScript

  • Strong proficiency with Python (services, jobs, data processing, or tooling)

  • Experience building on AWS, preferably serverless/event-driven architectures (Lambda, SQS/SNS/EventBridge, S3)

  • Experience working with high-traffic or business-critical systems

  • Solid understanding of performance optimization techniques (caching, async processing, data access patterns)

  • Experience with Terraform for production infrastructure (IAM, networking, secrets, repeatable environments)

  • Experience with testing frameworks and pragmatic test strategy (unit, integration, contract)

  • Familiarity with CI/CD pipelines (GitHub Actions preferred; alternatives acceptable)

  • Experience debugging, monitoring, and operating production systems

  • Comfortable working in a distributed team environment

  • Strong operational skills: logging, metrics, tracing, dashboards/alerts, and production support practices
Infrastructure & Platform Experience

  • Cloud experience, preferably AWS, including:

  • Lambda

  • SQS / SNS / EventBridge / Kafka

  • S3

  • CloudWatch

  • API Gateway (where applicable)

  • Experience with Infrastructure as Code, preferably Terraform

  • Experience with private networking patterns (VPC, security groups, PrivateLink/VPC endpoints) is a plus

  • Exposure to containerized workloads (EKS/Kubernetes) is a plus, even if the core architecture is serverless-first
Collaboration & Others

  • Prior experience leading projects, features, or technical initiatives

  • Ability to influence architecture and design decisions

  • Strong ownership mindset and ability to identify and execute improvements independently
AI & Developer Productivity

  • Familiarity with embeddings and vector search concepts, and the tradeoffs they introduce (latency, cost, relevance)

  • Experience integrating with LLM/embedding providers via clean abstractions (timeouts, retries, fallbacks, rate limits)

  • Awareness of AI industry standards/practices: prompt/version management, evaluation/regression checks, basic guardrails, and auditability

  • Hands-on experience using AI tools to improve development workflows and code quality (e.g., Copilot, Claude Code, OpenAI-based tools)

  • Ability to articulate how AI has improved development speed, quality, testing, or maintainability
Nice to Have

  • Experience building high-throughput services (e.g., millions of requests/minute class systems) and tuning concurrency/connection pools

  • Experience designing "saved filter" or "materialized view" style performance optimizations for analytics/trends workloads

  • Experience with multi-region data and compliance-minded architectures

  • Experience refactoring legacy systems or consolidating services for efficiency and cost savings
Why Join This Team

  • Help build a modern backend platform where quality and scalability are non-negotiable, enabling a high-impact product for the company with visible outcomes and real customer adoption.

  • Work with cutting-edge technologies and modern AI tooling (embeddings, vector search, LLM providers, evaluation/guardrails) while staying grounded in strong backend engineering practices.

  • Supportive, collaborative team culture-ideas are heard, discussed openly, and improved together as a group

What We Offer:

  • Enjoy comprehensive paid time off that allows you to have an enhanced work-life balance

  • Excellent medical, dental, and vision options

  • 401(k) matching, life insurance, commuter benefits, and parental leave plans

  • Complimentary CalmApp subscription for you and your loved ones, because mental wellness matters.

  • Energetic work environment with a hybrid work style, providing the balance you need.

  • Thrive within our inclusive community and seize ongoing professional development opportunities to elevate your career.

  • Total compensation range for this position: $188,000-$250,000 USD per year.

Start Date :ASAP
Our Story:
AtMeltwater, we believe that when you have the right people in the right environment, great things happen.
Our best-in-class technology empowers our 27,000 customersaround
the world to make better business decisions through data. But we can't do that without our global team of developers, innovators, problem-solvers, and high-performers who embrace challenges and find new solutions for our customers.
Our award-winning global culture drives everything we do and creates
an environment where our employees can make an impact, learn every day, feel a sense of belonging, and celebrate each other's successes along
the way.
We are innovators at the core who see the potential in people, ideas and technologies. Together, we challenge ourselves to go big, be bold, and build best-in-class solutions for our customers.
We're proud of our diverse team of 2,200+ employeesin50 locationsacross
25 countriesaround the world. No matter where you are, you'll work with people who care about your success and get the support you need to unlock new heights in your career.
We are Meltwater. Inspired by innovation, powered by people.
Equal Employment Opportunity Statement
Meltwater is an Equal Opportunity Employer and Prohibits Discrimination and Harassment of Any Kind: At Meltwater, we are dedicated to fostering an inclusive and diverse workplace where every employee feels valued, respected, and empowered. We are committed to the principle of equal employment opportunity and strive to provide a work environment that is free from discrimination and harassment.
All employment decisions at Meltwater are made based on business needs, job requirements, and individual qualifications, without regard to race, color, religion or belief, gender, gender identity or expression, sexual orientation, national origin, genetics, disability, age, marital status, veteran status, or any other status protected by the applicable laws and regulations.
Meltwater does not tolerate discrimination or harassment of any kind, and we actively promote a culture of respect, fairness, and inclusivity. We encourage applicants of all backgrounds, experiences, and abilities to apply and join us in our mission to drive innovation and make a positive impact in the world.
We may use AI to assist in aspects of our hiring process, such as reviewing candidate information, capturing interview notes, and supporting interview activities. These tools are used only to assist our team through increased efficiencies. Every output continues to be reviewed by humans, and all hiring decisions are made by humans. We remain committed to evaluating candidates fairly, consistently, and in compliance with all applicable laws