Experience integrating with LLM/embedding providers via clean abstractions (timeouts, retries ... strong backend engineering practices. * Supportive, collaborative team culture-ideas are heard ...
Experience integrating with LLM/embedding providers via clean abstractions (timeouts, retries ... strong backend engineering practices. * Supportive, collaborative team culture-ideas are heard ...
... LLM expertise to tackle context engineering at scale. Driver builds the context layer for employees ... Software Engineer - Backend Location : Remote or Austin, TX About the Role Our core innovation, the ...
... LLM expertise to tackle context engineering at scale. Driver builds the context layer for employees ... Software Engineer - Backend Location : Remote or Austin, TX About the Role Our core innovation, the ...
Experience integrating with LLM/embedding providers via clean abstractions (timeouts, retries ... strong backend engineering practices. * Supportive, collaborative team culture-ideas are heard ...
Experience integrating with LLM/embedding providers via clean abstractions (timeouts, retries ... strong backend engineering practices. * Supportive, collaborative team culture-ideas are heard ...
Software Engineer - Backend
Austin, TX · On-site +1
$175K - $275K/yr
... LLM expertise to tackle context engineering at scale. Driver builds the context layer for employees ... Software Engineer - Backend Location : Remote or Austin, TX About the Role Our core innovation, the ...
Software Engineer - Backend
Austin, TX · On-site +1
$175K - $275K/yr
... LLM expertise to tackle context engineering at scale. Driver builds the context layer for employees ... Software Engineer - Backend Location : Remote or Austin, TX About the Role Our core innovation, the ...
Backend Software Engineer
$180K - $230K/yr
Experience building AI/LLM infrastructure or data pipelines * Experience in high-growth startups or ... Strong backend engineering experience * Proficiency in Go or similar language * Experience with ...
Quick apply
Backend Software Engineer
$180K - $230K/yr
Experience building AI/LLM infrastructure or data pipelines * Experience in high-growth startups or ... Strong backend engineering experience * Proficiency in Go or similar language * Experience with ...
Sr. Engineer - Backend
Woonsocket, RI · On-site
We are seeking a Senior Backend Engineer with strong experience in Functional Java , SpringBoot ... Familiarity with LLM concepts (prompt engineering, APIs for model access, basic NLP tasks)
Sr. Engineer - Backend
Woonsocket, RI · On-site
We are seeking a Senior Backend Engineer with strong experience in Functional Java , SpringBoot ... Familiarity with LLM concepts (prompt engineering, APIs for model access, basic NLP tasks)
Senior Backend Engineer, Agentic
Palo Alto, CA · On-site
$350K - $500K/yr
About the Role As a Senior Backend Engineer at Inflection, you will own the platforms, systems, and ... Practical experience with LLM application patterns: RAG, tool use, evaluation loops, and the ...
Senior Backend Engineer, Agentic
Palo Alto, CA · On-site
$350K - $500K/yr
About the Role As a Senior Backend Engineer at Inflection, you will own the platforms, systems, and ... Practical experience with LLM application patterns: RAG, tool use, evaluation loops, and the ...
Backend Product Engineer
San Francisco, CA · On-site
$200K - $300K/yr
The Role We're hiring a Backend Product Engineer to build and maintain the systems that make Tolan ... Contribute to LLM engineering work that brings Tolan's AI capabilities to life. * Work cross ...
Backend Product Engineer
San Francisco, CA · On-site
$200K - $300K/yr
The Role We're hiring a Backend Product Engineer to build and maintain the systems that make Tolan ... Contribute to LLM engineering work that brings Tolan's AI capabilities to life. * Work cross ...
Backend Python Engineer for API Services
Austin, TX · Remote
$42 - $50/hr
Backend Python Engineer for API Services We are seeking a Backend Developer with a strong Data ... Exposure to AI/LLM engineering initiatives or MCP integrations * Familiarity with AI-assisted ...
Backend Python Engineer for API Services
Austin, TX · Remote
$42 - $50/hr
Backend Python Engineer for API Services We are seeking a Backend Developer with a strong Data ... Exposure to AI/LLM engineering initiatives or MCP integrations * Familiarity with AI-assisted ...
We are seeking a Senior Clojure Backend Engineer to help design, build, and scale our AI-powered ... with LLM APIs (OpenAI, Anthropic, AWS Bedrock, etc.) • Experience with vector databases ...
We are seeking a Senior Clojure Backend Engineer to help design, build, and scale our AI-powered ... with LLM APIs (OpenAI, Anthropic, AWS Bedrock, etc.) • Experience with vector databases ...
... LLM responses, batch matching jobs, payment processing, and real-time chat - while maintaining ... Design and build scalable backend services in Node.js/TypeScript, including RESTful APIs ...
... LLM responses, batch matching jobs, payment processing, and real-time chat - while maintaining ... Design and build scalable backend services in Node.js/TypeScript, including RESTful APIs ...
Backend Python Engineer for API Services
Cupertino, CA · On-site +1
$50 - $60/hr
Backend Python Engineer for API Services We are seeking a Backend Developer with a strong Data ... Exposure to AI/LLM engineering initiatives or MCP integrations * Familiarity with AI-assisted ...
Backend Python Engineer for API Services
Cupertino, CA · On-site +1
$50 - $60/hr
Backend Python Engineer for API Services We are seeking a Backend Developer with a strong Data ... Exposure to AI/LLM engineering initiatives or MCP integrations * Familiarity with AI-assisted ...
Senior Backend Engineer
Dallas, TX · On-site +1
Our backend systems are the backbone of the traveler experience, and this role plays a critical ... LLM-powered features into our platform * Tackle high-scale engineering challenges to ensure ...
Quick apply
Senior Backend Engineer
Dallas, TX · On-site +1
Our backend systems are the backbone of the traveler experience, and this role plays a critical ... LLM-powered features into our platform * Tackle high-scale engineering challenges to ensure ...
Sr. Backend Engineer
Rockville, MD · On-site
As a Senior Backend Engineer, you'll lead through excellent code, solve complex problems, set high ... Experience using LLM-based coding tools with a disciplined approach to validating output - you do ...
Sr. Backend Engineer
Rockville, MD · On-site
As a Senior Backend Engineer, you'll lead through excellent code, solve complex problems, set high ... Experience using LLM-based coding tools with a disciplined approach to validating output - you do ...
Senior Backend Engineer
Los Angeles, CA · On-site +1
About The Role We're seeking a Senior Backend Engineer and help scale the backbone of our platform ... AI-powered coding assistants and LLM-based development enhancements The Arena Club Standard Life at ...
Senior Backend Engineer
Los Angeles, CA · On-site +1
About The Role We're seeking a Senior Backend Engineer and help scale the backbone of our platform ... AI-powered coding assistants and LLM-based development enhancements The Arena Club Standard Life at ...
Senior Backend Engineer - AI Product
Framingham, MA · On-site
$165K - $215K/yr
Who We're Looking For We're seeking a backend engineer who ships reliable, well-designed systems ... LLM APIs (Anthropic Claude, OpenRouter) with streaming (SSE), error handling, and cost optimization ...
Senior Backend Engineer - AI Product
Framingham, MA · On-site
$165K - $215K/yr
Who We're Looking For We're seeking a backend engineer who ships reliable, well-designed systems ... LLM APIs (Anthropic Claude, OpenRouter) with streaming (SSE), error handling, and cost optimization ...
Senior Backend Engineer (AI Focus)
New York, NY · On-site
$140K - $190K/yr
The role You'll be a core backend engineer building the services and infrastructure that power our ... Integration with LLM frameworks (LangChain, LlamaIndex) and vector databases * Backend features ...
Senior Backend Engineer (AI Focus)
New York, NY · On-site
$140K - $190K/yr
The role You'll be a core backend engineer building the services and infrastructure that power our ... Integration with LLM frameworks (LangChain, LlamaIndex) and vector databases * Backend features ...
Senior Backend Engineer
Rockville, MD · Hybrid
Software Guidance & Assistance, Inc., (SGA), is searching for a Senior Backend Engineer for a ... Experience using LLM-based coding tools with a disciplined approach to validating output - you do ...
Senior Backend Engineer
Rockville, MD · Hybrid
Software Guidance & Assistance, Inc., (SGA), is searching for a Senior Backend Engineer for a ... Experience using LLM-based coding tools with a disciplined approach to validating output - you do ...
Senior Backend Engineer
Los Angeles, CA · On-site
$150K - $195K/yr
About The Role We're seeking a Senior Backend Engineer and help scale the backbone of our platform ... AI-powered coding assistants and LLM-based development enhancements The Arena Club Standard Life at ...
Senior Backend Engineer
Los Angeles, CA · On-site
$150K - $195K/yr
About The Role We're seeking a Senior Backend Engineer and help scale the backbone of our platform ... AI-powered coding assistants and LLM-based development enhancements The Arena Club Standard Life at ...
Senior Backend Engineer
Plano, TX · On-site
... LLM-powered features into our platform * Tackle high-scale engineering challenges to ensure ... Solid understanding of backend architecture, distributed systems, and scalability principles
Senior Backend Engineer
Plano, TX · On-site
... LLM-powered features into our platform * Tackle high-scale engineering challenges to ensure ... Solid understanding of backend architecture, distributed systems, and scalability principles
Llm Backend Engineer information
See salary details
$60.5K - $73.1K
4% of jobs
$73.1K - $85.7K
2% of jobs
$85.7K - $98.3K
2% of jobs
$98.3K - $110.9K
7% of jobs
$110.9K - $123.5K
9% of jobs
$124.7K is the 25th percentile. Wages below this are outliers.
$123.5K - $136K
11% of jobs
$136K - $148.6K
14% of jobs
The median wage is $149.5K / yr.
$148.6K - $161.2K
15% of jobs
$169.1K is the 75th percentile. Wages above this are outliers.
$161.2K - $173.8K
17% of jobs
$173.8K - $186.4K
13% of jobs
$186.4K - $199K
5% of jobs
$60.5K
$147.7K
$199K
How much do llm backend engineer jobs pay per year?
What are some common challenges faced by LLM Backend Engineers when deploying large language models in production?
What are LLM Backend Engineers?
What are the key skills and qualifications needed to thrive as an LLM Backend Engineer, and why are they important?

Other
Medical, Dental, Vision, Life, Retirement, PTO
Posted 17 days ago
Job description
Description
About the RoleWe're looking for a Senior Backend Engineer to build and scale the GenAI Lens backend platform. This is a production-focused role centered on MongoDB data design and performance, scalable/durable data ingestion and processing pipelines, and operating high-throughput systems with strong observability and reliability.
You'll also help build and evolve our API layer (GraphQL and JSON-RPC). Experience with GraphQL is a strong plus, but the core focus is data systems and platform engineering. You should be comfortable working in a product that leverages modern AI technologies (embeddings, vector search, LLM integrations) and understand the practical standards that come with them-evaluation, guardrails, observability, and cost controls.What You'll Work On
Maintain and improve our data pipelines to keep data flowing reliably from ingestion to delivery
Scalable, durable data ingestion and processing pipelines (event-driven, fault-tolerant workflows; retries, idempotency, backfills, and DLQs)
Own data quality by implementing monitoring, alerting, and validation
Design MongoDB schemas and query/index strategies for scale (aggregation pipelines, Atlas Search/vector search where relevant)
JSON-RPC data layer service that powers GraphQL (designing/maintaining RPC methods, scaling throughput/latency, and evolving contracts safely)
Support AI-adjacent platform needs (embedding generation workflows, provider abstractions, prompt/model metadata, evaluation hooks)
Own backend services end-to-end, from design and implementation through deployment and production support
Deliver scalable GraphQL resolvers with performance-aware patterns (batching, caching, pagination)
Build and evolve the JSON-RPC data access layer for GraphQL, including method design, backward compatibility, and performance tuning.
Own MongoDB performance: modeling, indexing, aggregation pipelines, and measurable latency/throughput targets
Build reliable serverless/event-driven components (idempotency, retries, DLQs, backpressure, rate limiting)
Improve reliability and operational readiness (SLO-minded engineering, incident response hygiene, runbooks)
Partner closely with frontend, product, and UX to enable features cleanly and safely
Drive code quality via testing, reviews, and CI/CD improvements
Mentor engineers and influence engineering standards across the team
Experience building and maintaining backend services in production
Strong experience with GraphQL APIs (schema design, resolver patterns, authorization, performance)
Strong experience with MongoDB (data modeling, indexing, aggregation pipelines; Atlas Search and Vector Search, sharding experience is a plus)
Strong proficiency with Node.js and JavaScript / TypeScript
Strong proficiency with Python (services, jobs, data processing, or tooling)
Experience building on AWS, preferably serverless/event-driven architectures (Lambda, SQS/SNS/EventBridge, S3)
Experience working with high-traffic or business-critical systems
Solid understanding of performance optimization techniques (caching, async processing, data access patterns)
Experience with Terraform for production infrastructure (IAM, networking, secrets, repeatable environments)
Experience with testing frameworks and pragmatic test strategy (unit, integration, contract)
Familiarity with CI/CD pipelines (GitHub Actions preferred; alternatives acceptable)
Experience debugging, monitoring, and operating production systems
Comfortable working in a distributed team environment
Strong operational skills: logging, metrics, tracing, dashboards/alerts, and production support practices
Cloud experience, preferably AWS, including:
Lambda
SQS / SNS / EventBridge / Kafka
S3
CloudWatch
API Gateway (where applicable)
Experience with Infrastructure as Code, preferably Terraform
Experience with private networking patterns (VPC, security groups, PrivateLink/VPC endpoints) is a plus
Exposure to containerized workloads (EKS/Kubernetes) is a plus, even if the core architecture is serverless-first
Prior experience leading projects, features, or technical initiatives
Ability to influence architecture and design decisions
Strong ownership mindset and ability to identify and execute improvements independently
Familiarity with embeddings and vector search concepts, and the tradeoffs they introduce (latency, cost, relevance)
Experience integrating with LLM/embedding providers via clean abstractions (timeouts, retries, fallbacks, rate limits)
Awareness of AI industry standards/practices: prompt/version management, evaluation/regression checks, basic guardrails, and auditability
Hands-on experience using AI tools to improve development workflows and code quality (e.g., Copilot, Claude Code, OpenAI-based tools)
Ability to articulate how AI has improved development speed, quality, testing, or maintainability
Experience building high-throughput services (e.g., millions of requests/minute class systems) and tuning concurrency/connection pools
Experience designing "saved filter" or "materialized view" style performance optimizations for analytics/trends workloads
Experience with multi-region data and compliance-minded architectures
Experience refactoring legacy systems or consolidating services for efficiency and cost savings
Help build a modern backend platform where quality and scalability are non-negotiable, enabling a high-impact product for the company with visible outcomes and real customer adoption.
Work with cutting-edge technologies and modern AI tooling (embeddings, vector search, LLM providers, evaluation/guardrails) while staying grounded in strong backend engineering practices.
Supportive, collaborative team culture-ideas are heard, discussed openly, and improved together as a group
What We Offer:
Enjoy comprehensive paid time off that allows you to have an enhanced work-life balance
Excellent medical, dental, and vision options
401(k) matching, life insurance, commuter benefits, and parental leave plans
Complimentary CalmApp subscription for you and your loved ones, because mental wellness matters.
Energetic work environment with a hybrid work style, providing the balance you need.
Thrive within our inclusive community and seize ongoing professional development opportunities to elevate your career.
Total compensation range for this position: $188,000-$250,000 USD per year.
Start Date :ASAP
Our Story:
AtMeltwater, we believe that when you have the right people in the right environment, great things happen.
Our best-in-class technology empowers our 27,000 customersaround
the world to make better business decisions through data. But we can't do that without our global team of developers, innovators, problem-solvers, and high-performers who embrace challenges and find new solutions for our customers.
Our award-winning global culture drives everything we do and creates
an environment where our employees can make an impact, learn every day, feel a sense of belonging, and celebrate each other's successes along
the way.
We are innovators at the core who see the potential in people, ideas and technologies. Together, we challenge ourselves to go big, be bold, and build best-in-class solutions for our customers.
We're proud of our diverse team of 2,200+ employeesin50 locationsacross
25 countriesaround the world. No matter where you are, you'll work with people who care about your success and get the support you need to unlock new heights in your career.
We are Meltwater. Inspired by innovation, powered by people.
Equal Employment Opportunity Statement
Meltwater is an Equal Opportunity Employer and Prohibits Discrimination and Harassment of Any Kind: At Meltwater, we are dedicated to fostering an inclusive and diverse workplace where every employee feels valued, respected, and empowered. We are committed to the principle of equal employment opportunity and strive to provide a work environment that is free from discrimination and harassment.
All employment decisions at Meltwater are made based on business needs, job requirements, and individual qualifications, without regard to race, color, religion or belief, gender, gender identity or expression, sexual orientation, national origin, genetics, disability, age, marital status, veteran status, or any other status protected by the applicable laws and regulations.
Meltwater does not tolerate discrimination or harassment of any kind, and we actively promote a culture of respect, fairness, and inclusivity. We encourage applicants of all backgrounds, experiences, and abilities to apply and join us in our mission to drive innovation and make a positive impact in the world.
We may use AI to assist in aspects of our hiring process, such as reviewing candidate information, capturing interview notes, and supporting interview activities. These tools are used only to assist our team through increased efficiencies. Every output continues to be reviewed by humans, and all hiring decisions are made by humans. We remain committed to evaluating candidates fairly, consistently, and in compliance with all applicable laws
About Meltwater
Sourced by ZipRecruiter
Industry
It services
Company size
1,001 - 5,000 Employees
Headquarters location
San Francisco, CA, US
Year founded
2001