ZipRecruiter

Log In

1

Llm Backend Engineer Jobs in Reston, VA (NOW HIRING)

Hexaware Technologies, Inc

AI Engineer

Reston, VA · On-site

The ideal candidate is a hands-on engineer with strong Python backend development skills, practical ... Features GenAI/LLM integration AI-assisted model insight generation Chatbot integration Prompt ...

next page

Showing results 1-20

All JobsLlm Backend Engineer JobsLlm Backend Engineer Jobs in Reston, VA

Llm Backend Engineer information

See Reston, VA salary details

$62.9K

$153.6K

$207K

How much do llm backend engineer jobs pay per year?

As of Aug 12, 2026, the average yearly pay for llm backend engineer in Reston, VA is $153,620.00, according to ZipRecruiter salary data. Most workers in this role earn between $129,000.00 and $178,900.00 per year, depending on experience, location, and employer.

What are some common challenges faced by LLM backend engineers when deploying large language models in production?

LLM Backend Engineers often encounter challenges such as optimizing inference latency, managing high resource consumption, and ensuring scalability for production workloads. Balancing model performance with cost efficiency requires careful selection of hardware, batching strategies, and model quantization techniques. Additionally, they must address security and privacy concerns associated with handling sensitive data processed by the models. Collaboration with data scientists and DevOps teams is essential to streamline model updates and monitor system health.

What is an LLM backend engineer?

LLM Backend Engineers are software engineers who specialize in designing, building, and optimizing the backend infrastructure that supports large language models (LLMs) like GPT-4. They focus on integrating LLMs into products and services, ensuring scalable APIs, managing data pipelines, and optimizing inference performance. Their work often involves deploying models in cloud environments, monitoring system reliability, and collaborating with AI researchers to bring advancements into production. LLM Backend Engineers play a critical role in making AI-powered applications robust, efficient, and accessible to end users.

What are the key skills and qualifications needed to thrive as an LLM backend engineer?

To thrive as an LLM Backend Engineer, you need a solid foundation in software engineering, backend architecture, and experience working with large language models, typically supported by a degree in computer science or a related field. Proficiency with programming languages like Python or Java, cloud platforms (AWS, GCP, Azure), and machine learning frameworks such as TensorFlow or PyTorch is essential, along with familiarity with APIs and containerization tools like Docker or Kubernetes. Strong problem-solving, collaboration, and communication skills distinguish top performers in this role. These skills ensure robust, scalable, and efficient deployment of LLM-powered applications while enabling effective teamwork and innovation.
What are popular job titles related to Llm Backend Engineer jobs in Reston, VA? For Llm Backend Engineer jobs in Reston, VA, the most frequently searched job titles are:
What job categories do people searching Llm Backend Engineer jobs in Reston, VA look for? The top searched job categories for Llm Backend Engineer jobs in Reston, VA are:
What cities near Reston, VA are hiring for Llm Backend Engineer jobs? Cities near Reston, VA with the most Llm Backend Engineer job openings:
Llm Backend Engineer jobs near you
Infographic showing various Llm Backend Engineer job openings in Reston, VA as of August 2026, with employment types broken down into 86% Full Time, 9% Part Time, and 5% Contract. Highlights an 86% Physical, 5% Hybrid, and 9% Remote job distribution, with an average salary of $153,620 per year, or $73.9 per hour.

Backend Software Engineer - GenAI

Rune Technologies

Arlington, VA • On-site

Full-time

Re-posted 20 days ago

Job description

Job Summary:
Rune Technologies builds mission-critical software for military logistics and sustainment, aiming to modernize the logistics technology backbone for U.S. and allied militaries. As a Backend Software Engineer focused on GenAI systems, you will design and implement production-grade AI systems to enhance the logistics domain, collaborating with a team of engineers and military stakeholders.
Responsibilities:
• Design, build, and deploy production-grade GenAI systems -- including RAG architectures, vector databases, LLM integrations, and tool-call frameworks -- in support of Saga, Rune's AI agentic product layer.
• Build and maintain evaluation and testing harnesses to validate LLM output quality and catch regressions in production.
• Collaborate with the broader platform and product teams to integrate AI capabilities into TyrOS workflows.
• Participate in technical design discussions and code reviews, contributing to a culture of engineering rigor and mission focus.
• Triage and debug issues in production, ensuring reliability and rapid iteration in support of operational needs.
• Work closely with engineers, product managers, and military stakeholders to ensure AI systems meet real-world sustainment requirements.
Qualifications:
Required:
• 4+ years of experience in software engineering, with a strong backend foundation -- distributed systems, APIs, production-grade software.
• Hands-on experience building GenAI systems: vector databases, LLM integration, RAG architectures, and evaluation harnesses for LLM output.
• Familiarity with tool routing, tool-call validation, and common LLM failure modes.
• Understanding of the science underlying the systems you build -- not just how to wire them together, but why they work and where they break.
• Background at an AI-native company, or a clear transition from backend engineering into AI specialization.
• Strong sense of ownership and a bias for action.
Preferred:
• Experience with fine-tuning or model evaluation workflows.
• Familiarity with AI infrastructure: embedding pipelines and inference optimization.
• Experience working on software in defense, aerospace, or other complex operational domains.
• Experience deploying software to production environments, including cloud (AWS, Kubernetes) and edge infrastructure.
Company:
Rune Technologies develops AI-enabled predictive logistics solutions for military operations. Founded in 2024, the company is headquartered in Arlington, USA, with a team of 51-200 employees. The company is currently Growth Stage.

Apply