ZipRecruiter

Log In

1

Llm Backend Engineer Jobs in Washington (NOW HIRING)

Cisco

Software Engineer, Backend

Mclean, VA · On-site

$155K - $222K/yr

Experienceutilizingautomated testing frameworks and LLM-based coding assistants within the software development lifecycle. Preferred Qualifications * Programming experience in Rust, Scala, Python.

Cisco

Software Engineer, Backend

Arlington, VA · On-site

$155K - $222K/yr

Experienceutilizingautomated testing frameworks and LLM-based coding assistants within the software development lifecycle. Preferred Qualifications * Programming experience in Rust, Scala, Python.

Cisco

Software Engineer, Backend

Fulton, MD · On-site

$155K - $222K/yr

Experienceutilizingautomated testing frameworks and LLM-based coding assistants within the software development lifecycle. Preferred Qualifications * Programming experience in Rust, Scala, Python.

Cisco

Software Engineer, Backend

Washington, DC · On-site

$155K - $222K/yr

Experienceutilizingautomated testing frameworks and LLM-based coding assistants within the software development lifecycle. Preferred Qualifications * Programming experience in Rust, Scala, Python.

Cisco

Software Engineer, Backend

Reston, VA · On-site

$155K - $222K/yr

Experienceutilizingautomated testing frameworks and LLM-based coding assistants within the software development lifecycle. Preferred Qualifications * Programming experience in Rust, Scala, Python.

Cisco

Software Engineer, Backend

Rockville, MD · On-site

$155K - $222K/yr

Experienceutilizingautomated testing frameworks and LLM-based coding assistants within the software development lifecycle. Preferred Qualifications * Programming experience in Rust, Scala, Python.

Cisco

Software Engineer, Backend

Ashburn, VA · On-site

$155K - $222K/yr

Experienceutilizingautomated testing frameworks and LLM-based coding assistants within the software development lifecycle. Preferred Qualifications * Programming experience in Rust, Scala, Python.

Cisco

Software Engineer, Backend

Herndon, VA · On-site

$155K - $222K/yr

Experienceutilizingautomated testing frameworks and LLM-based coding assistants within the software development lifecycle. Preferred Qualifications * Programming experience in Rust, Scala, Python.

Cisco

Software Engineer, Backend

Annapolis Junction, MD · On-site

$155K - $222K/yr

Experienceutilizingautomated testing frameworks and LLM-based coding assistants within the software development lifecycle. Preferred Qualifications * Programming experience in Rust, Scala, Python.

next page

Showing results 1-20

All JobsLlm Backend Engineer JobsLlm Backend Engineer Jobs in Washington

Llm Backend Engineer information

What are some common challenges faced by LLM backend engineers when deploying large language models in production?

LLM Backend Engineers often encounter challenges such as optimizing inference latency, managing high resource consumption, and ensuring scalability for production workloads. Balancing model performance with cost efficiency requires careful selection of hardware, batching strategies, and model quantization techniques. Additionally, they must address security and privacy concerns associated with handling sensitive data processed by the models. Collaboration with data scientists and DevOps teams is essential to streamline model updates and monitor system health.

What is an LLM backend engineer?

LLM Backend Engineers are software engineers who specialize in designing, building, and optimizing the backend infrastructure that supports large language models (LLMs) like GPT-4. They focus on integrating LLMs into products and services, ensuring scalable APIs, managing data pipelines, and optimizing inference performance. Their work often involves deploying models in cloud environments, monitoring system reliability, and collaborating with AI researchers to bring advancements into production. LLM Backend Engineers play a critical role in making AI-powered applications robust, efficient, and accessible to end users.

What are the key skills and qualifications needed to thrive as an LLM backend engineer?

To thrive as an LLM Backend Engineer, you need a solid foundation in software engineering, backend architecture, and experience working with large language models, typically supported by a degree in computer science or a related field. Proficiency with programming languages like Python or Java, cloud platforms (AWS, GCP, Azure), and machine learning frameworks such as TensorFlow or PyTorch is essential, along with familiarity with APIs and containerization tools like Docker or Kubernetes. Strong problem-solving, collaboration, and communication skills distinguish top performers in this role. These skills ensure robust, scalable, and efficient deployment of LLM-powered applications while enabling effective teamwork and innovation.
What are popular job titles related to Llm Backend Engineer jobs in Washington? For Llm Backend Engineer jobs in Washington, the most frequently searched job titles are:
What job categories do people searching Llm Backend Engineer jobs in Washington look for? The top searched job categories for Llm Backend Engineer jobs in Washington are:
What cities in Washington are hiring for Llm Backend Engineer jobs? Cities in Washington with the most Llm Backend Engineer job openings:
Llm Backend Engineer jobs near you
Infographic showing various Llm Backend Engineer job openings in Washington as of August 2026, with employment types broken down into 75% Full Time, and 25% Contract. Highlights an 75% In-person, and 25% Remote job distribution.

Backend Software Engineer - GenAI

Rune Technologies

Arlington, VA • On-site

Full-time

Re-posted 18 days ago

Job description

Job Summary:
Rune Technologies builds mission-critical software for military logistics and sustainment, aiming to modernize the logistics technology backbone for U.S. and allied militaries. As a Backend Software Engineer focused on GenAI systems, you will design and implement production-grade AI systems to enhance the logistics domain, collaborating with a team of engineers and military stakeholders.
Responsibilities:
• Design, build, and deploy production-grade GenAI systems -- including RAG architectures, vector databases, LLM integrations, and tool-call frameworks -- in support of Saga, Rune's AI agentic product layer.
• Build and maintain evaluation and testing harnesses to validate LLM output quality and catch regressions in production.
• Collaborate with the broader platform and product teams to integrate AI capabilities into TyrOS workflows.
• Participate in technical design discussions and code reviews, contributing to a culture of engineering rigor and mission focus.
• Triage and debug issues in production, ensuring reliability and rapid iteration in support of operational needs.
• Work closely with engineers, product managers, and military stakeholders to ensure AI systems meet real-world sustainment requirements.
Qualifications:
Required:
• 4+ years of experience in software engineering, with a strong backend foundation -- distributed systems, APIs, production-grade software.
• Hands-on experience building GenAI systems: vector databases, LLM integration, RAG architectures, and evaluation harnesses for LLM output.
• Familiarity with tool routing, tool-call validation, and common LLM failure modes.
• Understanding of the science underlying the systems you build -- not just how to wire them together, but why they work and where they break.
• Background at an AI-native company, or a clear transition from backend engineering into AI specialization.
• Strong sense of ownership and a bias for action.
Preferred:
• Experience with fine-tuning or model evaluation workflows.
• Familiarity with AI infrastructure: embedding pipelines and inference optimization.
• Experience working on software in defense, aerospace, or other complex operational domains.
• Experience deploying software to production environments, including cloud (AWS, Kubernetes) and edge infrastructure.
Company:
Rune Technologies develops AI-enabled predictive logistics solutions for military operations. Founded in 2024, the company is headquartered in Arlington, USA, with a team of 51-200 employees. The company is currently Growth Stage.

Apply