ZipRecruiter

Log In

1

Llm Backend Engineer Jobs in Reston, VA (NOW HIRING)

Booz Allen Hamilton

AI Software Engineer

Washington, DC · On-site

Build LLM-powered features including prompt orchestration, RAG pipelines, grounding and evaluation ... Design and implement backend features end-to-end, including APIs, integrations with data sources ...

B5 Recruiting

AI Engineer

Washington, DC

AI Developer -- Generative AI / LLM Engineering Employment Type: Full-Time - Washington, DC ... Build and maintain backend APIs in Python (FastAPI preferred) * Deploy to Azure cloud (App Services ...

next page

Showing results 1-20

People also search for

All JobsLlm Backend Engineer JobsLlm Backend Engineer Jobs in Reston, VA

Llm Backend Engineer information

See Reston, VA salary details

$62.9K

$153.6K

$207K

How much do llm backend engineer jobs pay per year?

As of May 30, 2026, the average yearly pay for llm backend engineer in Reston, VA is $153,620.00, according to ZipRecruiter salary data. Most workers in this role earn between $129,000.00 and $178,900.00 per year, depending on experience, location, and employer.

What are the key skills and qualifications needed to thrive as an LLM Backend Engineer, and why are they important?

To thrive as an LLM Backend Engineer, you need a solid foundation in software engineering, backend architecture, and experience working with large language models, typically supported by a degree in computer science or a related field. Proficiency with programming languages like Python or Java, cloud platforms (AWS, GCP, Azure), and machine learning frameworks such as TensorFlow or PyTorch is essential, along with familiarity with APIs and containerization tools like Docker or Kubernetes. Strong problem-solving, collaboration, and communication skills distinguish top performers in this role. These skills ensure robust, scalable, and efficient deployment of LLM-powered applications while enabling effective teamwork and innovation.

What are some common challenges faced by LLM Backend Engineers when deploying large language models in production?

LLM Backend Engineers often encounter challenges such as optimizing inference latency, managing high resource consumption, and ensuring scalability for production workloads. Balancing model performance with cost efficiency requires careful selection of hardware, batching strategies, and model quantization techniques. Additionally, they must address security and privacy concerns associated with handling sensitive data processed by the models. Collaboration with data scientists and DevOps teams is essential to streamline model updates and monitor system health.

What are LLM Backend Engineers?

LLM Backend Engineers are software engineers who specialize in designing, building, and optimizing the backend infrastructure that supports large language models (LLMs) like GPT-4. They focus on integrating LLMs into products and services, ensuring scalable APIs, managing data pipelines, and optimizing inference performance. Their work often involves deploying models in cloud environments, monitoring system reliability, and collaborating with AI researchers to bring advancements into production. LLM Backend Engineers play a critical role in making AI-powered applications robust, efficient, and accessible to end users.
What are popular job titles related to Llm Backend Engineer jobs in Reston, VA? For Llm Backend Engineer jobs in Reston, VA, the most frequently searched job titles are:
What job categories do people searching Llm Backend Engineer jobs in Reston, VA look for? The top searched job categories for Llm Backend Engineer jobs in Reston, VA are:
What cities near Reston, VA are hiring for Llm Backend Engineer jobs? Cities near Reston, VA with the most Llm Backend Engineer job openings:
Llm Backend Engineer jobs near you
Infographic showing various Llm Backend Engineer job openings in Reston, VA as of May 2026, with employment types broken down into 100% Full Time. Highlights an 86% Physical, and 14% Remote job distribution, with an average salary of $153,620 per year, or $73.9 per hour.
Sr. Backend Engineer

Sr. Backend Engineer

Software Guidance & Assistance

Rockville, MD

Other

Posted 29 days ago

Job description

Software Guidance & Assistance, Inc., (SGA), is searching for a Senior Backend Engineer for a CONTRACT assignment with one of our premier Regulatory clients in the DMV or NY/NJ areas.
You'll build backend systems for a platform that helps financial analysts monitor U.S. market integrity. The role involves creating user-friendly tools powered by one of the largest financial regulatory datasets in the cloud, processing billions of daily market events. This is a greenfield architecture opportunity with strong work-life balance. As a Senior Backend Engineer, you'll lead through excellent code, solve complex problems, set high standards, and drive innovation. The role requires technical excellence with effective communication, stakeholder influence, and genuine passion for the mission.
Responsibilities:
  • Design, develop, test, implement, and support technical solutions within an Agile development environment, utilizing distributed microservices architecture, big-data technologies (HIVE, Presto, Spark, Hadoop), and full-stack systems
  • Partner with cross-functional teams to understand application requirements and testing scenarios, delivering scalable technical solutions that meet business objectives
  • Build and maintain high-performance API platforms on AWS infrastructure, enabling interactive-speed access to big data while adhering to AWS Well-Architected Framework principles
  • Leverage AI tools and technologies to enhance development efficiency, code quality, and solution innovation throughout the software development lifecycle
  • Drive technical innovation by staying current with emerging technology trends, including AI/ML advancements, evaluating new tools and frameworks, and actively contributing to internal and external technology communities
  • Demonstrate a growth mindset, take ownership of deliverables, maintain customer-centric focus, and exercise sound technical judgment in decision-making
Required Skills:
  • Bachelor's degree in computer science, Information Technology, Engineering, or related technical field
  • 8+ years of professional software engineering experience with demonstrated leadership capabilities
  • 3+ years of hands-on development experience in Java, JavaScript/TypeScript, or SQL
  • 2+ years developing REST/web services and writing complex SQL queries for relational databases
  • 3+ years working with big data technologies such as Hadoop, Spark, or Presto
  • Proven experience with AWS services including EMR (Hive/Presto), ECS, Lambda, and S3
  • Proficiency with DevOps practices and CI/CD pipelines using tools like Jenkins and CloudFormation
  • Working knowledge of scripting languages including Unix Shell or Python
  • Experience using LLM-based coding tools with a disciplined approach to validating output - you don't merge what you can't explain
SGA is a technology and resource solutions provider driven to stand out. We are a women-owned business. Our mission: to solve big IT problems with a more personal, boutique approach. Each year, we match consultants like you to more than 1,000 engagements. When we say let's work better together, we mean it. You'll join a diverse team built on these core values: customer service, employee development, and quality and integrity in everything we do. Be yourself, love what you do and find your passion at work. Please find us at .
SGA is an Equal Opportunity Employer and does not discriminate on the basis of Race, Color, Sex, Sexual Orientation, Gender Identity, Religion, National Origin, Disability, Veteran Status, Age, Marital Status, Pregnancy, Genetic Information, or Other Legally Protected Status. We are committed to providing access, equal opportunity, and reasonable accommodation for individuals with disabilities in employment, and our services, programs, and activities. Please visit our company to request an accommodation or assistance regarding our policy.

Apply