ZipRecruiter

Log In

1

Llm Backend Engineer Jobs in Washington (NOW HIRING)

Smart Synergies

Agentic AI Engineer

Reston, VA · On-site

$127K - $168K/yr

... back-end engineering fundamentals.   Major Responsibilities * Build Generative AI & Retrieval-Augmented Generation LLM Applications * Build LLM-powered applications for text generation ...

The Atlantic

Senior Engineer

Washington, DC

$115K - $140K/yr

Strong backend programming ability and comfort with general DevOps work (CI/CD, infrastructure-as ... Experience securing agentic and LLM-driven workflows against over-access, data exfiltration, and ...

Atlantic Media

Senior Engineer

Washington, DC · On-site

$115 - $140/hr

... and LLM-driven workflows against over-access, data exfiltration, and backdoors Experience ... Contribute to general DevOps and backend engineering across company-wide architecture The role will ...

next page

Showing results 1-20

All JobsLlm Backend Engineer JobsLlm Backend Engineer Jobs in Washington

Llm Backend Engineer information

What is an LLM backend engineer?

LLM Backend Engineers are software engineers who specialize in designing, building, and optimizing the backend infrastructure that supports large language models (LLMs) like GPT-4. They focus on integrating LLMs into products and services, ensuring scalable APIs, managing data pipelines, and optimizing inference performance. Their work often involves deploying models in cloud environments, monitoring system reliability, and collaborating with AI researchers to bring advancements into production. LLM Backend Engineers play a critical role in making AI-powered applications robust, efficient, and accessible to end users.

What are the key skills and qualifications needed to thrive as an LLM backend engineer?

To thrive as an LLM Backend Engineer, you need a solid foundation in software engineering, backend architecture, and experience working with large language models, typically supported by a degree in computer science or a related field. Proficiency with programming languages like Python or Java, cloud platforms (AWS, GCP, Azure), and machine learning frameworks such as TensorFlow or PyTorch is essential, along with familiarity with APIs and containerization tools like Docker or Kubernetes. Strong problem-solving, collaboration, and communication skills distinguish top performers in this role. These skills ensure robust, scalable, and efficient deployment of LLM-powered applications while enabling effective teamwork and innovation.

What are some common challenges faced by LLM backend engineers when deploying large language models in production?

LLM Backend Engineers often encounter challenges such as optimizing inference latency, managing high resource consumption, and ensuring scalability for production workloads. Balancing model performance with cost efficiency requires careful selection of hardware, batching strategies, and model quantization techniques. Additionally, they must address security and privacy concerns associated with handling sensitive data processed by the models. Collaboration with data scientists and DevOps teams is essential to streamline model updates and monitor system health.

What are popular job titles related to Llm Backend Engineer jobs in Washington?

For Llm Backend Engineer jobs in Washington, the most frequently searched job titles are:

What job categories do people searching Llm Backend Engineer jobs in Washington look for?

The top searched job categories for Llm Backend Engineer jobs in Washington are:

What cities in Washington are hiring for Llm Backend Engineer jobs?

Cities in Washington with the most Llm Backend Engineer job openings:

Llm Backend Engineer jobs near you
Infographic showing various Llm Backend Engineer job openings in Washington as of August 2026, with employment types broken down into 95% Full Time, 2% Part Time, and 3% Contract. Highlights an 77% Physical, 4% Hybrid, and 19% Remote job distribution.

Senior Backend Engineer

Software Guidance & Assistance

Rockville, MD • On-site

Other

Re-posted 23 days ago

Job description

Software Guidance & Assistance, Inc., (SGA), is searching for a Senior Backend Engineer for a CONTRACT assignment with one of our premier Regulatory clients. This position is hybrid (3 days/week) in Rockville, MD, Tysons, VA, or NJ/NY areas.
You'll build backend systems for a platform that helps financial analysts monitor U.S. market integrity. The role involves creating user-friendly tools powered by one of the largest financial regulatory datasets in the cloud, processing billions of daily market events. This is a greenfield architecture opportunity with strong work-life balance. As a Senior Backend Engineer, you'll lead through excellent code, solve complex problems, set high standards, and drive innovation. The role requires technical excellence with effective communication, stakeholder influence, and genuine passion for the mission.
Responsibilities :
  • Design, develop, test, implement, and support technical solutions within an Agile development environment, utilizing distributed microservices architecture, big-data technologies (HIVE, Presto, Spark, Hadoop), and full-stack systems
  • Partner with cross-functional teams to understand application requirements and testing scenarios, delivering scalable technical solutions that meet business objectives
  • Build and maintain high-performance API platforms on AWS infrastructure, enabling interactive-speed access to big data while adhering to AWS Well-Architected Framework principles
  • Leverage AI tools and technologies to enhance development efficiency, code quality, and solution innovation throughout the software development lifecycle
  • Drive technical innovation by staying current with emerging technology trends, including AI/ML advancements, evaluating new tools and frameworks, and actively contributing to internal and external technology communities
  • Demonstrate a growth mindset, take ownership of deliverables, maintain customer-centric focus, and exercise sound technical judgment in decision-making
Required Skills :
  • Bachelor's degree in computer science, Information Technology, Engineering, or related technical field
  • 8+ years of professional software engineering experience with demonstrated leadership capabilities
  • 3+ years of hands-on development experience in Java, JavaScript/TypeScript, or SQL
  • 2+ years developing REST/web services and writing complex SQL queries for relational databases
  • 3+ years working with big data technologies such as Hadoop, Spark, or Presto
  • Proven experience with AWS services including EMR (Hive/Presto), ECS, Lambda, and S3
  • Proficiency with DevOps practices and CI/CD pipelines using tools like Jenkins and CloudFormation
  • Working knowledge of scripting languages including Unix Shell or Python
  • Experience using LLM-based coding tools with a disciplined approach to validating output - you don't merge what you can't explain
SGA is a technology and resource solutions provider driven to stand out. We are a women-owned business. Our mission: to solve big IT problems with a more personal, boutique approach. Each year, we match consultants like you to more than 1,000 engagements. When we say let's work better together, we mean it. You'll join a diverse team built on these core values: customer service, employee development, and quality and integrity in everything we do. Be yourself, love what you do and find your passion at work. Please find us at .
SGA is an Equal Opportunity Employer and does not discriminate on the basis of Race, Color, Sex, Sexual Orientation, Gender Identity, Religion, National Origin, Disability, Veteran Status, Age, Marital Status, Pregnancy, Genetic Information, or Other Legally Protected Status. We are committed to providing access, equal opportunity, and reasonable accommodation for individuals with disabilities in employment, and our services, programs, and activities. Please visit our company to request an accommodation or assistance regarding our policy.

Apply