ZipRecruiter

Log In

1

Llm Backend Engineer Jobs in Washington (NOW HIRING)

The Atlantic Monthly Group

Senior Engineer

Washington, DC · On-site

$115K - $140K/yr

Strong backend programming ability and comfort with general DevOps work (CI/CD, infrastructure-as ... Experience securing agentic and LLM-driven workflows against over-access, data exfiltration, and ...

Strategio Inc.

Senior Software Engineer

Columbia, MD · On-site

$90 - $130/hr

You bring strong backend engineering capabilities, modern frontend expertise, and hands‑on ... Implement Generative AI solutions including LLM integrations, prompt engineering, and RAG pipelines

Knak Digital

Full Stack Engineer

Washington, DC · On-site

$120/hr

Build features across the front end, backend services, and geospatial data stores that support ... exposure to LLM or agentic development workflows, and cloud/container experience with Docker ...

Knak Digital

Full Stack Engineer

Washington, DC · On-site +1

$120/hr

Build features across the front end, backend services, and geospatial data stores that support ... exposure to LLM or agentic development workflows, and cloud/container experience with Docker ...

New

Hexaware Technologies, Inc

AI Engineer

Reston, VA · On-site

The ideal candidate is a hands-on engineer with strong Python backend development skills, practical ... Features GenAI/LLM integration AI-assisted model insight generation Chatbot integration Prompt ...

Tata Consultancy Service Limited

Engineer

Mclean, VA · On-site

$100K - $120K/yr

Build, fine-tune, and optimize LLM-based applications, ensuring high accuracy, reliability, and ... Work with APIs, microservices, and backend systems to embed GenAI features into applications at ...

Rackner

R&D DevSecOps Engineer

Washington, DC · Remote

What You'll Do * Build backend services, APIs, data workflows, and AI-enabled applications ... Develop model-agnostic coding agents and LLM workflows with human approval, prompt history ...

Trilagen

Agentic AI Engineer

Bethesda, MD · On-site

We need engineer's who can own the entire agent stack: a production frontend, a robust backend, a properly secured API and identity layer, a memory architecture that scales, and LLM integrations that ...

Trilagen

Agentic AI Engineer

Bethesda, MD · On-site

We need engineer's who can own the entire agent stack: a production frontend, a robust backend, a properly secured API and identity layer, a memory architecture that scales, and LLM integrations that ...

Trilagen

Agentic AI Engineer

Mclean, VA · On-site

We need engineer's who can own the entire agent stack: a production frontend, a robust backend, a properly secured API and identity layer, a memory architecture that scales, and LLM integrations that ...

Trilagen

Agentic AI Engineer

Mclean, VA · On-site

We need engineer's who can own the entire agent stack: a production frontend, a robust backend, a properly secured API and identity layer, a memory architecture that scales, and LLM integrations that ...

previous pagenext page

Showing results 21-40

All JobsLlm Backend Engineer JobsLlm Backend Engineer Jobs in Washington

Llm Backend Engineer information

What is an LLM backend engineer?

LLM Backend Engineers are software engineers who specialize in designing, building, and optimizing the backend infrastructure that supports large language models (LLMs) like GPT-4. They focus on integrating LLMs into products and services, ensuring scalable APIs, managing data pipelines, and optimizing inference performance. Their work often involves deploying models in cloud environments, monitoring system reliability, and collaborating with AI researchers to bring advancements into production. LLM Backend Engineers play a critical role in making AI-powered applications robust, efficient, and accessible to end users.

What are the key skills and qualifications needed to thrive as an LLM backend engineer?

To thrive as an LLM Backend Engineer, you need a solid foundation in software engineering, backend architecture, and experience working with large language models, typically supported by a degree in computer science or a related field. Proficiency with programming languages like Python or Java, cloud platforms (AWS, GCP, Azure), and machine learning frameworks such as TensorFlow or PyTorch is essential, along with familiarity with APIs and containerization tools like Docker or Kubernetes. Strong problem-solving, collaboration, and communication skills distinguish top performers in this role. These skills ensure robust, scalable, and efficient deployment of LLM-powered applications while enabling effective teamwork and innovation.

What are some common challenges faced by LLM backend engineers when deploying large language models in production?

LLM Backend Engineers often encounter challenges such as optimizing inference latency, managing high resource consumption, and ensuring scalability for production workloads. Balancing model performance with cost efficiency requires careful selection of hardware, batching strategies, and model quantization techniques. Additionally, they must address security and privacy concerns associated with handling sensitive data processed by the models. Collaboration with data scientists and DevOps teams is essential to streamline model updates and monitor system health.

What are popular job titles related to Llm Backend Engineer jobs in Washington?

For Llm Backend Engineer jobs in Washington, the most frequently searched job titles are:

What job categories do people searching Llm Backend Engineer jobs in Washington look for?

The top searched job categories for Llm Backend Engineer jobs in Washington are:

What cities in Washington are hiring for Llm Backend Engineer jobs?

Cities in Washington with the most Llm Backend Engineer job openings:

Llm Backend Engineer jobs near you
Infographic showing various Llm Backend Engineer job openings in Washington as of August 2026, with employment types broken down into 95% Full Time, 2% Part Time, and 3% Contract. Highlights an 77% Physical, 4% Hybrid, and 19% Remote job distribution.

Senior Engineer

The Atlantic Monthly Group

Washington, DC • On-site

$115K - $140K/yr

Full-time

Posted 15 days ago

Job description

The Atlantic is looking for a hands-on Senior Engineer to help us deliver industry-leading security across our applications and services. We aim to support a more thoughtful American public by powering and expanding our Pulitzer Prize-winning journalism - and we want the products we ship to be worthy of that mission.
This is a unique opportunity to contribute to innovative, high-profile projects: you will configure, program, and integrate advanced security systems, working closely with engineering teams to keep our platforms seamless, secure, and reliable.
Minimum Qualifications:
  • 5+ years of software engineering experience, with significant hands-on work in security engineering
  • Strong backend programming ability and comfort with general DevOps work (CI/CD, infrastructure-as-code, cloud platforms)
  • Deep understanding of secure software design and modern application security practices, including zero trust principles
  • Hands-on experience with IAM, WAFs, and secure data access controls
  • A track record of owning security incidents end to end - triage, root cause, and durable fixes

Preferred Qualifications:
  • Experience securing agentic and LLM-driven workflows against over-access, data exfiltration, and backdoors
  • Experience developing security tooling and automation
  • Familiarity with major cloud providers (AWS, GCP, or Azure) and an infrastructure-as-code tool (Terraform or similar)
  • Background in consumer-facing web or mobile products
  • Experience using observability and monitoring tools (Datadog, Sentry) as security and quality signals in production
  • Familiarity with threat modeling and secure-by-design architecture

As The Atlantic's Senior Security Engineer, you will:
  • Partner with engineering teams to architect applications with security and data protection built in from the start, including zero trust networking and secure data access controls
  • Review architecture diagrams, code, and proposals to spot security issues before they ship
  • Secure agentic and LLM-driven workflows to prevent over-access, data exfiltration, and backdoors
  • Work with Operations to stand up and tune WAFs and IAM
  • Develop tooling that makes it easier to secure our applications and company data
  • Triage security incidents, identify root causes, and build solutions that prevent recurrence
  • Participate in on-call rotation (outside of standard business hours) to monitor, troubleshoot, and resolve production incidents, ensuring system reliability and uptime.
  • Contribute to general DevOps and backend engineering across company-wide architecture
  • The role will at times include night, early-morning, and weekend work.

As The Atlantic's Senior Security Engineer, you are:
  • A builder, deep and broad: This is fundamentally an engineering role - you'd rather build, architect, and solve hard technical problems than manage a checklist. You're equally at home in backend code, infrastructure, and DevOps, and you measure your impact in systems shipped and risks eliminated, not tickets tracked.
  • Security-minded by design: You think like an attacker, architect defensively, and build security into systems rather than bolting it on afterward.
  • AI-fluent: You understand how agentic and LLM-driven systems create new categories of security risk, and you're excited to work out how to secure them.
  • A collaborator: You embed naturally with engineering teams and help them build securely by partnering on solutions - earning trust rather than enforcing from the outside.
  • Pragmatic: You balance strong security with the need to ship, and you gravitate toward the simplest solution that genuinely reduces risk.
  • A strong communicator: You can articulate security risk and tradeoffs clearly to both engineers and non-technical stakeholders.
  • An interest in the pursuit of truth: You believe in what The Atlantic does and want the products we ship to reflect that.

Salary minimum: $115,000; Salary maximum: $140,000
This role is based in Washington, D.C.
This is a Guild position.
About The Atlantic:
The Atlantic has, for more than 160 years, advanced ideas that matter and sparked global conversation on the most important issues of our time. We aim to bring clarity and original thinking to questions of consequence, on topics ranging from politics, the economy, and global affairs to technology, science, and culture. As the third-longest-running magazine in America, we find ourselves at a remarkable moment: one of both continuation and transformation, of upholding our legacy while continuously reinventing ourselves for the future.
The Atlantic Monthly Group LLC ("The Atlantic") is an Equal Opportunity Employer. The Atlantic is committed to diversity and encourages members of traditionally underrepresented communities to apply, including women, LGBTQ people, people of color, and people with disabilities. We do not discriminate against our applicants because of race, color, religion, sex (including gender identity, sexual orientation, and pregnancy), national origin, age, disability, veteran status, genetic information, or any other status protected by applicable law.
Job offers to work at The Atlantic are contingent upon the candidate's successful completion of reference checks and compliance with The Atlantic's COVID-19 vaccination policy. The Atlantic requires all employees to be vaccinated against COVID-19, including subsequent boosters, and submit proof of vaccination status. Employees who cannot receive the vaccine because of a disability/medical contraindication or sincerely-held religious belief may request an accommodation (e.g., an exemption) to this requirement.

Apply