Litellm

60 Litellm Jobs Hiring Near You

Senior Software Engineer, AI Transformation

$125K - $165K/yr

Implement and evolve inference and tool-calling pathways using Claude models on Amazon Bedrock, LiteLLM, and MCP/tool gateways within Omada's secure networks. * Partner with teams across Engineering ...

Be Seen First

Create and manage teams in LiteLLM, user accounts, API keys, roles, quotas, budgets, and permissions. * Configure platform settings to support Laboratory security, governance, and operational ...

New

Familiarity with LiteLLM or multi-LLM routing frameworks. Working knowledge of Java and Unix/Linux environments. Experience with CI/CD and Agile/DevOps practices.

Senior Software Engineer, AI Transformation

$125K - $165K/yr

Implement and evolve inference and tool-calling pathways using Claude models on Amazon Bedrock, LiteLLM, and MCP/tool gateways within Omada's secure networks. * Partner with teams across Engineering ...

AI Platform Engineer, Senior

Laurel, MD · On-site

$104K - $142K/yr

... LiteLLM • Experience with agentic frameworks, including LangChain • Experience with vector databases and embedding systems • Experience with high-performance computing or distributed systems ...

AI Platform Engineer, Senior

Laurel, MD · On-site

$104K - $142K/yr

... LiteLLM • Experience with agentic frameworks, including LangChain • Experience with vector databases and embedding systems • Experience with high-performance computing or distributed systems ...

... LiteLLM, or similar • Working knowledge of at least one evaluation system • Understanding of Agentic best practices • Experience implementing MCP Servers/Clients • Experience with Postgres ...

Preferred : • Familiarity with FastAPI, OpenAI APIs, Baseten, LiteLLM, LiveKit, PostgreSQL, Redis, and S3 is a plus. Company : Welcome to Catalyst Labs - Powering Catalytic Growth At Catalyst Labs ...

Preferred : • Familiarity with FastAPI, OpenAI APIs, Baseten, LiteLLM, LiveKit, PostgreSQL, Redis, and S3 is a plus. Company : Welcome to Catalyst Labs - Powering Catalytic Growth At Catalyst Labs ...

Preferred : • Familiarity with FastAPI, OpenAI APIs, Baseten, LiteLLM, LiveKit, PostgreSQL, Redis, and S3 is a plus. Company : Welcome to Catalyst Labs - Powering Catalytic Growth At Catalyst Labs ...

Showing results 41-60

Litellm Jobs Information

Infographic showing various job openings at Litellm in the United States as of August 2026, with employment types broken down into 100% Full Time. Highlights an 100% Physical job distribution.

Full Stack Software Engineer (AI Infrastructure)

The Josef Group

Columbia, MD • On-site

$120 - $180/hr

Other

This job post has expired today. Applications are no longer accepted.


Job description

Full Stack Software Engineer (AI Infrastructure)
  • Columbia, Maryland

Description: Join us in building the next generation of AI infrastructure that will power innovation across the customer organization. We're seeking a full-stack software engineer to support our AI infrastructure team. In this role, you'll help build and maintain the platform that provides the foundation for the customer's AI capabilities, with a focus on inference services while supporting a broader ecosystem of AI-enabled applications.

Responsibilities:
  • Implement and support infrastructure for AI model inference under the guidance of senior engineers.
  • Contribute to the development and maintenance of production AI services and applications, including retrieval augmented generation (RAG) and autonomous agents.
  • Participate in implementing monitoring, logging, and observability for AI services.
  • Assist with automating infrastructure provisioning and configuration using IaC principles.
  • Help ensure availability, reliability, and performance of AI platform components.
  • Follow established security best practices for AI systems and data.
  • Work within ambiguous problem spaces while learning to define structured solutions.
  • Collaborate with cross-functional teams and contribute to shared engineering standards.
Skills Requirements:
  • Experience contributing to production systems.
  • Familiarity with high-volume web application architectures.
  • Exposure to cloud engineering, preferably AWS.
  • Working knowledge of Kubernetes concepts and containerized deployments.
  • Proficiency in Python.
  • Familiarity with CI/CD pipelines and DevOps practices.
  • Ability to learn unfamiliar technologies quickly.
  • Strong communication skills and willingness to ask questions.
Nice to Haves:
  • Exposure to AI inference serving technologies (vLLM, LiteLLM, etc.).
  • Familiarity with agentic frameworks (LangChain).
  • Awareness of vector databases and embedding systems.
  • Interest in distributed systems or performance engineering.
#J-18808-Ljbffr