Vllm Jobs in Texas (NOW HIRING)

... vLLM alongside commercial LLM APIs. • Implement solutions for regulated, high-trust environments, including PII handling, auditability, deterministic fallbacks, and observability. Required ...

LangGraph * vLLM * Experience designing and orchestrating multi-agent workflows, tool integrations, and autonomous decision-making frameworks. * Ability to develop, test, and optimize AI-driven ...

Upstream your architectural improvements and hardware backends directly into open-source repositories like vLLM, SGLang, and PyTorch, acting as a bridge between the hardware teams and the open-source ...

Hands-on experience with Python, Java, LangGraph, and vLLM. * Experience designing and orchestrating multi-agent workflows, tool integrations, and autonomous decision-making frameworks. * Ability to ...

Python / Java LangGraph vLLM Experience designing and orchestrating multi-agent workflows, tool integrations, and autonomous decision-making frameworks. Ability to develop, test, and optimize AI ...

We are looking for a motivated Deep Learning engineer to bring advanced CUDA features and Distributed Runtime technologies into AI stacks, including PyTorch, TRT-LLM, vLLM, SGLang, JAX, etc. You will ...

Optimize inference using ONNX, vLLM, TensorRT, and GPU acceleration. * Manage datasets, preprocess data, and implement RAG with vector databases (FAISS, Chroma, Pinecone). * Automate training ...

Hands-on experience with LangGraph and vLLM * Strong knowledge of LLM integration, RAG/retrieval systems, and AI application architecture * Experience with microservices, REST APIs, and enterprise ...

Work on the inference and serving layer: model routing, prompt/context management, and self-hosted serving with vLLM alongside commercial LLM APIs. * Harden systems for a regulated, high-trust ...

Python / Java LangGraph vLLM Experience designing and orchestrating multi-agent workflows, tool integrations, and autonomous decision-making frameworks. Ability to develop, test, and optimize AI ...

Familiarity with popular LLM frameworks and libraries such as TensorRT, TensorRT-LLM, vLLM, SGLang, MLC-LLM, or FlashInfer. * A track record of strong software design, execution, and collaboration ...

Integrating networking capabilities into AI serving stacks such as vLLM, SGLang, and TensorRT-LLM * Contributing to and maintaining open-source projects, mentoring engineers, conducting design ...

Integrating networking capabilities into AI serving stacks such as vLLM, SGLang, and TensorRT-LLM. * Publishing findings, representing NVIDIA in industry forums and standards bodies, and mentoring ...

Deploy and optimize LLM / VLLM inference stacks using vLLM, Hugging Face Transformers, TensorRT-LLM, TGI, Ollama, llama.cpp, Ray Serve, or Triton Inference Server. * Integrate commercial and ...

Deploy and optimize LLM / VLLM inference stacks using vLLM, Hugging Face Transformers, TensorRT-LLM, TGI, Ollama, llama.cpp, Ray Serve, or Triton Inference Server. * Integrate commercial and open ...

Experience with OpenAI-compatible APIs, vLLM, or Text Generation Inference (TGI) * Experience deploying AI workloads on Azure GPU infrastructure * Familiarity with LoRA / PEFT fine-tuning * Exposure ...

Integrating networking capabilities into AI serving stacks such as vLLM, SGLang, and TensorRT-LLM.* Publishing findings, representing NVIDIA in industry forums and standards bodies, and mentoring ...

LangGraph * vLLM * Experience designing and orchestrating multi-agent workflows , tool integrations, and autonomous decision-making frameworks. * Ability to develop, test, and optimize AI-driven ...

We are looking for a motivated Deep Learning engineer to bring advanced communication technologies into AI stacks, including PyTorch, TRT-LLM, vLLM, SGLang, JAX, etc. You will be working with the ...

Build robust serving infrastructure to productionize machine learning models and Large Language Models (LLMs) using modern serving frameworks (e.g., vLLM, TensorRT-LLM, KServe, Triton). * Cloud ...