LLM Inference Deployment Engineer
$180K - $240K/yr
About the Role EnCharge AI is seeking an LLM Inference Deployment Engineer to optimize, deploy, and scale large language models (LLMs) for high-performance inference on its energy efficient AI ...
Inference
60 Inference Jobs Hiring Near You
LLM Inference Deployment Engineer
$180K - $240K/yr
About the Role EnCharge AI is seeking an LLM Inference Deployment Engineer to optimize, deploy, and scale large language models (LLMs) for high-performance inference on its energy efficient AI ...
Solutions Architect, Inference Deployments
Santa Clara, CA ยท On-site
$74 - $97.50/hr
Build inference pipelines with tools like NVIDIA Dynamo, distributing tasks among GPU workers to improve efficiency. * Collaborate with DevOps teams to orchestrate disaggregated inference using ...
Solutions Architect, Inference Deployments
Santa Clara, CA ยท On-site
$74 - $97.50/hr
Build inference pipelines with tools like NVIDIA Dynamo, distributing tasks among GPU workers to improve efficiency. * Collaborate with DevOps teams to orchestrate disaggregated inference using ...
Technical Program Manager, Inference
Livingston, NJ ยท On-site
$140K - $182K/yr
The Inference team is responsible for building and operating highly scalable, reliable production inference services for both serverless and dedicated inference use cases. The work spans platform ...
Technical Program Manager, Inference
Livingston, NJ ยท On-site
$140K - $182K/yr
The Inference team is responsible for building and operating highly scalable, reliable production inference services for both serverless and dedicated inference use cases. The work spans platform ...
About the Role We're hiring an Inference Engineer to advance our mission of building real-time multimodal intelligence. Your Impact * Design and build low latency, scalable, and reliable model ...
About the Role We're hiring an Inference Engineer to advance our mission of building real-time multimodal intelligence. Your Impact * Design and build low latency, scalable, and reliable model ...
Applied Machine Learning Engineer
$220K - $320K/yr
About Inference.net Inference.net trains and hosts specialized language models for companies who want frontier-quality AI at a fraction of the cost. The models we train match GPT-5 accuracy but are ...
Applied Machine Learning Engineer
$220K - $320K/yr
About Inference.net Inference.net trains and hosts specialized language models for companies who want frontier-quality AI at a fraction of the cost. The models we train match GPT-5 accuracy but are ...
NVIDIA is recruiting a Senior Inference Performance Engineer to push NVIDIA's performance limits on large-scale AI inference benchmarks. This position provides an outstanding opportunity to employ ...
NVIDIA is recruiting a Senior Inference Performance Engineer to push NVIDIA's performance limits on large-scale AI inference benchmarks. This position provides an outstanding opportunity to employ ...
Technical Program Manager, Inference
New York, NY ยท On-site
$141K - $182K/yr
The Inference team is responsible for building and operating highly scalable, reliable production inference services for both serverless and dedicated inference use cases. The work spans platform ...
Quick apply
Technical Program Manager, Inference
New York, NY ยท On-site
$141K - $182K/yr
The Inference team is responsible for building and operating highly scalable, reliable production inference services for both serverless and dedicated inference use cases. The work spans platform ...
Filmmaker / Storyteller
$100K - $140K/yr
Filmmaker / Storyteller Inference.net is seeking a Filmmaker / Storyteller to join our team and help define the narrative of building the world's largest distributed GPU cluster. This role combines ...
Filmmaker / Storyteller
$100K - $140K/yr
Filmmaker / Storyteller Inference.net is seeking a Filmmaker / Storyteller to join our team and help define the narrative of building the world's largest distributed GPU cluster. This role combines ...
Solutions Architect, Inference Deployments
Santa Clara, CA ยท On-site
$74 - $97.50/hr
Build inference pipelines with tools like NVIDIA Dynamo, distributing tasks among GPU workers to improve efficiency. * Collaborate with DevOps teams to orchestrate disaggregated inference using ...
Solutions Architect, Inference Deployments
Santa Clara, CA ยท On-site
$74 - $97.50/hr
Build inference pipelines with tools like NVIDIA Dynamo, distributing tasks among GPU workers to improve efficiency. * Collaborate with DevOps teams to orchestrate disaggregated inference using ...
Technical Program Manager, Inference
Sunnyvale, CA ยท On-site
$151K - $196K/yr
The Inference team is responsible for building and operating highly scalable, reliable production inference services for both serverless and dedicated inference use cases. The work spans platform ...
Quick apply
Technical Program Manager, Inference
Sunnyvale, CA ยท On-site
$151K - $196K/yr
The Inference team is responsible for building and operating highly scalable, reliable production inference services for both serverless and dedicated inference use cases. The work spans platform ...
AI Inference Engineer - Speech
Seattle, WA ยท On-site
$332K/yr
What you can expect We are looking for an AI Inference Engineer with a solid background in speech recognition and model inference. In this role, you will develop state-of-the-art automatic speech ...
AI Inference Engineer - Speech
Seattle, WA ยท On-site
$332K/yr
What you can expect We are looking for an AI Inference Engineer with a solid background in speech recognition and model inference. In this role, you will develop state-of-the-art automatic speech ...
Solutions Architect, Inference Deployments
Santa Clara, CA ยท On-site
$74 - $97.50/hr
Build inference pipelines with tools like NVIDIA Dynamo, distributing tasks among GPU workers to improve efficiency. * Collaborate with DevOps teams to orchestrate disaggregated inference using ...
Solutions Architect, Inference Deployments
Santa Clara, CA ยท On-site
$74 - $97.50/hr
Build inference pipelines with tools like NVIDIA Dynamo, distributing tasks among GPU workers to improve efficiency. * Collaborate with DevOps teams to orchestrate disaggregated inference using ...
Technical Program Manager, Inference
Bellevue, WA ยท On-site
$145K - $188K/yr
The Inference team is responsible for building and operating highly scalable, reliable production inference services for both serverless and dedicated inference use cases. The work spans platform ...
Quick apply
Technical Program Manager, Inference
Bellevue, WA ยท On-site
$145K - $188K/yr
The Inference team is responsible for building and operating highly scalable, reliable production inference services for both serverless and dedicated inference use cases. The work spans platform ...
NVIDIA is recruiting a Senior Inference Performance Engineer to push NVIDIA's performance limits on large-scale AI inference benchmarks. This position provides an outstanding opportunity to employ ...
NVIDIA is recruiting a Senior Inference Performance Engineer to push NVIDIA's performance limits on large-scale AI inference benchmarks. This position provides an outstanding opportunity to employ ...
Technical Program Manager, Inference
Livingston, NJ ยท On-site
$140K - $182K/yr
The Inference team is responsible for building and operating highly scalable, reliable production inference services for both serverless and dedicated inference use cases. The work spans platform ...
Quick apply
Technical Program Manager, Inference
Livingston, NJ ยท On-site
$140K - $182K/yr
The Inference team is responsible for building and operating highly scalable, reliable production inference services for both serverless and dedicated inference use cases. The work spans platform ...
ML Engineer, Inference & Optimization
Palo Alto, CA ยท On-site
$134K - $161K/yr
About the Role We are seeking Senior/Staff level Inference Engineers to accelerate the performance of Pika's AI-driven products. In this highly technical role, you will operate at the intersection of ...
ML Engineer, Inference & Optimization
Palo Alto, CA ยท On-site
$134K - $161K/yr
About the Role We are seeking Senior/Staff level Inference Engineers to accelerate the performance of Pika's AI-driven products. In this highly technical role, you will operate at the intersection of ...
Senior Inference Engineer - AI
Eagan, MN ยท On-site
$106K - $146K/yr
About the Role As a Senior Inference Engineer, AI , responsibilities include/you will: * Within Platform Engineering and Enterprise AI Services, an AI Inference Engineer is responsible for ...
Senior Inference Engineer - AI
Eagan, MN ยท On-site
$106K - $146K/yr
About the Role As a Senior Inference Engineer, AI , responsibilities include/you will: * Within Platform Engineering and Enterprise AI Services, an AI Inference Engineer is responsible for ...
Technical Program Manager, Inference
Manhattan, NY ยท On-site
$142K - $183K/yr
As a Technical Program Manager focused on inference, you will lead complex programs that enhance the delivery and optimization of inference services, ensuring alignment across various teams to meet ...
Technical Program Manager, Inference
Manhattan, NY ยท On-site
$142K - $183K/yr
As a Technical Program Manager focused on inference, you will lead complex programs that enhance the delivery and optimization of inference services, ensuring alignment across various teams to meet ...
Software Engineer, Inference Runtime
New York, NY ยท On-site +1
The Role We are looking for an Inference Runtime Software Engineer to push forward LM Studio's inference stack on-device and in the cloud. You will integrate new inference engines and runtime ...
Software Engineer, Inference Runtime
New York, NY ยท On-site +1
The Role We are looking for an Inference Runtime Software Engineer to push forward LM Studio's inference stack on-device and in the cloud. You will integrate new inference engines and runtime ...
Software Engineer, Inference Runtime
New York, NY ยท Remote
$150K - $350K/yr
The Role We are looking for an Inference Runtime Software Engineer to push forward LM Studio's inference stack on-device and in the cloud. You will integrate new inference engines and runtime ...
Quick apply
Software Engineer, Inference Runtime
New York, NY ยท Remote
$150K - $350K/yr
The Role We are looking for an Inference Runtime Software Engineer to push forward LM Studio's inference stack on-device and in the cloud. You will integrate new inference engines and runtime ...
Inference Jobs Information
Job description
EnCharge AI is a leader in advanced AI hardware and software systems for edge-to-cloud computing. EnCharge's robust and scalable next-generation in-memory computing technology provides orders-of-magnitude higher compute efficiency and density compared to today's best-in-class solutions. The high-performance architecture is coupled with seamless software integration and will enable the immense potential of AI to be accessible in power, energy, and space constrained applications. EnCharge AI launched in 2022 and is led by veteran technologists with backgrounds in semiconductor design and AI systems.
About the Role
EnCharge AI is seeking an LLM Inference Deployment Engineer to optimize, deploy, and scale large language models (LLMs) for high-performance inference on its energy efficient AI accelerators. You will work at the intersection of AI frameworks, model optimization, and runtime execution to ensure efficient model execution and low-latency AI inference.
Responsibilities
Qualifications
EnchargeAI is an equal employment opportunity employer in the United States.
The salary range for this position is $180,000 to $240,000 USD ($175,000 to $245,000 CAD) per year. Actual compensation offered will be determined based on job-related knowledge, skills, and experience.
About the Role
EnCharge AI is seeking an LLM Inference Deployment Engineer to optimize, deploy, and scale large language models (LLMs) for high-performance inference on its energy efficient AI accelerators. You will work at the intersection of AI frameworks, model optimization, and runtime execution to ensure efficient model execution and low-latency AI inference.
Responsibilities
- Deploy and optimize LLMs (GPT, LLaMA, Mistral, Falcon, etc.) post-training from libraries like HuggingFace
- Utilize inference runtimes such as ONNX Runtime, vLLM for efficient execution.
- Optimize batching, caching, and tensor parallelism to improve LLM scalability in real-time applications.
- Develop and maintain high-performance inference pipelines using Docker, Kubernetes, and other inference servers.
Qualifications
- Bachelor's or Master's degree in Computer Science, Electrical Engineering, or related field.
- Experience in LLM inference deployment, model optimization, and runtime engineering.
- Strong expertise in LLM inference frameworks (PyTorch, ONNX Runtime, vLLM, TensorRT-LLM, DeepSpeed).
- In-depth knowledge of the Python programming language for model integration and performance tuning.
- Strong understanding of high-level model representations and experience implementing framework-level optimizations for Generative AI use cases
- Experience with containerized AI deployments (Docker, Kubernetes, Triton Inference Server, TensorFlow Serving, TorchServe).
- Strong knowledge of LLM memory optimization strategies for long-context applications.
- Experience with real-time LLM applications (chatbots, code generation, retrieval-augmented generation).
EnchargeAI is an equal employment opportunity employer in the United States.
The salary range for this position is $180,000 to $240,000 USD ($175,000 to $245,000 CAD) per year. Actual compensation offered will be determined based on job-related knowledge, skills, and experience.
About EnCharge AI
Sourced by ZipRecruiter
Industry
Embedded software
Company size
11 - 50 Employees
Headquarters location
Santa Clara, CA, US
Year founded
2022