Inference Software Engineer
Cupertino, CA · On-site
Etched is building AI chips that are hard-coded for individual model architectures. They are seeking an Inference Software Engineer to contribute to the architecture and design of the Sohu host ...
Etched
60 Etched Software Engineer Intern Jobs Hiring Near You
Inference Software Engineer
Cupertino, CA · On-site
Etched is building AI chips that are hard-coded for individual model architectures. They are seeking an Inference Software Engineer to contribute to the architecture and design of the Sohu host ...
Inference Software Engineer
Cupertino, CA · On-site
Etched is a company focused on building AI chips tailored for specific model architectures. They are seeking an Inference Software Engineer to contribute to the architecture and design of the Sohu ...
Inference Software Engineer
Cupertino, CA · On-site
Etched is a company focused on building AI chips tailored for specific model architectures. They are seeking an Inference Software Engineer to contribute to the architecture and design of the Sohu ...
Inference Software Engineer
Cupertino, CA · On-site
Etched is a company focused on building AI chips tailored for specific model architectures. They are seeking an Inference Software Engineer to contribute to the architecture and design of the Sohu ...
Inference Software Engineer
Cupertino, CA · On-site
Etched is a company focused on building AI chips tailored for specific model architectures. They are seeking an Inference Software Engineer to contribute to the architecture and design of the Sohu ...
About Etched Etched is building AI chips that are hard-coded for individual model architectures ... Contribute to the architecture and design of the Sohu host software stack * Implement high ...
About Etched Etched is building AI chips that are hard-coded for individual model architectures ... Contribute to the architecture and design of the Sohu host software stack * Implement high ...
Inference Software Engineer
Cupertino, CA · On-site
$2.0K/mo
About Etched Etched is building AI chips that are hard-coded for individual model architectures ... Contribute to the architecture and design of the Sohu host software stack * Implement high ...
Inference Software Engineer
Cupertino, CA · On-site
$2.0K/mo
About Etched Etched is building AI chips that are hard-coded for individual model architectures ... Contribute to the architecture and design of the Sohu host software stack * Implement high ...
Inference Software Engineer
Cupertino, CA · On-site
$2.0K/mo
About Etched Etched is building AI chips that are hard-coded for individual model architectures ... Contribute to the architecture and design of the Sohu host software stack * Implement high ...
Inference Software Engineer
Cupertino, CA · On-site
$2.0K/mo
About Etched Etched is building AI chips that are hard-coded for individual model architectures ... Contribute to the architecture and design of the Sohu host software stack * Implement high ...
Backed by hundreds of millions from top-tier investors and staffed by leading engineers, Etched is ... Strong understanding of hardware/software co-design * Excellent communication and collaboration ...
Quick apply
Backed by hundreds of millions from top-tier investors and staffed by leading engineers, Etched is ... Strong understanding of hardware/software co-design * Excellent communication and collaboration ...
Backed by hundreds of millions from top-tier investors and staffed by leading engineers, Etched is ... Strong understanding of hardware/software co-design * Excellent communication and collaboration ...
Backed by hundreds of millions from top-tier investors and staffed by leading engineers, Etched is ... Strong understanding of hardware/software co-design * Excellent communication and collaboration ...
Backed by hundreds of millions from top-tier investors and staffed by leading engineers, Etched is ... Strong understanding of hardware/software co-design * Excellent communication and collaboration ...
Backed by hundreds of millions from top-tier investors and staffed by leading engineers, Etched is ... Strong understanding of hardware/software co-design * Excellent communication and collaboration ...
Infrastructure Intern
San Jose, CA · On-site
Job Summary Our infrastructurerole drives the development and adoption of next-generation infrastructure tooling, enabling Etched ASIC, Software, and Platform engineers to iterate faster, build more ...
Infrastructure Intern
San Jose, CA · On-site
Job Summary Our infrastructurerole drives the development and adoption of next-generation infrastructure tooling, enabling Etched ASIC, Software, and Platform engineers to iterate faster, build more ...
Backed by hundreds of millions from top-tier investors and staffed by leading engineers, Etched is ... Strong understanding of hardware/software co-design * Excellent communication and collaboration ...
Backed by hundreds of millions from top-tier investors and staffed by leading engineers, Etched is ... Strong understanding of hardware/software co-design * Excellent communication and collaboration ...
Supercomputing Intern
San Jose, CA · On-site
Backed by hundreds of millions from top-tier investors and staffed by leading engineers, Etched is ... Supercomputing is also responsible for the deployment and provisioning of software frameworks and ...
Supercomputing Intern
San Jose, CA · On-site
Backed by hundreds of millions from top-tier investors and staffed by leading engineers, Etched is ... Supercomputing is also responsible for the deployment and provisioning of software frameworks and ...
Supercomputing Intern
San Jose, CA · On-site
Backed by hundreds of millions from top-tier investors and staffed by leading engineers, Etched is ... Supercomputing is also responsible for the deployment and provisioning of software frameworks and ...
Quick apply
Supercomputing Intern
San Jose, CA · On-site
Backed by hundreds of millions from top-tier investors and staffed by leading engineers, Etched is ... Supercomputing is also responsible for the deployment and provisioning of software frameworks and ...
Backed by hundreds of millions from top-tier investors and staffed by leading engineers, Etched is ... Supercomputing is also responsible for the deployment and provisioning of software frameworks and ...
Backed by hundreds of millions from top-tier investors and staffed by leading engineers, Etched is ... Supercomputing is also responsible for the deployment and provisioning of software frameworks and ...
Inference Intern
San Jose, CA · On-site
Backed by hundreds of millions from top-tier investors and staffed by leading engineers, Etched is ... Implement high-performance software components for the Model Toolkit You may be a good fit if you ...
Inference Intern
San Jose, CA · On-site
Backed by hundreds of millions from top-tier investors and staffed by leading engineers, Etched is ... Implement high-performance software components for the Model Toolkit You may be a good fit if you ...
Inference Intern
San Jose, CA · On-site
Backed by hundreds of millions from top-tier investors and staffed by leading engineers, Etched is ... Implement high-performance software components for the Model Toolkit You may be a good fit if you ...
Quick apply
Inference Intern
San Jose, CA · On-site
Backed by hundreds of millions from top-tier investors and staffed by leading engineers, Etched is ... Implement high-performance software components for the Model Toolkit You may be a good fit if you ...
Backed by hundreds of millions from top-tier investors and staffed by leading engineers, Etched is ... Implement high-performance software components for the Model Toolkit You may be a good fit if you ...
Backed by hundreds of millions from top-tier investors and staffed by leading engineers, Etched is ... Implement high-performance software components for the Model Toolkit You may be a good fit if you ...
Infrastructure Software Engineer
San Jose, CA · On-site
$150K - $250K/yr
About Etched Etched is building the world's first AI inference system purpose-built for ... We build this infrastructure as software - and we engineer it with the same best practices we apply ...
Infrastructure Software Engineer
San Jose, CA · On-site
$150K - $250K/yr
About Etched Etched is building the world's first AI inference system purpose-built for ... We build this infrastructure as software - and we engineer it with the same best practices we apply ...
Infrastructure Software Engineer
San Jose, CA · Hybrid
$202K - $240K/yr
About Etched Etched is building the world's first AI inference system purpose-built for ... We build this infrastructure as software - and we engineer it with the same best practices we apply ...
Infrastructure Software Engineer
San Jose, CA · Hybrid
$202K - $240K/yr
About Etched Etched is building the world's first AI inference system purpose-built for ... We build this infrastructure as software - and we engineer it with the same best practices we apply ...
Mech / Thermal Intern
San Jose, CA · On-site
Backed by hundreds of millions from top-tier investors and staffed by leading engineers, Etched is redefining the infrastructure layer for the fastest growing industry in history. Job Summary Our ...
Quick apply
Mech / Thermal Intern
San Jose, CA · On-site
Backed by hundreds of millions from top-tier investors and staffed by leading engineers, Etched is redefining the infrastructure layer for the fastest growing industry in history. Job Summary Our ...
Etched Jobs Information
What other companies are hiring for Software Engineer Intern jobs?
What are the most popular jobs at Etched?
What are the most popular categories at Etched?
Full-time
Posted 22 days ago
Job description
Job Summary:
Etched is building AI chips that are hard-coded for individual model architectures. They are seeking an Inference Software Engineer to contribute to the architecture and design of the Sohu host software stack and implement high-performance, modular code across the complete Etched software stack.
Responsibilities:
• Contribute to the architecture and design of the Sohu host software stack
• Implement high-performance, modular code across the complete Etched software stack, consisting of a mix of Rust, C++ and Python.
• Interface with firmware and drivers teams delivering highest-performance HW/SW stack.
• Work with AI model researchers and product-facing teams building out the Etched serving front-end.
• Build scheduling logic for handling continuous batching and real time inference
• Implement inference-time acceleration techniques such as speculative decoding, tree search, KV cache sharing, etc.
• Implement distributed networking primitives for efficient multi-server inference
Qualifications:
Required:
• Experience with C++ and Python
• Familiarity with transformer model architectures and inference serving stacks (vLLM, SGLang, etc.) or experience working in distributed inference/training environments
• Experience working cross-functionally in large software and hardware organizations
Preferred:
• Experience with Rust
• Familiarity with GPU kernels, the CUDA compilation stack and related tools, or other hardware accelerators
• Understanding of distributed systems, networking, and parallel programming
Company:
Building the hardware for superintelligence Founded in 2022, the company is headquartered in Cupertino, USA, with a team of 51-200 employees. The company is currently Growth Stage.
Etched is building AI chips that are hard-coded for individual model architectures. They are seeking an Inference Software Engineer to contribute to the architecture and design of the Sohu host software stack and implement high-performance, modular code across the complete Etched software stack.
Responsibilities:
• Contribute to the architecture and design of the Sohu host software stack
• Implement high-performance, modular code across the complete Etched software stack, consisting of a mix of Rust, C++ and Python.
• Interface with firmware and drivers teams delivering highest-performance HW/SW stack.
• Work with AI model researchers and product-facing teams building out the Etched serving front-end.
• Build scheduling logic for handling continuous batching and real time inference
• Implement inference-time acceleration techniques such as speculative decoding, tree search, KV cache sharing, etc.
• Implement distributed networking primitives for efficient multi-server inference
Qualifications:
Required:
• Experience with C++ and Python
• Familiarity with transformer model architectures and inference serving stacks (vLLM, SGLang, etc.) or experience working in distributed inference/training environments
• Experience working cross-functionally in large software and hardware organizations
Preferred:
• Experience with Rust
• Familiarity with GPU kernels, the CUDA compilation stack and related tools, or other hardware accelerators
• Understanding of distributed systems, networking, and parallel programming
Company:
Building the hardware for superintelligence Founded in 2022, the company is headquartered in Cupertino, USA, with a team of 51-200 employees. The company is currently Growth Stage.