Inference Software Engineer
Cupertino, CA · On-site
Etched is building AI chips that are hard-coded for individual model architectures. They are seeking an Inference Software Engineer to contribute to the architecture and design of the Sohu host ...
Etched
60 Etched Software Engineer Intern Jobs Hiring Near You
Inference Software Engineer
Cupertino, CA · On-site
Etched is building AI chips that are hard-coded for individual model architectures. They are seeking an Inference Software Engineer to contribute to the architecture and design of the Sohu host ...
Inference Software Engineer
Cupertino, CA · On-site
Etched is a company focused on building AI chips tailored for specific model architectures. They are seeking an Inference Software Engineer to contribute to the architecture and design of the Sohu ...
Inference Software Engineer
Cupertino, CA · On-site
Etched is a company focused on building AI chips tailored for specific model architectures. They are seeking an Inference Software Engineer to contribute to the architecture and design of the Sohu ...
About Etched Etched is building AI chips that are hard-coded for individual model architectures ... Contribute to the architecture and design of the Sohu host software stack * Implement high ...
About Etched Etched is building AI chips that are hard-coded for individual model architectures ... Contribute to the architecture and design of the Sohu host software stack * Implement high ...
About Etched Etched is building AI chips that are hard-coded for individual model architectures ... Contribute to the architecture and design of the Sohu host software stack * Implement high ...
About Etched Etched is building AI chips that are hard-coded for individual model architectures ... Contribute to the architecture and design of the Sohu host software stack * Implement high ...
Inference Software Engineer
Cupertino, CA · On-site
$2.0K/mo
About Etched Etched is building AI chips that are hard-coded for individual model architectures ... Contribute to the architecture and design of the Sohu host software stack * Implement high ...
Inference Software Engineer
Cupertino, CA · On-site
$2.0K/mo
About Etched Etched is building AI chips that are hard-coded for individual model architectures ... Contribute to the architecture and design of the Sohu host software stack * Implement high ...
We co-design chips, racks, software, and manufacturing to deliver best-in-class throughput and ... Backed by hundreds of millions from top-tier investors and staffed by leading engineers, Etched is ...
We co-design chips, racks, software, and manufacturing to deliver best-in-class throughput and ... Backed by hundreds of millions from top-tier investors and staffed by leading engineers, Etched is ...
We co-design chips, racks, software, and manufacturing to deliver best-in-class throughput and ... Backed by hundreds of millions from top-tier investors and staffed by leading engineers, Etched is ...
Quick apply
We co-design chips, racks, software, and manufacturing to deliver best-in-class throughput and ... Backed by hundreds of millions from top-tier investors and staffed by leading engineers, Etched is ...
We co-design chips, racks, software, and manufacturing to deliver best-in-class throughput and ... Backed by hundreds of millions from top-tier investors and staffed by leading engineers, Etched is ...
We co-design chips, racks, software, and manufacturing to deliver best-in-class throughput and ... Backed by hundreds of millions from top-tier investors and staffed by leading engineers, Etched is ...
Job Summary Our infrastructure role drives the development and adoption of next-generation infrastructure tooling, enabling Etched ASIC, Software, and Platform engineers to iterate faster, build more ...
Job Summary Our infrastructure role drives the development and adoption of next-generation infrastructure tooling, enabling Etched ASIC, Software, and Platform engineers to iterate faster, build more ...
Infrastructure Intern
San Jose, CA · On-site
Job Summary Our infrastructure role drives the development and adoption of next-generation infrastructure tooling, enabling Etched ASIC, Software, and Platform engineers to iterate faster, build more ...
Quick apply
Infrastructure Intern
San Jose, CA · On-site
Job Summary Our infrastructure role drives the development and adoption of next-generation infrastructure tooling, enabling Etched ASIC, Software, and Platform engineers to iterate faster, build more ...
Infrastructure Intern
San Jose, CA · On-site
Job Summary Our infrastructurerole drives the development and adoption of next-generation infrastructure tooling, enabling Etched ASIC, Software, and Platform engineers to iterate faster, build more ...
Infrastructure Intern
San Jose, CA · On-site
Job Summary Our infrastructurerole drives the development and adoption of next-generation infrastructure tooling, enabling Etched ASIC, Software, and Platform engineers to iterate faster, build more ...
Supercomputing Intern
San Jose, CA · On-site
We co-design chips, racks, software, and manufacturing to deliver best-in-class throughput and ... Backed by hundreds of millions from top-tier investors and staffed by leading engineers, Etched is ...
Supercomputing Intern
San Jose, CA · On-site
We co-design chips, racks, software, and manufacturing to deliver best-in-class throughput and ... Backed by hundreds of millions from top-tier investors and staffed by leading engineers, Etched is ...
We co-design chips, racks, software, and manufacturing to deliver best-in-class throughput and ... Backed by hundreds of millions from top-tier investors and staffed by leading engineers, Etched is ...
We co-design chips, racks, software, and manufacturing to deliver best-in-class throughput and ... Backed by hundreds of millions from top-tier investors and staffed by leading engineers, Etched is ...
Supercomputing Intern
San Jose, CA · On-site
We co-design chips, racks, software, and manufacturing to deliver best-in-class throughput and ... Backed by hundreds of millions from top-tier investors and staffed by leading engineers, Etched is ...
Quick apply
Supercomputing Intern
San Jose, CA · On-site
We co-design chips, racks, software, and manufacturing to deliver best-in-class throughput and ... Backed by hundreds of millions from top-tier investors and staffed by leading engineers, Etched is ...
Inference Intern
San Jose, CA · On-site
We co-design chips, racks, software, and manufacturing to deliver best-in-class throughput and ... Backed by hundreds of millions from top-tier investors and staffed by leading engineers, Etched is ...
Quick apply
Inference Intern
San Jose, CA · On-site
We co-design chips, racks, software, and manufacturing to deliver best-in-class throughput and ... Backed by hundreds of millions from top-tier investors and staffed by leading engineers, Etched is ...
We co-design chips, racks, software, and manufacturing to deliver best-in-class throughput and ... Backed by hundreds of millions from top-tier investors and staffed by leading engineers, Etched is ...
We co-design chips, racks, software, and manufacturing to deliver best-in-class throughput and ... Backed by hundreds of millions from top-tier investors and staffed by leading engineers, Etched is ...
Inference Intern
San Jose, CA · On-site
We co-design chips, racks, software, and manufacturing to deliver best-in-class throughput and ... Backed by hundreds of millions from top-tier investors and staffed by leading engineers, Etched is ...
Inference Intern
San Jose, CA · On-site
We co-design chips, racks, software, and manufacturing to deliver best-in-class throughput and ... Backed by hundreds of millions from top-tier investors and staffed by leading engineers, Etched is ...
Infrastructure Software Engineer
San Jose, CA · Hybrid
$202K - $240K/yr
About Etched Etched is building hardware for frontier intelligence. We co-design chips, racks ... We build this infrastructure as software - and we engineer it with the same best practices we apply ...
Infrastructure Software Engineer
San Jose, CA · Hybrid
$202K - $240K/yr
About Etched Etched is building hardware for frontier intelligence. We co-design chips, racks ... We build this infrastructure as software - and we engineer it with the same best practices we apply ...
Infrastructure Software Engineer
San Jose, CA · On-site
$150K - $250K/yr
About Etched Etched is building hardware for frontier intelligence. We co-design chips, racks ... We build this infrastructure as software - and we engineer it with the same best practices we apply ...
Infrastructure Software Engineer
San Jose, CA · On-site
$150K - $250K/yr
About Etched Etched is building hardware for frontier intelligence. We co-design chips, racks ... We build this infrastructure as software - and we engineer it with the same best practices we apply ...
Infrastructure Software Engineer
San Jose, CA · On-site
$150K - $250K/yr
About Etched Etched is building hardware for frontier intelligence. We co-design chips, racks ... We build this infrastructure as software - and we engineer it with the same best practices we apply ...
Quick apply
Infrastructure Software Engineer
San Jose, CA · On-site
$150K - $250K/yr
About Etched Etched is building hardware for frontier intelligence. We co-design chips, racks ... We build this infrastructure as software - and we engineer it with the same best practices we apply ...
Etched Jobs Information
What other companies are hiring for Software Engineer Intern jobs?
What are the most popular jobs at Etched?
What are the most popular categories at Etched?
Full-time
Posted 4 days ago
Job description
Job Summary:
Etched is building AI chips that are hard-coded for individual model architectures. They are seeking an Inference Software Engineer to contribute to the architecture and design of the Sohu host software stack and implement high-performance, modular code across the complete Etched software stack.
Responsibilities:
• Contribute to the architecture and design of the Sohu host software stack
• Implement high-performance, modular code across the complete Etched software stack, consisting of a mix of Rust, C++ and Python.
• Interface with firmware and drivers teams delivering highest-performance HW/SW stack.
• Work with AI model researchers and product-facing teams building out the Etched serving front-end.
• Build scheduling logic for handling continuous batching and real time inference
• Implement inference-time acceleration techniques such as speculative decoding, tree search, KV cache sharing, etc.
• Implement distributed networking primitives for efficient multi-server inference
Qualifications:
Required:
• Experience with C++ and Python
• Familiarity with transformer model architectures and inference serving stacks (vLLM, SGLang, etc.) or experience working in distributed inference/training environments
• Experience working cross-functionally in large software and hardware organizations
Preferred:
• Experience with Rust
• Familiarity with GPU kernels, the CUDA compilation stack and related tools, or other hardware accelerators
• Understanding of distributed systems, networking, and parallel programming
Company:
Etched is an AI chip startup that designs and manufactures hardware systems optimized for artificial intelligence model inference workloads. Founded in 2022, the company is headquartered in San Jose, USA, with a team of 51-200 employees. The company is currently Growth Stage.
Etched is building AI chips that are hard-coded for individual model architectures. They are seeking an Inference Software Engineer to contribute to the architecture and design of the Sohu host software stack and implement high-performance, modular code across the complete Etched software stack.
Responsibilities:
• Contribute to the architecture and design of the Sohu host software stack
• Implement high-performance, modular code across the complete Etched software stack, consisting of a mix of Rust, C++ and Python.
• Interface with firmware and drivers teams delivering highest-performance HW/SW stack.
• Work with AI model researchers and product-facing teams building out the Etched serving front-end.
• Build scheduling logic for handling continuous batching and real time inference
• Implement inference-time acceleration techniques such as speculative decoding, tree search, KV cache sharing, etc.
• Implement distributed networking primitives for efficient multi-server inference
Qualifications:
Required:
• Experience with C++ and Python
• Familiarity with transformer model architectures and inference serving stacks (vLLM, SGLang, etc.) or experience working in distributed inference/training environments
• Experience working cross-functionally in large software and hardware organizations
Preferred:
• Experience with Rust
• Familiarity with GPU kernels, the CUDA compilation stack and related tools, or other hardware accelerators
• Understanding of distributed systems, networking, and parallel programming
Company:
Etched is an AI chip startup that designs and manufactures hardware systems optimized for artificial intelligence model inference workloads. Founded in 2022, the company is headquartered in San Jose, USA, with a team of 51-200 employees. The company is currently Growth Stage.