Job Summary:
Etched is building the worldโs first AI inference system purpose-built for transformers, delivering unprecedented performance and efficiency. The Infrastructure Software Engineer will lead the development of custom infrastructure and tooling to support fast, reliable, and scalable AI model development, enabling engineers to innovate and optimize performance.
Responsibilities:
โข Design and build the orchestration layers that drive our hybrid high-performance clustersโenabling simulation, synthesis, and continuous integration of AI ASICs at unprecedented scale.
โข Develop and maintain a fully programmable infrastructure control plane to ensure reproducibility, auditability, and rapid iteration across the entire stack.
โข Create tools and abstractions that empower engineers to harness massive parallelism without worrying about the underlying complexity..
โข Prototype and execute workload orchestration and migration strategies between on-premise and cloud environments, balancing performance, storage availability and replication, uptime, and cost across heterogeneous hardware and compute backends.
โข Implement real-time telemetry, tracing systems that surface insights from millions of metrics, enabling proactive debugging and system optimization.
โข Build a full observability stack that includes dashboards, alerting, automated responses, and a synthetic testing framework to proactively test infrastructure performance and reliability for various application and data flows, ensuring we remain proactive against issues impacting development and productivity workflows.
Qualifications:
Required:
โข Strong software engineering mindset and quality instincts
โข Deep understanding of systems
โข Experience in building and managing infrastructure with precision, repeatability, and intent
โข Design and build orchestration layers for hybrid high-performance clusters
โข Develop and maintain a fully programmable infrastructure control plane
โข Create tools and abstractions for massive parallelism
โข Prototype and execute workload orchestration and migration strategies
โข Implement real-time telemetry and tracing systems
โข Build a full observability stack including dashboards, alerting, and synthetic testing framework
โข Strong programming skills in languages such as Python, Go, Rust, and C++
โข Expert-level knowledge of Linux, virtualization, containerization, and CI/CD pipelines
โข Familiarity with Infrastructure as Code tools like OpenTofu, Ansible, or Puppet
โข Understanding and use of PromQL and other telemetry/query languages
โข Track record of debugging and resolving hardware-software integration problems
โข Ability to lead and mentor technical teams
โข 8+ years of experience in infrastructure engineering, systems programming, or backend software development
โข Driven by curiosity, take initiative, and have an innate sense of ownership
Preferred:
โข Familiarity with Bazel build system
โข Deep understanding of ASIC development flows, especially involving Synopsys, Cadence, and Verilator
โข Hands-on experience architecting systems with AWS, GCP, or Azure
โข Experience monitoring, provisioning, and debugging bare-metal servers and network hardware
โข Comfortable in profiling and optimizing compute environments for single-threaded latency, memory-bound workloads, or I/O throughput
โข Proficiency building or operating telemetry systems at scale using Prometheus, Grafana, Loki, VictoriaMetrics
Company:
Building the hardware for superintelligence Founded in 2022, the company is headquartered in San Jose, USA, with a team of 51-200 employees. The company is currently Growth Stage.