Job Summary:
Cadence is a technology company focused on developing leaders and innovators in the field. They are seeking a Senior Distributed Systems Engineer to design scalable data processing infrastructure for a next-generation distributed transistor-level electromigration and IR drop analysis tool.
Responsibilities:
โข Architect and develop the core distributed infrastructure for a Python-based platform orchestrating high-performance C++ solvers, focusing on:
โข Efficient ingestion pipelines for large-scale netlists and simulation data
โข High-performance I/O for multi-TB circuit databases
โข Serialization/deserialization layers bridging Python and C++ components
โข Streaming results from distributed solver instances
โข Task distribution architecture with fault-tolerant scheduling for long-running simulations
โข Resource management and load balancing across compute clusters
โข Monitoring and observability for distributed workflows
โข Optimization of task granularity and dependency management
โข Scalable visualization for multi-dimensional TB-scale simulation results
โข Interactive data exploration and optimization techniques (downsampling, LOD, progressive rendering)
Qualifications:
Required:
โข 5+ years building production distributed systems with Python
โข Deep experience with Dask Distributed or similar frameworks (Spark, Ray, Celery)
โข Strong grasp of distributed computing patterns, data locality, and fault tolerance
โข Expertise in high-performance I/O (HDF5, Parquet, Arrow, columnar formats)
โข Data partitioning strategies, memory-mapped files, zero-copy techniques, streaming patterns
โข Python/C++ interop (pybind11, Cython, ctypes)
โข Experience with large-scale scientific/engineering visualization systems
Preferred:
โข Background in EDA, VLSI, semiconductor design, or computational engineering
โข HPC experience with job schedulers (Slurm, PBS, LSF)
โข GPU acceleration knowledge
โข Familiarity with modern languages, tools (Go, Plotly, Bokeh, Holoviews, Datashader)
โข Open-source distributed computing contributions
Company:
Cadence is a market leader in AI and digital twins, pioneering the application of computational software to accelerate innovation in the engineering design of silicon to systems. Founded in 1988, the company is headquartered in San Jose, USA, with a team of 10001+ employees. The company is currently Late Stage.