Job Summary:
WindBorne Systems is supercharging weather forecasts with a unique proprietary data source: a global constellation of next-generation smart weather balloons. They are seeking a Machine Learning Operations Engineer to streamline operational processes and improve the reliability of their AI weather models.
Responsibilities:
• Research to Operations pipelines — Our models serve real-time forecasts to customers with strict latency requirements. You'd own uptime end-to-end: build health monitoring, improve logging, diagnose failures across nodes.
• Inference scaling & compute strategy — We have an on-prem cluster but also use cloud providers, especially for production deployments. You'd evaluate cost/performance tradeoffs across cloud options as we scale, and also help manage growing on-prem resources for compute and storage.
• Data pipelines & upstream reliability — Weather data comes from dozens of sources (satellites, government agencies, our own balloon observations) with varying schedules, incomplete documentation and sometimes failing or changing quality. You'd build pipelines for training and realtime data that gracefully handle upstream delays, do QC checks on data, and add logging and alerting for a zoo of edge cases.
• Training infrastructure — Make distributed training runs reliable. They die from silent OOMs, network faults, and storage issues. Build monitoring, auto-recovery, and job scheduling so researchers can launch experiments with less need for babysitting them.
Qualifications:
Required:
• Have run production systems end-to-end — you've been paged at 2am because a pipeline stopped serving and you know how to build systems so that stops happening
• Experience with large datasets spanning petabytes
• Understand cloud GPU economics and how to balance workloads across on-prem and cloud
• Comfortable keeping up with fast-paced model releases and building reliable custom deployments for them
• Experience with PyTorch, Docker, cursed memory management, compression and debugging network saturation.
Company:
WindBorne collects atmospheric data using smart weather balloons for weather forecasting, climate research, and environmental monitoring. Founded in 2015, the company is headquartered in Stanford, USA, with a team of 51-200 employees. The company is currently Growth Stage.