Job Summary:
NorthMark Compute & Cloud (NMC²) is a technology-driven company focused on enhancing high-performance computing and cloud infrastructure. The Senior Kubernetes Engineer will design, implement, and optimize GPU-accelerated container platforms, enabling high-performance workloads across hybrid or on-prem environments.
Responsibilities:
• Architecting and operating Kubernetes clusters optimised for GPU workloads, leveraging NVIDIA GPU Operator, Network Operator and DCGM
• Developing, deploying and maintaining custom Kubernetes operators and controllers to automate infrastructure services
• Integrating NVIDIA device plugins, Multi-Instance GPU (MIG) and GPU sharing features into the scheduling layer
• Optimising GPU utilisation and job placement through scheduler extensions, such as kube-scheduler plugins, Slurm and Volcano
• Collaborating with HPC, ML and DevOps teams to ensure multi-tenant, high-throughput cluster performance
• Driving observability and telemetry integrations using Prometheus, Grafana, DCGM Exporter and OpenTelemetry
• Implementing secure multi-user and multi-namespace GPU isolation, with RBAC and policy enforcement, such as OPA or Gatekeeper
• Maintaining CI/CD pipelines for Kubernetes infrastructure using GitOps, ArgoCD and FluxCD
• Contributing to infrastructure-as-code, using Terraform, Helm, and Kustomize
• Participating in performance tuning, incident response and production readiness reviews
Qualifications:
Required:
• Extensive experience with Kubernetes in production-grade environments and working with NVIDIA and Kubernetes, including GPU Operator, device plugin, NVML, MIG and DCGM
• Proficiency in Go or Python for operator development and Kubernetes controller logic
• Deep understanding of Kubernetes internals, including CRDs, RBAC, custom controllers and scheduler extensions
• Experience with GPU-intensive workloads, for example for LLMs, training pipelines and scientific computing
• Hands-on experience with Helm, Kustomize and GitOps workflows
• Familiarity with CNI plugins, especially NVIDIA CNI and Multus
• Experience with monitoring GPU metrics and cluster health using Prometheus and DCGM Exporter
• Must be legally authorized to work in the United States without the need for employer sponsorship, now or at any time in the future.
Company:
NorthMark Strategies is a multi-strategy investment firm managing diverse portfolios and offering advisory services across sectors. Founded in , the company is headquartered in New York, USA, with a team of 51-200 employees. The company is currently Growth Stage.