ZipRecruiter

Log In

1

Cuda Kernel Engineer Jobs in New York (NOW HIRING)

CoreWeave

Systems Engineer, Kernel

New York, NY · On-site

$165K - $242K/yr

HPC/AI workloads (CUDA, GPUDirect, RoCE/InfiniBand) * Kernel-Hardware Enablement - Support new ... Strong C programming skills with the ability to write maintainable and upstream-quality code.

CoreWeave

Systems Engineer, Kernel

Livingston, NJ · On-site

$165K - $242K/yr

HPC/AI workloads (CUDA, GPUDirect, RoCE/InfiniBand) * Kernel-Hardware Enablement - Support new ... Strong C programming skills with the ability to write maintainable and upstream-quality code.

Baseten

Software Engineer - GPU Kernels

New York, NY · On-site

$180K - $360K/yr

THE ROLE We're seeking a GPU Kernel Engineer to join our team at the cutting edge of AI ... Write and optimize code using CUDA, PTX assembly, and architecture-specific techniques * Apply ...

YO AI Labs

CUDA Software Engineer - Remote

New York, NY · Remote

$60 - $100/hr

Strong expertise in CUDA programming and GPU kernel optimization . * Advanced C++ development skills. * Hands-on experience with GLSL and WebGPU . * Experience using GPU profiling tools such as ...

YO AI Labs

CUDA Developer - Remote

New York, NY · Remote

Strong expertise in CUDA programming and GPU kernel optimization . * Advanced C++ development skills. * Hands-on experience with GLSL and WebGPU . * Experience using GPU profiling tools such as ...

YO AI Labs

CUDA Engineering Expert - Remote

New York, NY · Remote

$60 - $100/hr

Strong expertise in CUDA programming and GPU kernel optimization . * Advanced C++ development skills. * Hands-on experience with GLSL and WebGPU . * Experience using GPU profiling tools such as ...

BaseTen

Software Engineer - Model Products

Manhattan, NY · On-site

$140 - $210/hr

Join us and help build the platform engineers turn to to ship AI products. THE ROLE Baseten's Model ... Profile and optimize TensorRT‑LLM kernels, analyze CUDA kernel performance, implement custom CUDA ...

Career Renew

Senior Machine Learning Engineer

New York, NY · Remote

$165K - $225K/yr

... CUDA kernel engineering, TensorRT/ONNX export, and inference serving frameworks such as Triton Experience with hosting computer vision model inference on NVIDIA DGX Spark. Understanding of FDA ...

Baseten

Software Engineer - Model Products

New York, NY · On-site

$180K - $360K/yr

Join us and help build the platform engineers turn to to ship AI products. THE ROLE: Baseten ... Profile and optimize TensorRT-LLM kernels, analyze CUDA kernel performance, implement custom CUDA ...

Jump Trading

Research Engineer, Pre-Training

New York, NY · On-site

$300K - $350K/yr

As a Pre-Training Research Engineer, you'll be at the forefront of developing massive-scale ... CUDA kernel development, Triton/Pallas/CuTe DSLs, PyTorch/JAX internals, XLA optimization, or ...

next page

Showing results 1-20

All JobsCuda Kernel Engineer JobsCuda Kernel Engineer Jobs in New York

Cuda Kernel Engineer information

What is a CUDA Kernel Engineer?

Cuda Kernel Engineers are specialized software developers who design, implement, and optimize parallel computing algorithms using NVIDIA's CUDA platform. They write 'kernels,' which are functions that run on Graphics Processing Units (GPUs) to accelerate computational tasks in areas such as machine learning, scientific simulations, and graphics rendering. These engineers need strong skills in C/C++ programming, GPU architecture, and performance optimization techniques. Their work is crucial for applications that require high-speed data processing and efficient resource utilization.

What skills and qualifications are needed to be a CUDA Kernel Engineer?

To thrive as a CUDA Kernel Engineer, you need strong proficiency in C/C++ programming, parallel computing concepts, and a solid foundation in GPU architectures, typically supported by a degree in computer science or a related field. Expertise in NVIDIA CUDA toolkits, GPU profiling tools like Nsight, and familiarity with version control systems are essential. Analytical thinking, problem-solving abilities, and effective collaboration skills help engineers optimize code and work well within development teams. These skills and qualities are crucial for delivering high-performance, scalable GPU solutions in computationally intensive applications.

What are common challenges faced by CUDA Kernel Engineers when optimizing GPU code for performance?

Cuda Kernel Engineers often encounter challenges such as managing memory hierarchy efficiently, minimizing data transfer between host and device, and avoiding thread divergence. Ensuring optimal occupancy and maximizing parallelism while preventing bottlenecks like bank conflicts or uncoalesced memory access are also key concerns. Collaborating closely with software architects and data scientists is common, as solutions frequently require balancing algorithmic accuracy with hardware limitations. Addressing these challenges requires continuous profiling, testing, and iterative optimization.

What are popular job titles related to Cuda Kernel Engineer jobs in New York?

For Cuda Kernel Engineer jobs in New York, the most frequently searched job titles are:

What job categories do people searching Cuda Kernel Engineer jobs in New York look for?

The top searched job categories for Cuda Kernel Engineer jobs in New York are:

What cities in New York are hiring for Cuda Kernel Engineer jobs?

Cities in New York with the most Cuda Kernel Engineer job openings:

Cuda Kernel Engineer jobs near you
Infographic showing various Cuda Kernel Engineer job openings in New York as of August 2026, with employment types broken down into 87% Full Time, 8% Part Time, and 5% Contract. Highlights an 59% In-person, and 41% Remote job distribution.

Systems Engineer, Kernel

CoreWeave

New York, NY • On-site

$165K - $242K/yr

Full-time

Re-posted 11 days ago

CoreWeave rating

9.8

Company rating: 9.8 out of 10

Based on 7 frontline employees who took The Breakroom Quiz

1st of 224 rated it services

Job description

CoreWeave is The Essential Cloud for AI™. Built for pioneers by pioneers, CoreWeave delivers a platform of technology, tools, and teams that enables innovators to build and scale AI with confidence. Trusted by leading AI labs, startups, and global enterprises, CoreWeave combines superior infrastructure performance with deep technical expertise to accelerate breakthroughs and turn compute into capability. Founded in 2017, CoreWeave became a publicly traded company (Nasdaq: CRWV) in March 2025. Learn more at www.coreweave.com.
What You'll Do:

CoreWeave is seeking a highly skilled and motivated Systems Kernel Engineer to join our HAVOCK Team, reporting into the Manager of Systems Engineering. In this role, you will be a key contributor to the stability, performance, and evolution of CoreWeave's Linux based infrastructure. As a kernel generalist, you will be responsible for debugging kernel-level issues, analyzing and fixing crashes, panics, dumps, and upstreaming fixes and features that improves the performance and reliability of our stack.

This position is ideal for someone who thrives in low-level systems engineering, and understands how modern workloads stress kernels, and is excited to work across a diverse hardware/software ecosystem including CPUs, GPUs, DPUs, networking, and storage.

Kernel Hardware - Acceleration - Virtualization - Operating Systems - Containerization - Kubelet

Our Team's Stack:

  • Python, Go, bash/sh, C
  • Prometheus, Victoria Metrics, Grafana
  • Linux Kernel (custom build), Ubuntu
  • Intel/AMD/ARM CPUs, Nvidia GPUs, DPUs, Infiniband and Ethernet NICs
  • Docker, kubernetes (k8s), KubeVirt, containerd, kubelet

Focus Areas:

  • Kernel Debugging – Analyze kernel crashes, oopses, panics, and dumps to identify root causes and propose fixes.
  • Upstream Contributions – Develop patches for the Linux kernel and upstream them where applicable (networking, storage, virtualization, GPU/DPU enablement).
  • Stack-Wide Support – Ensure kernel support and stability across:
    • Virtualization (KubeVirt, QEMU, vFIO)
    • Container runtimes (containerd, nydus, kubelet)
    • HPC/AI workloads (CUDA, GPUDirect, RoCE/InfiniBand)
  • Kernel-Hardware Enablement – Support new hardware bring-up across Intel, AMD, ARM CPUs, NVIDIA GPUs, DPUs, and NICs.
  • Performance & Stability – Tune kernel subsystems for latency, throughput, and scalability in distributed HPC/AI clusters.
About the role:
  • Triage and fix kernel crashes and performance regressions.
  • Develop, test, and upstream kernel patches relevant to CoreWeave's hardware/software environment.
  • Collaborate with hardware vendors and the Linux community on feature enablement.
  • Implement diagnostics and tooling for kernel-level observability.
  • Work closely with HPC and Fleet teams to ensure kernel readiness for production workloads.
  • Provide kernel-level expertise during incident response and root-cause investigations.
Who You Are:
  • 5+ years of professional experience in Linux kernel engineering or systems-level development.
  • Bachelor's degree in Computer Engineering, Electrical Engineering, Computer Science, or a related field.
  • Deep understanding of kernel internals (memory management, scheduling, networking, storage, drivers).
  • Experience debugging kernel crashes, dumps, and panics using tools like crash, gdb, kdump.
  • Strong C programming skills with the ability to write maintainable and upstream-quality code.
  • Experience working with kernel modules, drivers, and subsystems.
  • Strong problem-solving abilities with a "full-stack" systems perspective.

Preferred:

  • Contributions to the Linux kernel or related open-source projects.
  • Familiarity with virtualization (KVM, QEMU, VFIO) and container runtimes.
  • Networking stack expertise (InfiniBand, RoCE, TCP/IP performance tuning).
  • GPU/DPU bring-up and driver experience.
  • Experience in HPC or large-scale distributed systems.
  • Familiarity with QA/QE best practices
  • Experience working in Cloud environments
  • Experience as a software engineer writing large-scale applications
  • Experience with machine learning is a huge bonus

The base salary range for this role is $165,000 to $242,000. The starting salary will be determined based on job-related knowledge, skills, experience, and market location. We strive for both market alignment and internal equity when determining compensation. In addition to base salary, our total rewards package includes a discretionary bonus, equity awards, and a comprehensive benefits program (all based on eligibility).

What We Offer

The range we've posted represents the typical compensation range for this role. To determine actual compensation, we review the market rate for each candidate which can include a variety of factors. These include qualifications, experience, interview performance, and location.

In addition to a competitive salary, we offer a variety of benefits to support your needs. The benefits below reflect our US-based offerings for full-time employees; for roles in other locations, benefits vary and are shared during the hiring process. These include:

  • Medical, dental, and vision insurance - 100% paid for by CoreWeave
  • Company-paid Life Insurance
  • Voluntary supplemental life insurance
  • Short and long-term disability insurance
  • Flexible Spending Account
  • Health Savings Account
  • Tuition Reimbursement
  • Ability to Participate in Employee Stock Purchase Program (ESPP)
  • Mental Wellness Benefits through Spring Health
  • Family-Forming support provided by Carrot
  • Paid Parental Leave
  • Flexible, full-service childcare support with Kinside
  • 401(k) with a generous employer match
  • Flexible PTO
  • Catered lunch each day in our office and data center locations
  • A casual work environment
  • A work culture focused on innovative disruption

California Applicants

California Consumer Privacy Act

Equal Opportunity & Accommodations

CoreWeave is an equal opportunity employer, committed to fostering an inclusive and supportive workplace. All qualified applicants and candidates will receive consideration for employment without regard to race, color, religion, sex, disability, age, sexual orientation, gender identity, national origin, veteran status, or genetic information.

As part of this commitment and consistent with the Americans with Disabilities Act (ADA), CoreWeave will ensure that qualified applicants and candidates with disabilities are provided reasonable accommodations for the hiring process, unless such accommodation would cause an undue hardship. If reasonable accommodation is needed, please contact: careers@coreweave.com.

Export Control Compliance

This position requires access to export controlled information. To conform to U.S. Government export regulations applicable to that information, applicant must either be (A) a U.S. person, defined as a (i) U.S. citizen or national, (ii) U.S. lawful permanent resident (green card holder), (iii) refugee under 8 U.S.C. § 1157, or (iv) asylee under 8 U.S.C. § 1158, (B) eligible to access the export controlled information without a required export authorization, or (C) eligible and reasonably likely to obtain the required export authorization from the applicable U.S. government agency. CoreWeave may, for legitimate business reasons, decline to pursue any export licensing process.

What CoreWeave employees say

Pay

Benefits

Hours and flexibility

Workplace

Get the full story on Breakroom