1

Gpu Programming Jobs in New York (NOW HIRING)

Experience with NVIDIA GPU programming and CUDA * Experience with distributed training frameworks, such as DeepSpeed, FSDL, Ray * Experience with inference frameworks like vLLM * Experience with ...

New

GPU Systems Engineer

New York, NY · On-site

$200K - $300K/yr

... latency programming, FPGA technology, hardware acceleration and machine learning. Our ongoing ... Design, deploy, and scale distributed GPU clusters, from hardware selection and network topology ...

GPU Systems Engineer

New York, NY · Hybrid

$200K - $300K/yr

... latency programming, FPGA technology, hardware acceleration and machine learning. Our ongoing ... Design, deploy, and scale distributed GPU clusters, from hardware selection and network topology ...

... latency programming, FPGA technology, hardware acceleration and machine learning. Our ongoing ... Summary: Our GPU fleet is one of the fastest-growing and most critical parts of the firm ...

New

... GPU programming, or ML infrastructure * Familiarity with the serving (e.g., vLLM, SGLang) and training (e.g., slime, verl, TRL) toolchains. You don't need all of these, but you should be able to go ...

Showing results 21-40

Gpu Programming information

See New York salary details

$36.1K

$71.1K

$104.5K

How much do gpu programming jobs pay per year?

As of Aug 21, 2026, the average yearly pay for gpu programming in New York is $71,084.00, according to ZipRecruiter salary data. Most workers in this role earn between $55,200.00 and $87,500.00 per year, depending on experience, location, and employer.

What is GPU programming?

A GPU Programming job involves writing and optimizing code to run on Graphics Processing Units (GPUs) for parallel computing tasks. This role is commonly found in fields like machine learning, scientific computing, gaming, and data analytics. GPU programmers use languages such as CUDA, OpenCL, or Vulkan to accelerate computations and improve performance. They work closely with software engineers and data scientists to optimize algorithms for high-performance applications.

What types of projects or applications do GPU programmers commonly work on?

GPU Programmers are often involved in developing or optimizing software for high-performance applications such as machine learning, scientific simulations, real-time rendering in gaming and visualization, and video/image processing tools. Their daily work may include collaborating with software engineers, data scientists, and hardware teams to create efficient, scalable parallel algorithms that leverage GPU capabilities. The role frequently requires problem-solving to maximize computational efficiency and troubleshooting complex performance bottlenecks. By working across multidisciplinary teams, GPU Programmers help deliver robust solutions for data-intensive problems in areas like healthcare, finance, automotive technology, and entertainment.

What are the key skills and qualifications needed to thrive in GPU programming, and why are they important?

To excel in GPU Programming, you need a strong background in parallel computing concepts, mathematics, and proficiency in languages such as CUDA, OpenCL, or DirectX/OpenGL, often supported by a degree in computer science, engineering, or a related field. Familiarity with NVIDIA and AMD GPU development tools, performance profilers, and possibly certifications like NVIDIA's Deep Learning Institute courses are valuable. Teamwork, effective communication, and strong problem-solving abilities are essential soft skills in this field. These competencies enable efficient development, optimization, and integration of high-performance GPU code in real-world applications.

What are the most commonly searched types of Gpu Programming jobs in New York?

The most popular types of Gpu Programming jobs in New York are:

Infographic showing various Gpu Programming job openings in New York as of August 2026, with employment types broken down into 1% Internship, 79% Full Time, 15% Part Time, 4% Contract, and 1% Nights. Highlights an 88% Physical, 4% Hybrid, and 8% Remote job distribution, with an average salary of $71,084 per year, or $34.2 per hour.

Machine Learning Engineer (Junior)

Doist

Manhattan, NY • On-site

$90 - $130/hr

Other

Posted yesterday

New


Job description

Pangram Labs is hiring for a strong junior Machine Learning Engineer. In this role, you will build software to support the machine learning development cycle from data generation, to training models, to deployment and monitoring production machine learning systems in real customer environments. At Pangram, ML engineers are highly involved in the research effort, are involved in publishing research, and regularly contribute ideas and innovations to the team. However, formal research experience is not necessary.

This is an in‑person role in our office in Downtown Brooklyn, NYC.

Responsibilities
  • Build robust data pipelines that mine the Internet at scale and generate millions of synthetic text examples for training detection models
  • Manage distributed infrastructure for multi‑GPU LLM training
  • Profiling and optimizing training and inference code
  • Deploy efficient inference pipelines for serving LLMs at scale
Requirements
  • B.S. or M.S. in Computer Science or related areas
  • Practical experience with deep learning: internships, undergrad or masters’ level research projects in an academic lab, Kaggle competitions, or interesting side projects
  • Strong programming skills in Python and modern ML frameworks
  • Excellent understanding of transformers and LLM fundamentals
  • Comfort working across research and engineering boundaries
Nice to have
  • Experience with NVIDIA GPU programming and CUDA
  • Experience with distributed training frameworks, such as DeepSpeed, FSDL, Ray
  • Experience with inference frameworks like vLLM
  • Experience with large-scale data processing (Spark, Beam) and orchestration (Airflow)
  • Experience with MLOps and experiment tracking
  • Experience with DevOps tools
  • Familiarity with cloud-based infrastructure (AWS/GCP)
#J-18808-Ljbffr