ZipRecruiter

Log In

1

Weekend Software Engineer Gpu Jobs in New York (NOW HIRING)

YO AI Labs

CUDA Software Engineer - Remote

New York, NY · Remote

$60 - $100/hr

You will apply your expertise in CUDA, C++, and GPU programming to analyze, optimize, and improve high-performance GPU kernels. No prior AI experience is required. Key Responsibilities * Analyze ...

New

ornn.com

Software Engineer

New York, NY · On-site

Familiarity with GPU compute, cloud infrastructure, or datacenter operations. * Experience with IaC ... The near term engineering execution will define whether Fabric can onboard its first cohort of ...

previous pagenext page

Showing results 21-40

All JobsSoftware Engineer Gpu JobsWeekend Software Engineer Gpu JobsWeekend Software Engineer Gpu Jobs in New York

Weekend Software Engineer Gpu information

What is the difference between Weekend Software Engineer Gpu vs Weekend Software Engineer Cloud?

AspectWeekend Software Engineer GpuWeekend Software Engineer Cloud
Required CredentialsBachelor's in Computer Science or related, experience with GPU programmingBachelor's in Computer Science or related, experience with cloud platforms
Work EnvironmentOn-site or remote, focused on GPU hardware and softwareRemote or hybrid, focused on cloud infrastructure and services
Industry UsageGaming, AI, high-performance computingWeb services, SaaS, enterprise solutions
Search & Comparison IntentYesYes

The Weekend Software Engineer Gpu and Weekend Software Engineer Cloud roles share similar educational backgrounds and work environments but differ in focus areas. The GPU role emphasizes hardware acceleration and high-performance computing, while the Cloud role centers on cloud infrastructure and services. Both are in high demand and often compared by job seekers exploring flexible tech roles.

What are the most commonly searched types of Software Engineer Gpu jobs in New York?

The most popular types of Software Engineer Gpu jobs in New York are:

What cities in New York are hiring for Weekend Software Engineer Gpu jobs?

Cities in New York with the most Weekend Software Engineer Gpu job openings:

Weekend Software Engineer Gpu jobs near you

Software Engineer, Inference Runtime

LM Studio

New York, NY • On-site

$150K - $350K/yr

Full-time

Medical, Dental, Vision, PTO

Posted 8 days ago

Job description

LM Studio is used by millions of people around the world to run AI on their own computers, and now with Bionic - also in the cloud. Our values prioritize putting the human in the center, and creating tools that we want to use ourselves, and recommend to our friends and family.
As a team, we work with high technical intensity and personal responsibility. We are looking for curious, self-motivated, creative, and technically excellent teammates to join us and build the future of human-AI interactions in software.
The Role
We are looking for an Inference Runtime Software Engineer to push forward LM Studio's inference stack on-device and in the cloud. You will integrate new inference engines and runtime capabilities, bring up new open-weight models and modalities, and optimize model execution for a wide range of CPU and GPU targets. You will also contribute improvements to the open-source projects we build on.
Qualifications
  • Significant experience building production ML systems, inference runtimes, or performance-sensitive infrastructure
  • Strong programming ability in Python and C++
  • Deep understanding of transformer architectures and the mechanics of model inference
  • Experience profiling CPU or GPU workloads and reasoning about compute, memory, synchronization, and data movement
  • Experience with PyTorch and inference systems such as llama.cpp, MLX, ExecuTorch, vLLM, SGLang, or TensorRT-LLM
  • Strong debugging instincts across model code, runtime internals, operating systems, and CPU or GPU execution
  • Takes personal responsibility for the correctness and performance of their work

Bonus Qualifications
  • Past contributions to open-source inference runtime projects such as llama.cpp, MLX, ExecuTorch, vLLM, SGLang, or TensorRT-LLM

Responsibilities
  • Maintain and push forward our inference stack on-device and in the cloud
  • Bring up new model architectures and multimodal models
  • Improve latency, throughput, memory use, and reliability across CPU, CUDA, Metal, Vulkan, and ROCm runtimes
  • Build runtime capabilities for model loading, batching, scheduling, caching, and distributed execution
  • Benchmark and diagnose correctness and performance problems across the inference stack
  • Contribute upstream to open-source projects such as llama.cpp and MLX

Benefits
  • Competitive salary and equity grants
  • Great medical, vision, dental healthcare plans
  • Catered team lunch / expensed dinners in the office
  • Flexible PTO
  • Flexible WFH
  • Sun-drenched office in SoHo in NYC

Apply