Ml Inference Jobs in New York (NOW HIRING)

Deploying real-time ML inference pipelines processing millions of records at high throughput * Experience building end to end automated MLOps capabilities along with model and feature drift ...

ML compilers and framework internals: PyTorch internals, torch.compile, custom operators ... Low-precision inference: INT8/FP8/FP4 quantization, mixed-precision serving. * Profiling and ...

Develop infrastructure components for our ML inference platform using Python and Go * Implement and maintain Kubernetes deployments for model serving * Contribute to our inference orchestration layer ...

The ML Engineer has hands-on experience building and optimizing ML inference systems that run in production environments. This role will develop and tune pipelines that transform millions of photos ...

The ML Engineer has hands-on experience building and optimizing ML inference systems that run in production environments. This role will develop and tune pipelines that transform millions of photos ...

Hands-on experience with managed ML inference and serving platforms such as AWS SageMaker and GCP Vertex AI. * A proven track record operating inference at large scale across a range of model types ...

Work with model developers to tune their neural networks for better inference efficiency and ... working with ML inference or linear algebra computation * C++ programming skills, including ...

Oversee technical strategy and architecture in ML Inference Platform services * Design, implement, and scale critical engineering components and services to support ML inference and deployment * Work ...

Oversee technical strategy and architecture in ML Inference Platform services * Design, implement, and scale critical engineering components and services to support ML inference and deployment * Work ...

Can be anywhere in that lifecycle, from training machine learning systems, to creating the interfaces users use to navigate inference results. * An interest and passion for AI/ML systems, if you ...

Can be anywhere in that lifecycle, from training machine learning systems, to creating the interfaces users use to navigate inference results. * An interest and passion for AI/ML systems, if you ...

Optimize and tune kernels and compiled code to achieve latency targets for ML inference * Conduct design and code reviews. Evaluate code performance, debug, diagnose and drive resolution of compiler ...

Implement, refine, and productionize cutting-edge techniques (quantization, speculative decoding, kv cache reuse, chunked prefill and LoRA) for ML model inference and infrastructure. * Deep dive into ...

The AI/ML TPM team owns delivery and execution across CoreWeave's AI/ML Platform Services ... The Inference team is responsible for building and operating highly scalable, reliable production ...

The AI/ML TPM team owns delivery and execution across CoreWeave's AI/ML Platform Services ... The Inference team is responsible for building and operating highly scalable, reliable production ...

The AI/ML TPM team owns delivery and execution across CoreWeave's AI/ML Platform Services ... The Inference team is responsible for building and operating highly scalable, reliable production ...

What You'll Own - Real-Time Proxy Bidding Engine (Tier 1) - Define and lead the engine that computes per-request bids at sub-millisecond latency, build the ML inference infrastructure serving model ...

What You'll Own - Real-Time Proxy Bidding Engine (Tier 1) - Define and lead the engine that computes per-request bids at sub-millisecond latency, build the ML inference infrastructure serving model ...

What You'll Own - Real-Time Proxy Bidding Engine (Tier 1) - Define and lead the engine that computes per-request bids at sub-millisecond latency, build the ML inference infrastructure serving model ...

About the Role We're looking for a AI/ML Engineer (Senior/Staff/Principal) - Threat Detection who will design, build, and operationalize the detection algorithms, ML inference pipelines, and risk ...