ZipRecruiter

Log In

1

Machine Learning Compiler Engineer Jobs in New York

Teleskope

Machine Learning Engineer

New York, NY · On-site

$160K - $210K/yr

About the role We are seeking a Machine Learning Engineer to strengthen our element classification system - working closely with data scientists and data annotators to ship and improve entity ...

DraftKings

Senior Machine Learning Engineer

New York, NY · On-site

$114K - $157K/yr

The Crown Is Yours As a Senior Machine Learning Engineer, you'll join a team of algorithm experts and data science technologists building innovative data products that solve analytically complex ...

SageSure

Senior Machine Learning Engineer

Jersey City, NJ · On-site

$127K - $168K/yr

As a Senior Machine Learning Engineer, you'll play a crucial role in optimizing orchestration processes and ensuring fast and efficient model deployment and delivery. You'll work closely with ...

Comcast

Machine Learning Engineer 2

New York, NY · On-site

$126K - $189K/yr

Innovating by contributing to the creation of patents, Application Programming Interfaces (APIs), and other intellectual property * Testing and evaluating machine learning solutions from internal and ...

Capital One

Lead Machine Learning Engineer

New York, NY · On-site +1

$112K - $147K/yr

Lead Machine Learning Engineer As a Capital One Machine Learning Engineer (MLE), you'll be part of an Agile team dedicated to productionizing machine learning applications and systems at scale. You ...

WireScreen

Machine Learning Engineer

New York, NY · On-site

$150K - $195K/yr

As a Machine Learning Engineer at WireScreen, you will be working across our data systems to unlock the source of truth behind one of the world's economic powerhouses: China. This role is critical to ...

Optiver

Machine Learning Research Engineer

New York, NY

$224K/yr

Optiver is a seeking a Machine Learning Research Engineer to join our team, focusing on a pivotal AI initiative. This role would offer the opportunity to have significant impact across Machine ...

PROPRIUS

Senior Machine Learning Engineer

New York, NY

$114K - $157K/yr

Sr. Machine Learning Engineer Location: New York, NY Sponsorship: Yes Relocation: Yes Industry: Machine Learning A leading provider of AI is looking for a Sr. ML Engineer. Our client is an industry ...

Capital One

Lead Machine Learning Engineer

New York, NY · On-site

$112K - $147K/yr

Lead Machine Learning Engineer As a Capital One Machine Learning Engineer (MLE), you'll be part of an Agile team dedicated to productionizing machine learning applications and systems at scale. You ...

SageSure

Senior Machine Learning Engineer

Jersey City, NJ · On-site

$127K - $168K/yr

As a Senior Machine Learning Engineer, you'll play a crucial role in optimizing orchestration processes and ensuring fast and efficient model deployment and delivery. You'll work closely with ...

Capital One

Lead Machine Learning Engineer

New York, NY · On-site +1

$112K - $147K/yr

Lead Machine Learning Engineer As a Capital One Machine Learning Engineer (MLE), you'll be part of an Agile team dedicated to productionizing machine learning applications and systems at scale. You ...

next page

Showing results 1-20

All JobsMachine Learning Compiler Engineer JobsMachine Learning Compiler Engineer Jobs in New York

Machine Learning Compiler Engineer information

See New York salary details

$34.5K

$140.9K

$211.7K

How much do machine learning compiler engineer jobs pay per year?

As of Jul 22, 2026, the average yearly pay for machine learning compiler engineer in New York is $140,878.00, according to ZipRecruiter salary data. Most workers in this role earn between $111,000.00 and $169,600.00 per year, depending on experience, location, and employer.

What is a Machine Learning Compiler Engineer job?

A Machine Learning Compiler Engineer focuses on optimizing and building compilers that translate high-level machine learning models into efficient code runnable on specialized hardware (e.g., GPUs, TPUs). They work on improving performance, memory usage, and execution efficiency of ML workloads by designing compiler optimizations, code generation techniques, and leveraging frameworks like LLVM or MLIR. Their role bridges the gap between ML researchers and hardware engineers, ensuring models run efficiently on target platforms.

What are the typical daily responsibilities of a Machine Learning Compiler Engineer?

As a Machine Learning Compiler Engineer, your daily responsibilities often include designing and implementing new compiler optimizations, collaborating with machine learning researchers to support model deployment, and debugging performance or correctness issues in compiled code. You may participate in code reviews, write technical documentation, and conduct benchmarking to evaluate how machine learning models perform on various hardware backends. Close collaboration with hardware engineers, software architects, and data scientists is common, ensuring end-to-end solutions meet both research and production requirements. Staying updated with the latest advancements in both compiler technology and machine learning frameworks is also a key aspect of the role.

What are the key skills and qualifications needed to thrive in the Machine Learning Compiler Engineer position, and why are they important?

A Machine Learning Compiler Engineer needs a deep understanding of computer science fundamentals, compiler theory, and experience with machine learning frameworks, often supported by a relevant degree in computer science or engineering. Proficiency with tools such as LLVM, TVM, MLIR, and languages like C++, Python, and CUDA is typically required, and familiarity with hardware architectures is a plus. Strong problem-solving, teamwork, and communication skills are essential for collaborating with cross-functional teams and addressing complex system issues. These capabilities are important for designing and optimizing compilers that enable scalable and efficient deployment of machine learning models on diverse hardware platforms.

What are the most commonly searched types of Machine Learning Compiler Engineer jobs in New York? The most popular types of Machine Learning Compiler Engineer jobs in New York are:
What are popular job titles related to Machine Learning Compiler Engineer jobs in New York? For Machine Learning Compiler Engineer jobs in New York, the most frequently searched job titles are:
What job categories do people searching Machine Learning Compiler Engineer jobs in New York look for? The top searched job categories for Machine Learning Compiler Engineer jobs in New York are:
Machine Learning Compiler Engineer jobs near you
Infographic showing various Machine Learning Compiler Engineer job openings in New York as of July 2026, with employment types broken down into 93% Full Time, and 7% Nights. Highlights an 100% In-person job distribution, with an average salary of $140,878 per year, or $67.7 per hour.
Machine Learning Engineer

Machine Learning Engineer

Teleskope

New York, NY • On-site

$160K - $210K/yr

Full-time

Medical, Dental, Vision, Retirement, PTO

Posted yesterday

Job description

About Teleskope
Teleskope is redefining data security for the AI era with the only dedicated platform that combines precise visibility with automated remediation. Teleskope continuously scans, catalogs and classifies data in-motion and at-rest while automating policy-based actions, helping organizations proactively manage data sprawl while securely enabling AI adoption.
Fresh off our $25 million Series A round, Teleskope is entering a high-growth phase backed by top-tier investors and exceptional product-market fit.
About the role
We are seeking a Machine Learning Engineer to strengthen our element classification system - working closely with data scientists and data annotators to ship and improve entity classification pipelines across varied data sources (text, documents, relational data, OCR, etc.). This role will bridge research experimentation and production implementation, helping evolve our current pipelines and advance toward our next generation element classification system.
This is a hybrid role requiring 3+ days in-office in New York City.
What You'll Do:
  • Lead a team responsible for building, maintaining, and scaling production ML pipelines for entity extraction and data element classification across diverse data types.
  • Partner with both analytics and ML-focused data scientists to translate experiments into deployed systems and unblock technical bottlenecks.
  • Implement evaluation, monitoring, and regression testing frameworks in collaboration with QC.
  • Drive incremental improvements to classification models and pipelines with a focus on measurable impact.
  • Advocate for and implement best practices around model deployment, versioning, and operational monitoring.

About you:
  • 4+ years of experience building and deploying ML systems in production.
  • Strong experience with NLP systems and supervised entity classification models.
  • Comfort moving from research prototypes to CI/CD and production pipelines.
  • Proficiency in Python with common ML tooling.
  • Strong analytical instincts and problem solving under ambiguity.
  • Collaborative communicator who can partner across data science and engineering functions.

What you'll get:
  • A high-impact role at an early-stage startup in a fast-growing market.
  • Ownership over ML systems that directly power every customer workflow on the platform.
  • An opportunity to contribute to core ML systems that power our classification service.
  • A beautiful, well-stocked office in NYC's Financial District.
  • Flexible vacation and work from home days.
  • Competitive salary and meaningful equity.
  • Health, vision, dental, 401k and more benefits, heavily subsidized by Teleskope.

What We Value:
At Teleskope, we value strong engineers who build real systems. We look for team members who combine ML depth with pragmatic execution, take ownership of critical infrastructure, and ship reliable solutions that deliver real-world security and privacy outcomes.

Apply