ZipRecruiter

Log In

1

Machine Learning Compiler Engineer Jobs in New York

Canals

Machine Learning Engineer

New York, NY · Remote

We're looking for a senior-level Machine Learning Engineer who can move quickly while maintaining high quality, owning end-to-end ML pipelines while shaping product features that deliver real-world ...

Canals

Machine Learning Engineer

New York, NY · On-site

We're looking for a senior-level Machine Learning Engineer who can move quickly while maintaining high quality, owning end-to-end ML pipelines while shaping product features that deliver real-world ...

Virtu Financial

Machine Learning Engineer

New York, NY · On-site

$200K - $300K/yr

Virtu's Research Technology team is looking for an experienced Machine Learning Engineer to join a small group of technologists whose primary function is building the infrastructure that powers our ...

Virtu Financial

Machine Learning Engineer

New York, NY

$200K - $300K/yr

Virtu's Research Technology team is looking for an experienced Machine Learning Engineer to join a small group of technologists whose primary function is building the infrastructure that powers our ...

Harnham

Lead Machine Learning Engineer

Manhattan, NY · On-site

$113K - $148K/yr

Lead Machine Learning Engineer New York City, NY - Hybrid (3 days per week onsite) $200,000 - $220,000 Base Salary+ Bonus + RSU package available THE COMPANY We are partnering with a leading consumer ...

RunSybil

Machine Learning Engineer

New York, NY · On-site

About this Role We are seeking talented engineers intent on changing the security industry. If you ... Understanding of both modern and classic machine learning techniques * Equally comfortable with ...

Spgi

Machine Learning Engineer

New York, NY · On-site +1

$209K - $250K/yr

Machine Learning Engineer Location: 55 Water Street, New York, NY 10041 (Telecommuting permitted within normal commuting distance of New York, NY office) Job Duties: Kensho Technologies LLC seeks a ...

Teleskope

Machine Learning Engineer

New York, NY · On-site

$160K - $210K/yr

About the role We are seeking a Machine Learning Engineer to strengthen our element classification system - working closely with data scientists and data annotators to ship and improve entity ...

S&P Global

Machine Learning Engineer II

Manhattan, NY · On-site

We are seeking a mid-level Machine Learning Engineer to help develop and scale RAG systems across the company. This is a hands-on, full-lifecycle ML role with a strong emphasis on retrieval models ...

S&P Global

Machine Learning Engineer II

New York, NY

We are seeking a mid-level Machine Learning Engineer to help develop and scale RAG systems across the company. This is a hands-on, full-lifecycle ML role with a strong emphasis on retrieval models ...

previous pagenext page

Showing results 21-40

All JobsMachine Learning Compiler Engineer JobsMachine Learning Compiler Engineer Jobs in New York

Machine Learning Compiler Engineer information

See New York salary details

$34.5K

$140.9K

$211.7K

How much do machine learning compiler engineer jobs pay per year?

As of Sep 2, 2026, the average yearly pay for machine learning compiler engineer in New York is $140,878.00, according to ZipRecruiter salary data. Most workers in this role earn between $111,000.00 and $169,600.00 per year, depending on experience, location, and employer.

What is a machine learning compiler engineer?

A Machine Learning Compiler Engineer focuses on optimizing and building compilers that translate high-level machine learning models into efficient code runnable on specialized hardware (e.g., GPUs, TPUs). They work on improving performance, memory usage, and execution efficiency of ML workloads by designing compiler optimizations, code generation techniques, and leveraging frameworks like LLVM or MLIR. Their role bridges the gap between ML researchers and hardware engineers, ensuring models run efficiently on target platforms.

What are the typical daily responsibilities of a machine learning compiler engineer?

As a Machine Learning Compiler Engineer, your daily responsibilities often include designing and implementing new compiler optimizations, collaborating with machine learning researchers to support model deployment, and debugging performance or correctness issues in compiled code. You may participate in code reviews, write technical documentation, and conduct benchmarking to evaluate how machine learning models perform on various hardware backends. Close collaboration with hardware engineers, software architects, and data scientists is common, ensuring end-to-end solutions meet both research and production requirements. Staying updated with the latest advancements in both compiler technology and machine learning frameworks is also a key aspect of the role.

What are the key skills and qualifications needed to thrive as a machine learning compiler engineer?

A Machine Learning Compiler Engineer needs a deep understanding of computer science fundamentals, compiler theory, and experience with machine learning frameworks, often supported by a relevant degree in computer science or engineering. Proficiency with tools such as LLVM, TVM, MLIR, and languages like C++, Python, and CUDA is typically required, and familiarity with hardware architectures is a plus. Strong problem-solving, teamwork, and communication skills are essential for collaborating with cross-functional teams and addressing complex system issues. These capabilities are important for designing and optimizing compilers that enable scalable and efficient deployment of machine learning models on diverse hardware platforms.

What are the most commonly searched types of Machine Learning Compiler Engineer jobs in New York?

The most popular types of Machine Learning Compiler Engineer jobs in New York are:

What are popular job titles related to Machine Learning Compiler Engineer jobs in New York?

For Machine Learning Compiler Engineer jobs in New York, the most frequently searched job titles are:

What job categories do people searching Machine Learning Compiler Engineer jobs in New York look for?

The top searched job categories for Machine Learning Compiler Engineer jobs in New York are:

Machine Learning Compiler Engineer jobs near you
Infographic showing various Machine Learning Compiler Engineer job openings in New York as of August 2026, with employment types broken down into 1% As Needed, 79% Full Time, 19% Part Time, and 1% Contract. Highlights an 87% Physical, 2% Hybrid, and 11% Remote job distribution, with an average salary of $140,878 per year, or $67.7 per hour.

Machine Learning Engineer

Canals

New York, NY • Remote

Full-time

Re-posted 24 days ago

Job description

About Canals

Canals builds software for wholesale distributors, helping them operate more efficiently through automation and AI.

Our customers are the companies responsible for moving the materials that power the real economy; electrical supplies, plumbing products, roofing materials, HVAC equipment, and more. Every day, thousands of people rely on Canals to help process orders, manage purchasing, handle accounts payable, and streamline critical business workflows.

We're a profitable, rapidly growing company with a team of roughly 100 people distributed across North and South America. We care deeply about building great products, hiring exceptional people, and creating an environment where talented individuals can do the best work of their careers.

The Role

Our customer base is expanding fast, and AI is central to how we scale and deliver value. We’re looking for a senior-level Machine Learning Engineer who can move quickly while maintaining high quality, owning end-to-end ML pipelines while shaping product features that deliver real-world impact.

What You’ll Do

  • Design, build, and maintain scalable machine learning models that improve and automate logistics processes for our customers.

  • Own projects end-to-end, from problem definition and data exploration to model deployment and monitoring in production.

  • Collaborate closely with engineering teams to align ML work with customer needs and deliver features that drive business value.

  • Serve as a technical leader and mentor within the ML area, reviewing code and ensuring best practices for reproducibility, quality, and performance.

  • Evaluate and implement tools and frameworks to improve our ML infrastructure and workflows.

  • Help shape the future of Canals as we continue scaling with our customers.

What You'll Bring

  • Senior-level experience building and deploying machine learning models in production environments.

  • Experience designing scalable data pipelines and working with large datasets.

  • Comfort taking ownership of projects and ensuring models deliver real, measurable customer value.

  • Strong Python skills with knowledge of ML frameworks (e.g., scikit-learn, PyTorch, TensorFlow) and data tools (e.g., Pandas, Spark).

  • Ability to guide and unblock others, providing thoughtful code reviews and architectural feedback.

  • Experience working independently in a fast-paced, product-focused environment.

  • Previous experience in high-growth startups or small teams is a plus.

  • Familiarity with MLOps practices and tools is a plus.

Why Join Canals

We're building software that solves real problems for an industry that keeps the world running. Our customers rely on our platform every day to operate their businesses.

We've found strong product-market fit and continue to grow quickly, creating opportunities for people who want to have a meaningful impact on the trajectory of a company.

We believe great people build great companies. That's why we invest heavily in hiring, development, and creating an environment where talented individuals can do the best work of their careers.

You'll work alongside ambitious, thoughtful teammates who care deeply about what they do, challenge each other directly, and have a lot of fun along the way.

We value ownership, transparency, and continuous improvement. Good ideas can come from anywhere, and people are trusted to make things happen.

We're remote-first, flexible, and distributed across North and South America, bringing together talented people from a wide range of backgrounds and experiences.

Canals.ai is an equal opportunity employer. In addition to EEO being the law, it is a policy that is fully consistent with our principles. All qualified applicants will receive consideration for employment without regard to status as a protected veteran or a qualified individual with a disability, or other protected status such as race, religion, color, national origin, sex, sexual orientation, gender identity, genetic information, pregnancy or age.