1

Machine Learning Compiler Engineer Jobs in New York

We are looking for a Machine Learning Engineer to help us create artificial intelligence products. Machine Learning Engineer responsibilities include creating machine learning models and retraining ...

About the Role We are seeking a skilled and innovative Machine Learning Engineer to join our team. This person will implement and develop machine learning models to enhance our platform ...

Machine Learning Engineers build production grade machine learning algorithms that operate in real time or at scale. They have a very deep understanding of machine learning algorithms and cloud ...

We are seeking a Machine Learning Engineer to join the High Frequency Trading Technology team. This role will apply the latest AI technologies to solve various real-world problems and streamline day ...

We are seeking a Machine Learning Engineer to join the High Frequency Trading Technology team. This role will apply the latest AI technologies to solve various real-world problems and streamline day ...

Machine Learning Engineer

New York, NY · On-site +1

$170K - $212K/yr

We're looking for a Machine Learning Engineer to help us build systems that more accurately understand the performance that promotion can have, giving customers actionable insights for building their ...

Machine Learning Engineer

New York, NY · On-site +1

$170K - $212K/yr

We're looking for a Machine Learning Engineer to help us build systems that more accurately understand the performance that promotion can have, giving customers actionable insights for building their ...

Treeswift is seeking a highly skilled and motivated engineer to join our team. You will play a pivotal role in developing and deploying state-of-the-art machine learning solutions to advance our ...

We are looking for an engineer with robust experience in machine learning and strong mathematical foundations to join our growing ML team and to help drive the direction of our ML platform. Machine ...

We are looking for an engineer with robust experience in machine learning and strong mathematical foundations to join our growing ML team and to help drive the direction of our ML platform. Machine ...

As a Machine Learning Senior Engineer, you will be involved in major architectural decisions and developments on algorithms, focusing particularly on deep neural network algorithms. Responsibilities ...

Machine Learning Engineer

New York, NY · Hybrid

$90K - $254K/yr

We are in search of an exceptional Machine Learning Engineer to join our accomplished team. In this role, you will take the lead in developing and fine-tuning predictive ML models, with a primary ...

next page

Showing results 1-20

People also search for

Machine Learning Compiler Engineer information

See New York salary details

$34.5K

$140.9K

$211.7K

How much do machine learning compiler engineer jobs pay per year?

As of Jun 8, 2026, the average yearly pay for machine learning compiler engineer in New York is $140,878.00, according to ZipRecruiter salary data. Most workers in this role earn between $111,000.00 and $169,600.00 per year, depending on experience, location, and employer.

What is a Machine Learning Compiler Engineer job?

A Machine Learning Compiler Engineer focuses on optimizing and building compilers that translate high-level machine learning models into efficient code runnable on specialized hardware (e.g., GPUs, TPUs). They work on improving performance, memory usage, and execution efficiency of ML workloads by designing compiler optimizations, code generation techniques, and leveraging frameworks like LLVM or MLIR. Their role bridges the gap between ML researchers and hardware engineers, ensuring models run efficiently on target platforms.

What are the typical daily responsibilities of a Machine Learning Compiler Engineer?

As a Machine Learning Compiler Engineer, your daily responsibilities often include designing and implementing new compiler optimizations, collaborating with machine learning researchers to support model deployment, and debugging performance or correctness issues in compiled code. You may participate in code reviews, write technical documentation, and conduct benchmarking to evaluate how machine learning models perform on various hardware backends. Close collaboration with hardware engineers, software architects, and data scientists is common, ensuring end-to-end solutions meet both research and production requirements. Staying updated with the latest advancements in both compiler technology and machine learning frameworks is also a key aspect of the role.

What are the key skills and qualifications needed to thrive in the Machine Learning Compiler Engineer position, and why are they important?

A Machine Learning Compiler Engineer needs a deep understanding of computer science fundamentals, compiler theory, and experience with machine learning frameworks, often supported by a relevant degree in computer science or engineering. Proficiency with tools such as LLVM, TVM, MLIR, and languages like C++, Python, and CUDA is typically required, and familiarity with hardware architectures is a plus. Strong problem-solving, teamwork, and communication skills are essential for collaborating with cross-functional teams and addressing complex system issues. These capabilities are important for designing and optimizing compilers that enable scalable and efficient deployment of machine learning models on diverse hardware platforms.

What are the most commonly searched types of Machine Learning Compiler Engineer jobs in New York? The most popular types of Machine Learning Compiler Engineer jobs in New York are:
Infographic showing various Machine Learning Compiler Engineer job openings in New York as of May 2026, with employment types broken down into 94% Full Time, 2% Part Time, 2% Contract, and 2% Nights. Highlights an 94% Physical, 1% Hybrid, and 5% Remote job distribution, with an average salary of $140,878 per year, or $67.7 per hour.
Machine Learning Compiler Engineer

Machine Learning Compiler Engineer

Qualcomm

New York, NY • On-site

Full-time

Posted 2 days ago


Qualcomm rating

9.6

Company rating: 9.6 out of 10

Based on 5 frontline employees who took The Breakroom Quiz

4th of 186 rated software companies


Job description

Company:
Qualcomm Technologies, Inc.
Job Area:
Engineering Group, Engineering Group > Machine Learning Engineering
General Summary:
If you're interested in advancing and applying mathematics, programming languages theory, advanced algorithms, and generative AI to program optimization for cutting-edge machine learning accelerators, then you really want to be talking to us!
The Compiler Labs unit in Qualcomm's AI Software department is looking for ML Compiler engineers to join our team. We work tactically on improving existing ML compilers and strategically on developing new and innovative ML compilers.
Mapping ML algorithms to ML accelerators is currently one of the most interesting and challenging problems in compilers. Our compiler targets include the Qualcomm Hexagon Neural Signal Processor, Adreno GPUs, low-power ML accelerators, and CPU accelerators.
What makes this work exciting right now
The complexity of modern ML architectures demands multi-tier compilers and new thinking about phase ordering. Polyhedral optimization is directly relevant to the deeply nested imperfect loop nests that characterize generative AI - and the implied execution model is pulling polyhedral techniques toward dataflow concepts and structured speculation. Communication-avoiding algorithms from high-performance computing are increasingly relevant. We are advancing compilers and intermediate representations that generalize cleanly across new innovations in ML model algorithms, so that our work compounds rather than restarts. We are working on correctness verification for programs built around quantized neural operators. And we are contributing to open-source dialect convergence in the LLVM and MLIR ecosystems - we have open-sourced our Hexagon-MLIR compiler and are actively developing it for Triton and Torch-MLIR flows.
Generative AI is part of the work
Generative AI is reshaping compiler development itself - both as a tool that accelerates how engineers build compilers, and as a capability that lives inside compilers. Domain-specific languages are a particularly strong target for AI tools in compilation, because the compression, abstraction, and structure DSLs provide give AI models the right level of representation to operate on. We expect our engineers to be fluent in incorporating generative AI into the compiler development workflow and into compilers themselves.
Our technical approach
Our approach emphasizes powerful representations for precisely and compactly modeling programs and the optimization challenges, and using advanced mathematics and algorithms for performing optimizations. We are also solid in using "old school" compiler technologies as they apply to contemporary ML challenges, and in meticulous software engineering to produce beautiful compilers. We are keen about seeing our compilers used and having large impact on Qualcomm's business.
Levels and locations
This job description spans multiple levels, from entry to experienced. Our team is a good home for compiler developers with advanced degrees, and we have solid mentoring and give substantial responsibility quickly to entry-level engineers.
We are looking for candidates to join our teams in New York City, Austin, San Diego, and Raleigh, NC. For experienced candidates, we may consider remote work arrangements.
Responsibilities
  • Work on a wide range of ML compilers
  • Improve ML compiler optimization capabilities through benchmark analysis and profiling
  • Innovate new ML compiler and optimization algorithms
  • Incorporate generative AI into the compiler development workflow and into compilers themselves
  • Upstream compiler algorithms to open-source compiler projects
  • Author research publications and represent the company in conferences and industry forums
  • For senior levels - lead and manage projects while doing substantial technical work
Required
  • Experience with compiler development and computer architecture
  • ML experience
  • A degree in the field of computer science or applied mathematics
  • Experience with software engineering
  • Solid intellectual ability, motivation, and a strong history of achievement
  • Excellent oral and written communication skills
Desired
  • Experience with MLIR, MLIR dialects (LinAlg, Affine), PyTorch 2.0, TVM, Triton, and/or LLVM
  • Experience incorporating generative AI into compiler development workflow (AI-assisted code generation, AI-assisted analysis, AI-assisted refactoring and review)
  • Experience designing or extending DSLs as targets for AI-driven program synthesis
  • ML applications and ML optimization experience
  • ML architecture experience
  • High-performance computing experience, including communication-avoiding algorithms
  • Polyhedral compiler optimization experience
  • Loop transformation and vectorization experience
  • GPU programming, parallel programming experience
  • General optimization experience

Minimum Qualifications:
• Bachelor's degree in Computer Science, Engineering, Information Systems, or related field and 8+ years of Hardware Engineering, Software Engineering, Systems Engineering, or related work experience.
OR
Master's degree in Computer Science, Engineering, Information Systems, or related field and 7+ years of Hardware Engineering, Software Engineering, Systems Engineering, or related work experience.
OR
PhD in Computer Science, Engineering, Information Systems, or related field and 6+ years of Hardware Engineering, Software Engineering, Systems Engineering, or related work experience.
Qualcomm is an equal opportunity employer. If you are an individual with a disability and need an accommodation during the application/hiring process, rest assured that Qualcomm is committed to providing an accessible process. You may e-mail disability-accomodations@qualcomm.com or call Qualcomm's toll-free number found here. Upon request, Qualcomm will provide reasonable accommodations to support individuals with disabilities to be able participate in the hiring process. Qualcomm is also committed to making our workplace accessible for individuals with disabilities. (Keep in mind that this email address is used to provide reasonable accommodations for individuals with disabilities. We will not respond here to requests for updates on applications or resume inquiries).
To all Staffing and Recruiting Agencies: Our Careers Site is only for individuals seeking a job at Qualcomm. Staffing and recruiting agencies and individuals being represented by an agency are not authorized to use this site or to submit profiles, applications or resumes, and any such submissions will be considered unsolicited. Qualcomm does not accept unsolicited resumes or applications from agencies. Please do not forward resumes to our jobs alias, Qualcomm employees or any other company location. Qualcomm is not responsible for any fees related to unsolicited resumes/applications.
EEO Employer: Qualcomm is an equal opportunity employer; all qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, Veteran status, or any other protected classification.
Qualcomm expects its employees to abide by all applicable policies and procedures, including but not limited to security and other requirements regarding protection of Company confidential information and other confidential and/or proprietary information, to the extent those requirements are permissible under applicable law.
Pay range and Other Compensation & Benefits:
$200,800.00 - $301,200.00
The above pay scale reflects the broad, minimum to maximum, pay scale for this job code for the location for which it has been posted. Even more importantly, please note that salary is only one component of total compensation at Qualcomm. We also offer a competitive annual discretionary bonus program and opportunity for annual RSU grants (employees on sales-incentive plans are not eligible for our annual bonus). In addition, our highly competitive benefits package is designed to support your success at work, at home, and at play. Your recruiter will be happy to discuss all that Qualcomm has to offer - and you can review more details about our US benefits at this link.
If you would like more information about this role, please contact Qualcomm Careers.

Qualcomm logo

About Qualcomm

Sourced by ZipRecruiter

Qualcomm is enabling a world where everyone and everything can be intelligently connected. You interact with products and technologies made possible by Qualcomm every day, including 5G-enabled smartphones that double as pro-level cameras and gaming devices, smarter vehicles and cities, and the technology behind the smart, connected factories that manufactured your latest purchase. Our powerful connectivity solutions keep you connected—even in remote areas. Qualcomm 5G and AI innovations are the power behind the connected intelligent edge. You’ll find our technologies behind and inside the innovations that deliver significant value across multiple industries and to billions of people every day.

Industry

Technology, communication and media

Company size

10,000+ Employees

Headquarters location

San Diego, CA, US

Year founded

1985