1

Machine Learning Compiler Engineer Jobs in Boston, MA

Lead Machine Learning Engineer

Cambridge, MA · On-site

$112K - $147K/yr

Lead Machine Learning Engineer At Capital One, we are changing banking for good by creating responsible and reliable AI-powered systems. Our investments in technology infrastructure and world-class ...

Lead Machine Learning Engineer

Cambridge, MA · On-site

$112K - $147K/yr

Lead Machine Learning Engineer At Capital One, we are changing banking for good by creating responsible and reliable AI-powered systems. Our investments in technology infrastructure and world-class ...

Showing results 41-60

Machine Learning Compiler Engineer information

See Boston, MA salary details

$34.2K

$139.9K

$210.2K

How much do machine learning compiler engineer jobs pay per year?

As of Sep 9, 2026, the average yearly pay for machine learning compiler engineer in Boston, MA is $139,895.00, according to ZipRecruiter salary data. Most workers in this role earn between $110,300.00 and $168,400.00 per year, depending on experience, location, and employer.

What is a machine learning compiler engineer?

A Machine Learning Compiler Engineer focuses on optimizing and building compilers that translate high-level machine learning models into efficient code runnable on specialized hardware (e.g., GPUs, TPUs). They work on improving performance, memory usage, and execution efficiency of ML workloads by designing compiler optimizations, code generation techniques, and leveraging frameworks like LLVM or MLIR. Their role bridges the gap between ML researchers and hardware engineers, ensuring models run efficiently on target platforms.

What are the typical daily responsibilities of a machine learning compiler engineer?

As a Machine Learning Compiler Engineer, your daily responsibilities often include designing and implementing new compiler optimizations, collaborating with machine learning researchers to support model deployment, and debugging performance or correctness issues in compiled code. You may participate in code reviews, write technical documentation, and conduct benchmarking to evaluate how machine learning models perform on various hardware backends. Close collaboration with hardware engineers, software architects, and data scientists is common, ensuring end-to-end solutions meet both research and production requirements. Staying updated with the latest advancements in both compiler technology and machine learning frameworks is also a key aspect of the role.

What are the key skills and qualifications needed to thrive as a machine learning compiler engineer?

A Machine Learning Compiler Engineer needs a deep understanding of computer science fundamentals, compiler theory, and experience with machine learning frameworks, often supported by a relevant degree in computer science or engineering. Proficiency with tools such as LLVM, TVM, MLIR, and languages like C++, Python, and CUDA is typically required, and familiarity with hardware architectures is a plus. Strong problem-solving, teamwork, and communication skills are essential for collaborating with cross-functional teams and addressing complex system issues. These capabilities are important for designing and optimizing compilers that enable scalable and efficient deployment of machine learning models on diverse hardware platforms.

What are the most commonly searched types of Machine Learning Compiler Engineer jobs in Boston, MA?

The most popular types of Machine Learning Compiler Engineer jobs in Boston, MA are:

What are popular job titles related to Machine Learning Compiler Engineer jobs in Boston, MA?

For Machine Learning Compiler Engineer jobs in Boston, MA, the most frequently searched job titles are:

What job categories do people searching Machine Learning Compiler Engineer jobs in Boston, MA look for?

The top searched job categories for Machine Learning Compiler Engineer jobs in Boston, MA are:

Infographic showing various Machine Learning Compiler Engineer job openings in Boston, MA as of September 2026, with employment types broken down into 1% Internship, 1% As Needed, 79% Full Time, 18% Part Time, and 1% Contract. Highlights an 82% Physical, 3% Hybrid, and 15% Remote job distribution, with an average salary of $139,895 per year, or $67.3 per hour.

Machine Learning Engineer II, Logistics AI

Cambridge, MA

Instacart
Technology, Communication and Media • 10K+ employees

Full-time

Re-posted 20 days ago


Key responsibilities

  • Design, develop, and deploy machine learning solutions to address practical challenges in the marketplace.

  • Collaborate with product managers, data scientists, and backend engineers to understand business needs and create ML/AI applications.

  • Refine and advance algorithms and models to improve operational efficiency.


Instacart rating

6.9

Company rating: 6.9 out of 10

Based on 33 frontline employees who took The Breakroom Quiz

35th of 64 rated delivery companies


Job description

We're transforming the grocery industry

At Instacart, we invite the world to share love through food because we believe everyone should have access to the food they love and more time to enjoy it together. Where others see a simple need for grocery delivery, we see exciting complexity and endless opportunity to serve the varied needs of our community. We work to deliver an essential service that customers rely on to get their groceries and household goods, while also offering safe and flexible earnings opportunities to Instacart Personal Shoppers.

Instacart has become a lifeline for millions of people, and we’re building the team to help push our shopping cart forward. If you’re ready to do the best work of your life, come join our table.

Instacart is a Flex First team

There’s no one-size fits all approach to how we do our best work. Our employees have the flexibility to choose where they do their best work—whether it’s from home, an office, or your favorite coffee shop—while staying connected and building community through regular in-person events. Learn more about our flexible approach to where we work.

About the Role:

As a Machine Learning Engineer, you will have the opportunity to collaborate closely with senior engineers and product leaders as part of your team. Together, you'll develop and enhance Instacart's marketplace systems. You will use machine learning to devise and refine solutions in crucial areas such as routing optimization, pricing, dispatch, and mapping. You will actively contribute to initiatives, assisting in all stages from the initial concept, through prototyping and experimentation, to final implementation.

About the Team:

The Logistics AI group is responsible for the intelligence and execution behind Instacart’s fulfillment system. The team optimizes a multi-sided marketplace to ensure customers get their orders on-time and in high quality, shoppers get efficient and fulfilling work, and retailers and consumer brands get reasonable business. The team tackles hard problems in a variety of spaces, such as matching, pricing, and geospatial, as well as foundational problems executing on a high throughput system with dynamic data.

About the Job:

  • Design, develop, and deploy machine learning solutions to tackle practical challenges in the marketplace.
  • Collaborate closely with product managers, data scientists, and backend engineers to deeply understand business needs and create impactful ML/AI applications.
  • Actively engage with diverse stakeholders to ensure that solutions are well-integrated and aligned with business goals.
  • Push the envelope on our operational efficiency by continually refining and advancing our algorithms and models.

About You:

Minimum Qualifications:

  • Have a graduate degree (masters or PhD) in artificial intelligence, machine learning, operations research or equivalent self study and experience 
  • Have strong programming skills in Python and fluency in data manipulation (SQL, Pandas) and Machine Learning (scikit-learn, XGBoost, Keras/Tensorflow) tools
  • Have strong analytical skills and problem-solving ability
  • Are a strong communicator who can collaborate with diverse stakeholders across all levels

Preferred Qualifications:

  • Have 1-2 years of industry experience using machine learning to solve real-world problems with large datasets
  • Knowledge of deep learning frameworks and methodologies
  • Experience in applying machine learning and optimization techniques to solve marketplace problems

Instacart provides highly market-competitive compensation and benefits in each location where our employees work. This role is remote and the base pay range for a successful candidate is dependent on their permanent work location. Please review our Flex First remote work policy here.

Offers may vary based on many factors, such as candidate experience and skills required for the role. Additionally, this role is eligible for a new hire equity grant as well as annual refresh grants. Please read more about our benefits offerings here.

For US based candidates, the base pay ranges for a successful candidate are listed below.


What Instacart employees say

Pay

Benefits

Hours and flexibility

Workplace

Get the full story on Breakroom


Instacart logo

About Instacart

Sourced by ZipRecruiter

Instacart, based in San Francisco, CA, US, operates within the retail industry, specifically grocery delivery and pick-up service. It is recognized as a pioneer in this field, delivering fresh groceries from local stores directly to customers' doors. The company, which launched its services in 2012, continues to pioneer change in the online grocery shopping sector through its commitment to cutting-edge technology, new business ideas, and dedicated service.

Industry

Technology, communication and media

Company size

10,000+ Employees

Headquarters location

San Francisco, CA, US

Year founded

2012