1

Machine Learning Compiler Engineer Jobs in Boston, MA

What you'll need to succeed as a Machine Learning Engineer at XPO Minimum qualifications: * Bachelor's degree in Computer Science, Engineering, or related field, or equivalent related work or ...

Machine Learning Engineer

Woburn, MA · On-site

$115K - $140K/yr

The Role As a Machine Learning Engineer, you will help develop and integrate cutting-edge AI/ML models into production systems that solve critical national security problems. Working as part of a ...

The Role As a Machine Learning Engineer, you will help develop and integrate cutting-edge AI/ML models into production systems that solve critical national security problems. Working as part of a ...

Senior Machine Learning Engineer

Boston, MA · On-site +1

$133K - $175K/yr

Position Summary The Machine Learning Engineer will be responsible for the end-to-end development and deployment of Large language and machine learning models, with a primary focus on data ...

Senior Machine Learning Engineer

Boston, MA · Remote

$125K - $165K/yr

Position Summary The Machine Learning Engineer will be responsible for the end-to-end development and deployment of Large language and machine learning models, with a primary focus on data ...

Machine Learning Engineer

Woburn, MA · On-site

$115K - $140K/yr

The Role As a Machine Learning Engineer, you will help develop and integrate cutting-edge AI/ML models into production systems that solve critical national security problems. Working as part of a ...

What you'll need to succeed as a Machine Learning Engineer at XPO Minimum qualifications: * Bachelor's degree in Computer Science, Engineering, or related field, or equivalent related work or ...

Senior Machine Learning Engineer

Boston, MA · On-site +1

$133K - $175K/yr

Position Summary The Machine Learning Engineer will be responsible for the end-to-end development and deployment of Large language and machine learning models, with a primary focus on data ...

Senior Machine Learning Engineer

Boston, MA · On-site

$133K - $175K/yr

Position Summary The Machine Learning Engineer will be responsible for the end-to-end development and deployment of Large language and machine learning models, with a primary focus on data ...

We're looking for a Senior Machine Learning Engineer to help advance the state of voice understanding at Modulate. In this role, you'll design, train, evaluate, and deploy cutting‑edge machine ...

New

Base pay range $130,000.00/yr - $215,000.00/yr Direct message the job poster from Alsym Energy Alsym Energy is seeking a Machine Learning Scientist or Engineer to design, build, and deploy agentic AI ...

Sr. Lead Machine Learning Engineer

Cambridge, MA · On-site +1

$112K - $147K/yr

Sr. Lead Machine Learning Engineer As a Capital One Machine Learning Engineer (MLE) , you'll be part of an Agile team dedicated to productionizing machine learning applications and systems at scale.

Showing results 21-40

Machine Learning Compiler Engineer information

See Boston, MA salary details

$34.2K

$139.9K

$210.2K

How much do machine learning compiler engineer jobs pay per year?

As of Sep 10, 2026, the average yearly pay for machine learning compiler engineer in Boston, MA is $139,895.00, according to ZipRecruiter salary data. Most workers in this role earn between $110,300.00 and $168,400.00 per year, depending on experience, location, and employer.

What is a machine learning compiler engineer?

A Machine Learning Compiler Engineer focuses on optimizing and building compilers that translate high-level machine learning models into efficient code runnable on specialized hardware (e.g., GPUs, TPUs). They work on improving performance, memory usage, and execution efficiency of ML workloads by designing compiler optimizations, code generation techniques, and leveraging frameworks like LLVM or MLIR. Their role bridges the gap between ML researchers and hardware engineers, ensuring models run efficiently on target platforms.

What are the typical daily responsibilities of a machine learning compiler engineer?

As a Machine Learning Compiler Engineer, your daily responsibilities often include designing and implementing new compiler optimizations, collaborating with machine learning researchers to support model deployment, and debugging performance or correctness issues in compiled code. You may participate in code reviews, write technical documentation, and conduct benchmarking to evaluate how machine learning models perform on various hardware backends. Close collaboration with hardware engineers, software architects, and data scientists is common, ensuring end-to-end solutions meet both research and production requirements. Staying updated with the latest advancements in both compiler technology and machine learning frameworks is also a key aspect of the role.

What are the key skills and qualifications needed to thrive as a machine learning compiler engineer?

A Machine Learning Compiler Engineer needs a deep understanding of computer science fundamentals, compiler theory, and experience with machine learning frameworks, often supported by a relevant degree in computer science or engineering. Proficiency with tools such as LLVM, TVM, MLIR, and languages like C++, Python, and CUDA is typically required, and familiarity with hardware architectures is a plus. Strong problem-solving, teamwork, and communication skills are essential for collaborating with cross-functional teams and addressing complex system issues. These capabilities are important for designing and optimizing compilers that enable scalable and efficient deployment of machine learning models on diverse hardware platforms.

What are the most commonly searched types of Machine Learning Compiler Engineer jobs in Boston, MA?

The most popular types of Machine Learning Compiler Engineer jobs in Boston, MA are:

What are popular job titles related to Machine Learning Compiler Engineer jobs in Boston, MA?

For Machine Learning Compiler Engineer jobs in Boston, MA, the most frequently searched job titles are:

What job categories do people searching Machine Learning Compiler Engineer jobs in Boston, MA look for?

The top searched job categories for Machine Learning Compiler Engineer jobs in Boston, MA are:

Infographic showing various Machine Learning Compiler Engineer job openings in Boston, MA as of September 2026, with employment types broken down into 1% Internship, 1% As Needed, 79% Full Time, 18% Part Time, and 1% Contract. Highlights an 82% Physical, 3% Hybrid, and 15% Remote job distribution, with an average salary of $139,895 per year, or $67.3 per hour.

Machine Learning Engineer - Hybrid

Boston, MA • On-site

XPO
Import-Export • 10K+ employees

$100K - $120K/yr

Full-time

Medical, Life, Retirement, PTO

Posted 19 days ago


XPO rating

6.9

Company rating: 6.9 out of 10

Based on 227 frontline employees who took The Breakroom Quiz

231st of 365 rated logistics


Job description

What you’ll need to succeed as a Machine Learning Engineer at XPO

Minimum qualifications:

  • Bachelor's degree in Computer Science, Engineering, or related field, or equivalent related work or military experience
  • 1 year of experience in software or machine learning engineering, including hands-on experience building data pipelines, ML infrastructure, or MLOps tooling
  • Experience developing data preparation, validation, or quality-checking tooling for machine learning pipelines
  • Proficiency in Python and SQL
  • Experience with cloud data or ML platforms (e.g., AWS, GCP, BigQuery)
  • Strong collaboration skills, with experience partnering with data science/applied science teams and data engineering teams

Preferred qualifications:

  • Master's degree in Computer Science or related field
  • 3+ years of experience building ML infrastructure for training, evaluation, and deployment at scale
  • Experience building and maintaining CI/CD pipelines for machine learning models
  • Experience with model serving and inference infrastructure (batch and real-time)
  • Experience implementing model monitoring, drift detection, and feedback-loop tooling
  • Experience with containerization and orchestration (Docker, Kubernetes)
  • Experience partnering with data engineering teams on data pipeline reliability and access

 

About the Machine Learning Engineer job

Pay, benefits and more:

  • Competitive compensation package 
  • Full health insurance benefits available on day one 
  • Life and disability insurance 
  • Earn up to 15 days of PTO over your first year  
  • 9 paid company holidays 
  • 401(k) option with company match 
  • Education assistance 
  • Opportunity to participate in a company incentive plan

What you’ll do on a typical day:

  • Build and maintain data preparation and validation tooling to ensure high-quality inputs for ML and optimization models
  • Design and implement ML infrastructure for model training, evaluation, and deployment
  • Build and maintain CI/CD pipelines for machine learning models, including automated testing and validation
  • Implement model monitoring, drift detection, and feedback loops to track model performance in production
  • Partner with applied and data scientists to productionize models and streamline the path from experimentation to deployment
  • Collaborate with data engineering teams to ensure reliable, accessible data pipelines
  • Contribute to shared MLOps tooling and best practices across the AI/ML organization

Annual Salary Range: $100,000 to $120,000 Actual compensation may vary due to factors such as experience and skill set. This is an incentive-based position, which may include bonuses, incentive or commission plans.

About XPO

XPO is a top ten global provider of transportation services, with a highly integrated network of people, technology and physical assets. At XPO, we look for employees who like a challenge and can communicate effectively in all situations. We want to leverage your skills and years of experience to drive positive results while ensuring a bright future for yourself and XPO. If you’re looking for a growth opportunity, join us at XPO. 

We are proud to be an Equal Opportunity employer. Qualified applicants will receive consideration for employment without regard to race, sex, disability, veteran or other protected status.

All applicants who receive a conditional offer of employment may be required to take and pass a pre-employment drug test. 

The above statements are not an exhaustive list of all required responsibilities, duties and skills for this job classification. 

Review XPO's candidate privacy statement here.


What XPO employees say

Pay

Benefits

Hours and flexibility

Workplace

Get the full story on Breakroom


XPO logo

About XPO

Sourced by ZipRecruiter

Founded in Greenwich, Connecticut, XPO Logistics, Inc., operating under the brand name XPO, is a one of the leading companies in the transportation and logistics sector. Operating its services in 30 countries, the company employs the use of ground-breaking technology in providing a broad suite of logistics services including supply chain management, freight brokerage, last mile logistics, and intermodal and drayage transportation. XPO's impressive history dates back to 2011 and within its relatively short existence, it has made a series of acquisitions to consolidate its top-notch range of services. Their mission is to provide outstanding results to customers by envisioning and implementing significant advancements in freight transportation and logistics.

Industry

Import-export

Company size

10,000+ Employees

Headquarters location

Greenwich, CT, US