ZipRecruiter

Log In

1

Machine Learning Compiler Engineer Jobs in Boston, MA

Ikigai Labs

Machine Learning Engineer

Cambridge, MA · On-site

$125K - $150K/yr

... engineer with strong software fundamentals and a keen interest in collaborative problem-solving. Key Responsibilities: * ML Optimization and Deployment: Develop and deploy machine learning models for ...

Ikigai Labs

Machine Learning Engineer

Cambridge, MA · On-site

$135K - $200K/yr

... engineer with strong software fundamentals and a keen interest in collaborative problem-solving. Key Responsibilities: * ML Optimization and Deployment: Develop and deploy machine learning models for ...

Capital One

Sr. Lead Machine Learning Engineer

Cambridge, MA · On-site +1

$112K - $147K/yr

Sr. Lead Machine Learning Engineer As a Capital One Machine Learning Engineer (MLE) , you'll be part of an Agile team dedicated to productionizing machine learning applications and systems at scale.

Bespoke Labs

Machine Learning Engineer

Lowell, MA · On-site

Must-Have Skills 3+ years of ML engineering experience -- model training, fine-tuning, or post-training pipelines in research or production Strong Python and deep learning proficiency (PyTorch ...

Bespoke Labs

Machine Learning Engineer

Cambridge, MA · On-site

Must-Have Skills 3+ years of ML engineering experience -- model training, fine-tuning, or post-training pipelines in research or production Strong Python and deep learning proficiency (PyTorch ...

Bespoke Labs

Machine Learning Engineer

Brockton, MA · On-site

Must-Have Skills 3+ years of ML engineering experience -- model training, fine-tuning, or post-training pipelines in research or production Strong Python and deep learning proficiency (PyTorch ...

Amazon

Machine Learning Engineer, Alexa AI

Boston, MA · On-site

The Alexa AI team is looking for a passionate, talented, and inventive Machine Learning Engineer with a strong machine learning background, to build capabilities such as fine tuning, distillation ...

Capital One

Lead Machine Learning Engineer

Cambridge, MA

$112K - $147K/yr

Lead Machine Learning Engineer At Capital One, we are changing banking for good by creating responsible and reliable AI-powered systems. Our investments in technology infrastructure and world-class ...

next page

Showing results 1-20

All JobsMachine Learning Compiler Engineer JobsMachine Learning Compiler Engineer Jobs in Boston, MA

Machine Learning Compiler Engineer information

See Boston, MA salary details

$34.2K

$139.9K

$210.2K

How much do machine learning compiler engineer jobs pay per year?

As of Jul 9, 2026, the average yearly pay for machine learning compiler engineer in Boston, MA is $139,895.00, according to ZipRecruiter salary data. Most workers in this role earn between $110,300.00 and $168,400.00 per year, depending on experience, location, and employer.

What is a Machine Learning Compiler Engineer job?

A Machine Learning Compiler Engineer focuses on optimizing and building compilers that translate high-level machine learning models into efficient code runnable on specialized hardware (e.g., GPUs, TPUs). They work on improving performance, memory usage, and execution efficiency of ML workloads by designing compiler optimizations, code generation techniques, and leveraging frameworks like LLVM or MLIR. Their role bridges the gap between ML researchers and hardware engineers, ensuring models run efficiently on target platforms.

What are the typical daily responsibilities of a Machine Learning Compiler Engineer?

As a Machine Learning Compiler Engineer, your daily responsibilities often include designing and implementing new compiler optimizations, collaborating with machine learning researchers to support model deployment, and debugging performance or correctness issues in compiled code. You may participate in code reviews, write technical documentation, and conduct benchmarking to evaluate how machine learning models perform on various hardware backends. Close collaboration with hardware engineers, software architects, and data scientists is common, ensuring end-to-end solutions meet both research and production requirements. Staying updated with the latest advancements in both compiler technology and machine learning frameworks is also a key aspect of the role.

What are the key skills and qualifications needed to thrive in the Machine Learning Compiler Engineer position, and why are they important?

A Machine Learning Compiler Engineer needs a deep understanding of computer science fundamentals, compiler theory, and experience with machine learning frameworks, often supported by a relevant degree in computer science or engineering. Proficiency with tools such as LLVM, TVM, MLIR, and languages like C++, Python, and CUDA is typically required, and familiarity with hardware architectures is a plus. Strong problem-solving, teamwork, and communication skills are essential for collaborating with cross-functional teams and addressing complex system issues. These capabilities are important for designing and optimizing compilers that enable scalable and efficient deployment of machine learning models on diverse hardware platforms.

What are the most commonly searched types of Machine Learning Compiler Engineer jobs in Boston, MA? The most popular types of Machine Learning Compiler Engineer jobs in Boston, MA are:
What are popular job titles related to Machine Learning Compiler Engineer jobs in Boston, MA? For Machine Learning Compiler Engineer jobs in Boston, MA, the most frequently searched job titles are:
What job categories do people searching Machine Learning Compiler Engineer jobs in Boston, MA look for? The top searched job categories for Machine Learning Compiler Engineer jobs in Boston, MA are:
Machine Learning Compiler Engineer jobs near you
Infographic showing various Machine Learning Compiler Engineer job openings in Boston, MA as of July 2026, with employment types broken down into 6% Locum Tenens, 6% As Needed, 80% Full Time, 7% Part Time, and 1% Contract. Highlights an 92% Physical, 3% Hybrid, and 5% Remote job distribution, with an average salary of $139,895 per year, or $67.3 per hour.
Machine Learning Engineer

Machine Learning Engineer

Ikigai Labs

Cambridge, MA • On-site

$125K - $150K/yr

Full-time

Re-posted 16 days ago

Job description

Company Description
The Ikigai platform unlocks the power of generative AI for tabular data. We enable business users to connect disparate data, leverage no-code AI/ML, and build enterprise-wide AI apps in just a few clicks. Ikigai is built on top of its three proprietary foundation blocks developed from years of MIT research - aiMatch, for data reconciliation, aiCast, for prediction, and aiPlan, for scenario planning and optimization. Our platform enables eXpert-in-The-Loop (XiTL) for model reinforcement learning and refinement, at scale.
With a combination of enterprise expertise and deep research in the field of AI, Ikigai Labs helps scale enterprises with AI by solving data engineering and modeling problems for business users and data scientists alike. Our unique ability to unlock value in tabular and time series data through AI-powered data harmonization, forecasting, dynamic learning and planning, is our Ikigai, our purpose in the world of AI.
As an AI/ML Engineer at Ikigai Labs, you will be part of a high-performing team responsible for optimizing and deploying ML solutions to maximize performance and scalability. We seek a dynamic and passionate engineer with strong software fundamentals and a keen interest in collaborative problem-solving.
Key Responsibilities:
  • ML Optimization and Deployment: Develop and deploy machine learning models for optimal performance and scalability.
  • Productivity Tools Development: Build tools and services to enhance the ML platform, utilizing technologies like Kubernetes, Helm, and EKS.
  • Model Architecture: Apply a strong understanding of deep learning architectures (CNNs, RNNs, etc.) to solve complex problems.
  • Research Adaptation: Stay abreast of recent ML and deep learning literature and adapt findings to real-world applications.
  • Collaborative Development: Work with cross-functional teams to integrate AI and ML solutions that drive business value.
  • Data Handling: Manage large datasets and build ML pipelines for data processing and training.
  • ETL/ELT Processes: Design and develop scalable data integration processes.
  • Predictive Modeling Platform: Develop an on-demand predictive modeling platform using gRPC.
  • Cloud and Containerization: Utilize Kubernetes for managing Docker containers and various cloud services (AWS, Azure) to solve cloud-native challenges.
  • Stakeholder Management: Provide occasional support to our customer success team.

Technologies We Use:
  • Languages: Python3, C++, Rust, SQL
  • Frameworks: PyTorch, TensorFlow, Docker
  • Databases: Postgres, Elasticsearch, DynamoDB, RDS
  • Cloud: Kubernetes, Helm, EKS, Terraform, AWS
  • Data Engineering: Apache Arrow, Dremio, Ray
  • Miscellaneous: Git, Jupyterhub, Apache Superset, Plotly Dash

Qualifications:
  • Bachelor's degree in Computer Science, Math, Engineering, or related field (Master's preferred) with 0-5+ years of experience (depending on the level)
  • Strong understanding of data structures, data modeling, algorithms, and software architecture.
  • Proficient in probability, statistics, and algorithm development.
  • Hands-on experience with ML and deep learning libraries (Scikit Learn, Keras, TensorFlow, PyTorch, Theano, DyLib).
  • (Bonus) Experience with big data and distributed computing (Hadoop, MapReduce, Spark, Storm).
  • Proficiency in Python, AWS services, and ETL/ELT pipelines.
  • Understanding of key software design principles, design patterns, and testing best practices.
  • Experience with Kubernetes and/or EKS is a plus.
  • Ability to learn quickly in a fast-paced, agile environment.
  • Excellent organizational, time management, and communication skills.
  • Willingness to engage in pair programming, share knowledge, and provide and receive constructive feedback.
  • Strong problem-solving skills and the ability to take initiative.
Location Requirement: Candidates must reside in or near Cambridge, MA or San Mateo, CA. This role is not open to other locations at this time.
Equal Opportunity Employment:
Ikigai Labs is committed to equal employment opportunity and non-discrimination for all employees and qualified applicants. We value diversity and are dedicated to fostering an inclusive environment for all employees, regardless of race, color, sex, gender identity or expression, age, religion, national origin, ancestry, citizenship, disability, military or veteran status, genetic information, sexual orientation, marital status, or any other characteristic protected under applicable law.
If you are passionate about machine learning and eager to make an impact, we would love to hear from you. Apply today to join the Ikigai Labs team and help us build the future of AI.

Apply