ZipRecruiter

Log In

1

Ml Compiler Engineer Jobs in Boston, MA (NOW HIRING)

All JobsMl Compiler Engineer JobsMl Compiler Engineer Jobs in Boston, MA

Ml Compiler Engineer information

See Boston, MA salary details

$35.9K

$96.9K

$154.3K

How much do ml compiler engineer jobs pay per year?

As of Aug 27, 2026, the average yearly pay for ml compiler engineer in Boston, MA is $96,889.00, according to ZipRecruiter salary data. Most workers in this role earn between $72,200.00 and $118,400.00 per year, depending on experience, location, and employer.

What does an ML Compiler Engineer do?

An ML Compiler Engineer designs and develops compilers and software tools that optimize machine learning models for deployment on various hardware platforms. Their work involves translating high-level ML code into optimized, low-level instructions that can run efficiently on CPUs, GPUs, or specialized accelerators. They collaborate closely with hardware engineers and ML researchers to ensure models execute quickly and accurately. Additionally, ML Compiler Engineers may work on improving performance, reducing memory usage, and supporting new ML frameworks or hardware.

What are some typical collaboration points between an ML Compiler Engineer and other teams during a project?

ML Compiler Engineers frequently collaborate with machine learning researchers to understand model requirements, with hardware engineers to optimize for specific accelerators, and with software developers to ensure seamless integration into production systems. This role often involves participating in cross-functional meetings, code reviews, and design discussions to align compiler optimizations with both hardware capabilities and end-user needs. Effective communication and teamwork are essential, as these engineers play a central role in bridging the gap between algorithm design and efficient execution on target platforms.

What are the key skills and qualifications needed to thrive as an ML Compiler Engineer, and why are they important?

To thrive as an ML Compiler Engineer, you need a strong background in computer science, compiler design, machine learning concepts, and typically a degree in computer science or a related field. Familiarity with tools like LLVM, MLIR, TensorFlow XLA, and programming in C++ and Python is often required, along with experience in optimizing machine learning workloads. Strong problem-solving abilities, attention to detail, and effective collaboration skills help set top professionals apart. These skills ensure efficient translation and optimization of ML models for diverse hardware, enhancing performance and scalability.

What is the difference between Ml Compiler Engineer vs Machine Learning Engineer?

AspectMl Compiler EngineerMachine Learning Engineer
Required SkillsProgramming, compiler design, optimization, ML frameworksData analysis, model development, programming, ML frameworks
Work EnvironmentResearch labs, tech companies, AI hardware firmsTech companies, startups, data-driven organizations
CertificationsComputer science, software engineering, specialized compiler coursesMachine learning, data science, AI certifications
Industry UsageAI hardware, software optimization, ML infrastructureModel development, deployment, data analysis

While both roles involve machine learning, Ml Compiler Engineers focus on optimizing ML models through compiler design and software performance, whereas Machine Learning Engineers develop and deploy ML models for applications. The roles often overlap in skills but differ in their primary focus areas.

What are popular job titles related to Ml Compiler Engineer jobs in Boston, MA?

For Ml Compiler Engineer jobs in Boston, MA, the most frequently searched job titles are:

What job categories do people searching Ml Compiler Engineer jobs in Boston, MA look for?

The top searched job categories for Ml Compiler Engineer jobs in Boston, MA are:

What cities near Boston, MA are hiring for Ml Compiler Engineer jobs?

Cities near Boston, MA with the most Ml Compiler Engineer job openings:

Ml Compiler Engineer jobs near you
Infographic showing various Ml Compiler Engineer job openings in Boston, MA as of August 2026, with employment types broken down into 89% Full Time, 7% Part Time, and 4% Contract. Highlights an 85% Physical, 5% Hybrid, and 10% Remote job distribution, with an average salary of $96,889 per year, or $46.6 per hour.

Distinguished Systems Developer - SQL Engine

InterSystems

Boston, MA • On-site

$49.25 - $67.25/hr

Full-time

This job post has expired today. Applications are no longer accepted.

Job description

Job Summary:
InterSystems is a creative data technology provider redefining the future of analytics and intelligent data platforms. The role involves designing core foundations of a data platform, focusing on optimizing query processing for traditional and AI-driven workloads.
Responsibilities:
• Query parsing, validation, and transformation
• Logical/physical optimization over multi-model data (row, columnar, stream, document, vector)
• Plan generation and adaptive execution strategies
• Code generation and vectorized execution
• Compiler-accelerated storage access patterns for AI workflows
• Collaborative integration with our multi-model storage engine
• Architect and implement query optimization and execution components that scale across petabytes
• Design tooling and frameworks that make AI and analytics convergence seamless
• Collaborate with platform and storage teams to leverage multi-model indexing and caching strategies
• Contribute to building programmable, intelligent data pipelines that drive downstream ML model performance
• Mentor engineers, guide technical debates, and influence long-term system direction
• Champion a culture of quality, rigor, and innovation
Qualifications:
Required:
• 10+ years of experience in systems-level or database internals engineering
• Proven expertise in SQL query engines, optimizers, execution runtimes, or data compiler toolchains
• Experience with multi-model data systems (SQL + JSON, vector search, graph traversal)
• Expert in at least one systems programming languages, or LLVM-based codegen environments
• Strong grasp of relational algebra, compiler construction, and data-intensive workloads
• Passion for designing software that balances performance, correctness, and usability
Preferred:
• Familiarity with AI infrastructure or ML inference pipelines is a strong plus
• PHD degree or published research experience is highly advantageous
Company:
InterSystems is a vendor of software and technology for high-performance database management, integration, and health information systems. Founded in 1978, the company is headquartered in Cambridge, USA, with a team of 1001-5000 employees. The company is currently Late Stage.

Apply