ZipRecruiter

Log In

1

Machine Learning Compiler Engineer Jobs in Boston, MA

C the Signs

Senior Machine Learning Engineer

Boston, MA · On-site +1

$133K - $175K/yr

Position Summary The Machine Learning Engineer will be responsible for the end-to-end development and deployment of Large language and machine learning models, with a primary focus on data ...

C the Signs

Senior Machine Learning Engineer

Boston, MA · Remote

$125K - $165K/yr

Position Summary The Machine Learning Engineer will be responsible for the end-to-end development and deployment of Large language and machine learning models, with a primary focus on data ...

Motional

Machine Learning Systems Engineer

Boston, MA · On-site +1

We are looking for a Machine Learning Systems Engineer to join our ML Acceleration team. In this role, you will be responsible for the core systems that enable our researchers to train frontier ...

WHOOP

Software Engineer, Machine Learning

Boston, MA · On-site

WHOOP is a company focused on health and fitness technology, and they are seeking a Software Engineer specializing in Machine Learning. The role involves designing, developing, and deploying machine ...

Apple

Senior Machine Learning Engineer

Cambridge, MA · On-site

$133K - $176K/yr

Senior Machine Learning Engineer Imagine what you could do here! The people here at Apple don't just create products -- they build the kind of wonder that's revolutionized entire industries. It's the ...

Ikigai Labs

Machine Learning Engineer

Cambridge, MA · On-site

$125K - $150K/yr

... engineer with strong software fundamentals and a keen interest in collaborative problem-solving. Key Responsibilities: * ML Optimization and Deployment: Develop and deploy machine learning models for ...

Capital One

Sr. Lead Machine Learning Engineer

Cambridge, MA · On-site +1

$112K - $147K/yr

Sr. Lead Machine Learning Engineer As a Capital One Machine Learning Engineer (MLE) , you'll be part of an Agile team dedicated to productionizing machine learning applications and systems at scale.

Bespoke Labs

Machine Learning Engineer

Brockton, MA · On-site

Must-Have Skills 3+ years of ML engineering experience -- model training, fine-tuning, or post-training pipelines in research or production Strong Python and deep learning proficiency (PyTorch ...

Motional

Staff Machine Learning Engineer

Boston, MA · On-site +1

As a Staff Machine Learning Engineer, you will serve as a technical leader defining the roadmap and architecture for the machine learning systems that power our data discovery and model improvement ...

Whoop

Software Engineer, Machine Learning

Boston, MA · On-site +1

$150K - $215K/yr

... machine learning models and algorithms into production. Will also accept a Master's degree in Computer Science, Data Science, Software Engineering or related technical field (or foreign degree ...

Whoop

Software Engineer, Machine Learning

Boston, MA

$150K - $215K/yr

... machine learning models and algorithms into production. Will also accept a Master's degree in Computer Science, Data Science, Software Engineering or related technical field (or foreign degree ...

Whoop

Software Engineer, Machine Learning

Boston, MA · On-site

$150K - $215K/yr

... machine learning models and algorithms into production. Will also accept a Master's degree in Computer Science, Data Science, Software Engineering or related technical field (or foreign degree ...

Bespoke Labs

Machine Learning Engineer

Lowell, MA

Must-Have Skills 3+ years of ML engineering experience -- model training, fine-tuning, or post-training pipelines in research or production Strong Python and deep learning proficiency (PyTorch ...

next page

Showing results 1-20

All JobsMachine Learning Compiler Engineer JobsMachine Learning Compiler Engineer Jobs in Boston, MA

Machine Learning Compiler Engineer information

See Boston, MA salary details

$34.2K

$139.9K

$210.2K

How much do machine learning compiler engineer jobs pay per year?

As of Jun 19, 2026, the average yearly pay for machine learning compiler engineer in Boston, MA is $139,895.00, according to ZipRecruiter salary data. Most workers in this role earn between $110,300.00 and $168,400.00 per year, depending on experience, location, and employer.

What is a Machine Learning Compiler Engineer job?

A Machine Learning Compiler Engineer focuses on optimizing and building compilers that translate high-level machine learning models into efficient code runnable on specialized hardware (e.g., GPUs, TPUs). They work on improving performance, memory usage, and execution efficiency of ML workloads by designing compiler optimizations, code generation techniques, and leveraging frameworks like LLVM or MLIR. Their role bridges the gap between ML researchers and hardware engineers, ensuring models run efficiently on target platforms.

What are the typical daily responsibilities of a Machine Learning Compiler Engineer?

As a Machine Learning Compiler Engineer, your daily responsibilities often include designing and implementing new compiler optimizations, collaborating with machine learning researchers to support model deployment, and debugging performance or correctness issues in compiled code. You may participate in code reviews, write technical documentation, and conduct benchmarking to evaluate how machine learning models perform on various hardware backends. Close collaboration with hardware engineers, software architects, and data scientists is common, ensuring end-to-end solutions meet both research and production requirements. Staying updated with the latest advancements in both compiler technology and machine learning frameworks is also a key aspect of the role.

What are the key skills and qualifications needed to thrive in the Machine Learning Compiler Engineer position, and why are they important?

A Machine Learning Compiler Engineer needs a deep understanding of computer science fundamentals, compiler theory, and experience with machine learning frameworks, often supported by a relevant degree in computer science or engineering. Proficiency with tools such as LLVM, TVM, MLIR, and languages like C++, Python, and CUDA is typically required, and familiarity with hardware architectures is a plus. Strong problem-solving, teamwork, and communication skills are essential for collaborating with cross-functional teams and addressing complex system issues. These capabilities are important for designing and optimizing compilers that enable scalable and efficient deployment of machine learning models on diverse hardware platforms.

What are the most commonly searched types of Machine Learning Compiler Engineer jobs in Boston, MA? The most popular types of Machine Learning Compiler Engineer jobs in Boston, MA are:
What are popular job titles related to Machine Learning Compiler Engineer jobs in Boston, MA? For Machine Learning Compiler Engineer jobs in Boston, MA, the most frequently searched job titles are:
What job categories do people searching Machine Learning Compiler Engineer jobs in Boston, MA look for? The top searched job categories for Machine Learning Compiler Engineer jobs in Boston, MA are:
Machine Learning Compiler Engineer jobs near you

Senior Machine Learning Engineer

C the Signs

Boston, MA • On-site, Remote

$133K - $175K/yr

Full-time

Posted 22 days ago

Job description

Position Summary
The Machine Learning Engineer will be responsible for the end-to-end development and deployment of Large language and machine learning models, with a primary focus on data preprocessing, model training, and fine-tuning using large-scale healthcare datasets. This role requires a strong understanding of Large language models, machine learning principles, data engineering, and experience working with sensitive healthcare data.
Key Responsibilities
  • Data Preprocessing: Clean, transform, and prepare large, complex healthcare datasets for machine learning model development. This includes handling missing values, outlier detection, feature engineering, and data normalization. Identify, collect, and curate relevant, industry-specific datasets for model retraining. Format data appropriately for the chosen LLM and training pipeline
  • Model Training & Fine-Tuning: Design, train, and fine-tune various LLMs on extensive healthcare data to solve specific clinical or operational problems. Set up and manage the training environment, including GPU instances and required software. Train and fine-tune pre-trained LLMs on the custom dataset to achieve specific goals. Experiment with and fine-tune hyperparameters such as learning rate, batch size, and training epochs to optimize model performance. Integration of structured + unstructured data (multi-modal/multi-input models)
  • Model Evaluation & Optimization: Evaluate model performance using appropriate metrics, identify areas for improvement, and implement optimization strategies.
  • Pipeline Development: Develop and maintain robust and scalable data and ML pipelines for model training, inference, and deployment.
  • Collaboration: Work closely with data scientists, clinicians, and software engineers to understand requirements, integrate models into production systems, and ensure data privacy and security compliance.
  • Research & Development: Stay up-to-date with the latest advancements in machine learning and healthcare AI, and explore new technologies and methodologies to enhance our solutions.
  • Documentation: Maintain clear and comprehensive documentation of models, data pipelines, and experimental results.

Requirements
  • Education: Bachelor's or Master's degree in Computer Science, Machine Learning, Artificial Intelligence, or a related quantitative field.
  • Experience:
    • 5+ years of experience in Machine Learning Engineering or a similar role.
    • Proven experience with large-scale data preprocessing, LLM/model training, and fine-tuning.
    • Experience with distributed training (PyTorch Distributed, DeepSpeed, Ray, Hugging Face Accelerate).
    • Experience with GPU/TPU optimization, memory management for large language models.
    • Experience working with healthcare data is highly desirable.
  • Technical Skills:
    • Proficiency in Python and relevant ML libraries (e.g., TensorFlow, PyTorch, Scikit-learn, Pandas, NumPy).
    • Strong understanding of various machine learning algorithms,Large Language Models, and deep learning architectures.
    • Experience with cloud platforms (e.g., GCP, AWS) and distributed computing frameworks (e.g., Spark) is a plus.
    • Familiarity with MLOps practices and tools.
  • Soft Skills:
    • Excellent problem-solving and analytical skills.
    • Strong communication and collaboration abilities.
    • Ability to work independently and as part of a team in a fast-paced environment.
  • Work Authorization:
      • Must be a US Citizen, Green Card holder, or currently in the US have valid H1B visa

Benefits
Why Join Us?
Joining C the Signs is not just about building AI; it's about shaping the future of healthcare. If you are a technical leader with an unshakable belief in the power of AI to save lives and the ability to make it happen at scale, this is your opportunity to create a tangible, global impact.
Benefits:
  • Competitive salary and benefits package.
  • Flexible working arrangements (remote or hybrid options available).
  • The opportunity to work on life-changing AI technology that directly impacts patient outcomes.
  • Join a team that combines cutting-edge innovation with a mission to save lives and improve health equity.
  • Continuous learning opportunities with access to the latest tools and advancements in AI and healthcare.

Apply