ZipRecruiter

Log In

1

Machine Learning Compiler Engineer Jobs in New York

WITHIN

Machine Learning Engineer

New York, NY · Hybrid

$90K - $254K/yr

We are in search of an exceptional Machine Learning Engineer to join our accomplished team. In this role, you will take the lead in developing and fine-tuning predictive ML models, with a primary ...

Reddit

Machine Learning Engineer

New York, NY · On-site +1

$223K - $260K/yr

Collaborate closely with multiple stakeholders across product, engineering, research and marketing. Train, evaluate, test, and deploy machine learning models. Part-time telecommuting is an option.

Kitware

Machine Learning Engineer

New York, NY · On-site

$85K - $125K/yr

... machine learning, artificial intelligence, and computer vision * Perform rapid prototyping and enhanced development to be integrated into operational systems * Contribute your strong programming ...

Reddit

Machine Learning Engineer

New York, NY · On-site

$223K - $260K/yr

Collaborate closely with multiple stakeholders across product, engineering, research and marketing. Train, evaluate, test, and deploy machine learning models. Part-time telecommuting is an option.

Virtu Financial

Machine Learning Engineer

New York, NY · On-site

$200K - $300K/yr

Virtu's Research Technology team is looking for an experienced Machine Learning Engineer to join a small group of technologists whose primary function is building the infrastructure that powers our ...

Virtu Financial

Machine Learning Engineer

New York, NY · On-site

$200K - $300K/yr

Virtu's Research Technology team is looking for an experienced Machine Learning Engineer to join a small group of technologists whose primary function is building the infrastructure that powers our ...

PhysicsX

Machine Learning Engineer

New York, NY · On-site

Who We're Looking For As a Machine Learning Engineer in Delivery, you are a problem solver who stays anchored to impact. You are someone who can grasp advanced engineering concepts across multiple ...

NYULMC

Machine Learning Engineer

New York, NY · On-site

As a ML Engineer, you will support the implementation of diverse Generative AI and Machine Learning initiatives across the health system. You will be responsible for driving specific projects forward ...

next page

Showing results 1-20

All JobsMachine Learning Compiler Engineer JobsMachine Learning Compiler Engineer Jobs in New York

Machine Learning Compiler Engineer information

See New York salary details

$34.5K

$140.9K

$211.7K

How much do machine learning compiler engineer jobs pay per year?

As of Jun 29, 2026, the average yearly pay for machine learning compiler engineer in New York is $140,878.00, according to ZipRecruiter salary data. Most workers in this role earn between $111,000.00 and $169,600.00 per year, depending on experience, location, and employer.

What is a Machine Learning Compiler Engineer job?

A Machine Learning Compiler Engineer focuses on optimizing and building compilers that translate high-level machine learning models into efficient code runnable on specialized hardware (e.g., GPUs, TPUs). They work on improving performance, memory usage, and execution efficiency of ML workloads by designing compiler optimizations, code generation techniques, and leveraging frameworks like LLVM or MLIR. Their role bridges the gap between ML researchers and hardware engineers, ensuring models run efficiently on target platforms.

What are the typical daily responsibilities of a Machine Learning Compiler Engineer?

As a Machine Learning Compiler Engineer, your daily responsibilities often include designing and implementing new compiler optimizations, collaborating with machine learning researchers to support model deployment, and debugging performance or correctness issues in compiled code. You may participate in code reviews, write technical documentation, and conduct benchmarking to evaluate how machine learning models perform on various hardware backends. Close collaboration with hardware engineers, software architects, and data scientists is common, ensuring end-to-end solutions meet both research and production requirements. Staying updated with the latest advancements in both compiler technology and machine learning frameworks is also a key aspect of the role.

What are the key skills and qualifications needed to thrive in the Machine Learning Compiler Engineer position, and why are they important?

A Machine Learning Compiler Engineer needs a deep understanding of computer science fundamentals, compiler theory, and experience with machine learning frameworks, often supported by a relevant degree in computer science or engineering. Proficiency with tools such as LLVM, TVM, MLIR, and languages like C++, Python, and CUDA is typically required, and familiarity with hardware architectures is a plus. Strong problem-solving, teamwork, and communication skills are essential for collaborating with cross-functional teams and addressing complex system issues. These capabilities are important for designing and optimizing compilers that enable scalable and efficient deployment of machine learning models on diverse hardware platforms.

What are the most commonly searched types of Machine Learning Compiler Engineer jobs in New York? The most popular types of Machine Learning Compiler Engineer jobs in New York are:
What are popular job titles related to Machine Learning Compiler Engineer jobs in New York? For Machine Learning Compiler Engineer jobs in New York, the most frequently searched job titles are:
What job categories do people searching Machine Learning Compiler Engineer jobs in New York look for? The top searched job categories for Machine Learning Compiler Engineer jobs in New York are:
Machine Learning Compiler Engineer jobs near you
Machine Learning Engineer

Machine Learning Engineer

WITHIN

New York, NY • Hybrid

$90K - $254K/yr

Other

Medical, Dental, Vision, Retirement, PTO

Posted 18 days ago

Key responsibilities

  • Lead the development and refinement of predictive machine learning models, particularly Ad Score and Ad Account Health.

  • Conduct in-depth data analysis to identify trends, patterns, and insights that inform model development and optimization.

  • Collaborate with data engineers and engineering teams to create feature engineering pipelines and deploy models into products through APIs.

Job description

About the Role: We are in search of an exceptional Machine Learning Engineer to join our accomplished team. In this role, you will take the lead in developing and fine-tuning predictive ML models, with a primary focus on Ad Score and Ad Account Health. You will play a crucial part in delivering actionable insights and solutions to our clients, and your work will be integral to our mission.

Responsibilities include but are not limited to;

  • ML Model Development: Lead the development and refinement of predictive ML models, particularly Ad Score and Ad Account Health.
  • Data Analysis: Conduct in-depth data analysis to identify trends, patterns, and insights that inform model development and optimization.
  • Feature Engineering: Collaborate with data engineers to create and maintain feature engineering pipelines to support model training.
  • Model Evaluation: Implement rigorous evaluation methodologies to assess model performance, making necessary adjustments for continuous improvement.
  • Deployment and Integration: Work closely with engineering teams to deploy models and integrate them into our products through APIs.
  • Collaboration: Collaborate closely with product managers, full-stack engineers, and TPMs to ensure seamless integration of data science solutions into our products.
  • Research and Innovation: Stay up-to-date with the latest developments in the field of data science and machine learning, and explore innovative approaches to problem-solving.

Requirements

  • Master's or Ph.D. in a related field with a strong academic background.
  • Proven experience as a Data Scientist with a track record of developing and deploying predictive ML models.
  • Expertise in machine learning techniques, including but not limited to regression, classification, clustering, and deep learning.
  • Proficiency in data manipulation, feature engineering, and model evaluation.
  • Strong programming skills in languages such as Python and experience with libraries like TensorFlow, PyTorch, or scikit-learn.
  • Excellent communication skills and the ability to collaborate effectively within cross-functional teams.
  • A passion for continuous learning and staying updated with the latest trends and technologies in data science.
  • Strong problem-solving abilities and the capacity to translate complex data into actionable insights.
Required knowledge of:
  • Python
  • SQL
  • Cloud Platforms (GCP, AWS, Azure)
  • Data Warehouses (BigQuery, Snowflake, Redshift)
  • LLMs / AI APIs
  • Git / GitHub
Nice to have:
  • Data Transformation (dbt)
  • Semantic Layers (Cube, Looker, dbt Metrics)
  • TypeScript
  • Bayesian modeling experience - ideally Marketing Mix Models (PyMC, Stan, or similar..). Understands priors, MCMC sampling, posterior diagnostics.
  • Causal inference / experimentation- geo experiments (matched markets), A/B testing at scale. Familiar with incrementality measurement.
  • Marketing/advertising domain- understanding of attribution, media channels (paid social, search, display, video), campaign structures.
  • Nice to have - familiarity with adstock/saturation curves and budget optimization

Our interview process includes, but is not limited to the following:

  • Excel and Typing Test

We offer a competitive salary and benefits based on ability level, including:

  • Unlimited vacation policy
  • Monthly Phone Stipend
  • Comprehensive Medical, Dental, and Vision insurance options
  • 401(K) plan with matching
  • Dog friendly office
  • Hybrid work opportunity
  • Professional Development Program
  • Bonus Perk - Seamless allowance

Total compensation based on education, experience, and skills level ($90,900-$254,100)

  • Level 1 - Possesses essential capabilities

    • $90,900-$123,540

  • Level 2 - Possesses developing capabilities

    • $123,540-$156,180

  • Level 3 - Possesses notable capabilities.

    • $156,180-$188,820

  • Level 4 - Possesses strong capabilities.

    • $188,820-$221,460

  • Level 5 - Possesses advanced capabilities.

    • $221,460-$254,100

Apply