1

Machine Learning Compiler Engineer Jobs in New York

Looking for a Machine Learning Engineer with strong python, scala, AWS, Kubernetes & machine learning frameworks. * 80% of model Engineering work & 20% of operations work * Email arbitration with ...

About this Role We are seeking talented engineers intent on changing the security industry. If you ... Understanding of both modern and classic machine learning techniques * Equally comfortable with ...

Senior Machine Learning Engineer

New York, NY ยท On-site +1

$114K - $157K/yr

Position Overview As a Senior Machine Learning Engineer, you will play a key role in designing, developing, and evolving machine learning systems that support conversational AI, search, multi-agent ...

About the Role We are looking for a Machine Learning Engineer, MLOps to help operationalize and scale our machine learning systems. This is an engineering-focused role centered on building the ...

Machine Learning Engineer

New York, NY ยท On-site

$160K - $210K/yr

About the role We are seeking a Machine Learning Engineer to strengthen our element classification system - working closely with data scientists and data annotators to ship and improve entity ...

As a Senior Machine Learning Engineer, you'll play a crucial role in optimizing orchestration processes and ensuring fast and efficient model deployment and delivery. You'll work closely with ...

Lead Machine Learning Engineer

New York, NY ยท On-site

$112K - $147K/yr

Lead Machine Learning Engineer As a Capital One Machine Learning Engineer (MLE), you'll be part of an Agile team dedicated to productionizing machine learning applications and systems at scale. You ...

Lead Machine Learning Engineer

New York, NY ยท On-site +1

$112K - $147K/yr

Lead Machine Learning Engineer As a Capital One Machine Learning Engineer (MLE), you'll be part of an Agile team dedicated to productionizing machine learning applications and systems at scale. You ...

We're looking for a Machine Learning Engineer to join Snap Inc! What you'll do: * Build and deploy machine learning models that power core products, serving millions of Snapchatters * Apply modern ML ...

Machine Learning Engineer

New York, NY ยท On-site

$150K - $195K/yr

As a Machine Learning Engineer at WireScreen, you will be working across our data systems to unlock the source of truth behind one of the world's economic powerhouses: China. This role is critical to ...

next page

Showing results 1-20

Machine Learning Compiler Engineer information

See New York salary details

$34.5K

$140.9K

$211.7K

How much do machine learning compiler engineer jobs pay per year?

As of Jun 29, 2026, the average yearly pay for machine learning compiler engineer in New York is $140,878.00, according to ZipRecruiter salary data. Most workers in this role earn between $111,000.00 and $169,600.00 per year, depending on experience, location, and employer.

What is a Machine Learning Compiler Engineer job?

A Machine Learning Compiler Engineer focuses on optimizing and building compilers that translate high-level machine learning models into efficient code runnable on specialized hardware (e.g., GPUs, TPUs). They work on improving performance, memory usage, and execution efficiency of ML workloads by designing compiler optimizations, code generation techniques, and leveraging frameworks like LLVM or MLIR. Their role bridges the gap between ML researchers and hardware engineers, ensuring models run efficiently on target platforms.

What are the typical daily responsibilities of a Machine Learning Compiler Engineer?

As a Machine Learning Compiler Engineer, your daily responsibilities often include designing and implementing new compiler optimizations, collaborating with machine learning researchers to support model deployment, and debugging performance or correctness issues in compiled code. You may participate in code reviews, write technical documentation, and conduct benchmarking to evaluate how machine learning models perform on various hardware backends. Close collaboration with hardware engineers, software architects, and data scientists is common, ensuring end-to-end solutions meet both research and production requirements. Staying updated with the latest advancements in both compiler technology and machine learning frameworks is also a key aspect of the role.

What are the key skills and qualifications needed to thrive in the Machine Learning Compiler Engineer position, and why are they important?

A Machine Learning Compiler Engineer needs a deep understanding of computer science fundamentals, compiler theory, and experience with machine learning frameworks, often supported by a relevant degree in computer science or engineering. Proficiency with tools such as LLVM, TVM, MLIR, and languages like C++, Python, and CUDA is typically required, and familiarity with hardware architectures is a plus. Strong problem-solving, teamwork, and communication skills are essential for collaborating with cross-functional teams and addressing complex system issues. These capabilities are important for designing and optimizing compilers that enable scalable and efficient deployment of machine learning models on diverse hardware platforms.

What are the most commonly searched types of Machine Learning Compiler Engineer jobs in New York? The most popular types of Machine Learning Compiler Engineer jobs in New York are:
What are popular job titles related to Machine Learning Compiler Engineer jobs in New York? For Machine Learning Compiler Engineer jobs in New York, the most frequently searched job titles are:
What job categories do people searching Machine Learning Compiler Engineer jobs in New York look for? The top searched job categories for Machine Learning Compiler Engineer jobs in New York are:
Machine Learning Engineer@ VA/ NYC

Machine Learning Engineer@ VA/ NYC

Palnar

Manhattan, NY โ€ข On-site

Full-time

Posted 19 days ago


Job description

Role Info:
  • Looking for a Machine Learning Engineer with strong python, scala, AWS, Kubernetes & machine learning frameworks.
  • 80% of model Engineering work & 20% of operations work
  • Email arbitration with real time data processing.
  • Has model in Random forest model and moving to transformers soon in feature development.

Top Skills:
  • 5+ years of exp. in Machine Learning Engineer
  • Python exp. is a must.
  • Scala exp. is a must.
  • ML Frameworks (TensorFlow, PyTorch, Scikit-learn & Keras) exp. is a must.
  • AWS exp. is a must.
  • Kubernetes exp. is a must.
  • Experience with CI/CD