ZipRecruiter

Log In

1

Machine Learning Compiler Engineer Jobs in New York

Canals

Machine Learning Engineer

New York, NY · Remote

We're looking for a senior-level Machine Learning Engineer who can move quickly while maintaining high quality, owning end-to-end ML pipelines while shaping product features that deliver real-world ...

Canals

Machine Learning Engineer

New York, NY · On-site

We're looking for a senior-level Machine Learning Engineer who can move quickly while maintaining high quality, owning end-to-end ML pipelines while shaping product features that deliver real-world ...

Virtu Financial

Machine Learning Engineer

New York, NY · On-site

$200K - $300K/yr

Virtu's Research Technology team is looking for an experienced Machine Learning Engineer to join a small group of technologists whose primary function is building the infrastructure that powers our ...

Virtu Financial

Machine Learning Engineer

New York, NY · On-site

$200K - $300K/yr

Virtu's Research Technology team is looking for an experienced Machine Learning Engineer to join a small group of technologists whose primary function is building the infrastructure that powers our ...

Palnar

Machine Learning Engineer@ VA/ NYC

Manhattan, NY · On-site

Looking for a Machine Learning Engineer with strong python, scala, AWS, Kubernetes & machine learning frameworks. * 80% of model Engineering work & 20% of operations work * Email arbitration with ...

RunSybil

Machine Learning Engineer

New York, NY · On-site

About this Role We are seeking talented engineers intent on changing the security industry. If you ... Understanding of both modern and classic machine learning techniques * Equally comfortable with ...

Capital One

Lead Machine Learning Engineer

New York, NY · On-site +1

$112K - $147K/yr

Lead Machine Learning Engineer As a Capital One Machine Learning Engineer (MLE), you'll be part of an Agile team dedicated to productionizing machine learning applications and systems at scale. You ...

exacare ai

Machine Learning Engineer

New York, NY · On-site

About the Role We are looking for a Machine Learning Engineer, MLOps to help operationalize and scale our machine learning systems. This is an engineering-focused role centered on building the ...

next page

Showing results 1-20

All JobsMachine Learning Compiler Engineer JobsMachine Learning Compiler Engineer Jobs in New York

Machine Learning Compiler Engineer information

See New York salary details

$34.5K

$140.9K

$211.7K

How much do machine learning compiler engineer jobs pay per year?

As of Jul 22, 2026, the average yearly pay for machine learning compiler engineer in New York is $140,878.00, according to ZipRecruiter salary data. Most workers in this role earn between $111,000.00 and $169,600.00 per year, depending on experience, location, and employer.

What is a Machine Learning Compiler Engineer job?

A Machine Learning Compiler Engineer focuses on optimizing and building compilers that translate high-level machine learning models into efficient code runnable on specialized hardware (e.g., GPUs, TPUs). They work on improving performance, memory usage, and execution efficiency of ML workloads by designing compiler optimizations, code generation techniques, and leveraging frameworks like LLVM or MLIR. Their role bridges the gap between ML researchers and hardware engineers, ensuring models run efficiently on target platforms.

What are the typical daily responsibilities of a Machine Learning Compiler Engineer?

As a Machine Learning Compiler Engineer, your daily responsibilities often include designing and implementing new compiler optimizations, collaborating with machine learning researchers to support model deployment, and debugging performance or correctness issues in compiled code. You may participate in code reviews, write technical documentation, and conduct benchmarking to evaluate how machine learning models perform on various hardware backends. Close collaboration with hardware engineers, software architects, and data scientists is common, ensuring end-to-end solutions meet both research and production requirements. Staying updated with the latest advancements in both compiler technology and machine learning frameworks is also a key aspect of the role.

What are the key skills and qualifications needed to thrive in the Machine Learning Compiler Engineer position, and why are they important?

A Machine Learning Compiler Engineer needs a deep understanding of computer science fundamentals, compiler theory, and experience with machine learning frameworks, often supported by a relevant degree in computer science or engineering. Proficiency with tools such as LLVM, TVM, MLIR, and languages like C++, Python, and CUDA is typically required, and familiarity with hardware architectures is a plus. Strong problem-solving, teamwork, and communication skills are essential for collaborating with cross-functional teams and addressing complex system issues. These capabilities are important for designing and optimizing compilers that enable scalable and efficient deployment of machine learning models on diverse hardware platforms.

What are the most commonly searched types of Machine Learning Compiler Engineer jobs in New York? The most popular types of Machine Learning Compiler Engineer jobs in New York are:
What are popular job titles related to Machine Learning Compiler Engineer jobs in New York? For Machine Learning Compiler Engineer jobs in New York, the most frequently searched job titles are:
What job categories do people searching Machine Learning Compiler Engineer jobs in New York look for? The top searched job categories for Machine Learning Compiler Engineer jobs in New York are:
Machine Learning Compiler Engineer jobs near you
Infographic showing various Machine Learning Compiler Engineer job openings in New York as of July 2026, with employment types broken down into 93% Full Time, and 7% Nights. Highlights an 100% In-person job distribution, with an average salary of $140,878 per year, or $67.7 per hour.

Applied Machine Learning Engineer

Fireworks AI

New York, NY

Other

Posted 4 days ago

Job description

The Role:

As an Applied Machine Learning Engineer, you will serve as a vital bridge between cutting-edge AI research and practical, real-world applications. Your work will focus on developing, fine-tuning, and operationalizing machine learning models that drive business value and enhance user experiences. This is a hands-on engineering role that combines deep technical expertise with a strong customer focus to deliver scalable AI solutions.

Key Responsibilities:
  • Customer Success: Collaborate directly with the GTM team (Account Executives and Solutions Architects) to ensure smooth integration and successful deployment of ML solutions.
  • Demo / Proof of Concept (PoC): Build and present compelling PoCs that demonstrate the capabilities of our AI technology.
  • Application Build: Design, develop, and deploy end-to-end AI-powered applications tailored to customer needs.
  • Platform Features / Bug Fixes: Contribute to the internal ML platform, including adding features and resolving issues.
  • New Model Enablements: Integrate and enable new machine learning models into the existing platform or client environments.
  • Performance Optimizations: Improve system performance, efficiency, and scalability of deployed models and applications.
  • Partnership Enablement: Work closely with partners to enable joint AI solutions and ensure seamless collaboration.
Minimum Qualifications:
  • Bachelor's degree in Computer Science, Engineering, or a related technical field.
  • 5+ years of experience in a software engineering role, with a strong preference for customer-facing roles.
  • Robust coding skills required, preferably with proficiency in Python.
  • Demonstrated ability to lead and execute complex technical projects with a focus on customer success.
  • Strong interpersonal and communication skills; ability to thrive in dynamic, cross-functional teams.
Preferred Qualifications:
  • Master's degree in Computer Science, Engineering, or a related technical field.
  • Experience working in a startup or fast-paced environment.
  • Hands-on experience fine-tuning machine learning models, including supervised fine-tuning (SFT) and reinforcement learning from human feedback (RLHF or RFT).
  • Solid understanding of generative AI, machine learning principles, and enterprise infrastructure.

Apply