ZipRecruiter

Log In

1

Machine Learning Compiler Engineer Jobs in New York

Seven Seven Software

Machine Learning Engineer

Newark, NJ · On-site

... Machine learning models and data ingestion pipelines. • Develop and support a platform that enables data scientists to rapidly develop, train, and experiment with machine learning models. • ...

Finch Services

Machine Learning Engineer

Manhattan, NY · On-site +1

$180K - $280K/yr

Machine Learning Engineer Legal work is buried in unstructured documents, repetitive workflows, and data that no existing system handles well -- and we're building the AI to fix it. As a Machine ...

Inizio Partners

Machine Learning Engineer (GCP)

Manhattan, NY · Remote

$58.25 - $79.75/hr

Machine Learning Engineer- 2 Positions Overall experience of minimum 7 years and machine learning experience of at least 3 - 4 years. Location- Remote Overview: As a GCP ML Engineer, you'll design ...

Virtu Financial

Machine Learning Engineer

New York, NY · On-site

$200K - $300K/yr

Virtu's Research Technology team is looking for an experienced Machine Learning Engineer to join a small group of technologists whose primary function is building the infrastructure that powers our ...

Virtu Financial

Machine Learning Engineer

New York, NY · On-site

$200K - $300K/yr

Virtu's Research Technology team is looking for an experienced Machine Learning Engineer to join a small group of technologists whose primary function is building the infrastructure that powers our ...

PhysicsX

Machine Learning Engineer

New York, NY · On-site

Who We're Looking For As a Machine Learning Engineer in Delivery, you are a problem solver who stays anchored to impact. You are someone who can grasp advanced engineering concepts across multiple ...

Palnar

Machine Learning Engineer@ VA/ NYC

Manhattan, NY · On-site

Looking for a Machine Learning Engineer with strong python, scala, AWS, Kubernetes & machine learning frameworks. * 80% of model Engineering work & 20% of operations work * Email arbitration with ...

Indeed

Machine Learning Engineer III

Manhattan, NY

Comscore, Total Visits, March 2025) Day to Day As a Machine Learning Engineer III, you will be a team lead. You will own one of the team's major workstreams, help drive technical direction for the ...

Capgemini

Machine Learning Engineer

Manhattan, NY

Machine Learning Engineer Choosing Capgemini means choosing a company where you will be empowered to shape your career in the way you'd like, where you'll be supported and inspired by?a collaborative ...

Alignerr

Machine Learning Engineer

Manhattan, NY · Remote

$154K/yr

Machine Learning Engineer (AI Data Trainer) About the Role What if your machine learning expertise could directly influence how the world's most advanced AI systems reason, plan, and solve problems ...

Indeed

Machine Learning Engineer

Manhattan, NY

As a Machine Learning Engineer, you will prepare datasets, train and optimize models, and maintain and improve model inference services. You will learn and apply new techniques from open source ...

next page

Showing results 1-20

People also search for

All JobsMachine Learning Compiler Engineer JobsMachine Learning Compiler Engineer Jobs in New York

Machine Learning Compiler Engineer information

See New York salary details

$34.5K

$140.9K

$211.7K

How much do machine learning compiler engineer jobs pay per year?

As of Jun 8, 2026, the average yearly pay for machine learning compiler engineer in New York is $140,878.00, according to ZipRecruiter salary data. Most workers in this role earn between $111,000.00 and $169,600.00 per year, depending on experience, location, and employer.

What is a Machine Learning Compiler Engineer job?

A Machine Learning Compiler Engineer focuses on optimizing and building compilers that translate high-level machine learning models into efficient code runnable on specialized hardware (e.g., GPUs, TPUs). They work on improving performance, memory usage, and execution efficiency of ML workloads by designing compiler optimizations, code generation techniques, and leveraging frameworks like LLVM or MLIR. Their role bridges the gap between ML researchers and hardware engineers, ensuring models run efficiently on target platforms.

What are the typical daily responsibilities of a Machine Learning Compiler Engineer?

As a Machine Learning Compiler Engineer, your daily responsibilities often include designing and implementing new compiler optimizations, collaborating with machine learning researchers to support model deployment, and debugging performance or correctness issues in compiled code. You may participate in code reviews, write technical documentation, and conduct benchmarking to evaluate how machine learning models perform on various hardware backends. Close collaboration with hardware engineers, software architects, and data scientists is common, ensuring end-to-end solutions meet both research and production requirements. Staying updated with the latest advancements in both compiler technology and machine learning frameworks is also a key aspect of the role.

What are the key skills and qualifications needed to thrive in the Machine Learning Compiler Engineer position, and why are they important?

A Machine Learning Compiler Engineer needs a deep understanding of computer science fundamentals, compiler theory, and experience with machine learning frameworks, often supported by a relevant degree in computer science or engineering. Proficiency with tools such as LLVM, TVM, MLIR, and languages like C++, Python, and CUDA is typically required, and familiarity with hardware architectures is a plus. Strong problem-solving, teamwork, and communication skills are essential for collaborating with cross-functional teams and addressing complex system issues. These capabilities are important for designing and optimizing compilers that enable scalable and efficient deployment of machine learning models on diverse hardware platforms.

What are the most commonly searched types of Machine Learning Compiler Engineer jobs in New York? The most popular types of Machine Learning Compiler Engineer jobs in New York are:
What are popular job titles related to Machine Learning Compiler Engineer jobs in New York? For Machine Learning Compiler Engineer jobs in New York, the most frequently searched job titles are:
What job categories do people searching Machine Learning Compiler Engineer jobs in New York look for? The top searched job categories for Machine Learning Compiler Engineer jobs in New York are:
Machine Learning Compiler Engineer jobs near you
Infographic showing various Machine Learning Compiler Engineer job openings in New York as of May 2026, with employment types broken down into 94% Full Time, 2% Part Time, 2% Contract, and 2% Nights. Highlights an 94% Physical, 1% Hybrid, and 5% Remote job distribution, with an average salary of $140,878 per year, or $67.7 per hour.

Applied Machine Learning Engineer

Fireworks AI

Manhattan, NY

$170K - $240K/yr

Other

Posted 20 days ago

Job description

Applied Machine Learning Engineer

New York, NY; San Mateo, CA

About Us:

At Fireworks, we're building the future of generative AI infrastructure. Our platform delivers the highest-quality models with the fastest and most scalable inference in the industry. We've been independently benchmarked as the leader in LLM inference speed and are driving cutting-edge innovation through projects like our own function calling and multimodal models. Fireworks is a Series C company valued at $4 billion and backed by top investors including Benchmark, Sequoia, Lightspeed, Index, and Evantic. We're an ambitious, collaborative team of builders, founded by veterans of Meta PyTorch and Google Vertex AI.

The Role:

As an Applied Machine Learning Engineer, you will serve as a vital bridge between cutting-edge AI research and practical, real-world applications. Your work will focus on developing, fine-tuning, and operationalizing machine learning models that drive business value and enhance user experiences. This is a hands-on engineering role that combines deep technical expertise with a strong customer focus to deliver scalable AI solutions.

Key Responsibilities:
  • Customer Success: Collaborate directly with the GTM team (Account Executives and Solutions Architects) to ensure smooth integration and successful deployment of ML solutions.
  • Demo / Proof of Concept (PoC): Build and present compelling PoCs that demonstrate the capabilities of our AI technology.
  • Application Build: Design, develop, and deploy end-to-end AI-powered applications tailored to customer needs.
  • Platform Features / Bug Fixes: Contribute to the internal ML platform, including adding features and resolving issues.
  • New Model Enablements: Integrate and enable new machine learning models into the existing platform or client environments.
  • Performance Optimizations: Improve system performance, efficiency, and scalability of deployed models and applications.
  • Partnership Enablement: Work closely with partners to enable joint AI solutions and ensure seamless collaboration.
Minimum Qualifications:
  • Bachelor's degree in Computer Science, Engineering, or a related technical field.
  • 5+ years of experience in a software engineering role, with a strong preference for customer-facing roles.
  • Robust coding skills required, preferably with proficiency in Python.
  • Demonstrated ability to lead and execute complex technical projects with a focus on customer success.
  • Strong interpersonal and communication skills; ability to thrive in dynamic, cross-functional teams.
Preferred Qualifications:
  • Master's degree in Computer Science, Engineering, or a related technical field.
  • Experience working in a startup or fast-paced environment.
  • Hands-on experience fine-tuning machine learning models, including supervised fine-tuning (SFT) and reinforcement learning from human feedback (RLHF or RFT).
  • Solid understanding of generative AI, machine learning principles, and enterprise infrastructure.

Total compensation for this role also includes meaningful equity in a fast-growing startup, along with a competitive salary and comprehensive benefits package. Base salary is determined by a range of factors including individual qualifications, experience, skills, interview performance, market data, and work location. The listed salary range is intended as a guideline and may be adjusted.

Base Pay Range (Plus Equity)

$170,000 - $240,000 USD

Why Fireworks AI?
  • Solve Hard Problems: Tackle challenges at the forefront of AI infrastructure, from low-latency inference to scalable model serving.
  • Build What's Next: Work with bleeding-edge technology that impacts how businesses and developers harness AI globally.
  • Ownership & Impact: Join a fast-growing, passionate team where your work directly shapes the future of AI—no bureaucracy, just results.
  • Learn from the Best: Collaborate with world-class engineers and AI researchers who thrive on curiosity and innovation.

Fireworks AI is an equal-opportunity employer. We celebrate diversity and are committed to creating an inclusive environment for all innovators.

Apply