1

Junior Machine Learning Compiler Engineer Jobs in New York

Staff Machine Learning Engineer

New York, NY · On-site +1

$179K - $224K/yr

About the Staff Machine Learning Engineer at Headspace: The AI & Machine Learning group at ... Mentorship of junior engineers and contribution to DEIB initiatives Preferred Skills: * Master ...

Our team is a passionate mix of engineers across electrical, firmware, software, and machine learning. Core Responsibilities * Architect Physics Foundation Models: Design and train deep learning ...

Machine Learning Engineer

New York, NY · On-site

$145K - $170K/yr

Constructing machine learning models including data collection, normalization, and standardization, data pipeline construction, model selection and hyperparameter tuning, working ml systems that can ...

Machine Learning at Headspace is a dynamic and innovative group whose mission is to improve the ... Mentorship of junior engineers and contribution to DEIB initiatives Preferred Skills: * PhD in ...

Machine Learning Engineer

New York, NY · Hybrid

$145K - $170K/yr

Constructing machine learning models including data collection, normalization, and standardization, data pipeline construction, model selection and hyperparameter tuning, working ml systems that can ...

New

We're looking for a senior-level Machine Learning Engineer who can move quickly while maintaining high quality, owning end-to-end ML pipelines while shaping product features that deliver real-world ...

We're looking for a senior-level Machine Learning Engineer who can move quickly while maintaining high quality, owning end-to-end ML pipelines while shaping product features that deliver real-world ...

New

Machine Learning Engineer

New York, NY · On-site

$200K - $300K/yr

Virtu's Research Technology team is looking for an experienced Machine Learning Engineer to join a small group of technologists whose primary function is building the infrastructure that powers our ...

Machine Learning Engineer

New York, NY · On-site

$200K - $300K/yr

Virtu's Research Technology team is looking for an experienced Machine Learning Engineer to join a small group of technologists whose primary function is building the infrastructure that powers our ...

We are seeking a Senior Machine Learning Engineer to join our AI & ML team in New York City. You ... Mentor junior engineers. Share domain knowledge and help build genuine technical depth on the team.

Who We're Looking For As a Machine Learning Engineer in Delivery, you are a problem solver who stays anchored to impact. You are someone who can grasp advanced engineering concepts across multiple ...

We are seeking a Senior Machine Learning Engineer to join our AI & ML team in New York City. You ... Mentor junior engineers. Share domain knowledge and help build genuine technical depth on the team.

next page

Showing results 1-20

Junior Machine Learning Compiler Engineer information

What are typical projects and responsibilities for a Junior Machine Learning Compiler Engineer in a collaborative team setting?

As a Junior Machine Learning Compiler Engineer, you can expect to work on projects that focus on optimizing machine learning models for performance and deployment across various hardware platforms. Typical responsibilities include assisting in developing and debugging compiler passes, implementing optimizations, and contributing to code reviews. You'll frequently collaborate with senior engineers, data scientists, and hardware specialists to ensure that models are efficiently translated and executed. This role offers valuable learning opportunities through hands-on coding, exposure to state-of-the-art ML frameworks, and regular team meetings for knowledge sharing and mentorship.

What does a Junior Machine Learning Compiler Engineer do?

A Junior Machine Learning Compiler Engineer helps design, develop, and optimize compilers for machine learning models. Their work involves translating high-level machine learning code into efficient low-level code that can run on various hardware platforms, such as CPUs, GPUs, or specialized AI chips. They often collaborate with software engineers and data scientists to ensure that machine learning workloads run efficiently and correctly. This role typically involves programming, debugging, and performance tuning, often using languages like C++, Python, and specialized frameworks.

What are the key skills and qualifications needed to thrive as a Junior Machine Learning Compiler Engineer, and why are they important?

To thrive as a Junior Machine Learning Compiler Engineer, you need a solid background in computer science fundamentals, programming (especially C++ and Python), and foundational knowledge of machine learning and compiler theory. Familiarity with frameworks and tools such as LLVM, TensorFlow, MLIR, and version control systems is typically required, along with a relevant bachelor’s or master’s degree. Strong problem-solving abilities, attention to detail, and effective teamwork and communication skills set standout candidates apart. These skills and qualities are crucial for efficiently optimizing machine learning models for various hardware targets and collaborating on innovative compiler solutions.

What is the difference between Junior Machine Learning Compiler Engineer vs Data Scientist?

AspectJunior Machine Learning Compiler EngineerData Scientist
Required CredentialsBachelor's in Computer Science, Software Engineering, or related field; knowledge of compiler design and ML frameworksBachelor's or higher in Data Science, Statistics, Computer Science, or related field; strong analytical skills
Work EnvironmentSoftware development teams, focusing on compiler optimization for ML modelsData analysis teams, focusing on data interpretation and model development
Employer & Industry UsageTech companies, AI startups, hardware firmsTech firms, finance, healthcare, research institutions

The Junior Machine Learning Compiler Engineer primarily focuses on developing and optimizing compilers for machine learning models, requiring programming and compiler knowledge. In contrast, a Data Scientist analyzes data, builds models, and provides insights. Both roles are essential in AI and tech industries but differ in technical focus and daily tasks.

What are the most commonly searched types of Machine Learning Compiler Engineer jobs in New York? The most popular types of Machine Learning Compiler Engineer jobs in New York are:
What job categories do people searching Junior Machine Learning Compiler Engineer jobs in New York look for? The top searched job categories for Junior Machine Learning Compiler Engineer jobs in New York are:
What cities in New York are hiring for Junior Machine Learning Compiler Engineer jobs? Cities in New York with the most Junior Machine Learning Compiler Engineer job openings:
Infographic showing various Junior Machine Learning Compiler Engineer job openings in New York as of July 2026, with employment types broken down into 100% Full Time. Highlights an 100% In-person job distribution.

Applied Machine Learning Engineer

Fireworks AI

Manhattan, NY • On-site

Full-time

Re-posted 28 days ago


Job description

Job Summary:
Fireworks AI is building the future of generative AI infrastructure, delivering high-quality models with fast and scalable inference. The Applied Machine Learning Engineer will develop, fine-tune, and operationalize machine learning models to drive business value and enhance user experiences.
Responsibilities:
• Collaborate directly with the GTM team (Account Executives and Solutions Architects) to ensure smooth integration and successful deployment of ML solutions.
• Build and present compelling PoCs that demonstrate the capabilities of our AI technology.
• Design, develop, and deploy end-to-end AI-powered applications tailored to customer needs.
• Contribute to the internal ML platform, including adding features and resolving issues.
• Integrate and enable new machine learning models into the existing platform or client environments.
• Improve system performance, efficiency, and scalability of deployed models and applications.
• Work closely with partners to enable joint AI solutions and ensure seamless collaboration.
Qualifications:
Required:
• Bachelor’s degree in Computer Science, Engineering, or a related technical field.
• 5+ years of experience in a software engineering role, with a strong preference for customer-facing roles.
• Robust coding skills required, preferably with proficiency in Python.
• Demonstrated ability to lead and execute complex technical projects with a focus on customer success.
• Strong interpersonal and communication skills; ability to thrive in dynamic, cross-functional teams.
Preferred:
• Master’s degree in Computer Science, Engineering, or a related technical field.
• Experience working in a startup or fast-paced environment.
• Hands-on experience fine-tuning machine learning models, including supervised fine-tuning (SFT) and reinforcement learning from human feedback (RLHF or RFT).
• Solid understanding of generative AI, machine learning principles, and enterprise infrastructure.
Company:
Fireworks AI is an advanced platform that enables users to build, tune, and scale AI applications using open-source models Founded in 2022, the company is headquartered in Redwood City, USA, with a team of 51-200 employees. The company is currently Growth Stage.