ZipRecruiter

Log In

1

Embedded Machine Learning Engineer Jobs (NOW HIRING)

Chefman

Machine Learning Engineer

Mahwah, NJ

As a Machine Learning Engineer, you will play a critical role in shaping the future of cooking ... This is an opportunity to work at the intersection of machine learning, embedded systems, computer ...

MatrixSpace

Machine Learning Engineer

Burlington, MA · Remote

$165K - $200K/yr

Experience with embedded systems, GPUs, NPUs, FPGAs, or hardware acceleration. * Familiarity ... At MatrixSpace, Machine Learning Engineering is where advanced AI research becomes real-world ...

Velo3D

Machine Learning Engineer

Fremont, CA

$150K - $220K/yr

We are seeking a Machine Learning Engineer to join our team developing machine learning solutions ... Work with print software and embedded teams to integrate validated models into production code ...

Velo3D

Machine Learning Engineer

Fremont, CA

$150K - $220K/yr

We are seeking a Machine Learning Engineer to join our team developing machine learning solutions ... Work with print software and embedded teams to integrate validated models into production code ...

next page

Showing results 1-20

All JobsEmbedded Machine Learning Engineer Jobs

Embedded Machine Learning Engineer information

See salary details

$70K

$153.4K

$174K

How much do embedded machine learning engineer jobs pay per year?

As of Jul 30, 2026, the average yearly pay for embedded machine learning engineer in the United States is $153,383.00, according to ZipRecruiter salary data. Most workers in this role earn between $131,500.00 and $173,000.00 per year, depending on experience, location, and employer.

What are the key skills and qualifications needed to thrive as an Embedded Machine Learning Engineer, and why are they important?

To thrive as an Embedded Machine Learning Engineer, you need expertise in machine learning algorithms, embedded systems programming (C/C++ or Python), and a solid understanding of hardware constraints, usually supported by a degree in computer science, electrical engineering, or related fields. Familiarity with tools like TensorFlow Lite, ONNX, microcontroller SDKs, and experience with real-time operating systems (RTOS) are typically required. Strong problem-solving, communication skills, and the ability to collaborate across multidisciplinary teams help you stand out in this role. These skills are crucial for efficiently deploying intelligent models on resource-constrained devices, ensuring optimal performance and seamless integration in real-world applications.

What does an Embedded Machine Learning Engineer do?

An Embedded Machine Learning Engineer designs and implements machine learning models that can run efficiently on embedded systems, such as microcontrollers and edge devices. Their work involves optimizing algorithms to fit within the resource constraints of these devices, integrating ML models into hardware, and ensuring real-time performance. They collaborate closely with hardware engineers and software developers to deploy intelligent features in products like smart sensors, IoT devices, and autonomous systems.

What are some common challenges faced by Embedded Machine Learning Engineers when deploying models to hardware devices?

One of the main challenges for Embedded Machine Learning Engineers is optimizing machine learning models to run efficiently on devices with limited memory, processing power, and energy capacity. Ensuring real-time performance while maintaining accuracy often requires model quantization, pruning, or using lightweight architectures. Additionally, engineers must carefully manage hardware-software integration and address issues like compatibility with various microcontrollers and ensuring secure, reliable updates for deployed models. Close collaboration with hardware engineers and software developers is essential to overcome these challenges and deliver robust embedded AI solutions.

What is the difference between Embedded Machine Learning Engineer vs Firmware Engineer?

AspectEmbedded Machine Learning EngineerFirmware Engineer
Required CredentialsBachelor's/Master's in Computer Science, Electrical Engineering, or related; knowledge of ML frameworksBachelor's in Electrical Engineering, Computer Engineering, or related; embedded systems experience
Work EnvironmentDevelops ML models for embedded devices, often in IoT or smart devicesDesigns and implements low-level firmware for hardware devices
Industry UsageTech companies, IoT, consumer electronics, automotiveConsumer electronics, automotive, industrial equipment

The Embedded Machine Learning Engineer focuses on integrating machine learning models into embedded systems, while the Firmware Engineer specializes in developing low-level software for hardware devices. Both roles require embedded systems knowledge but differ in their core focus and skill sets.

More about Embedded Machine Learning Engineer jobs
What cities are hiring for Embedded Machine Learning Engineer jobs? Cities with the most Embedded Machine Learning Engineer job openings:
What states have the most Embedded Machine Learning Engineer jobs? States with the most job openings for Embedded Machine Learning Engineer jobs include:
What job categories do people searching Embedded Machine Learning Engineer jobs look for? The top searched job categories for Embedded Machine Learning Engineer jobs are:
Embedded Machine Learning Engineer jobs near you
Infographic showing various Embedded Machine Learning Engineer job openings in the United States as of July 2026, with employment types broken down into 100% Contract. Highlights an 100% In-person job distribution, with an average salary of $153,383 per year, or $73.7 per hour.

Sr. Embedded Machine Learning Engineer

Allen Control Systems

Austin, TX • On-site

$122K - $161K/yr

Full-time

Medical, Dental, Vision, PTO

Posted 20 days ago

Job description

Company Overview
Allen Control Systems (ACS) is a cutting-edge defense startup founded by two former Navy electrical engineers with a proven track record in robotics and software. We are developing an autonomous gun turret using advanced computer vision and control systems to precisely detect, track, and neutralize enemy drones.
With an engineering-first culture, ACS values technical excellence and innovation. Backed by our founders' successful exits from two previous ventures acquired for a combined $180M in 2022, we are committed to ensuring that the groundbreaking technologies we develop will have a real-world impact.
About The Role
We are looking for a Senior Embedded Machine Learning Engineer to own the end-to-end process of taking trained ML models and deploying them efficiently onto resource-constrained edge hardware. This role sits at the intersection of machine learning, embedded systems, and hardware engineering. You will integrate, convert, and optimize models to run within strict constraints on latency, memory, power, and thermal budget, and build the supporting C++ infrastructure that hosts them on device. You will partner closely with the CVML team who build the models, the embedded and firmware teams who own the device, and the product team who define performance targets. Success means models that are not just accurate in the lab but fast, small, and dependable in the field.
What You'll Do
  • Apply quantization, pruning, knowledge distillation, operator fusion, and graph optimization to shrink models and reduce inference cost while protecting accuracy; convert trained models into edge-deployable formats using ONNX and TensorRT.
  • Profile inference on target accelerators including GPUs, NPUs, DSPs, and FPGAs; measure latency, throughput, memory footprint, and power consumption, then drive the changes needed to hit performance targets.
  • Design, write, and maintain the C++ application code that hosts inference on device, including pre- and post-processing pipelines, data and memory management, threading, and interfaces to the rest of the embedded system; ensure the combined model and C++ stack meets real-time constraints and fits within device memory budget.
  • Build test harnesses to verify on-device accuracy against reference results and catch regressions from optimization or quantization; contribute to tooling for packaging, versioning, and delivering model updates to deployed devices.
  • Set best practices for edge deployment, review designs and code, and mentor other engineers on optimization and embedded ML techniques; work closely with research, firmware, and product teams to set realistic performance targets and feed hardware constraints back into model design.

What You'll Need
  • 10+ years of professional software or systems engineering experience, including at least 2 years focused on deploying ML models to embedded or edge devices; Bachelor's or Master's degree in Computer Science, Electrical Engineering, Computer Engineering, or equivalent practical experience.
  • Very strong C++ proficiency; working knowledge of CUDA; hands-on experience with PyTorch and at least one edge inference runtime such as TensorFlow Lite, ONNX Runtime, or TensorRT.
  • Practical experience with model optimization techniques including post-training quantization, quantization-aware training, pruning, and distillation; demonstrated ability to profile and optimize for latency, memory, and power on constrained hardware.
  • Working knowledge of embedded or edge platforms such as NVIDIA Jetson, Qualcomm, ARM Cortex, or comparable NPUs and SoCs, and of Linux or an RTOS; solid grasp of computer architecture concepts relevant to inference including memory hierarchy, fixed-point arithmetic, and accelerator offload; domain experience in computer vision or sensor processing on device.

You'll Stand Out
  • Hands-on experience deploying computer vision models for detection or tracking tasks on embedded or edge hardware.
  • Experience with NVIDIA Jetson specifically, including TensorRT optimization and deployment on Jetson platforms.
  • Background in defense, autonomous systems, or robotics where real-time reliability matters.
  • Experience building or contributing to model update and OTA delivery pipelines for deployed edge devices.

What We Offer
  • Competitive salary
  • ACS Equity Package
  • Health, Dental, Vision Insurance
  • Paid Time Off

Allen Control Systems is an Equal Opportunity Employer, providing equal employment opportunities to all employees and applicants for employment. Allen Control Systems prohibits discrimination and harassment of any type without regard to race, color, religion, age, sex, national origin, disability status, genetics, protected veteran status, sexual orientation, gender identity or expression, or any other characteristic protected by federal, state or local laws. #LI-AS1

Apply