1

Senior Embedded Machine Learning Jobs (NOW HIRING)

Senior Embedded Software Engineer

Austin, TX · On-site

$122K - $161K/yr

As a Senior Embedded Software Engineer, you will play a key role in designing, developing, and ... Applying next-gen technology, high-density storage and machine learning to solve today's complex ...

Senior Embedded Software Engineer

Austin, TX · Hybrid

$122K - $161K/yr

As a Senior Embedded Software Engineer, you will play a key role in designing, developing, and ... Applying next-gen technology, high-density storage and machine learning to solve today's complex ...

Sr. Embedded SW Engineer

Palo Alto, CA

$145K - $191K/yr

Title: Sr. Embedded SW Engineer Location: Palo Alto, CA Duration: 2 Years Save Lives - Develop ... machines. Here are some highlights of this position: Design and develop Object Oriented real time ...

Sr. Machine Learning Engineer Location: New York, NY Sponsorship: Yes Relocation: Yes Industry ... with machine learning in embedded applications: model quantization, fixed point neural networks ...

Sr. Embedded SW Engineer

Palo Alto, CA · On-site

$145K - $191K/yr

Title: Sr. Embedded SW Engineer Location: Palo Alto, CA Duration: 2 Years Save Lives - Develop ... machines. Here are some highlights of this position: Design and develop Object Oriented real time ...

next page

Showing results 1-20

Senior Embedded Machine Learning information

See salary details

$75.5K

$144.8K

$193.5K

How much do senior embedded machine learning jobs pay per year?

As of Aug 1, 2026, the average yearly pay for senior embedded machine learning in the United States is $144,773.00, according to ZipRecruiter salary data. Most workers in this role earn between $124,000.00 and $162,500.00 per year, depending on experience, location, and employer.

What is the difference between Senior Embedded Machine Learning vs Embedded Software Engineer?

AspectSenior Embedded Machine LearningEmbedded Software Engineer
Required CredentialsBachelor's/Master's in CS, EE, or related; experience in ML and embedded systemsBachelor's in CS, EE, or related; strong programming skills in C/C++
Work EnvironmentDeveloping ML models for embedded devices, hardware integrationDesigning and implementing embedded software for devices
Industry UsageAI/ML-focused companies, IoT, consumer electronicsAutomotive, industrial, consumer electronics

While both roles involve embedded systems, Senior Embedded Machine Learning focuses on integrating ML models into hardware, requiring knowledge of AI and data science. Embedded Software Engineers primarily develop software for embedded devices, emphasizing firmware and system-level programming. The roles overlap in embedded environment skills but differ in their core focus on AI versus traditional software development.

What are some common challenges faced by Senior Embedded Machine Learning Engineers when deploying models on edge devices?

Senior Embedded Machine Learning Engineers often encounter challenges such as optimizing model size and inference speed to fit within the limited computational resources and memory of edge devices. Balancing accuracy and performance while minimizing power consumption is critical, especially for battery-operated products. Additionally, integrating models with existing embedded software and ensuring reliable, real-time operation can require close collaboration with hardware and firmware teams. Staying current with advancements in model compression and hardware acceleration is also essential for success in this role.

What are the key skills and qualifications needed to thrive as a Senior Embedded Machine Learning Engineer, and why are they important?

To thrive as a Senior Embedded Machine Learning Engineer, you need expertise in embedded systems, machine learning algorithms, and programming languages like C/C++ and Python, often backed by an advanced degree in computer science or electrical engineering. Familiarity with tools such as TensorFlow Lite, ONNX, and embedded hardware platforms (e.g., ARM Cortex-M, NVIDIA Jetson) is typically required. Strong problem-solving, project management, and communication skills distinguish top performers in this role. These capabilities are crucial for efficiently deploying optimized machine learning models on resource-constrained devices and effectively collaborating across multidisciplinary teams.

What does a Senior Embedded Machine Learning engineer do?

A Senior Embedded Machine Learning engineer designs, develops, and optimizes machine learning models to run efficiently on resource-constrained embedded devices such as microcontrollers, IoT devices, and edge hardware. They are responsible for integrating ML algorithms with embedded systems, ensuring low latency and minimal power consumption. Their work often involves collaborating with hardware engineers and software developers to deploy intelligent features in products like smart sensors, wearables, and autonomous systems.
What cities are hiring for Senior Embedded Machine Learning jobs? Cities with the most Senior Embedded Machine Learning job openings:
What are the most commonly searched types of Embedded Machine Learning jobs? The most popular types of Embedded Machine Learning jobs are:
What states have the most Senior Embedded Machine Learning jobs? States with the most job openings for Senior Embedded Machine Learning jobs include:

Sr. Embedded Machine Learning Engineer

Allen Control Systems

Austin, TX • On-site

$122K - $161K/yr

Full-time

Medical, Dental, Vision, PTO

Posted 22 days ago


Job description

Company Overview
Allen Control Systems (ACS) is a cutting-edge defense startup founded by two former Navy electrical engineers with a proven track record in robotics and software. We are developing an autonomous gun turret using advanced computer vision and control systems to precisely detect, track, and neutralize enemy drones.
With an engineering-first culture, ACS values technical excellence and innovation. Backed by our founders' successful exits from two previous ventures acquired for a combined $180M in 2022, we are committed to ensuring that the groundbreaking technologies we develop will have a real-world impact.
About The Role
We are looking for a Senior Embedded Machine Learning Engineer to own the end-to-end process of taking trained ML models and deploying them efficiently onto resource-constrained edge hardware. This role sits at the intersection of machine learning, embedded systems, and hardware engineering. You will integrate, convert, and optimize models to run within strict constraints on latency, memory, power, and thermal budget, and build the supporting C++ infrastructure that hosts them on device. You will partner closely with the CVML team who build the models, the embedded and firmware teams who own the device, and the product team who define performance targets. Success means models that are not just accurate in the lab but fast, small, and dependable in the field.
What You'll Do
  • Apply quantization, pruning, knowledge distillation, operator fusion, and graph optimization to shrink models and reduce inference cost while protecting accuracy; convert trained models into edge-deployable formats using ONNX and TensorRT.
  • Profile inference on target accelerators including GPUs, NPUs, DSPs, and FPGAs; measure latency, throughput, memory footprint, and power consumption, then drive the changes needed to hit performance targets.
  • Design, write, and maintain the C++ application code that hosts inference on device, including pre- and post-processing pipelines, data and memory management, threading, and interfaces to the rest of the embedded system; ensure the combined model and C++ stack meets real-time constraints and fits within device memory budget.
  • Build test harnesses to verify on-device accuracy against reference results and catch regressions from optimization or quantization; contribute to tooling for packaging, versioning, and delivering model updates to deployed devices.
  • Set best practices for edge deployment, review designs and code, and mentor other engineers on optimization and embedded ML techniques; work closely with research, firmware, and product teams to set realistic performance targets and feed hardware constraints back into model design.

What You'll Need
  • 10+ years of professional software or systems engineering experience, including at least 2 years focused on deploying ML models to embedded or edge devices; Bachelor's or Master's degree in Computer Science, Electrical Engineering, Computer Engineering, or equivalent practical experience.
  • Very strong C++ proficiency; working knowledge of CUDA; hands-on experience with PyTorch and at least one edge inference runtime such as TensorFlow Lite, ONNX Runtime, or TensorRT.
  • Practical experience with model optimization techniques including post-training quantization, quantization-aware training, pruning, and distillation; demonstrated ability to profile and optimize for latency, memory, and power on constrained hardware.
  • Working knowledge of embedded or edge platforms such as NVIDIA Jetson, Qualcomm, ARM Cortex, or comparable NPUs and SoCs, and of Linux or an RTOS; solid grasp of computer architecture concepts relevant to inference including memory hierarchy, fixed-point arithmetic, and accelerator offload; domain experience in computer vision or sensor processing on device.

You'll Stand Out
  • Hands-on experience deploying computer vision models for detection or tracking tasks on embedded or edge hardware.
  • Experience with NVIDIA Jetson specifically, including TensorRT optimization and deployment on Jetson platforms.
  • Background in defense, autonomous systems, or robotics where real-time reliability matters.
  • Experience building or contributing to model update and OTA delivery pipelines for deployed edge devices.

What We Offer
  • Competitive salary
  • ACS Equity Package
  • Health, Dental, Vision Insurance
  • Paid Time Off

Allen Control Systems is an Equal Opportunity Employer, providing equal employment opportunities to all employees and applicants for employment. Allen Control Systems prohibits discrimination and harassment of any type without regard to race, color, religion, age, sex, national origin, disability status, genetics, protected veteran status, sexual orientation, gender identity or expression, or any other characteristic protected by federal, state or local laws. #LI-AS1