1

Software Engineer Ml Jobs (NOW HIRING)

About the Opportunity We are seeking a Senior Software Engineer to design, build, deploy, monitor, and optimize production-ready ML services in regulated healthcare. You will work hands-on to package ...

Sr. Software Engineer - ML Systems

Denver, CO · On-site +1

$176K - $206K/yr

About the Opportunity We are seeking a Senior Software Engineer to design, build, deploy, monitor, and optimize production-ready ML services in regulated healthcare. You will work hands-on to package ...

Collaborate with ML engineers to build robust model pipelines utilizing the ML infrastructure. Requirements * Education: Bachelor's degree in a related field with 5+ years of relevant experience, or ...

Software Engineer, ML Infra

Mountain View, CA · On-site +1

$180K - $225K/yr

Collaborate with ML engineers to build robust model pipelines utilizing the ML infrastructure. Requirements * Education: Bachelor's degree in a related field with 5+ years of relevant experience, or ...

next page

Showing results 1-20

Software Engineer Ml information

See salary details

$63.5K

$147.5K

$205.5K

How much do software engineer ml jobs pay per year?

As of Jun 29, 2026, the average yearly pay for software engineer ml in the United States is $147,524.00, according to ZipRecruiter salary data. Most workers in this role earn between $120,000.00 and $173,000.00 per year, depending on experience, location, and employer.

What engineers make $500,000?

Senior software engineers, especially those working in high-demand areas like tech hubs or with expertise in machine learning, cloud computing, or specialized skills, can earn $500,000 or more annually through base salary, bonuses, and stock options. Achieving this level typically requires extensive experience, advanced technical skills, and often leadership responsibilities or working at large tech companies or startups with significant funding.

What does a Software Engineer, ML do?

A Software Engineer, ML (Machine Learning) designs, develops, and deploys software systems that use machine learning algorithms to solve complex problems. They work on tasks such as building data pipelines, training and testing machine learning models, and integrating these models into production applications. They collaborate closely with data scientists, product managers, and other engineers to ensure that ML systems are scalable, efficient, and meet business objectives. Their work often involves programming, data analysis, and staying up-to-date with the latest developments in AI and machine learning.

What are some common challenges faced by Software Engineers working in Machine Learning, and how can they be addressed?

Software Engineers in Machine Learning often encounter challenges such as managing large datasets, ensuring model accuracy, and keeping up with rapidly evolving frameworks and tools. Collaboration with data scientists and domain experts is essential to align technical solutions with business goals. Staying current through continuous learning and leveraging cloud-based platforms or MLOps practices can help streamline workflows and improve model deployment. Additionally, effective communication within cross-functional teams is crucial for addressing both technical and non-technical challenges.

Do ML engineers get paid well?

Machine Learning (ML) engineers typically earn high salaries due to their specialized skills in algorithms, data modeling, and programming languages like Python and TensorFlow. Compensation varies based on experience, location, and industry, but they generally receive above-average pay compared to other software engineering roles.

Which 5 jobs will survive AI?

Software engineers specializing in machine learning, AI system development, and data science are likely to continue thriving as these fields require complex problem-solving, creativity, and domain expertise that are difficult for AI to fully replicate. Roles involving AI model training, ethical oversight, and system integration will remain in demand due to their specialized knowledge and ongoing innovation needs.

What are the key skills and qualifications needed to thrive as a Software Engineer ML, and why are they important?

To thrive as a Software Engineer ML, you need strong proficiency in programming (especially Python), algorithms, machine learning theory, and a relevant degree in computer science or a related field. Experience with ML frameworks like TensorFlow or PyTorch, and familiarity with cloud computing platforms and version control systems are typically required. Analytical thinking, problem-solving, and effective communication skills help you stand out in collaborative and complex project environments. These skills are vital to efficiently develop, deploy, and maintain robust machine learning solutions that drive business value.

Are ML engineers still in demand?

ML engineers are currently in high demand due to the growth of artificial intelligence and machine learning applications across industries. They typically require skills in programming, data analysis, and frameworks like TensorFlow or PyTorch, and job opportunities are expected to remain strong as AI adoption expands.
More about Software Engineer Ml jobs
What cities are hiring for Software Engineer Ml jobs? Cities with the most Software Engineer Ml job openings:
What states have the most Software Engineer Ml jobs? States with the most job openings for Software Engineer Ml jobs include:
What job categories do people searching Software Engineer Ml jobs look for? The top searched job categories for Software Engineer Ml jobs are:
Staff Software Engineer, ML Infrastructure

Staff Software Engineer, ML Infrastructure

SimpliSafe

Boston, MA

Full-time

Medical, Retirement

Posted 8 days ago


SimpliSafe rating

9.7

Company rating: 9.7 out of 10

Based on 7 frontline employees who took The Breakroom Quiz

1st of 103 rated security


Job description

About SimpliSafe

We're a high-tech home security company that's passionate about protecting the life you've built and our mission of keeping Every Home Secure. And we've created a culture here that cares just as deeply about the career you're building. Ours is a no ego culture of collaboration and innovation where those seeking their next challenge can find big opportunities and make a huge impact on the lives of all those who we protect. We don't just want you to work here. We want you to grow and thrive here.
We're embracing a hybrid work model that enables our teams to split their time between office and home. Hybrid for us means we expect our teams to come together in our state-of-the-art office on two core days, typically Tuesday, Wednesday, or Thursday – working together in person and choosing where they work for the remainder of the week. We all benefit from flexibility and get to use the best of both worlds to get our work done.

Why are we hiring?

Well, we're growing and thriving. So, we need smart, talented, and humble people who share our values to join us as we disrupt the home security space and relentlessly pursue our mission of keeping Every Home Secure.

About the Role

We're looking for a Staff Software Engineer to join our Cloud ML team — the team that owns both the cloud-side ML infrastructure and the applied ML research that powers SimpliSafe's intelligent home security products. This is a senior individual contributor role for a distributed systems expert who wants to apply that craft to one of the most demanding problem domains in the company.

You'll partner closely with other Staff and Principal engineers to drive architecture, mentor across the team, and set the technical direction for our ML platform. The work spans two of our most demanding workloads: real-time computer vision inference that processes video from cameras and doorbells across our customer base, and LLM/GenAI infrastructure that will power our future generation of intelligent applications. Both are, fundamentally, distributed systems problems — high-throughput, low-latency, multi-tenant, GPU-aware, and unforgiving of regressions.

This role is for someone who has built and operated large-scale distributed services in production — high-QPS APIs, real-time platforms, low-latency serving systems — and is excited to bring that depth to ML infrastructure. Prior ML experience is a plus, not a prerequisite. If you've shipped systems that serve a lot of traffic, scale gracefully, and stay up at 3am, we want to talk to you.

What You'll Do

Set technical direction for ML infrastructure

  • Drive architecture decisions for our Kubernetes-based ML platform — anchored on Ray for inference, alongside KServe, Triton, and vLLM — across real-time and batch workloads.
  • Lead deep technical reviews on system design, capacity planning, and reliability for the highest-stakes ML systems at SimpliSafe.
  • Identify and remove the systemic bottlenecks in our ML deployment infrastructure — whether that's serving reliability, deployment friction, observability gaps, scaling, or cost.

Build and operate real-time CV inference at scale

  • Own the design and evolution of cloud-side inference systems that process live video and events from SimpliSafe devices in real time.
  • Drive throughput, latency, and cost improvements (batching strategies, GPU utilization, autoscaling, multi-model serving) for production CV models.
  • Build the feedback loops between cloud inference, edge devices, and the data flywheel that improves model quality over time.

Stand up LLM/GenAI serving infrastructure

  • Help shape how SimpliSafe serves LLMs in production — model serving patterns, KV-cache and batching strategies, evaluation pipelines, guardrails, and cost controls.
  • Partner with applied ML engineers to take new GenAI-powered product features from prototype to scaled deployment.

Raise the engineering bar across Cloud ML

  • Mentor engineers across the team through design reviews, code reviews, pairing, and written guidance — a meaningful uplift on everyone you work with.
  • Establish and evangelize best practices for model lifecycle management (registry, deployment, monitoring, rollback, drift) and on-call.
  • Write the documentation, runbooks, and architectural decision records that make the platform legible and durable.

Own reliability and operational excellence

  • Lead incident response and postmortems for critical ML systems; turn lessons learned into platform-level improvements.
  • Define SLOs, observability standards, and on-call practices for ML services in production.
Qualifications
  • 8+ years of software engineering experience, with a clear track record of building and operating large-scale distributed systems in production.
  • Deep expertise in high-throughput, low-latency services — ad serving, recommendations, real-time APIs, online platforms, or similar — including the operational reality of running them at scale.
  • Strong production experience on Kubernetes and AWS (EKS, S3, IAM, networking) and with Kafka, containerized deployments, CI/CD, and infrastructure-as-code.
  • Demonstrated experience with the building blocks of high-scale systems: load balancing, autoscaling, batching, caching, multi-tenancy, queuing, and capacity planning.
  • Proficiency in Python is required; experience with a systems language (Go, C++, Rust) for performance-sensitive components is a plus.
  • Staff-level technical leadership: ability to drive ambiguous, cross-cutting initiatives, align senior stakeholders, and elevate the engineers around you without formal authority.
  • Strong written and verbal communication — you can make complex technical tradeoffs legible to ML scientists, product, and other infra teams.
  • ML exposure is preferred — having deployed or operated production ML systems, worked closely with ML teams, or built ML-adjacent infrastructure. Exceptional distributed systems engineers without direct ML experience are encouraged to apply; we'll help you ramp.
Bonus Points
  • Hands-on experience with Ray, KServe, Triton, vLLM, or other ML serving stacks.
  • Hands-on experience with LLM serving in production (vLLM, TGI, TensorRT-LLM, SGLang) — KV cache management, continuous batching, speculative decoding, quantization for serving.
  • Experience building real-time video or streaming pipelines (Kafka, Kinesis, Flink, or similar) at scale.
  • Experience operating GPU-based inference systems — GPU-aware scheduling, multi-model serving, accelerator utilization optimization.
  • Familiarity with ML fundamentals — how models are trained, evaluated, versioned, deployed, monitored, and rolled back in production.
  • Experience with model lifecycle tooling (MLflow, Weights & Biases, model registries, drift detection, shadow deployments).
  • Open source contributions to distributed systems or ML infrastructure projects.
  • Experience operating in environments with strong security and compliance requirements.
Why This Role

The Cloud ML team owns the full surface area — infrastructure and applied research — which means your work as a Staff infra engineer directly shapes what's possible for the science. You'll have unusual leverage: the platform you build determines how fast SimpliSafe can ship intelligent features, and the features we ship directly impact whether someone's home is safer tonight than it was yesterday.

What Values You'll Share
  • Customer Obsessed - Building deep empathy for our customers, putting them at the core of our work, and developing strong, long-term relationships with them.
  • Aim High - Always challenging ourselves and others to raise the bar.
  • No Ego - Maintaining a "no job too small" attitude, and an open, inclusive and humble style.
  • One Team - Taking a highly collaborative approach to achieving success.
  • Lift As We Climb - Investing in developing others and helping others around us succeed.
  • Lean & Nimble - Working with agility and efficiency to experiment in an often ambiguous environment.
What We Offer
  • A mission- and values-driven culture and a safe, inclusive environment where you can build, grow and thrive
  • A comprehensive total rewards package that supports your wellness and provides security for SimpliSafers and their families (For more information on our total rewards please click here)
  • Free SimpliSafe system and professional monitoring for your home.
  • Employee Resource Groups (ERGs) that bring people together, give opportunities to network, mentor and develop, and advocate for change.

The target annual base pay range for this role is $146,600 to $215,100.

This target annual base pay range represents our good-faith estimate of what we expect to pay for this role. We use a market-based compensation approach to set our target annual base pay ranges and make adjustments annually. We carefully tailor individual compensation packages, including base pay, taking into consideration employees' job-related skills, experience, qualifications, work location, and other relevant business factors.

Beyond base pay, we offer a Total Rewards package that may include participation in our annual bonus program, equity, and other forms of compensation, in addition to a full range of medical, retirement, and lifestyle benefits. More details can be found here.

We're committed to fair and equitable pay practices, as well as pay transparency. We regularly review our programs to ensure they remain competitive and aligned with our values.

We wholeheartedly embrace and actively seek applications from all individuals, no matter how they identify. We are committed to cultivating a diverse and inclusive workplace, and we believe our work is enriched when we incorporate a multitude of perspectives, backgrounds, and experiences. We want everyone who works here to thrive and contribute to not only our mission of keeping every home secure, but also to making our workplace safe and supportive for others. If a reasonable accommodation may be needed to fully participate in the job application or interview process, to perform the essential functions of a position, or to receive other benefits and privileges of employment, please contact careers@simplisafe.com.