1

Ml Inference Jobs in Seattle, WA (NOW HIRING)

ML Software Engineer

Seattle, WA · On-site

$175 - $263.30/hr

You will integrate inference code into a full service stack to ensure that user traffic is served ... Familiarity with Apple ML stack (ANE, CoreML, MPS/Metal), high‑level general distributed ML stack ...

Technical Program Manager, Inference

Bellevue, WA · On-site

$145K - $188K/yr

The AI/ML TPM team owns delivery and execution across CoreWeave's AI/ML Platform Services ... The Inference team is responsible for building and operating highly scalable, reliable production ...

Inference Engineer

Bellevue, WA · On-site

$180 - $240/hr

Inference Engineer Location: Hybrid | Bellevue, WA Area Titles: Senior and Staff (multiple roles ... Experience working at a hyperscaler, AI lab, GPU cloud provider, or large‑scale ML infrastructure ...

Prototype and implement novel ML techniques for largescale inference * Design experiments, analyze ... results, and translate findings into productionready solutions * Collaborate with ML, systems, and ...

... inference, and monitoring in production environments. • Participate in continuous improvement of the ML infrastructure and processes for scalability and performance. Qualifications : Required : • ...

Prototype and implement novel ML techniques for largescale inference * Design experiments, analyze ... results, and translate findings into productionready solutions * Collaborate with ML, systems, and ...

Showing results 21-40

Ml Inference information

See Seattle, WA salary details

$42.7K

$139.7K

$223.6K

How much do ml inference jobs pay per year?

As of Sep 4, 2026, the average yearly pay for ml inference in Seattle, WA is $139,680.00, according to ZipRecruiter salary data. Most workers in this role earn between $112,100.00 and $154,800.00 per year, depending on experience, location, and employer.

What is ML inference?

ML inference refers to the process of using a trained machine learning model to make predictions or decisions based on new data. After a model has been trained on historical data, inference is the phase where that model is deployed and used in real-world applications, such as recognizing speech, detecting objects in images, or recommending products. The focus in ML inference is on speed, efficiency, and scalability to ensure quick predictions, often in real time. This process is critical for practical applications like mobile apps, web services, and embedded systems. Optimizing inference involves reducing latency, memory usage, and computational requirements.

What are the key skills and qualifications needed to thrive in ML inference?

To thrive in ML Inference, you need a solid background in machine learning principles, programming (Python or C++), and experience with deploying models at scale, often supported by a degree in computer science or a related field. Familiarity with frameworks and tools such as TensorFlow, PyTorch, ONNX, and cloud platforms like AWS SageMaker or Google AI Platform is typically required. Strong problem-solving skills, attention to detail, and effective communication are crucial soft skills for collaborating with multidisciplinary teams and optimizing model performance. These skills ensure efficient, scalable, and reliable deployment of machine learning solutions in real-world applications.

What are some common challenges faced by ML inference engineers when deploying models to production?

ML Inference Engineers often encounter challenges such as optimizing model latency and throughput to meet production requirements, ensuring compatibility with diverse hardware environments, and managing model versioning and updates without disrupting service. Additionally, balancing resource utilization and inference accuracy while monitoring real-time performance metrics is crucial. Collaboration with data scientists, DevOps, and software engineers is typically essential to streamline deployment and maintain robust, scalable inference pipelines.

What is the difference between Ml Inference vs Data Scientist?

AspectML InferenceData Scientist
Required CredentialsKnowledge of machine learning models, programming skillsDegree in data science, statistics, or related fields
Work EnvironmentDeploying models in production, real-time data processingData analysis, model development, research
Industry UsageAI product deployment, software companiesResearch institutions, tech firms, consulting

ML Inference focuses on deploying trained models to make predictions on new data, often in real-time. Data Scientists develop and analyze models, working primarily in research and development. While both roles require understanding of machine learning, ML Inference emphasizes deployment and operationalization, whereas Data Scientists focus on model creation and analysis.

What are popular job titles related to Ml Inference jobs in Seattle, WA?

For Ml Inference jobs in Seattle, WA, the most frequently searched job titles are:

What job categories do people searching Ml Inference jobs in Seattle, WA look for?

The top searched job categories for Ml Inference jobs in Seattle, WA are:

What cities near Seattle, WA are hiring for Ml Inference jobs?

Cities near Seattle, WA with the most Ml Inference job openings:

Infographic showing various Ml Inference job openings in Seattle, WA as of August 2026, with employment types broken down into 92% Full Time, 4% Part Time, and 4% Contract. Highlights an 82% Physical, 4% Hybrid, and 14% Remote job distribution, with an average salary of $139,680 per year, or $67.2 per hour.

ML Software Engineer

Apple Inc.

Seattle, WA • On-site

$175 - $263.30/hr

Other

Medical, Dental, Retirement

Re-posted 17 days ago


Apple rating

8.1

Company rating: 8.1 out of 10

Based on 681 frontline employees who took The Breakroom Quiz

6th of 30 rated technology retailers


Job description

Seattle, Washington, United States Machine Learning and AI

Our team builds ML‑inference applications and services on Apple Silicon in the datacenter, specifically focusing in recent years on generative AI as part of the Private Cloud Compute component of Apple Intelligence.

Description

As part of the team you will help engineer continuous improvements in stability and performance for private cloud compute, as well as help implement entirely new functionality as it emerges from the research community, in collaboration with product teams throughout Apple. We write performant and scalable frameworks (in Swift and C++) to distribute and coordinate ML inference tasks to different hardware acceleration IP blocks on different SoCs. We’re a collection of highly skilled and friendly engineers who value each other’s opinions and experience. We strive for excellence and believe strongly in the quality of our output. We have formed a team of domain experts who specializes in specific core subject areas, and also have broad experience of cloud software services and platforms. You will integrate inference code into a full service stack to ensure that user traffic is served reliably and performantly, and will have a strong focus on developing code that is easy and safe to develop, update and monitor.

Minimum Qualifications
  • Experience working as a software engineer on large production systems
  • Experience programming in: Swift, C, C++, Python, iOS/macOS or XCode
  • Practical experience running machine learning models and evaluating them for quality and performance metrics
Preferred Qualifications
  • Familiarity with Apple ML stack (ANE, CoreML, MPS/Metal), high‑level general distributed ML stack (PyTorch‑distributed, NCCL) and high throughput inter‑chip communication systems.
  • Quality focus – produce reliable, maintainable, deliverable software – Comfortable diving deep – working across multiple levels of abstraction – Good at handling relationships & communication – collaborate well with colleagues across a wide range of functions
Compensation and Benefits

At Apple, base pay is one part of our total compensation package and is determined within a range. This provides the opportunity to progress as you grow and develop within a role. The base pay range for this role is between $175,000 and $263,300, and your base pay will depend on your skills, qualifications, experience, and location.

Apple employees also have the opportunity to become an Apple shareholder through participation in Apple’s discretionary employee stock programs. Apple employees are eligible for discretionary restricted stock unit awards, and can purchase Apple stock at a discount if voluntarily participating in Apple’s Employee Stock Purchase Plan. You’ll also receive benefits including: Comprehensive medical and dental coverage, retirement benefits, a range of discounted products and free services, and for formal education related to advancing your career at Apple, reimbursement for certain educational expenses — including tuition. Additionally, this role might be eligible for discretionary bonuses or commission payments as well as relocation.

Learn more about Apple Benefits

Note: Apple benefit, compensation and employee stock programs are subject to eligibility requirements and other terms of the applicable plan or program.

Equal Opportunity and Diversity

Apple is an equal opportunity employer that is committed to inclusion and diversity. We seek to promote equal opportunity for all applicants without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, Veteran status, or other legally protected characteristics. Learn more about your EEO rights as an applicant

Accessibility

At Apple, we believe accessibility is a fundamental human right. You’ll find that idea reflected in everything here — in our culture, our benefits and our digital tools. By welcoming as many perspectives as possible, we help you build a career where you feel like you belong.

Learn about accessibility in Apple’s workplace

Learn about reasonable accommodations for job applicants

Apple accepts applications to this posting on an ongoing basis.

#J-18808-Ljbffr

What Apple employees say

Pay

Benefits

Hours and flexibility

Workplace

Get the full story on Breakroom


Apple logo

About Apple

Sourced by ZipRecruiter

Imagine what you could do here! At Apple, new ideas have a way of becoming extraordinary products, services, and customer experiences very quickly. Bring passion and dedication to your job and there's no telling what you could accomplish. Dynamic, intelligent people and inspiring, innovative technologies are the norm here. The people who work here have reinvented entire industries with all Apple Hardware products. The same real passion for innovation that goes into our products also applies to our practices strengthening our dedication to leave the world better than we found it.

Industry

Computer and electronic product manufacturing

Company size

10,000+ Employees

Headquarters location

Cupertino, CA, US

Year founded

1976