1

Ml Inference Jobs in Milwaukee, WI (NOW HIRING)

... ML inference (where appropriate for power and industrial use cases) Partner with hardware and firmware teams to ensure new Eaton products are Brightlayer Ready by design Platform & Architecture ...

New

This AI/ML Engineer role sits at the center of that transformation. You will do two things in ... Build and maintain data pipelines, model integration layers, and inference infrastructure for real ...

Integrate and fine-tune Large Language Models (LLMs) and other AI/ML models into enterprise applications. Develop and implement strategies for model deployment, inference, and monitoring, with an ...

This AI/ML Engineer role sits at the center of that transformation. You will do two things in ... Build and maintain data pipelines, model integration layers, and inference infrastructure for real ...

next page

Showing results 1-20

Ml Inference information

See Milwaukee, WI salary details

$36.9K

$120.9K

$193.6K

How much do ml inference jobs pay per year?

As of Aug 31, 2026, the average yearly pay for ml inference in Milwaukee, WI is $120,927.00, according to ZipRecruiter salary data. Most workers in this role earn between $97,000.00 and $134,000.00 per year, depending on experience, location, and employer.

What is ML inference?

ML inference refers to the process of using a trained machine learning model to make predictions or decisions based on new data. After a model has been trained on historical data, inference is the phase where that model is deployed and used in real-world applications, such as recognizing speech, detecting objects in images, or recommending products. The focus in ML inference is on speed, efficiency, and scalability to ensure quick predictions, often in real time. This process is critical for practical applications like mobile apps, web services, and embedded systems. Optimizing inference involves reducing latency, memory usage, and computational requirements.

What are the key skills and qualifications needed to thrive in ML inference?

To thrive in ML Inference, you need a solid background in machine learning principles, programming (Python or C++), and experience with deploying models at scale, often supported by a degree in computer science or a related field. Familiarity with frameworks and tools such as TensorFlow, PyTorch, ONNX, and cloud platforms like AWS SageMaker or Google AI Platform is typically required. Strong problem-solving skills, attention to detail, and effective communication are crucial soft skills for collaborating with multidisciplinary teams and optimizing model performance. These skills ensure efficient, scalable, and reliable deployment of machine learning solutions in real-world applications.

What are some common challenges faced by ML inference engineers when deploying models to production?

ML Inference Engineers often encounter challenges such as optimizing model latency and throughput to meet production requirements, ensuring compatibility with diverse hardware environments, and managing model versioning and updates without disrupting service. Additionally, balancing resource utilization and inference accuracy while monitoring real-time performance metrics is crucial. Collaboration with data scientists, DevOps, and software engineers is typically essential to streamline deployment and maintain robust, scalable inference pipelines.

What is the difference between Ml Inference vs Data Scientist?

AspectML InferenceData Scientist
Required CredentialsKnowledge of machine learning models, programming skillsDegree in data science, statistics, or related fields
Work EnvironmentDeploying models in production, real-time data processingData analysis, model development, research
Industry UsageAI product deployment, software companiesResearch institutions, tech firms, consulting

ML Inference focuses on deploying trained models to make predictions on new data, often in real-time. Data Scientists develop and analyze models, working primarily in research and development. While both roles require understanding of machine learning, ML Inference emphasizes deployment and operationalization, whereas Data Scientists focus on model creation and analysis.

What are popular job titles related to Ml Inference jobs in Milwaukee, WI?

For Ml Inference jobs in Milwaukee, WI, the most frequently searched job titles are:

What job categories do people searching Ml Inference jobs in Milwaukee, WI look for?

The top searched job categories for Ml Inference jobs in Milwaukee, WI are:

Data Software Engineer III - ML Ops

Milwaukee, WI


Northwestern Mutual Life Insurance Company
Finance and Insurance • 5 - 10K employees

8.0

Company rating: 8.0 out of 10

Based on 76 frontline employees who took The Breakroom Quiz

171st of 315 rated insurance

People enjoy working here

Good employer

Recommended by students


$112K - $135K/yr

Full-time

Posted 3 days ago

New


Job description

Northwestern Mutual (NM) has been helping people and businesses achieve financial security for over 169 years. Through a distinctive, whole-picture planning approach including both insurance and investments, we empower people to be financially confident. We combine the expertise of our financial professionals with a personalized digital experience and groundbreaking technology to best serve our clients.

About the Job

Data is a critical driver of this approach and a cornerstone for how we engage with our customers. To help lead the effort, NM's Assistant Director, Data Software Engineering - AI/ML Ops is seeking a highly motivated, curious, and passionate software engineers to build and design services, data pipelines, automation, and dashboards for our ML Ops platform and to implement and standardize practices for traditional and generative artificial intelligence.

You will be joining our Data Solutions and Enablement department (DSE) whose mission is to unlock and provide analytical insight on our core customer and client data to better serve our customers, field representative, and business partners. As a part of the team you will collaborate with Data Scientists, Software Engineers, Data Engineers, and Product Owners throughout the organization to help unlock the value of data through predictive analytics, operationalized machine learning, applied AI and generative AI.

What You'll do

ML Ops Team responsibilities include but are not limited to:

  • Building and standardizing services and patterns in Python and Java to enable model deployment, training, inference, and monitoring.

  • Building services and automation to streamline and manage the stages of the AI/ML life cycle and model governance

  • Develop reliable data pipelines that transform and aggregate data from NM's source systems and data platforms

  • Establish and maintain NM's data science, ML and AI platforms, with a focus on rapid iteration and operational deployment of predictive models, and cost management of workloads

  • Integrating various ML Ops platforms together such as Databricks, AWS Sagemaker, AWS Bedrock.

  • Establish a feature store of curated metrics, attributes, and features for ML models

  • Collaborate closely with data scientists, DevOps Engineers, and enterprise infrastructure teams to enable automation and monitoring across the machine learning lifecycle

  • Develop ML model monitoring pipelines for model performance, data quality, and gen AI evaluation, tracing, and metrics.

AI/ML Ops Baseline Competencies:

  • We work in Python and Java, leveraging Spring, Flask, FastMCP, FastMCP, Pandas, Spark, LangGraph and ML Flow

  • We leverage AWS and Databricks often and deploy software and AI/ML solutions CI/CD first. We aspire to automate and standardize everything.

  • We expect proficiency with databases and SQL from RDBMS (Postgres, SQL Server, MySql etc.) or big data platforms (Databricks, Spark, Redshift, Snowflake, Big Query etc).

  • We expect familiarity and experience with basic ML algorithms, LLMs, and GenAI/Agentic concepts.

  • We expect an understanding of basic tools and libraries common to data science, AI and ML. e.g. ML Flow, Pandas/Numpy/Sklearn, PyTorch/TensorFlow, or LlamaIndex/LangChain/LangGraph OR a strong mathematical and computer science background.

  • We are passionate about continuous learning and problem solving. Curiosity is expected, welcome, and rewarded.

  • We collaborate and work creatively every day.

The Data Software Engineer III leads the design and implementation of complex data systems, leveraging advanced data engineering techniques and emerging leadership skills.

Primary Duties & Responsibilities

  • Architect and develop scalable data pipelines using advanced programming skills

  • Gather and translate data requirements into technical solutions

  • Optimize sophisticated data integration and transformation processes

  • Enhance existing systems for performance and scalability

  • Mentor junior engineers and oversee CI/CD pipelines

What You'll Bring to the Role

  • Bachelor's degree in Computer Science, Engineering, or equivalent experience

  • Strong expertise in programming languages for data engineering

  • Experience with data processing frameworks and Kubernetes

  • Proficiency with cloud platforms (e.g., AWS, Azure, Google Cloud) and data visualization tools

  • Understanding of machine learning concepts

  • Expertise in CI/CD processes and version control

  • Expertise in source code management using Git and GitFlow

  • Strong understanding of CI/CD processes and tools (e.g., Jenkins, GitLab CI/CD, CircleCI) and experience with artifact repositories (e.g., Nexus, Artifactory)

  • Strong understanding of agile methodologies and experience in an agile development environment

Skills You Have

Adaptive Communication (NM) - Formulates strategies to be used to convey complex information about services, products, systems, or processes to targeted audiences; communicates and liaises between technical and non-technical audiences.

Analytical Thinking (NM) - Organizes and compares various aspects of a situation to comprehend and identify key or underlying complex issues through the use of quantitative data and analysis; leverages strong business acumen, problem solving, and interpersonal skills to think critically about situations from multiple perspectives and consistently seeks ways to improve processes.

Consulting (NM) - Connects with stakeholders to understand and gain specific information to help resolve customer problems in a given domain. Communicates effectively intent to customers, solicits customer requirements, utilizes domain knowledge and collaborates with the right stakeholders.

Databases & Data Platforms (NM) - Utilizes knowledge of databases to access, manage, and update information, typically containing aggregations of data records or files; includes understanding of different types of databases.

Engineering Expertise & Practices (NM) - Applies specialized experiences in different facets of engineering, including data, applications, cyber, systems, operations, product, security, and testing, along with technical aptitude to adapt new expertise as they become relevant through an understanding of underlying engineering principles.

Machine Learning (NM) - Applies understanding of and/or computes large data structures and sets using quantitative analysis methods, while building out data pipelines and statistics.

Programming Languages (NM) - Demonstrates proficiency in one or more programming languages to execute activities, tasks, practices, and deliverables associated with writing and modifying programs and scripts that comprise an application system; designs, codes, tests, and installs complex computer programs and maintains detailed documentation of programming tasks.

#LI-Hybrid

Compensation Range:

Pay Range - Start:

$108,160.00

Pay Range - End:

$162,240.00

Geographic Specific Pay Structure:

Structure 110:

$118,960.00 USD - $178,440.00 USD

Structure 115:

$124,400.00 USD - $186,600.00 USD

We believe in fairness and transparency. It's why we share the salary range for most of our roles. However, final salaries are based on a number of factors, including the skills and experience of the candidate; the current market; location of the candidate; and other factors uncovered in the hiring process. The standard pay structure is listed but if you're living in California, New York City or other eligible location, geographic specific pay structures, compensation and benefits could be applicable, click here to learn more.


Grow your career with a best-in-class company that puts our clients' interests at the center of all we do. Get started now!


Northwestern Mutual is an equal opportunity employer that welcomes talented individuals of all backgrounds. We are committed to creating and maintaining an environment in which each employee can contribute creative ideas, seek challenges, assume leadership and continue to focus on meeting and exceeding business and personal objectives.



Northwestern Mutual logo

About Northwestern Mutual

Sourced by ZipRecruiter

Northwestern Mutual has been helping families and businesses achieve financial security for over 160 years through a distinctive planning approach that integrates risk management with wealth accumulation, preservation, and distribution. With more than $290 billion in assets, $30 billion in revenues and more than $1.9 trillion worth of life insurance protection in force, Northwestern Mutual delivers financial security to more than 4.6 million clients. People are the power behind Northwestern Mutual, and diversity makes us better. We are committed to reflecting and serving the marketplace. We do so by attracting and improving the engagement of those who bring their outstanding perspectives, ideas, and beliefs.

Industry

Finance and insurance

Company size

5,001 - 10,000 Employees

Headquarters location

Milwaukee, WI, US


What Northwestern Mutual employees say

Pay

Benefits

Hours and flexibility

Workplace

Get the full story on Breakroom