1

Ml Inference Jobs in Wisconsin (NOW HIRING)

Systems Architect - Edge AI/ML

Milwaukee, WI · On-site

$238K/yr

... model inference, performance optimization, and lifecycle management at the edge. • Ensure ... and ML at the edge by establishing repeatable patterns for model development, deployment ...

Lead ML Ops Engineer

Milwaukee, WI · On-site

$101K - $133K/yr

... training, inference, evaluation, monitoring, retraining, and governance, including generative AI ... Leadership-level expertise in AI/ML platform engineering, spanning MLOps, LLMOps, and AIOps.

Lead ML Ops Engineer

Milwaukee, WI

$101K - $133K/yr

Oversee enterprisescale AI platforms supporting model training, inference, evaluation, monitoring ... Leadershiplevel expertise in AI/ML platform engineering, spanning MLOps, LLMOps, and AIOps.

Lead ML Ops Engineer

Racine, WI

$96K - $126K/yr

Oversee enterprisescale AI platforms supporting model training, inference, evaluation, monitoring ... Leadershiplevel expertise in AI/ML platform engineering, spanning MLOps, LLMOps, and AIOps.

This AI/ML Engineer role sits at the center of that transformation. You will do two things in ... Build and maintain data pipelines, model integration layers, and inference infrastructure for real ...

This AI/ML Engineer role sits at the center of that transformation. You will do two things in ... Build and maintain data pipelines, model integration layers, and inference infrastructure for real ...

next page

Showing results 1-20

Ml Inference information

What is ML inference?

ML inference refers to the process of using a trained machine learning model to make predictions or decisions based on new data. After a model has been trained on historical data, inference is the phase where that model is deployed and used in real-world applications, such as recognizing speech, detecting objects in images, or recommending products. The focus in ML inference is on speed, efficiency, and scalability to ensure quick predictions, often in real time. This process is critical for practical applications like mobile apps, web services, and embedded systems. Optimizing inference involves reducing latency, memory usage, and computational requirements.

What is the difference between Ml Inference vs Data Scientist?

AspectML InferenceData Scientist
Required CredentialsKnowledge of machine learning models, programming skillsDegree in data science, statistics, or related fields
Work EnvironmentDeploying models in production, real-time data processingData analysis, model development, research
Industry UsageAI product deployment, software companiesResearch institutions, tech firms, consulting

ML Inference focuses on deploying trained models to make predictions on new data, often in real-time. Data Scientists develop and analyze models, working primarily in research and development. While both roles require understanding of machine learning, ML Inference emphasizes deployment and operationalization, whereas Data Scientists focus on model creation and analysis.

What are some common challenges faced by ML inference engineers when deploying models to production?

ML Inference Engineers often encounter challenges such as optimizing model latency and throughput to meet production requirements, ensuring compatibility with diverse hardware environments, and managing model versioning and updates without disrupting service. Additionally, balancing resource utilization and inference accuracy while monitoring real-time performance metrics is crucial. Collaboration with data scientists, DevOps, and software engineers is typically essential to streamline deployment and maintain robust, scalable inference pipelines.

What are the key skills and qualifications needed to thrive in ML inference?

To thrive in ML Inference, you need a solid background in machine learning principles, programming (Python or C++), and experience with deploying models at scale, often supported by a degree in computer science or a related field. Familiarity with frameworks and tools such as TensorFlow, PyTorch, ONNX, and cloud platforms like AWS SageMaker or Google AI Platform is typically required. Strong problem-solving skills, attention to detail, and effective communication are crucial soft skills for collaborating with multidisciplinary teams and optimizing model performance. These skills ensure efficient, scalable, and reliable deployment of machine learning solutions in real-world applications.

Is ML inference a high paying job?

ML inference roles are generally well-paying, especially for those with skills in machine learning frameworks, programming, and cloud platforms. Salaries vary based on experience, location, and industry, but they tend to be higher than average for tech-related positions.
What job categories do people searching Ml Inference jobs in Wisconsin look for? The top searched job categories for Ml Inference jobs in Wisconsin are:
What cities in Wisconsin are hiring for Ml Inference jobs? Cities in Wisconsin with the most Ml Inference job openings:

Systems Architect - Edge AI/ML

Rite-Hite

Milwaukee, WI • On-site

$238K/yr

Full-time

Re-posted 18 days ago


Rite-Hite rating

8.6

Company rating: 8.6 out of 10

Based on 22 frontline employees who took The Breakroom Quiz

72nd of 487 rated machine equipment manufacturers


Job description

Job Summary:
Rite-Hite is a global leader in loading dock and door equipment, dedicated to innovation and safety. They are seeking a Systems Architect, Edge AI/ML to define and guide the architecture for AI and machine learning solutions deployed on edge platforms, ensuring scalability, reliability, and security.
Responsibilities:
• Define and maintain reference architectures, design patterns, and standards for deploying AI and ML models on edge devices and platforms.
• Establish common approaches for data ingestion, feature pipelines, model inference, performance optimization, and lifecycle management at the edge.
• Ensure architectural decisions support real-time operation, scalability, reliability, safety, and security.
• Drive the strategic use of AI and ML at the edge by establishing repeatable patterns for model development, deployment, monitoring, and update.
• Own a portion of the internal technology radar related to AI/ML, edge analytics, and sensing technologies.
• Foster a culture of responsible, ethical, and transparent AI practices aligned with cybersecurity, privacy, and safety requirements.
• Partner with product management and engineering teams to enable AI-driven capabilities such as condition monitoring, vision-based sensing, anomaly detection, and predictive insights.
• Guide architectural decisions related to edge compute constraints, sensor integration, and real-time inference workloads.
• Promote reuse and consistency of AI/ML components across products and platforms.
• Define patterns for integration between edge AI/ML solutions, device software, hybrid mobile applications, and enterprise or cloud-based platforms.
• Ensure solutions support online, offline, and hybrid deployment models common in industrial environments.
• Promote interoperability with internal systems and approved third-party technologies.
• Define secure-by-design and safety-aligned principles for AI/ML model deployment and operation at the edge.
• Ensure alignment with applicable safety, quality, and industrial cybersecurity standards.
• Participate in architecture and design reviews to assess risk, resilience, and compliance.
• Collaborate across product management, device and edge software, data science, cloud platforms, manufacturing, service, and mobile application teams.
• Provide technical leadership, mentorship, and guidance to engineers and teams working with AI/ML technologies.
• Serve as a technical advisor in strategic customer conversations and enterprise implementations when appropriate.
Qualifications:
Required:
• Bachelor’s degree in Computer Science, Software Engineering, Electrical Engineering, Data Science, or a related technical field required
• 8+ years of experience delivering AI/ML-enabled solutions, with demonstrated experience deploying models in edge or resource-constrained environments
• Strong understanding of AI/ML architectures, model lifecycle management, and real-time inference at the edge
• Experience designing systems that balance performance, accuracy, latency, and resource constraints
• Ability to think systemically across sensors, devices, edge platforms, mobile applications, and cloud services
• Strong communication skills and ability to influence cross-functional stakeholders
• Visionary technical leader who can inspire cross-functional teams and align stakeholders to a shared product vision
• Exceptional communicator across technical and non-technical audiences
• Committed to data-driven decision-making and delivery excellence
Preferred:
• Master’s degree preferred
• Experience with industrial, connected, or safety-critical systems preferred
• Familiarity with industrial automation, IoT ecosystems, or computer vision is a plus
Company:
Rite-Hite is a manufracturer of loading dock equipment, industrial doors, safety barriers, HVLS fans, industrial curtain walls. Founded in 1965, the company is headquartered in Milwaukee, USA, with a team of 1001-5000 employees. The company is currently Late Stage.

What Rite-Hite employees say

Pay

Benefits

Hours and flexibility

Workplace

Get the full story on Breakroom


Rite-Hite logo

About Rite-Hite

Sourced by ZipRecruiter

Rite-Hite is the global leader in the manufacture and distribution of industrial loading dock and door equipment. Our innovative products and world class sales organization ensure solid, consistent growth, both for our company and our staff.

Industry

Machinery manufacturing

Company size

1,001 - 5,000 Employees

Headquarters location

Milwaukee, WI, US

Year founded

1965

Social media