ZipRecruiter

Log In

1

Ml Infrastructure Engineer Jobs in Madison, WI (NOW HIRING)

Paradigm

Senior ML Ops Engineer

Middleton, WI · On-site

$123K - $170K/yr

... infrastructure, and AI-powered innovation. What You Will Do: · Design, build, and maintain ... Engineers, and Infrastructure teams to operationalize ML solutions and improve deployment ...

Urus

Senior AI/ML Engineer

Watertown, WI · On-site

$99K - $136K/yr

We are seeking a Senior AI/ML Engineer to lead the building of scalable real-time production-grade ... Cloud AI infrastructure fluency, specifically Databricks and AWS. * Experiment design and ...

Farm Systems

Senior AI/ML Engineer

Watertown, WI · On-site

$99K - $136K/yr

We are seeking a Senior AI/ML Engineer to lead the building of scalable real-time production-grade ... Cloud AI infrastructure fluency, specifically Databricks and AWS. * Experiment design and ...

AgSource

Senior AI/ML Engineer

Watertown, WI

$99K - $136K/yr

We are seeking a Senior AI/ML Engineer to lead the building of scalable real-time production-grade ... Cloud AI infrastructure fluency, specifically Databricks and AWS. * Experiment design and ...

AgSource

Senior AI/ML Engineer

Watertown, WI · On-site +1

$99K - $136K/yr

We are seeking a Senior AI/ML Engineer to lead the building of scalable real-time production-grade ... Cloud AI infrastructure fluency, specifically Databricks and AWS. * Experiment design and ...

Urus Group LP

Senior AI/ML Engineer

Watertown, WI · On-site +1

$99K - $136K/yr

We are seeking a Senior AI/ML Engineer to lead the building of scalable real-time production-grade ... Cloud AI infrastructure fluency, specifically Databricks and AWS. * Experiment design and ...

Sema4.ai

Staff Engineer, AI

Madison, WI · On-site

You'll be building foundational infrastructure in a fast-moving environment where decisions matter ... What You Bring * 7+ years of software engineering experience, including 2+ years building AI/ML ...

ApartmentIQ

Staff Software Engineer

Madison, WI · Remote

It's a wide role by design - Python for the ML and ingestion services, Terraform for everything ... Build the infrastructure you depend on. Every database, queue, and role is in Terraform, and you'll ...

next page

Showing results 1-20

All JobsMl Infrastructure Engineer JobsMl Infrastructure Engineer Jobs in Madison, WI

Ml Infrastructure Engineer information

See Madison, WI salary details

$46.9K

$128.1K

$183.4K

How much do ml infrastructure engineer jobs pay per year?

As of Aug 23, 2026, the average yearly pay for ml infrastructure engineer in Madison, WI is $128,055.00, according to ZipRecruiter salary data. Most workers in this role earn between $108,300.00 and $142,100.00 per year, depending on experience, location, and employer.

What is the difference between Ml Infrastructure Engineer vs Data Engineer?

AspectML Infrastructure EngineerData Engineer
Required CredentialsBachelor's/Master's in CS, experience with cloud platforms, scripting, and ML toolsBachelor's/Master's in CS, experience with databases, ETL, and data pipelines
Work EnvironmentFocus on deploying and maintaining ML systems, cloud infrastructure, and automationDesigning and building data pipelines, managing large datasets, and data storage
Employer & Industry UsageTech companies, AI startups, research labsFinance, healthcare, e-commerce, and data-driven industries

The ML Infrastructure Engineer specializes in building and maintaining the infrastructure that supports machine learning models, focusing on deployment, scalability, and automation. In contrast, Data Engineers primarily develop data pipelines and manage large datasets to enable data analysis and business intelligence. Both roles require strong technical skills and often overlap, but their core focus areas differ significantly.

What are popular job titles related to Ml Infrastructure Engineer jobs in Madison, WI?

For Ml Infrastructure Engineer jobs in Madison, WI, the most frequently searched job titles are:

What job categories do people searching Ml Infrastructure Engineer jobs in Madison, WI look for?

The top searched job categories for Ml Infrastructure Engineer jobs in Madison, WI are:

What cities near Madison, WI are hiring for Ml Infrastructure Engineer jobs?

Cities near Madison, WI with the most Ml Infrastructure Engineer job openings:

Ml Infrastructure Engineer jobs near you
Infographic showing various Ml Infrastructure Engineer job openings in Madison, WI as of August 2026, with employment types broken down into 89% Full Time, 6% Part Time, and 5% Contract. Highlights an 87% Physical, 5% Hybrid, and 8% Remote job distribution, with an average salary of $128,055 per year, or $61.6 per hour.

Senior ML Ops Engineer

Paradigm

Middleton, WI • On-site

$123K - $170K/yr

Full-time

Re-posted 11 days ago

Job description

Paradigm is a software company transforming the way that the residential, construction & building product industries operate across the globe. We are looking for a Senior ML Ops Engineer to be part of revolutionizing these industries. We are building the future with modern software engineering, agent-assisted systems, and mobile-first experiences. We are powered by our parent company, Builders FirstSource (NYSE: BLDR): a Fortune 300 company with over $23 billion in revenue and more than 29,000 employees across 550+ locations, BFS is redefining construction through data, digital infrastructure, and AI-powered innovation.

What You Will Do:

· Design, build, and maintain scalable MLOps solutions that support the end-to-end machine learning lifecycle, including model training, deployment, monitoring, and retraining.

· Develop and optimize automated ML deployment pipelines, ensuring reliable, reproducible, and efficient model delivery to production environments.

· Deploy and support machine learning models and AI solutions in production, maintaining best practices for scalability, reliability, security, and operational excellence.

· Implement and maintain model registries, experiment tracking, versioning, and governance practices to support consistent model lifecycle management.

· Build and support containerized ML workloads and deployment workflows using technologies such as Docker and Kubernetes.

· Develop monitoring, observability, and alerting capabilities for machine learning systems, including model performance tracking, drift detection, and data quality monitoring.

· Collaborate with Machine Learning Engineers, Data Scientists, Software Engineers, and Infrastructure teams to operationalize ML solutions and improve deployment efficiency.

· Implement and maintain IaC patterns using Terraform.

· Troubleshoot and resolve complex technical challenges related to model deployment, ML infrastructure, and production operations.

· Provide guidance and mentorship to other engineers.

What You Need to Succeed:

· Bachelor’s degree in Computer Science, Data Science, Artificial Intelligence or related field or equivalent experience.

· 4+ years of professional experience in software engineering, machine learning engineering, MLOps, platform engineering, DevOps, or a related technical discipline.

· Strong understanding of the machine learning lifecycle, including model training, validation, deployment, monitoring, and retraining.

· Experience building and maintaining automated machine learning pipelines and CI/CD workflows.

· Experience with MLOps platforms and tools such as MLflow, Kubeflow, Azure Machine Learning, Databricks, or similar technologies.

· Experience in Python programming, ML Framework and Agentic AI. Implemented model monitoring, experiment tracking, model versioning, and governance practices.

· Experience working with cloud-based machine learning solutions, preferably within Azure.

· Ability to independently solve complex technical challenges, make sound decisions with minimal guidance, and drive work to completion.

Ready to Join? Apply now at myparadigm.com/careers/

Compensation Range: $123K - $170K