1

Ml Inference Jobs in Ohio (NOW HIRING)

... for inference optimization; RAG architecture design and implementation. * Advanced cloud infrastructure (AWS EKS/ECS, GCP GKE, Azure AKS) knowledge. * Containerization strategies for ML workloads;

... for inference optimization; RAG architecture design and implementation. * Advanced cloud infrastructure (AWS EKS/ECS, GCP GKE, Azure AKS) knowledge. * Containerization strategies for ML workloads;

AI Architect

Cincinnati, OH

$60.50 - $79.50/hr

Proven experience architecting and delivering production AI or ML solutions on Azure* Experience ... Lead solution designs for AI platforms including vector databases, embedding pipelines, inference ...

Proven experience architecting and delivering production AI or ML solutions on Azure * Experience ... Lead solution designs for AI platforms including vector databases, embedding pipelines, inference ...

Proven experience architecting and delivering production AI or ML solutions on Azure * Experience ... Lead solution designs for AI platforms including vector databases, embedding pipelines, inference ...

Showing results 21-40

Ml Inference information

What is ML inference?

ML inference refers to the process of using a trained machine learning model to make predictions or decisions based on new data. After a model has been trained on historical data, inference is the phase where that model is deployed and used in real-world applications, such as recognizing speech, detecting objects in images, or recommending products. The focus in ML inference is on speed, efficiency, and scalability to ensure quick predictions, often in real time. This process is critical for practical applications like mobile apps, web services, and embedded systems. Optimizing inference involves reducing latency, memory usage, and computational requirements.

What is the difference between Ml Inference vs Data Scientist?

AspectML InferenceData Scientist
Required CredentialsKnowledge of machine learning models, programming skillsDegree in data science, statistics, or related fields
Work EnvironmentDeploying models in production, real-time data processingData analysis, model development, research
Industry UsageAI product deployment, software companiesResearch institutions, tech firms, consulting

ML Inference focuses on deploying trained models to make predictions on new data, often in real-time. Data Scientists develop and analyze models, working primarily in research and development. While both roles require understanding of machine learning, ML Inference emphasizes deployment and operationalization, whereas Data Scientists focus on model creation and analysis.

What are some common challenges faced by ML inference engineers when deploying models to production?

ML Inference Engineers often encounter challenges such as optimizing model latency and throughput to meet production requirements, ensuring compatibility with diverse hardware environments, and managing model versioning and updates without disrupting service. Additionally, balancing resource utilization and inference accuracy while monitoring real-time performance metrics is crucial. Collaboration with data scientists, DevOps, and software engineers is typically essential to streamline deployment and maintain robust, scalable inference pipelines.

What are the key skills and qualifications needed to thrive in ML inference?

To thrive in ML Inference, you need a solid background in machine learning principles, programming (Python or C++), and experience with deploying models at scale, often supported by a degree in computer science or a related field. Familiarity with frameworks and tools such as TensorFlow, PyTorch, ONNX, and cloud platforms like AWS SageMaker or Google AI Platform is typically required. Strong problem-solving skills, attention to detail, and effective communication are crucial soft skills for collaborating with multidisciplinary teams and optimizing model performance. These skills ensure efficient, scalable, and reliable deployment of machine learning solutions in real-world applications.

Is ML inference a high paying job?

ML inference roles are generally well-paying, especially for those with skills in machine learning frameworks, programming, and cloud platforms. Salaries vary based on experience, location, and industry, but they tend to be higher than average for tech-related positions.

What cities in Ohio are hiring for Ml Inference jobs?

Cities in Ohio with the most Ml Inference job openings:

Sr. Data Scientist, Programmatic Algorithms

impact.com

Columbus, OH • On-site

Full-time

Re-posted 20 days ago


Job description

Job Summary:
Impact.com is the world’s leading commerce partnership marketing platform, transforming the way businesses grow by enabling them to discover, manage, and scale partnerships across the entire customer journey. They are seeking a Senior Data Scientist to design and deploy machine learning models that optimize yield, pricing, and inventory allocation at scale, working closely with various teams while operating with significant autonomy.
Responsibilities:
• Design and deploy ML models that optimize auction pricing, bid shading, floor price setting, and yield across Impact's programmatic inventory.
• Build and iterate on real-time pricing algorithms that balance short-term revenue efficiency with long-term publisher and advertiser health.
• Develop and maintain feedback loops that allow pricing models to adapt to shifting market conditions, inventory mix, and demand patterns.
• Quantify the revenue impact of pricing model improvements; communicate tradeoffs between yield maximization, fill rate, and partner ROI to stakeholders.
• Own ML-driven inventory allocation logic: routing, pacing, and matching supply to demand across partner segments, deal types, and campaign objectives.
• Build models that forecast inventory availability, demand curves, and clearing prices to support proactive allocation decisions.
• Identify and address inefficiencies in inventory utilization — including unsold inventory, suboptimal deal matching, and allocation imbalances across the publisher base.
• Design and own the data infrastructure that feeds programmatic models: event pipelines, feature stores, training datasets, and real-time feature serving.
• Engineer high-signal features from auction logs, bid stream data, user signals, contextual attributes, and historical performance — at the scale of programmatic data volumes.
• Build robust data pipelines with production-grade standards: reliability, observability, versioning, and efficient reprocessing.
• Deploy models to production real-time inference environments; own latency, reliability, and throughput requirements for auction-time decision-making.
• Build monitoring systems that track model performance, data drift, and system health in production; define alerting thresholds and retraining triggers.
• Partner with MLOps and Platform Engineering to ensure scalable, low-latency serving infrastructure meets SLOs under high-volume auction traffic.
• Own the full model lifecycle: training, evaluation, deployment, A/B testing, and iteration.
• Design and execute rigorous A/B and holdout experiments to measure the causal impact of model changes on yield, fill rate, advertiser performance, and publisher revenue.
• Build evaluation frameworks that go beyond offline metrics — validating model behavior in live auction environments where feedback signals are delayed or noisy.
• Translate experimental results into clear business narratives; present findings and recommendations to Product and business stakeholders.
• Research and implement adaptive, self-learning components within the programmatic stack — including contextual bandits, reinforcement learning signals, and online learning approaches where appropriate.
• Design feedback mechanisms that close the loop between auction outcomes, model updates, and system behavior; reduce reliance on manual tuning and rule-based overrides.
• Stay current with advances in programmatic ML, auction theory, and online optimization; evaluate applicability to Impact's specific marketplace dynamics.
• Serve as the primary ML technical partner for the Rubicon product and engineering teams; translate business requirements into modeling approaches and communicate technical tradeoffs clearly.
• Collaborate with Data Science peers on shared infrastructure, modeling standards, and cross-domain feature reuse.
• Document models, architectures, and experimental findings to a standard that enables review, replication, and knowledge transfer across teams.
Qualifications:
Required:
• Experience: 5+ years in data science, ML engineering, or quantitative research, with at least 2+ years building and deploying ML models in programmatic advertising, ad tech, marketplace optimization, or a closely related domain (e.g., real-time bidding, dynamic pricing, auction systems).
• Programmatic & marketplace depth: Demonstrated understanding of programmatic auction mechanics (RTB, header bidding, floor pricing, deal types, bid shading) and how ML can be applied to optimize outcomes across the supply-demand stack.
• Production ML engineering: Proven ability to take models from prototype to production independently — including real-time inference, monitoring, retraining pipelines, and SLO ownership.
• Data architecture: Experience designing and building data pipelines, feature stores, and training infrastructure for high-volume, low-latency ML systems.
• Technical skills: Strong Python and SQL; proficiency with ML libraries (scikit-learn, XGBoost, LightGBM, PyTorch/TensorFlow) and large-scale data tools (Spark, Kafka, or equivalent streaming/batch frameworks).
• Experience with real-time feature serving and low-latency model deployment (REST APIs, gRPC, or streaming inference).
• Familiarity with production ML workflows: model versioning, drift monitoring, A/B testing, evaluation, and retraining.
• Experience processing and modeling at programmatic data scale: high-cardinality auction logs, bid stream data, impression and click events.
• Experimentation rigor: Strong grasp of causal inference and experiment design in online, delayed-feedback environments (auction holdouts, switchback tests, variance reduction techniques).
• Communication: Ability to explain complex modeling decisions and tradeoffs to Product and business stakeholders; comfortable presenting in cross-functional forums.
• Education: Bachelor's in a quantitative field (CS, Statistics, Math, Engineering, Economics, or similar); Master's/PhD preferred.
Preferred:
• Direct experience with SSP, DSP, or exchange-side yield optimization — particularly floor price optimization, bid landscape modeling, or deal matching algorithms.
• Familiarity with auction theory (first-price vs. second-price dynamics, optimal reserve pricing, revenue equivalence) and its practical implications for programmatic ML.
• Experience with contextual bandits, multi-armed bandits, or reinforcement learning applied to real-time decisioning problems.
• Knowledge of online learning and adaptive algorithms in production environments with non-stationary data distributions.
• Familiarity with privacy-preserving ML techniques relevant to programmatic (differential privacy, federated learning, cookieless attribution modeling).
• Experience with GCP tools (BigQuery, Vertex AI, Dataflow, Pub/Sub) and/or Databricks/Spark for large-scale event processing and model training.
• Exposure to supply forecasting, inventory management, or capacity planning in programmatic or marketplace contexts.
• Familiarity with Impact's affiliate and partnership ecosystem, or prior experience at the intersection of performance marketing and programmatic delivery.
Company:
impact.com, the world’s leading partnership management platform, is transforming the way businesses manage and optimize all types of partnerships—including traditional rewards affiliates, influencers, commerce content publishers, B2B, and more. Founded in 2008, the company is headquartered in Fort Thomas, USA, with a team of 1001-5000 employees. The company is currently Late Stage.