1

Ml Inference Jobs in Durham, NC (NOW HIRING)

Explore and evaluate new AI/ML techniques, tools, and methodologies, applying relevant innovations ... and inference efficiency to minimize cost and latency while preserving accuracy. * MLOps ...

Explore and evaluate new AI/ML techniques, tools, and methodologies, applying relevant innovations ... and inference efficiency to minimize cost and latency while preserving accuracy. * MLOps ...

Senior AI Systems Engineer

Raleigh, NC · On-site +1

$92K - $126K/yr

Experience with AI/ML frameworks and tooling such as PyTorch, Hugging Face, or similar ecosystems ... Experience with model serving, inference optimization, or AI platform tools such as MLflow ...

Senior AI Performance Architect

Raleigh, NC · On-site

$162K/yr

AI inference and training systems must scale to a large number of accelerators, servers and racks ... Understand trends in ML network design through customer engagements and latest academic research ...

Vice President, Data Science

Raleigh, NC · On-site

$177K - $350K/yr

Strong understanding of production ML system design, including batch vs real-time inference, model serving patterns, performance trade-offs, and failure modes. * Experience operating models in ...

Data Scientist

Cary, NC · On-site

$65 - $70/hr

Proven experience designing, deploying, and operating production ML and/or GenAI solutions, including APIs, batch, and real-time inference. * Experience in developing Machine Learning models using ...

Vice President, Data Science

Raleigh, NC · On-site

$177K - $350K/yr

Strong understanding of production ML system design, including batch vs real-time inference, model serving patterns, performance trade-offs, and failure modes. * Experience operating models in ...

Senior AI Systems Engineer

Raleigh, NC · On-site

$92K - $126K/yr

Experience with AI/ML frameworks and tooling such as PyTorch, Hugging Face, or similar ecosystems ... Experience with model serving, inference optimization, or AI platform tools such as MLflow ...

... inference infrastructure and pipelines. * Implement MLOps pipelines for continuous integration, deployment, and lifecycle management using Azure ML and GitHub Actions. * Ensure compliant change ...

New

Showing results 21-40

Ml Inference information

See Durham, NC salary details

$36.2K

$118.6K

$189.9K

How much do ml inference jobs pay per year?

As of Aug 7, 2026, the average yearly pay for ml inference in Durham, NC is $118,603.00, according to ZipRecruiter salary data. Most workers in this role earn between $95,200.00 and $131,400.00 per year, depending on experience, location, and employer.

What is ML inference?

ML inference refers to the process of using a trained machine learning model to make predictions or decisions based on new data. After a model has been trained on historical data, inference is the phase where that model is deployed and used in real-world applications, such as recognizing speech, detecting objects in images, or recommending products. The focus in ML inference is on speed, efficiency, and scalability to ensure quick predictions, often in real time. This process is critical for practical applications like mobile apps, web services, and embedded systems. Optimizing inference involves reducing latency, memory usage, and computational requirements.

What is the difference between Ml Inference vs Data Scientist?

AspectML InferenceData Scientist
Required CredentialsKnowledge of machine learning models, programming skillsDegree in data science, statistics, or related fields
Work EnvironmentDeploying models in production, real-time data processingData analysis, model development, research
Industry UsageAI product deployment, software companiesResearch institutions, tech firms, consulting

ML Inference focuses on deploying trained models to make predictions on new data, often in real-time. Data Scientists develop and analyze models, working primarily in research and development. While both roles require understanding of machine learning, ML Inference emphasizes deployment and operationalization, whereas Data Scientists focus on model creation and analysis.

What are some common challenges faced by ML inference engineers when deploying models to production?

ML Inference Engineers often encounter challenges such as optimizing model latency and throughput to meet production requirements, ensuring compatibility with diverse hardware environments, and managing model versioning and updates without disrupting service. Additionally, balancing resource utilization and inference accuracy while monitoring real-time performance metrics is crucial. Collaboration with data scientists, DevOps, and software engineers is typically essential to streamline deployment and maintain robust, scalable inference pipelines.

What are the key skills and qualifications needed to thrive in ML inference?

To thrive in ML Inference, you need a solid background in machine learning principles, programming (Python or C++), and experience with deploying models at scale, often supported by a degree in computer science or a related field. Familiarity with frameworks and tools such as TensorFlow, PyTorch, ONNX, and cloud platforms like AWS SageMaker or Google AI Platform is typically required. Strong problem-solving skills, attention to detail, and effective communication are crucial soft skills for collaborating with multidisciplinary teams and optimizing model performance. These skills ensure efficient, scalable, and reliable deployment of machine learning solutions in real-world applications.

Is ML inference a high paying job?

ML inference roles are generally well-paying, especially for those with skills in machine learning frameworks, programming, and cloud platforms. Salaries vary based on experience, location, and industry, but they tend to be higher than average for tech-related positions.
What are popular job titles related to Ml Inference jobs in Durham, NC? For Ml Inference jobs in Durham, NC, the most frequently searched job titles are:
What job categories do people searching Ml Inference jobs in Durham, NC look for? The top searched job categories for Ml Inference jobs in Durham, NC are:
What cities near Durham, NC are hiring for Ml Inference jobs? Cities near Durham, NC with the most Ml Inference job openings:

Applied AI Scientist

Cisco

Durham, NC • On-site

Full-time

Medical, Dental, Vision, Life, Retirement, PTO

Posted 29 days ago


Cisco Systems rating

8.0

Company rating: 8.0 out of 10

Based on 42 frontline employees who took The Breakroom Quiz

57th of 156 rated electronics manufacturers


Job description

The application window is expected to close on:

Job posting may be removed earlier if the position is filled or if a sufficient number of applications are received.

Meet the Team

Splunk, a Cisco company, is building a safer, more resilient digital world with an endtoend, fullstack platform designed for hybrid, multicloud environments. Join the Foundational Modeling team at Splunk, where we advance the state of AI for highvolume, realtime, multimodal machinegenerated data - including logs, time series, traces, and events. We combine deep AI research expertise with the scale and operational excellence of Splunk and Cisco's global engineering capabilities. Our work spans networking, security, observability, and customer experience - designing and deploying foundation models that enhance reliability, strengthen security, prevent downtime, and deliver predictive insights across Splunk Observability, Security, and Platform at enterprise scale. You'll be part of a culture that values technical excellence, impactdriven innovation, and crossfunctional collaboration - all within a flexible, growthoriented environment.

Your Impact

  • Contribute to the research, design, and development of large-scale foundation models for machine-generated data, with a primary focus on graph data and additional support for logs, time series, traces, and event modalities.
  • Develop and enhance distributed training and inference workflows, leveraging data-driven approaches to improve model quality, scalability, and operational efficiency.
  • Collaborate with engineering, product, and data science teams to understand requirements, incorporate stakeholder feedback, and deliver AI/ML solutions that address business and technical needs.
  • Share emerging ideas, technical insights, and best practices with teammates, contributing to technical discussions and helping advance team capabilities and project outcomes.
  • Explore and evaluate new AI/ML techniques, tools, and methodologies, applying relevant innovations to improve workflows, solve technical challenges, and support the team's roadmap and objectives.
  • Take ownership of assigned projects and deliver high-quality results with urgency, while proactively identifying obstacles, driving resolution of technical issues, and continuously improving development processes.

Minimum Qualifications:

  • Master Degree in Computer Science, or related quantitative field, plus 2+ years of industry research experience.
  • Proven track record in at least one of the following areas: Large-scale graph representation learning and Graph Neural Networks (GNNs) (e.g., GCN/GAT/GraphSAGE, heterogeneous GNNs, graph transformers), large language modeling for structured and unstructured data, multi-modal fusion of graph, text, log, and time-series data.
  • Solid proficiency in Python and deep learning frameworks (e.g., PyTorch, TensorFlow)
  • Experience translating research ideas into production systems.

Preferred Qualifications:

  • Deep experience with graph representation learning, graph transformers (e.g., GCN/GAT/GraphSAGE), spatio-temporal GNNs, heterogeneous graphs (HGNN/Relational GNNs), and knowledge-graph-augmented modeling.
  • Expertise in constructing and operating on large-scale graphs (entity graphs, service dependency graphs, topology graphs, causal graphs, or log-event graphs).
  • Hands-on experience with frameworks such as PyTorch Geometric (PyG), DGL, GraphGym, GraphML systems, or custom GNN runtimes.
  • Advanced Anomaly Detection with Graph: Track record developing hybrid graph-temporal approaches (e.g., GNN + Transformer, graph contrastive learning, dynamic graph forecasting) for detecting anomalies in high-volume operational data.
  • Hands-on experience developing, fine-tuning, or adapting foundation models for domain-specific data such as logs, time-series, graphs, operational telemetry, or enterprise knowledge, including representation learning across structured and unstructured modalities.
  • LargeScale Training & Optimization - Experience optimizing model architectures, distributed training pipelines, and inference efficiency to minimize cost and latency while preserving accuracy.
  • MLOps & Continuous Learning - Fluency in automated retraining, drift detection, incremental updates, and production monitoring of ML models.
  • Strong Research Track Record - Publications in top AI/ML conferences or journals (e.g., NeurIPS, ICML, ICLR, AAAI, CVPR, ACL, KDD) demonstrating contributions to stateoftheart methods and realworld applications.

Why Cisco?

At Cisco, we're revolutionizing how data and infrastructure connect and protect organizations in the AI era - and beyond. We've been innovating fearlessly for 40 years to create solutions that power how humans and technology work together across the physical and digital worlds. These solutions provide customers with unparalleled security, visibility, and insights across the entire digital footprint. Simply put - we power the future.

Fueled by the depth and breadth of our technology, we experiment and create meaningful solutions. Add to that our worldwide network of doers and experts, and you'll see that the opportunities to grow and build are limitless. We work as a team, collaborating with empathy to make really big things happen on a global scale. Because our solutions are everywhere, our impact is everywhere.

We are Cisco, and our power starts with you.

Why Cisco?

At Cisco, we're revolutionizing how data and infrastructure connect and protect organizations in the AI era - and beyond. We've been innovating fearlessly for 40 years to create solutions that power how humans and technology work together across the physical and digital worlds. These solutions provide customers with unparalleled security, visibility, and insights across the entire digital footprint.

Fueled by the depth and breadth of our technology, we experiment and create meaningful solutions. Add to that our worldwide network of doers and experts, and you'll see that the opportunities to grow and build are limitless. We work as a team, collaborating with empathy to make really big things happen on a global scale. Because our solutions are everywhere, our impact is everywhere.

We are Cisco, and our power starts with you.

Message to applicants applying to work in the U.S. and/or Canada:The starting salary range posted for this position is $165,300.00 to $209,200.00 and reflects the projected salary range for new hires in this position in U.S. and/or Canada locations, not including incentive compensation*, equity, or benefits.

Individual pay is determined by the candidate's hiring location, market conditions, job-related skillset, experience, qualifications, education, certifications, and/or training. The full salary range for certain locations is listed below. For locations not listed below, the recruiter can share more details about compensation for the role in your location during the hiring process.

U.S. employees are offered benefits, subject to Cisco's plan eligibility rules, which include medical, dental and vision insurance, a 401(k) plan with a Cisco matching contribution, paid parental leave, short and long-term disability coverage, and basic life insurance. Please see the Cisco careers site to discover more benefits and perks. Employees may be eligible to receive grants of Cisco restricted stock units, which vest following continued employment with Cisco for defined periods of time.

U.S. employees are eligible for paid time away as described below, subject to Cisco's policies:

  • 10 paid holidays per full calendar year, plus 1 floating holiday for non-exempt employees

  • 1 paid day off for employee's birthday, paid year-end holiday shutdown, and 4 paid days off for personal wellness determined by Cisco

  • Non-exempt employees** receive 16 days of paid vacation time per full calendar year, accrued at rate of 4.92 hours per pay period for full-time employees

  • Exempt employees participate in Cisco's flexible vacation time off program, which has no defined limit on how much vacation time eligible employees may use (subject to availability and some business limitations)

  • 80 hours of sick time off provided on hire date and each January 1st thereafter, and up to 80 hours ofunused sick timecarried forwardfrom one calendar yearto the next

  • Additional paid time away may be requested to deal with critical or emergency issues for family members

  • Optional 10 paid days per full calendar year to volunteer

For non-sales roles, employees are also eligible to earn annual bonuses subject to Cisco's policies.

Employees on sales plans earn performance-based incentive pay on top of their base salary, which is split between quota and non-quota components, subject to the applicable Cisco plan. For quota-based incentive pay, Cisco typically pays as follows:

  • .75% of incentive target for each 1% of revenue attainment up to 50% of quota;

  • 1.5% of incentive target for each 1% of attainment between 50% and 75%;

  • 1% of incentive target for each 1% of attainment between 75% and 100%; and

  • Once performance exceeds 100% attainment, incentive rates are at or above 1% for each 1% of attainment with no cap on incentive compensation.

For non-quota-based sales performance elements such as strategic sales objectives, Cisco may pay 0% up to 125% of target. Cisco sales plans do not have a minimum threshold of performance for sales incentive compensation to be paid.

The applicable full salary ranges for this position, by specific state, are listed below:

New York City Metro Area:

$181,000.00 - $270,300.00

Non-Metro New York state & Washington state:

$165,300.00 - $240,600.00

* For quota-based sales roles on Cisco's sales plan, the ranges provided in this posting include base pay and sales target incentive compensation combined.

** Employees in Illinois, whether exempt or non-exempt, will participate in a unique time off program to meet local requirements.


What Cisco Systems employees say

Pay

Benefits

Hours and flexibility

Workplace

Get the full story on Breakroom


Cisco Systems logo

About Cisco Systems

Sourced by ZipRecruiter

Cisco Systems, a global tech titan based in San Jose, CA, US, operates in the information technology and services industry. Founded in 1984, the company was derived from a project between two computer scientists from Stanford University. They aimed to connect different networks of computer systems at the university, resulting in the first multi-protocol router, and subsequently, the birth of Cisco. As an industry-leading manufacturer of networking hardware and telecommunications equipment, Cisco's product and services range includes routers, switches, firewall devices, and telecommunication technology. The company's mission, "to shape the future of the Internet by creating unprecedented value and opportunity for our customers, employees, investors, and ecosystem partners," is a testament to its pursuit of technology-forward innovation and customer satisfaction.

Industry

Computer and computer peripheral equipment and software wholesalers

Company size

10,000+ Employees

Headquarters location

San Jose, CA, US

Year founded

1984

Social media