1

Ml Infrastructure Engineer Jobs Near Me

Job Title: ML Engineer (AI/LLM & Cloud) Location: Jersey City, NJ (Hybrid - 3 Days Onsite) OR ... Build production-ready machine learning systems and infrastructure. * Productionize machine ...

Azure/Databricks Infrastructure Engineer

Columbus, OH · On-site

$53.75 - $72/hr

Experience supporting enterprise analytics, ETL, Snowflake, or modern data engineering ecosystems Experience supporting AI/ML or advanced analytics infrastructure environments Azure and/or Databricks ...

Senior ML Ops Engineer

Columbus, OH · On-site

$100K - $138K/yr

Senior ML Ops Engineer Overview As a Senior ML Ops Engineer at Mimecast, you will be a technical ... This role sits at the intersection of infrastructure engineering and machine learning. You will own ...

Senior ML Ops Engineer

Columbus, OH

$100K - $138K/yr

Senior ML Ops Engineer Overview As a Senior ML Ops Engineer at Mimecast, you will be a technical ... This role sits at the intersection of infrastructure engineering and machine learning. You will own ...

Senior ML Ops Engineer

Columbus, OH · On-site

$148 - $222/hr

Senior ML Ops Engineer**## **Overview**As a Senior ML Ops Engineer at Mimecast, you will be a ... This role sits at the intersection of infrastructure engineering and machine learning. You will own ...

ML Engineering role focused on building AI solutions and integrating them into the existing ... Experience with cloud infrastructure (must-have). * Ability to deploy applications in both Public ...

Senior Software Engineer

Columbus, OH · On-site

$118K - $156K/yr

You'll work closely with our research teams and our data platform team - leveraging their data and ML infrastructure expertise - while focusing on creating a robust, scalable, and developer-friendly ...

Senior Software Engineer

Columbus, OH

$118K - $156K/yr

You'll work closely with our research teams and our data platform team - leveraging their data and ML infrastructure expertise - while focusing on creating a robust, scalable, and developer-friendly ...

Reliability Engineer

Columbus, OH · Hybrid

$99K - $124K/yr

Reliability Engineer - IE08GE We're determined to make a difference and are proud to be an ... infrastructure automation and tooling development. * Experience in AI/ML frameworks for ...

Reliability Engineer

Columbus, OH · Hybrid

$99K - $124K/yr

Reliability Engineer - IE08GE We're determined to make a difference and are proud to be an ... infrastructure automation and tooling development. * Experience in AI/ML frameworks for ...

next page

Showing results 1-20

Ml Infrastructure Engineer information

See salary details

$46.5K

$127.1K

$182K

How much do ml infrastructure engineer jobs pay per year?

As of Aug 12, 2026, the average yearly pay for ml infrastructure engineer in the United States is $127,066.00, according to ZipRecruiter salary data. Most workers in this role earn between $107,500.00 and $141,000.00 per year, depending on experience, location, and employer.
What job categories do people searching Ml Infrastructure Engineer jobs look for? The top searched job categories for Ml Infrastructure Engineer jobs are:
What cities are hiring for Ml Infrastructure Engineer jobs? Cities with the most Ml Infrastructure Engineer job openings:
What states have the most Ml Infrastructure Engineer jobs? States with the most job openings for Ml Infrastructure Engineer jobs include:
A map of the United States highlighting the number of Ml Infrastructure Engineer job openings by state according to ZipRecruiter. The image is accompanied by a detailed chart listing the number of Ml Infrastructure Engineer job openings in each state, with California having the most at 2 and Alaska the least at 0.

Other

Posted 20 days ago


Job description

Job Title: ML Engineer (AI/LLM & Cloud)

Location: Jersey City, NJ (Hybrid – 3 Days Onsite) OR Columbus, OH (5 Days Onsite)
Duration: Contract-to-Hire


Job Summary

We are seeking a highly experienced ML Engineer to design, build, deploy, and integrate enterprise-scale AI/ML solutions within the JPMorgan Chase ecosystem. This role focuses on engineering production-ready machine learning applications, Large Language Model (LLM) solutions, and cloud-native ML platforms while partnering closely with Data Science teams and business stakeholders.

The ideal candidate is a hands-on engineer with strong Python expertise, cloud experience, and MLOps knowledge who can lead technical initiatives and deliver scalable AI solutions.


Key Responsibilities
  • Design, develop, deploy, and maintain scalable AI/ML applications.
  • Build production-ready machine learning systems and infrastructure.
  • Productionize machine learning models developed by Data Science teams.
  • Design and deploy Large Language Model (LLM) applications.
  • Integrate AI solutions into AWS and JPMorgan Chase internal cloud platforms.
  • Develop scalable model serving and inference pipelines.
  • Implement CI/CD pipelines for ML applications.
  • Build monitoring, observability, model drift detection, and automated retraining solutions.
  • Optimize AI applications for performance, scalability, reliability, and cost.
  • Collaborate with Product Managers, Data Scientists, Software Engineers, and Business SMEs.
  • Mentor junior engineers and provide technical leadership through architecture guidance and code reviews.
  • Research and implement modern AI/ML technologies and best practices.

Required Qualifications
  • Bachelor''s or Master''s degree in Computer Science, Engineering, Data Science, or a related field.
  • 10+ years of hands-on experience developing and deploying machine learning solutions in production.
  • Expert-level programming experience with Python.
  • Basic understanding of Java or Scala.
  • Strong experience with software engineering principles, data structures, algorithms, and distributed systems.
  • Extensive experience with AWS Cloud.
  • Experience deploying applications across public cloud and enterprise cloud platforms.
  • Hands-on experience with Docker and Kubernetes.
  • Strong experience with MLOps tools including MLflow, Kubeflow, SageMaker, or Vertex AI.
  • Experience implementing CI/CD pipelines for machine learning applications.
  • Experience designing scalable ML infrastructure and distributed data processing systems.
  • Proven ability to lead technical initiatives and mentor engineering teams.

Preferred Qualifications
  • Experience building and deploying Large Language Model (LLM) solutions.
  • Hands-on experience with Amazon Bedrock.
  • Experience with Generative AI applications.
  • Strong understanding of TensorFlow, PyTorch, or Scikit-learn.
  • Experience with Deep Learning, NLP, or Computer Vision.
  • Experience with distributed model training and high-throughput inference systems.
  • Knowledge of model optimization and AI performance tuning.