... engineering, or a related technical field * 3-7 years of experience building and maintaining scalable compute or machine learning infrastructure systems * Deep understanding of distributed systems ...
... engineering, or a related technical field * 3-7 years of experience building and maintaining scalable compute or machine learning infrastructure systems * Deep understanding of distributed systems ...
Machine Learning Infrastructure Engineer, GenAI Technology
New York, NY · On-site
$180K - $300K/yr
... engineering, or a related technical field * 3-7 years of experience building and maintaining scalable compute or machine learning infrastructure systems * Deep understanding of distributed systems ...
Machine Learning Infrastructure Engineer, GenAI Technology
New York, NY · On-site
$180K - $300K/yr
... engineering, or a related technical field * 3-7 years of experience building and maintaining scalable compute or machine learning infrastructure systems * Deep understanding of distributed systems ...
Senior Machine Learning Engineer
Manhattan, NY · On-site
$115K - $158K/yr
They are seeking a Senior Machine Learning Engineer to enhance their machine learning infrastructure and collaborate with cross-functional teams to deliver impactful ML solutions. Responsibilities ...
Senior Machine Learning Engineer
Manhattan, NY · On-site
$115K - $158K/yr
They are seeking a Senior Machine Learning Engineer to enhance their machine learning infrastructure and collaborate with cross-functional teams to deliver impactful ML solutions. Responsibilities ...
Machine Learning Researcher / Machine Learning Engineer
Manhattan, NY · On-site
$200K/yr
Distributed systems and AI infrastructure You'll tackle challenging mathematical and engineering ... Strong experience in Machine Learning, Deep Learning, Large Language Models, AI Infrastructure, or ...
Machine Learning Researcher / Machine Learning Engineer
Manhattan, NY · On-site
$200K/yr
Distributed systems and AI infrastructure You'll tackle challenging mathematical and engineering ... Strong experience in Machine Learning, Deep Learning, Large Language Models, AI Infrastructure, or ...
... Learning infrastructure, training, and inference challenges to advance our futures trading ... What you'll do As a Machine Learning Research Engineer, your key responsibilities include:
... Learning infrastructure, training, and inference challenges to advance our futures trading ... What you'll do As a Machine Learning Research Engineer, your key responsibilities include:
... Learning infrastructure, training, and inference challenges to advance our futures trading ... What you'll do As a Machine Learning Performance Engineer, your key responsibilities include:
... Learning infrastructure, training, and inference challenges to advance our futures trading ... What you'll do As a Machine Learning Performance Engineer, your key responsibilities include:
Machine Learning Research Engineer
New York, NY · On-site
$200K/yr
... Learning infrastructure, training, and inference challenges to advance our futures trading ... What you'll do As a Machine Learning Research Engineer, your key responsibilities include:
Machine Learning Research Engineer
New York, NY · On-site
$200K/yr
... Learning infrastructure, training, and inference challenges to advance our futures trading ... What you'll do As a Machine Learning Research Engineer, your key responsibilities include:
Machine Learning Performance Engineer
New York, NY · On-site
$200K/yr
... Learning infrastructure, training, and inference challenges to advance our futures trading ... What you'll do As a Machine Learning Performance Engineer, your key responsibilities include:
Machine Learning Performance Engineer
New York, NY · On-site
$200K/yr
... Learning infrastructure, training, and inference challenges to advance our futures trading ... What you'll do As a Machine Learning Performance Engineer, your key responsibilities include:
Senior Machine Learning Engineer
New York, NY · On-site
$190K - $250K/yr
Cloud Infrastructure: Manage and optimize AWS infrastructure for machine learning workloads ... Mentor junior engineers. Share domain knowledge and help build genuine technical depth on the team.
Senior Machine Learning Engineer
New York, NY · On-site
$190K - $250K/yr
Cloud Infrastructure: Manage and optimize AWS infrastructure for machine learning workloads ... Mentor junior engineers. Share domain knowledge and help build genuine technical depth on the team.
Senior Machine Learning Engineer
New York, NY · Remote
$190K - $250K/yr
Cloud Infrastructure: Manage and optimize AWS infrastructure for machine learning workloads ... Mentor junior engineers. Share domain knowledge and help build genuine technical depth on the team.
Quick apply
Senior Machine Learning Engineer
New York, NY · Remote
$190K - $250K/yr
Cloud Infrastructure: Manage and optimize AWS infrastructure for machine learning workloads ... Mentor junior engineers. Share domain knowledge and help build genuine technical depth on the team.
Machine Learning Engineer
New York, NY · On-site
$200K - $300K/yr
Virtu's Research Technology team is looking for an experienced Machine Learning Engineer to join a small group of technologists whose primary function is building the infrastructure that powers our ...
Machine Learning Engineer
New York, NY · On-site
$200K - $300K/yr
Virtu's Research Technology team is looking for an experienced Machine Learning Engineer to join a small group of technologists whose primary function is building the infrastructure that powers our ...
Machine Learning Engineer
$200K - $300K/yr
Virtu's Research Technology team is looking for an experienced Machine Learning Engineer to join a small group of technologists whose primary function is building the infrastructure that powers our ...
Machine Learning Engineer
$200K - $300K/yr
Virtu's Research Technology team is looking for an experienced Machine Learning Engineer to join a small group of technologists whose primary function is building the infrastructure that powers our ...
Machine Learning Engineer
Manhattan, NY · On-site
They are seeking a Machine Learning Engineer focused on MLOps to operationalize and scale their ... Responsibilities : • Build and maintain the workflows and infrastructure that support the end-to ...
Machine Learning Engineer
Manhattan, NY · On-site
They are seeking a Machine Learning Engineer focused on MLOps to operationalize and scale their ... Responsibilities : • Build and maintain the workflows and infrastructure that support the end-to ...
Machine Learning Engineer
Manhattan, NY · On-site
They are seeking Machine Learning Engineers to develop their platform for training, evaluating, and ... tools and training infrastructure. Responsibilities : • Turn cutting edge interpretability ...
Machine Learning Engineer
Manhattan, NY · On-site
They are seeking Machine Learning Engineers to develop their platform for training, evaluating, and ... tools and training infrastructure. Responsibilities : • Turn cutting edge interpretability ...
Machine Learning Engineer
New York, NY · On-site
$205K - $235K/yr
The Opportunity Good Inside is seeking a Machine Learning Engineer to join our Engineering team ... Build data pipelines and infrastructure to support model serving, feature storage, and real-time ...
Machine Learning Engineer
New York, NY · On-site
$205K - $235K/yr
The Opportunity Good Inside is seeking a Machine Learning Engineer to join our Engineering team ... Build data pipelines and infrastructure to support model serving, feature storage, and real-time ...
Staff Machine Learning Engineer, Personalization
New York, NY · On-site +1
$227K - $324K/yr
As a Staff Machine Learning Engineer, you will help shape the future of personalized discovery and ... learning infrastructure to build experiences that delight users and drive meaningful impact. This ...
Staff Machine Learning Engineer, Personalization
New York, NY · On-site +1
$227K - $324K/yr
As a Staff Machine Learning Engineer, you will help shape the future of personalized discovery and ... learning infrastructure to build experiences that delight users and drive meaningful impact. This ...
Machine Learning Engineer
Manhattan, NY · On-site
They are seeking Machine Learning Engineers to build a platform for training, evaluating, and ... infrastructure for frontier model interpretability, training, and inference. • Integrate new ...
Machine Learning Engineer
Manhattan, NY · On-site
They are seeking Machine Learning Engineers to build a platform for training, evaluating, and ... infrastructure for frontier model interpretability, training, and inference. • Integrate new ...
Staff Machine Learning Engineer, Personalization
New York, NY · On-site +1
$227K - $324K/yr
As a Staff Machine Learning Engineer, you will help shape the future of personalized discovery and ... learning infrastructure to build experiences that delight users and drive meaningful impact. This ...
Staff Machine Learning Engineer, Personalization
New York, NY · On-site +1
$227K - $324K/yr
As a Staff Machine Learning Engineer, you will help shape the future of personalized discovery and ... learning infrastructure to build experiences that delight users and drive meaningful impact. This ...
As an Applied Machine Learning Engineer, you will serve as a vital bridge between cutting-edge AI ... infrastructure.
As an Applied Machine Learning Engineer, you will serve as a vital bridge between cutting-edge AI ... infrastructure.
Machine Learning Engineer
New York, NY · On-site
$205K - $235K/yr
The Opportunity Good Inside is seeking a Machine Learning Engineer to join our Engineering team ... Build data pipelines and infrastructure to support model serving, feature storage, and real-time ...
Machine Learning Engineer
New York, NY · On-site
$205K - $235K/yr
The Opportunity Good Inside is seeking a Machine Learning Engineer to join our Engineering team ... Build data pipelines and infrastructure to support model serving, feature storage, and real-time ...
Machine Learning Infrastructure Engineer information
See Brooklyn, NY salary details
$48.9K - $61.8K
1% of jobs
$61.8K - $74.8K
1% of jobs
$74.8K - $87.8K
4% of jobs
$87.8K - $100.7K
9% of jobs
$100.7K - $113.7K
10% of jobs
$114.4K is the 25th percentile. Wages below this are outliers.
$113.7K - $126.6K
10% of jobs
The median wage is $131.9K / yr.
$126.6K - $139.6K
39% of jobs
$142.3K is the 75th percentile. Wages above this are outliers.
$139.6K - $152.5K
7% of jobs
$152.5K - $165.5K
10% of jobs
$165.5K - $178.4K
9% of jobs
$178.4K - $191.4K
1% of jobs
$48.9K
$133.6K
$191.4K
How much do machine learning infrastructure engineer jobs pay per year?
What are some common challenges faced by machine learning infrastructure engineers, and how can these be addressed on the job?
Machine Learning Infrastructure Engineers often face challenges such as ensuring infrastructure scalability, managing resource allocation, and maintaining system reliability while supporting rapid experimentation by data science teams. Balancing the needs for flexibility in research environments with production-grade stability requires a deep understanding of both engineering best practices and the unique requirements of machine learning workflows. Collaboration with data scientists, clear communication about infrastructure capabilities, and staying current with fast-evolving technologies are key strategies for success. Most companies encourage ongoing learning and provide opportunities to contribute to architecture decisions, which makes this a rewarding environment for problem-solvers and innovators.
What are the key skills and qualifications needed to thrive as a machine learning infrastructure engineer?
To thrive as a Machine Learning Infrastructure Engineer, you need a strong background in computer science, cloud computing, distributed systems, and experience with machine learning frameworks, often supported by a degree in a related field. Familiarity with tools such as Docker, Kubernetes, Terraform, as well as cloud platforms like AWS, GCP, or Azure, and certifications in cloud or DevOps technologies are highly valued. Strong problem-solving abilities, effective communication, and collaboration skills help engineers work seamlessly with data scientists and cross-functional teams. These skills are essential to design, implement, and maintain robust, scalable infrastructure that enables efficient machine learning development and deployment.
What is a machine learning infrastructure engineer?
A Machine Learning Infrastructure Engineer designs, builds, and maintains the systems that support the development and deployment of machine learning models. This includes managing data pipelines, optimizing model training and inference, and ensuring scalability and reliability in production environments. They work closely with data scientists, ML engineers, and DevOps teams to create efficient workflows and infrastructure. Key technologies often include cloud platforms, containerization, orchestration tools, and distributed computing frameworks.

$180K - $300K/yr
Other
Retirement
Posted 13 days ago
Job description
A Career with Point72's Technology Team
As Point72 reimagines the future of investing, our Technology team is constantly evolving our firm's IT infrastructure and engineering capabilities, positioning us at the forefront of a rapidly evolving technology landscape. We're a team of experts who experiment and work to discover new ways to harness open-source solutions, modern cloud architectures, and sophisticated Artificial Intelligence (AI) solutions, while embracing enterprise agile methodologies. Our commitment to building and innovating in the AI space provides the framework intended to drive smarter decision making and enhance how we build and operate our platforms and applications.
As a member of Point72's Technology team, we encourage and support your professional development from day one-helping you advance your technical skills, contribute innovative ideas, and satisfy your own intellectual curiosity-all while delivering real business impact for our multi-billion-dollar global business.
WHAT YOU'LL DO
- Design and implement high-performance infrastructure to support large-scale generative AI and machine learning workloads, enabling faster model iteration and real business impact
- Design and operate distributed systems for model training, hyperparameter tuning, inference, and data preprocessing pipelines to deliver reliable end-to-end machine learning (ML) workflows
- Collaborate with ML researchers and engineers to produce models, optimizing compute utilization, training throughput, and inference latency
- Develop and automate deployment, orchestration, and CI/CD pipelines for models and data workflows using container orchestration and infrastructure-as-code (IaC)
- Implement observability, monitoring, and cost-management strategies for GPU and accelerator compute environments to maintain predictable performance and spend
- Evaluate, integrate, and benchmark emerging hardware and software technologies across cloud and on-prem environments to improve scalability and throughput
- Drive security, compliance, and operational runbooks for GenAI infrastructure including access controls, secrets management, and incident response procedures
- Troubleshoot, profile, and optimize performance across GPU and CPU compute stacks to remove bottlenecks and increase reliability
- Document architecture, operational practices, and mentor engineers to expand team capability and accelerate adoption of production-ready GenAI infrastructure
WHAT'S REQUIRED
- Bachelor's or master's degree in computer science, electrical engineering, or a related technical field
- 3-7 years of experience building and maintaining scalable compute or machine learning infrastructure systems
- Deep understanding of distributed systems, container orchestration (Kubernetes), and public cloud platforms such as AWS, Google Cloud Platform, or Azure
- Hands-on experience with machine learning operations and infrastructure tools such as MLflow, Ray, Airflow, Kubeflow, and Terraform
- Strong understanding of reinforcement learning concepts and their infrastructure implications
- Proficiency in Python and systems-level programming in one or more languages such as Go, C++, or Rust
- Strong debugging, performance profiling, and optimization skills across GPU and CPU compute stacks
- Experience implementing monitoring, observability, and cost-optimization for GPU/accelerator-based compute environments
- Excellent collaboration and communication skills with a systems-thinking mindset
- Commitment to the highest ethical standards
WE TAKE CARE OF OUR PEOPLE
We invest in our people, their careers, their health, and their well-being. When you work here, we provide:
- Fully-paid health care benefits
- Generous parental and family leave policies
- Volunteer opportunities
- Support for employee-led affinity groups representing women, people of color and the LGBT+ community
- Mental and physical wellness programs
- Tuition assistance
- A 401(k) savings program with an employer match and more
ABOUT POINT72
Point72 is a leading global alternative investment firm led by Steven A. Cohen. Building on more than 30 years of investing experience, Point72 seeks to deliver superior returns for its investors through fundamental and systematic investing strategies across asset classes and geographies. We aim to attract and retain the industry's brightest talent by cultivating an investor-led culture and committing to our people's long-term growth. For more information, visit https://point72.com/.
The annual base salary range for this role is $180,000-$300,000 (USD) , which does not include discretionary bonus compensation or our comprehensive benefits package. Actual compensation offered to the successful candidate may vary from posted hiring range based upon geographic location, work experience, education, and/or skill level, among other things.
About Point72
Sourced by ZipRecruiter
Industry
Finance and insurance
Company size
501 - 1,000 Employees
Headquarters location
Stamford, CT, US
Year founded
1992