Sr. Director Back-end Engineering - AI Infrastructure Orchestration Company Introduction We exist to wow our customers. We know we're doing the right thing when we hear our customers say, "How did we ...
Sr. Director Back-end Engineering - AI Infrastructure Orchestration Company Introduction We exist to wow our customers. We know we're doing the right thing when we hear our customers say, "How did we ...
Senior AI Infrastructure Engineer
Santa Clara, CA · On-site
$127K - $173K/yr
About the role We are seeking a Senior AI Infrastructure Engineer to design, build, and scale the high-performance AI platform powering our autonomous driving models. While researchers focus on ...
Senior AI Infrastructure Engineer
Santa Clara, CA · On-site
$127K - $173K/yr
About the role We are seeking a Senior AI Infrastructure Engineer to design, build, and scale the high-performance AI platform powering our autonomous driving models. While researchers focus on ...
AI Infrastructure Engineer
Lake Mary, FL · Hybrid
$94K - $123K/yr
AI Infrastructure Engineer At BNY, our culture allows us to run our company better and enables employees' growth and success. As a leading global financial services company at the heart of the global ...
AI Infrastructure Engineer
Lake Mary, FL · Hybrid
$94K - $123K/yr
AI Infrastructure Engineer At BNY, our culture allows us to run our company better and enables employees' growth and success. As a leading global financial services company at the heart of the global ...
AI Infrastructure Engineer
Lake Mary, FL · Hybrid
$94K - $123K/yr
AI Infrastructure Engineer At BNY, our culture allows us to run our company better and enables employees' growth and success. As a leading global financial services company at the heart of the global ...
AI Infrastructure Engineer
Lake Mary, FL · Hybrid
$94K - $123K/yr
AI Infrastructure Engineer At BNY, our culture allows us to run our company better and enables employees' growth and success. As a leading global financial services company at the heart of the global ...
AI Infrastructure Engineer
Lake Mary, FL · On-site
$94K - $123K/yr
AI Infrastructure Engineer At BNY, our culture allows us to run our company better and enables employees' growth and success. As a leading global financial services company at the heart of the global ...
AI Infrastructure Engineer
Lake Mary, FL · On-site
$94K - $123K/yr
AI Infrastructure Engineer At BNY, our culture allows us to run our company better and enables employees' growth and success. As a leading global financial services company at the heart of the global ...
Senior AI Infrastructure Engineer
$127K - $173K/yr
About the role We are seeking a Senior AI Infrastructure Engineer to design, build, and scale the high-performance AI platform powering our autonomous driving models. While researchers focus on ...
Senior AI Infrastructure Engineer
$127K - $173K/yr
About the role We are seeking a Senior AI Infrastructure Engineer to design, build, and scale the high-performance AI platform powering our autonomous driving models. While researchers focus on ...
AI Infrastructure Engineer
Lake Mary, FL · On-site
$94K - $123K/yr
AI Infrastructure Engineer At BNY, our culture allows us to run our company better and enables employees' growth and success. As a leading global financial services company at the heart of the global ...
AI Infrastructure Engineer
Lake Mary, FL · On-site
$94K - $123K/yr
AI Infrastructure Engineer At BNY, our culture allows us to run our company better and enables employees' growth and success. As a leading global financial services company at the heart of the global ...
AI Infrastructure Engineer / MLOps
San Francisco, CA · On-site
$50 - $60/hr
Benefits: * 401(k) AI Infrastructure Engineer / MLOps San Francisco Bay Area, CA (100% Onsite) EITACIES is looking for an experienced AI Infrastructure Engineer to support large scale AI and machine ...
Quick apply
AI Infrastructure Engineer / MLOps
San Francisco, CA · On-site
$50 - $60/hr
Benefits: * 401(k) AI Infrastructure Engineer / MLOps San Francisco Bay Area, CA (100% Onsite) EITACIES is looking for an experienced AI Infrastructure Engineer to support large scale AI and machine ...
Software Engineer -- AI Infrastructure
Columbia, MD · On-site
$160K - $190K/yr
Software Engineer -- AI Infrastructure (Software Engineer, Level 2) -- 2 positions Location: Columbia, MD (on-site) Category: Software Engineering / AI Infrastructure / Cloud-Native Clearance ...
Quick apply
Software Engineer -- AI Infrastructure
Columbia, MD · On-site
$160K - $190K/yr
Software Engineer -- AI Infrastructure (Software Engineer, Level 2) -- 2 positions Location: Columbia, MD (on-site) Category: Software Engineering / AI Infrastructure / Cloud-Native Clearance ...
Senior AI Infrastructure Engineer
Wilmington, MA · On-site
$118K - $161K/yr
Senior AI Infrastructure Engineer, Developer Experience Analog Devices, Inc. (NASDAQ: ADI) is a global semiconductor leader that bridges the physical and digital worlds to enable breakthroughs at the ...
Senior AI Infrastructure Engineer
Wilmington, MA · On-site
$118K - $161K/yr
Senior AI Infrastructure Engineer, Developer Experience Analog Devices, Inc. (NASDAQ: ADI) is a global semiconductor leader that bridges the physical and digital worlds to enable breakthroughs at the ...
Senior AI Infrastructure Engineer
Wilmington, MA · Hybrid
$118K - $161K/yr
Senior AI Infrastructure Engineer, Developer Experience Analog Devices, Inc. (NASDAQ: ADI) is a global semiconductor leader that bridges the physical and digital worlds to enable breakthroughs at the ...
Senior AI Infrastructure Engineer
Wilmington, MA · Hybrid
$118K - $161K/yr
Senior AI Infrastructure Engineer, Developer Experience Analog Devices, Inc. (NASDAQ: ADI) is a global semiconductor leader that bridges the physical and digital worlds to enable breakthroughs at the ...
AI Infrastructure Engineer
$110K - $144K/yr
They are seeking an AI Infrastructure Engineer to own the infrastructure and operational reliability that powers their AI systems, focusing on defining infrastructure patterns and building ...
AI Infrastructure Engineer
$110K - $144K/yr
They are seeking an AI Infrastructure Engineer to own the infrastructure and operational reliability that powers their AI systems, focusing on defining infrastructure patterns and building ...
AI Infrastructure Engineer
Seattle, WA · On-site
$332K/yr
What you can expect We are seeking an experienced AI Infrastructure Engineer to join our AI Incubation team. You will be focused on building and optimizing large-scale training infrastructure for ...
AI Infrastructure Engineer
Seattle, WA · On-site
$332K/yr
What you can expect We are seeking an experienced AI Infrastructure Engineer to join our AI Incubation team. You will be focused on building and optimizing large-scale training infrastructure for ...
AI Infrastructure Engineer IV
Lehi, UT · On-site
$100K - $132K/yr
As an AI Infrastructure Engineer IV , you will play a critical role in designing, building, and maintaining the systems that power our AI and machine learning capabilities. You will ensure our ...
Quick apply
AI Infrastructure Engineer IV
Lehi, UT · On-site
$100K - $132K/yr
As an AI Infrastructure Engineer IV , you will play a critical role in designing, building, and maintaining the systems that power our AI and machine learning capabilities. You will ensure our ...
Software Engineer - AI Infrastructure
San Francisco, CA · On-site +1
$203K - $241K/yr
Software Engineer - AI Infrastructure Location: North America Remote / San Francisco • Full-Time About Andromeda Andromeda Cluster, founded by Nat Friedman and Daniel Gross, is on a mission to ...
Software Engineer - AI Infrastructure
San Francisco, CA · On-site +1
$203K - $241K/yr
Software Engineer - AI Infrastructure Location: North America Remote / San Francisco • Full-Time About Andromeda Andromeda Cluster, founded by Nat Friedman and Daniel Gross, is on a mission to ...
AI Engineer, AIOps & Infrastructure
San Francisco, CA · On-site
$126K - $166K/yr
Your Role As a Senior Software Engineer, AIOps & Infrastructure at Eloquent AI, you will be responsible for designing, building, and optimizing scalable, high-performance AI infrastructure to support ...
AI Engineer, AIOps & Infrastructure
San Francisco, CA · On-site
$126K - $166K/yr
Your Role As a Senior Software Engineer, AIOps & Infrastructure at Eloquent AI, you will be responsible for designing, building, and optimizing scalable, high-performance AI infrastructure to support ...
AI Infrastructure Engineer
New York, NY · On-site
$180K - $400K/yr
About the role We're hiring an AI Infrastructure Engineer to own the infrastructure, deployment, and operational reliability that powers Percepta's AI systems, including the autonomous agents at the ...
AI Infrastructure Engineer
New York, NY · On-site
$180K - $400K/yr
About the role We're hiring an AI Infrastructure Engineer to own the infrastructure, deployment, and operational reliability that powers Percepta's AI systems, including the autonomous agents at the ...
AI Infrastructure Engineer
New York, NY · Remote
$150K - $200K/yr
As vCluster's AI Infrastructure Specialist, you will work directly with customers at the earliest and most critical stage of their journey: from bare metal GPU nodes through to a production-ready ...
Quick apply
AI Infrastructure Engineer
New York, NY · Remote
$150K - $200K/yr
As vCluster's AI Infrastructure Specialist, you will work directly with customers at the earliest and most critical stage of their journey: from bare metal GPU nodes through to a production-ready ...
Lead AI Infrastructure Engineer
$293K - $306K/yr
Lead AI Infrastructure Engineer Location: Annapolis Junction, MD Clearance: TS/SCI with Polygraph required Work Type: On-site Salary: $293,000-$306,000 Position Overview We are seeking an experienced ...
Quick apply
Lead AI Infrastructure Engineer
$293K - $306K/yr
Lead AI Infrastructure Engineer Location: Annapolis Junction, MD Clearance: TS/SCI with Polygraph required Work Type: On-site Salary: $293,000-$306,000 Position Overview We are seeking an experienced ...
AI Infrastructure Engineer IV
Mendon, UT · On-site
$93K - $122K/yr
As an AI Infrastructure Engineer IV , you will play a critical role in designing, building, and maintaining the systems that power our AI and machine learning capabilities. You will ensure our ...
Quick apply
AI Infrastructure Engineer IV
Mendon, UT · On-site
$93K - $122K/yr
As an AI Infrastructure Engineer IV , you will play a critical role in designing, building, and maintaining the systems that power our AI and machine learning capabilities. You will ensure our ...
Ai Infrastructure information
See salary details
$28.13 - $33.50
3% of jobs
$33.50 - $38.88
3% of jobs
$38.88 - $44.25
13% of jobs
$47.54 is the 25th percentile. Wages below this are outliers.
$44.25 - $49.63
10% of jobs
$49.63 - $55
12% of jobs
The median wage is $58.23 / hr.
$55 - $60.38
16% of jobs
$60.38 - $65.76
16% of jobs
$67.10 is the 75th percentile. Wages above this are outliers.
$65.76 - $71.13
11% of jobs
$71.13 - $76.51
9% of jobs
$76.51 - $81.88
5% of jobs
$81.88 - $87.26
3% of jobs
$28
$59
$87
How much do ai infrastructure jobs pay per hour?
What is the difference between Ai Infrastructure vs Data Engineer?
| Aspect | Ai Infrastructure | Data Engineer |
|---|---|---|
| Required Credentials | Bachelor's in CS, Engineering, or related; knowledge of cloud platforms and AI tools | Bachelor's in CS, Data Science, or related; programming and database skills |
| Work Environment | Cloud environments, AI model deployment, infrastructure setup | Data pipelines, database management, data processing |
| Employer & Industry Usage | Tech companies, AI startups, cloud providers | Tech firms, finance, healthcare, e-commerce |
Ai Infrastructure professionals focus on building and maintaining the hardware and software systems that support AI models, while Data Engineers develop and manage data pipelines and databases. Both roles require technical skills and often collaborate but serve different core functions within AI and data ecosystems.
How much do AI infrastructure engineers make?
What are AI infrastructure jobs?
What are the key skills and qualifications needed to thrive in AI Infrastructure, and why are they important?
What is a $900000 AI job?
What are common challenges faced by professionals working in AI Infrastructure roles, and how can they be addressed?
What is AI Infrastructure?
What engineer makes $500,000 a year?

Other
Medical, Dental, Vision, Life, Retirement, PTO
Posted 13 days ago
Job description
Company Introduction
We exist to wow our customers. We know we're doing the right thing when we hear our customers say, "How did we ever live without Coupang?" Born out of an obsession to make shopping, eating, and living easier than ever, we're collectively disrupting the multi-billion-dollar e-commerce industry from the ground up. We are one of the fastest-growing e-commerce companies that established an unparalleled reputation for being a dominant and reliable force in South Korean commerce.
We are proud to have the best of both worlds - a startup culture with the resources of a large global public company. This fuels us to continue our growth and launch new services at the speed we have been since our inception. We are all entrepreneurs surrounded by opportunities to drive new initiatives and innovations. At our core, we are bold and ambitious people that like to get our hands dirty and make a hands-on impact. At Coupang, you will see yourself, your colleagues, your team, and the company grow every day.
Our mission to build the future of commerce is real. We push the boundaries of what's possible to solve problems and break traditional tradeoffs. Join Coupang now to create an epic experience in this always-on, high-tech, and hyper-connected world.
Role Overview
Strategy and Leadership
- Define and execute the long-term vision and roadmap for the company's AI infrastructure orchestration layer, aligning it with overall business and AI Services goals.
- Lead, mentor, and grow a high-performing engineering and operations team focused on AI infrastructure, and platform engineering.
- Manage budget and resource allocation for AI infrastructure delievrables.
- Act as a key liaison between AI Infra and other services owners and consumers, core engineering, Cloud infrastructure, and executive leadership.
- Oversee the design, implementation, and maintenance of the core orchestration platforms for large-scale AI model training (e.g., distributed training, hyperparameter tuning) and deployment (e.g., containerization, serverless functions, edge deployment).
- Ensure reliability, security, and compliance of the AI infrastructure, meeting strict standards for data governance and model integrity.
- Establish Service Level Objectives (SLOs) and Key Performance Indicators (KPIs) for the AI platform services and lead efforts for continuous optimization and performance tuning.
Success Metrics
A successful Senior Director - AI Infrastructure Orchestration will be measured by:
- The time-to-market for AI Infar build, scale and operate
- The resource utilization rate and cost efficiency of the AI compute infrastructure.
- The reliability and uptime of the core AI platform services.
- The talent retention and development within the AI Infrastructure team.
- Select, evaluate, and integrate the core technologies required for the AI stack (e.g., Kubernetes, Kubeflow, Ray, ML frameworks, GPU/accelerator management, distributed file systems).
- Champion infrastructure-as-code (IaC) principles to manage and provision AI resources consistently and at scale.
Education: Bachelor's or Master's degree in Computer Science, Engineering, or a related technical field.
Experience:
- 15+ years of progressive experience in software engineering, infrastructure, or platform operations.
- 5+ years of experience leading and managing technical teams, ideally in a Director or Sr. Director level or equivalent capacity.
- Deep, hands-on experience designing and operating large-scale distributed systems and cloud-native architectures
- Proven experience specifically with AI infrastructure orchestration (e.g., using Kubernetes, Kubeflow, or similar MLOps tools) and managing acceleratedcompute resources (GPUs, TPUs etc).
- 15+ years of Cloud backend engineering, Cloud Design, Deployment, DevOps
- 15+ years of experience leading system design, architecture leveraging Private Clouds and AWS and/or Azure/ GCP.
- 10+ years of demonstrable building and operating infrastructure as code. Infra Automation, Comfortable with many flavors of Linux
- 15+ year's of experience in building high-performance, highly-available and scalable distributed systems in the cloud.
- 15+ year's of experience in building and managing high-performance, highly-available and scalable Hybrid Cloud cloud environments .
- Excellent cross-group collaboration, outstanding verbal and written communication.
Skills:
- Expert-level knowledge of containerization and orchestration (Docker, Kubernetes).
- Strong background in DevOps and MLOps principles and tooling.
- Proficiency in at least one modern programming language (e.g., Python, Go).
- Exceptional strategic planning, organizational, and written/verbal communication skills.
- Prior experience managing infrastructure for training and inferecning of large language models (LLMs) or foundation models.
- Experience in a regulated industry with strict compliance requirements.
- AI Private Cloud -Building and operating
Pay & Benefits:
Our compensation reflects the cost of labor across several US geographic markets. At Coupang, your base pay is one part of your total compensation.
The base pay for this position ranges from $184,000/year in our lowest geographic market to $376,000/year in our highest geographic market. Pay is based on several factors including market location and may vary depending on job-related knowledge, skills, and experience.
General Description of All Benefits:
- Medical/Dental/Vision/Life, AD&D insurance
- Flexible Spending Accounts (FSA) & Health Savings Account (HSA)
- Long-term/Short-term Disability
- Employee Assistance Program (EAP) program
- 401K Plan with Company Match
- 18-21 days of the Paid Time Off (PTO) a year based on the tenure
- 12 Public Holidays
- Paid Parental leave
- Pre-tax commuterbenefits
- MTV - [Free] Electric Car Charging Station
General Description of Other Compensation:
"Other Compensation" includes, but is not limited to, bonuses, equity, or other forms of compensation that would be offered to the hired applicant in addition to their established salary range or wage scale.
Details to Consider
- This job posting may be closed prior to the stated end date for application if all openings are filled.
- Coupang has the right to rescind an offer of employment if a candidate is found to have submitted false information as part of the application process.
- Those eligible for employment protection (recipients of veteran's benefits, the disabled, etc.) may receive preferential treatment for employment in accordance with applicable laws.
Equal Opportunities for All
Coupang is an equal opportunity employer. Our unprecedented success could not be possible without the valuable inputs of our globally diverse team.
Privacy Notice
- Your personal information will be collected and managed by Coupang as stated in the Application Privacy Notice located below: https://www.coupang.jobs/privacy-policy/
Coupang is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, or gender (including pregnancy, gender identity, gender expression, sexual orientation, transgender status), national origin, age, disability, medical condition, HIV/AIDS or Hepatitis C status, marital status, military or veteran status, use of a trained dog guide or service animal, political activities, or affiliations, citizenship, or any other characteristic or class protected by the laws or regulations in the locations where we operate. If you need assistance and/or reasonable accommodation in the recruiting process due to a disability, please contact us at usrecruiting@coupang.com.