ZipRecruiter

Log In

1

Ai Infrastructure Engineer Jobs (NOW HIRING)

BNY Mellon

AI Infrastructure Engineer

Lake Mary, FL · On-site

$94K - $123K/yr

AI Infrastructure Engineer At BNY, our culture allows us to run our company better and enables employees' growth and success. As a leading global financial services company at the heart of the global ...

Autonomous Solutions

AI Infrastructure Engineer IV

Lehi, UT · On-site

$100K - $132K/yr

As an AI Infrastructure Engineer IV , you will play a critical role in designing, building, and maintaining the systems that power our AI and machine learning capabilities. You will ensure our ...

BNY

AI Infrastructure Engineer

Lake Mary, FL · Hybrid

$94K - $123K/yr

AI Infrastructure Engineer At BNY, our culture allows us to run our company better and enables employees' growth and success. As a leading global financial services company at the heart of the global ...

BNY

AI Infrastructure Engineer

Lake Mary, FL · Hybrid

$94K - $123K/yr

AI Infrastructure Engineer At BNY, our culture allows us to run our company better and enables employees' growth and success. As a leading global financial services company at the heart of the global ...

Percepta

AI Infrastructure Engineer

$110K - $144K/yr

They are seeking an AI Infrastructure Engineer to own the infrastructure and operational reliability that powers their AI systems, focusing on defining infrastructure patterns and building ...

Seekr

Senior AI Infrastructure Engineer

Austin, TX · On-site

$107K - $146K/yr

As a Senior AI Infrastructure Engineer, you will design, build, and operate the platforms that enable large-scale training, serving, evaluation, and deployment of foundation models and autonomous AI ...

Percepta

AI Infrastructure Engineer

New York, NY · On-site

$180K - $400K/yr

About the role We're hiring an AI Infrastructure Engineer to own the infrastructure, deployment, and operational reliability that powers Percepta's AI systems, including the autonomous agents at the ...

Gatik AI

Senior AI Infrastructure Engineer

Santa Clara, CA · On-site

$127K - $173K/yr

About the role We are seeking a Senior AI Infrastructure Engineer to design, build, and scale the high-performance AI platform powering our autonomous driving models. While researchers focus on ...

Crowe LLP

AI Infrastructure Engineer

Boston, MA

$116K - $153K/yr

As an AI Infrastructure Engineer, you are a deep technical contributor with subsystem ownership and notable technical influence. Your role will be crucial in ensuring that the AI solutions you ...

Crowe LLP

AI Infrastructure Engineer

New York, NY · On-site

$117K - $154K/yr

As an AI Infrastructure Engineer, you are a deep technical contributor with subsystem ownership and notable technical influence. Your role will be crucial in ensuring that the AI solutions you ...

Crowe LLP

AI Infrastructure Engineer

Cleveland, OH · On-site

$104K - $136K/yr

As an AI Infrastructure Engineer, you are a deep technical contributor with subsystem ownership and notable technical influence. Your role will be crucial in ensuring that the AI solutions you ...

next page

Showing results 1-20

All JobsAi Infrastructure Engineer Jobs

Ai Infrastructure Engineer information

See salary details

$46.5K

$127.1K

$182K

How much do ai infrastructure engineer jobs pay per year?

As of Jul 17, 2026, the average yearly pay for ai infrastructure engineer in the United States is $127,066.00, according to ZipRecruiter salary data. Most workers in this role earn between $107,500.00 and $141,000.00 per year, depending on experience, location, and employer.

How much do AI infra engineers make?

AI infrastructure engineers typically earn between $100,000 and $150,000 annually, with salaries increasing based on experience, skills in cloud platforms, and knowledge of machine learning frameworks. Senior roles or those with specialized expertise can earn over $180,000 per year.

What does a typical day look like for an AI Infrastructure Engineer?

A typical day for an AI Infrastructure Engineer often involves designing and maintaining the underlying systems that support machine learning and AI workloads, such as setting up scalable cloud environments, automating workflows with CI/CD pipelines, and troubleshooting performance bottlenecks. You might collaborate closely with data scientists and software engineers to ensure seamless integration between AI models and production infrastructure. Daily activities can include writing and reviewing infrastructure-as-code, monitoring system health, and responding to incidents or scaling requests as needed. This role offers a dynamic mix of hands-on technical work, problem-solving, and teamwork, providing opportunities to refine your skills and contribute meaningfully to cutting-edge AI projects.

What is a $900000 AI job?

A $900,000 AI job typically refers to a high-level position in artificial intelligence, such as senior AI engineer, research scientist, or AI director, often offering top-tier compensation due to expertise, experience, and the strategic importance of AI projects. These roles usually require advanced skills in machine learning, deep learning, and data infrastructure, along with significant industry experience and sometimes advanced degrees or certifications.

What are the key skills and qualifications needed to thrive in the Ai Infrastructure Engineer position, and why are they important?

To thrive as an AI Infrastructure Engineer, a strong background in computer science, cloud computing, and distributed systems is typically required, often supported by a degree in a related field. Familiarity with tools like Kubernetes, Docker, TensorFlow, and cloud platforms (AWS, Azure, or GCP), along with certifications in cloud technologies or DevOps, is highly valuable. Strong problem-solving abilities, collaboration, and effective communication skills are essential to excel within multidisciplinary engineering teams. These competencies ensure the reliable deployment, scaling, and optimization of AI workloads in dynamic production environments.

What does an AI Infrastructure Engineer do?

An AI Infrastructure Engineer designs, builds, and maintains the computing systems that support AI and machine learning workloads. They manage cloud services, optimize hardware and software performance, and ensure scalability for AI models. Their work involves configuring GPUs, CPUs, storage, and networking, as well as automating workflows with DevOps and MLOps tools. They collaborate with data scientists and engineers to streamline AI development and deployment. Their goal is to create reliable, efficient, and scalable AI infrastructure.

What do AI infrastructure engineers do?

AI infrastructure engineers design, build, and maintain the hardware and software systems that support artificial intelligence models and applications. They work with cloud platforms, high-performance computing, and data storage solutions, often using tools like Kubernetes and Docker, to ensure scalable and efficient AI operations.

What engineers make $500,000?

Senior AI Infrastructure Engineers, cloud architects, and machine learning engineers with extensive experience and advanced skills in AI systems, cloud platforms, and distributed computing can reach or exceed $500,000 in total compensation, especially in high-demand industries or companies. Achieving this level often requires specialized certifications, leadership roles, and a strong track record of impactful projects.
More about Ai Infrastructure Engineer jobs
What cities are hiring for Ai Infrastructure Engineer jobs? Cities with the most Ai Infrastructure Engineer job openings:
What are the most commonly searched types of Ai Infrastructure Engineer jobs? The most popular types of Ai Infrastructure Engineer jobs are:
What states have the most Ai Infrastructure Engineer jobs? States with the most job openings for Ai Infrastructure Engineer jobs include:
What job categories do people searching Ai Infrastructure Engineer jobs look for? The top searched job categories for Ai Infrastructure Engineer jobs are:
Ai Infrastructure Engineer jobs near you
Infographic showing various Ai Infrastructure Engineer job openings in the United States as of July 2026, with employment types broken down into 75% Full Time, and 25% Contract. Highlights an 75% In-person, and 25% Remote job distribution, with an average salary of $127,066 per year, or $61.1 per hour.
AI Infrastructure Engineer

AI Infrastructure Engineer

BNY Mellon

Lake Mary, FL • On-site

$94K - $123K/yr

Full-time

Medical, Dental, Vision, Life, Retirement, PTO

Posted 3 days ago

BNY Mellon rating

7.7

Company rating: 7.7 out of 10

Based on 50 frontline employees who took The Breakroom Quiz

106th of 148 rated financial services

Job description


AI Infrastructure Engineer
At BNY, our culture allows us to run our company better and enables employees' growth and success. As a leading global financial services company at the heart of the global financial system, we influence nearly 20% of the world's investible assets. Every day, our teams harness cutting-edge AI and breakthrough technologies to collaborate with clients, driving transformative solutions that redefine industries and uplift communities worldwide.
Recognized as a top destination for innovators, BNY is where bold ideas meet advanced technology and exceptional talent. Together, we power the future of finance - and this is what #LifeAtBNY is all about. Join us and be part of something extraordinary.
We're seeking a future team member for the role of AI Infrastructure Engineer to join our Technology team. This role is located in Lake Mary, FL or Pittsburgh, PA
In this role, you'll make an impact in the following ways:
  • Be hands-on with enterprise-grade NVIDIA AI infrastructure, supporting GPU-based compute, high-performance storage, and network systems designed for ML/AI at scale.
  • Deploy, monitor, and troubleshoot containerized AI workloads using Kubernetes, Docker, and GPU orchestration tools like Run:AI and NVIDIA BCM.
  • Own the observability of our AI platforms-monitor health, identify performance bottlenecks, and make strategic recommendations to drive platform reliability and maturity.
  • Automate infrastructure operations and provisioning using Python, Bash, and tools like Terraform or Ansible to reduce manual toil and accelerate experimentation.
  • Maintain and scale AI training and inference pipelines, integrating infrastructure workflows into CI/CD systems to enable seamless, automated deployment of AI workloads.

To be successful in this role, we're seeking the following:
  • Bachelor's degree in computer science or a related discipline, or equivalent work experience required; advanced degree preferred8-10 years of related experience required; experience in the securities or financial services industry is a plus.
  • Experience with Linux administration (RHEL/Ubuntu), shell scripting, and system-level debugging.
  • Proven experience running distributed systems in Kubernetes and containerized environments using Docker.
  • Familiarity with GPU resource management, including NVIDIA GPU Operator and device plugin lifecycle.
  • Experience with CI/CD workflows and infrastructure automation tools such as GitLab CI, Jenkins, Terraform, Helm, or Ansible.
  • Knowledge of networking fundamentals and persistent storage systems.
  • Exposure to cloud platforms (AWS, GCP, Azure) and hybrid GPU environments.
  • Ability to read and support Python code focused on ML/AI pipeline integration.
  • Strong analytical and troubleshooting skills with a collaborative mindset.
  • Effective communication skills and proactive ownership of platform reliability and performance.

At BNY, our culture speaks for itself, check out the latest BNY news at:
BNY Newsroom
BNY LinkedIn
Here's a few of our recent awards:
America's Most Innovative Companies, Fortune, 2025
World's Most Admired Companies, Fortune 2025
"Most Just Companies", Just Capital and CNBC, 2025
Our Benefits and Rewards:
BNY offers highly competitive compensation, benefits, and wellbeing programs rooted in a strong culture of excellence and our pay-for-performance philosophy. We provide access to flexible global resources and tools for your life's journey. Focus on your health, foster your personal resilience, and reach your financial goals as a valued member of our team, along with generous paid leaves, including paid volunteer time, that can support you and your family through moments that matter.
BNY is an Equal Employment Opportunity/Affirmative Action Employer - Underrepresented racial and ethnic groups/Females/Individuals with Disabilities/Protected Veterans.
About the Team
At BNY, our culture speaks for itself, check out the latest BNY news at BNY Newsroom & BNY LinkedIn
Here's a few of our recent awards:
  • America's Most Innovative Companies, Fortune, 2025
  • World's Most Admired Companies, Fortune 2025
  • "Most Just Companies", Just Capital and CNBC, 2025

Our Benefits and Rewards:
BNY offers highly competitive compensation, benefits, and wellbeing programs rooted in a strong culture of excellence and our pay-for-performance philosophy. We provide access to flexible global resources and tools for your life's journey. Focus on your health, foster your personal resilience, and reach your financial goals as a valued member of our team, along with generous paid leaves, including paid volunteer time, that can support you and your family through moments that matter.
BNY is an Equal Employment Opportunity/Affirmative Action Employer - Underrepresented racial and ethnic groups/Females/Individuals with Disabilities/Protected Veterans.
BNY assesses market data to ensure a competitive compensation package for our employees. The expected base salary for this position when employment commences can be found in the Job Info section at the bottom of the posting.
Base salary offered may vary depending on multiple individualized factors, including market location, job-related knowledge, skills, and experience. Base salary is only part of the total rewards package, which may include eligibility for an annual discretionary incentive award. Subject to the terms and conditions of the applicable plans then in effect, eligible employees may enroll in a 401(k) plan as well as participate in Company-sponsored medical, dental, vision, and basic life insurance plans for the employee and the employee's eligible dependents. Eligible employees also may receive other benefits (including various paid time off benefits, such as vacation and sick time), dependent on the position offered. Details of participation in these benefit plans will be provided if an employee receives an offer of employment.
If hired, the employee will be in an "at will" position and the Company reserves the right to modify base salary (as well as any other discretionary payments or compensation programs) at any time, including for reasons related to individual performance, Company or individual department/team performance, and market factors.

What BNY Mellon employees say

Pay

Benefits

Hours and flexibility

Workplace

Get the full story on Breakroom

BNY Mellon logo

About BNY Mellon

Sourced by ZipRecruiter

BNY Mellon is a global investments company dedicated to helping its clients manage and service their financial assets throughout the investment lifecycle. Whether providing financial services for institutions, corporations or individual investors, BNY Mellon delivers informed investment and wealth management and investment services in 35 countries. As of Dec. 31, 2021, BNY Mellon had $46.7 trillion in assets under custody and/or administration, and $2.4 trillion in assets under management. BNY Mellon can act as a single point of contact for clients looking to create, trade, hold, manage, service, distribute or restructure investments. BNY Mellon is the corporate brand of The Bank of New York Mellon Corporation (NYSE: BK). Additional information is available on www.bnymellon.com . Follow us on Twitter @BNYMellon or visit our newsroom at www.bnymellon.com/newsroom for the latest company news.

Industry

Finance and insurance

Company size

10,000+ Employees

Headquarters location

New York, NY, US

Year founded

1784

View All BNY Mellon Jobs

Apply