1

Ai Infrastructure Engineer Jobs in Washington (NOW HIRING)

Platform Infrastructure Engineer

Columbia, MD · On-site +1

$116K - $154K/yr

This role owns the engineering of our compute, virtualization, container, and automation platforms ... AI infrastructure (vLLM, Open WebUI, Jupyter) Benefits * 401(k) match of 6% with immediate vesting

This role owns the engineering of our compute, virtualization, container, and automation platforms ... AI infrastructure (vLLM, Open WebUI, Jupyter) Benefits * 401(k) match of 6% with immediate vesting

Platform Infrastructure Engineer

Columbia, MD · On-site +1

$116K - $154K/yr

This role owns the engineering of our compute, virtualization, container, and automation platforms ... AI infrastructure (vLLM, Open WebUI, Jupyter) Benefits * 401(k) match of 6% with immediate vesting

Infrastructure Engineer

Columbia, MD · On-site

$130K - $220K/yr

Infrastructure Engineer Columbia, MD | Full Time | TS/SCI with Polygraph Required Position ... About Us Intezra Inc. is a small business prime contractor for all realms of cyber and AI/ML ...

Infrastructure Engineer

Washington, DC · On-site

$121K - $159K/yr

... AI and intelligent automation. We always seek to delight our customers, so we retain highly ... Infrastructure Engineer - Field Systems Support - (PIPELINE) Position Summary: The Infrastructure ...

Cloud Infrastructure Engineer

Arlington, VA · On-site

$123K - $162K/yr

... an AI-enabled logistics command and control platform. The role involves designing and operating ... Required : • 5+ years of experience in DevOps, SRE, infrastructure or software engineering roles ...

Showing results 21-40

Ai Infrastructure Engineer information

See Washington salary details

$52.7K

$143.9K

$206.1K

How much do ai infrastructure engineer jobs pay per year?

As of Aug 8, 2026, the average yearly pay for ai infrastructure engineer in Washington is $143,915.00, according to ZipRecruiter salary data. Most workers in this role earn between $121,800.00 and $159,700.00 per year, depending on experience, location, and employer.

How much do AI infrastructure engineers make?

AI infrastructure engineers typically earn between $100,000 and $150,000 annually, depending on experience, location, and company size. Senior roles or those with specialized skills in cloud platforms and hardware may earn higher salaries, often exceeding $180,000.

What does a typical day look like for an AI infrastructure engineer?

A typical day for an AI Infrastructure Engineer often involves designing and maintaining the underlying systems that support machine learning and AI workloads, such as setting up scalable cloud environments, automating workflows with CI/CD pipelines, and troubleshooting performance bottlenecks. You might collaborate closely with data scientists and software engineers to ensure seamless integration between AI models and production infrastructure. Daily activities can include writing and reviewing infrastructure-as-code, monitoring system health, and responding to incidents or scaling requests as needed. This role offers a dynamic mix of hands-on technical work, problem-solving, and teamwork, providing opportunities to refine your skills and contribute meaningfully to cutting-edge AI projects.

What are the key skills and qualifications needed to thrive as an AI infrastructure engineer?

To thrive as an AI Infrastructure Engineer, a strong background in computer science, cloud computing, and distributed systems is typically required, often supported by a degree in a related field. Familiarity with tools like Kubernetes, Docker, TensorFlow, and cloud platforms (AWS, Azure, or GCP), along with certifications in cloud technologies or DevOps, is highly valuable. Strong problem-solving abilities, collaboration, and effective communication skills are essential to excel within multidisciplinary engineering teams. These competencies ensure the reliable deployment, scaling, and optimization of AI workloads in dynamic production environments.

What does an AI infrastructure engineer do?

An AI Infrastructure Engineer designs, builds, and maintains the computing systems that support AI and machine learning workloads. They manage cloud services, optimize hardware and software performance, and ensure scalability for AI models. Their work involves configuring GPUs, CPUs, storage, and networking, as well as automating workflows with DevOps and MLOps tools. They collaborate with data scientists and engineers to streamline AI development and deployment. Their goal is to create reliable, efficient, and scalable AI infrastructure.

What are the most commonly searched types of Ai Infrastructure Engineer jobs in Washington? The most popular types of Ai Infrastructure Engineer jobs in Washington are:
What job categories do people searching Ai Infrastructure Engineer jobs in Washington look for? The top searched job categories for Ai Infrastructure Engineer jobs in Washington are:
Infographic showing various Ai Infrastructure Engineer job openings in Washington as of August 2026, with employment types broken down into 81% Full Time, and 19% Contract. Highlights an 83% In-person, and 17% Remote job distribution, with an average salary of $143,915 per year, or $69.2 per hour.

Principal AI Platform Engineer - AI Center of Excellence

Mastercard, Inc.

Arlington, VA • On-site

Full-time

Medical, Dental, Vision, Life, Retirement, PTO

Posted 14 days ago


Job description

Our Purpose
Mastercard powers economies and empowers people in 200+ countries and territories worldwide. Together with our customers, we're helping build a sustainable economy where everyone can prosper. We support a wide range of digital payments choices, making transactions secure, simple, smart and accessible. Our technology and innovation, partnerships and networks combine to deliver a unique set of products and services that help people, businesses and governments realize their greatest potential.
Title and Summary
Principal AI Platform Engineer - AI Center of Excellence
Who is Mastercard?
Mastercard is a global technology company in the payments industry. Our mission is to connect and power an inclusive, digital economy that benefits everyone, everywhere by making transactions safe, simple, smart, and accessible. Using secure data and networks, partnerships and passion, our innovations and solutions help individuals, financial institutions, governments, and businesses realize their greatest potential.
Our decency quotient, or DQ, drives our culture and everything we do inside and outside of our company. With connections across more than 210 countries and territories, we are building a sustainable world that unlocks priceless possibilities for all.
Overview:
The AI Center of Excellence is seeking a Principal AI Infrastructure Engineer to build and scale next-generation infrastructure supporting Mastercard's growing AI workloads. This role focuses on enabling high-performance, scalable platforms across compute, storage, networking, and accelerators. The ideal candidate is technically deep, highly motivated, and brings an innovative, builder mindset to power advanced AI capabilities across the organization.
About the Role:
• Lead AI infrastructure roadmap for Mastercard's on premise private cloud, spanning strategy, design, procurement, delivery, installation, and lifecycle management, in alignment with enterprise AI priorities and governance frameworks.
• Act as a product owner for AI infrastructure, translating business and data science needs into scalable, future proof platform capabilities that support both predictive ML and generative/agentic AI workloads at enterprise scale.
• Lead RFI and RFP processes for AI infrastructure components, including CPU, GPU, storage, and networking, defining technical and commercial evaluation criteria, reviewing vendor responses, and driving fact based selection decisions in partnership with sourcing and finance teams.
• Architect and scale infrastructure capable of training large scale predictive and generative models on petabytes of data, while supporting low latency inference (real time and batch) with thousands of transactions per second (TPS) across global workloads.
• Define and champion modern AI infrastructure standards, including high performance storage , high speed networking , and advanced data center requirements such as liquid cooling and power dense rack design.
• Partner closely with data science, MLOps, and platform teams to ensure infrastructure choices align with model development, training, deployment, observability, and responsible AI requirements across the AI lifecycle.
• Collaborate cross functionally with enterprise architecture, security, risk, governance, compliance, and legal teams to ensure solutions meet Mastercard's regulatory, resiliency, and ethical AI standards.
• Influence senior leadership and executive stakeholders, clearly articulating trade offs, ROI, and risk, and confidently advocating for the right technical and architectural decisions through structured narratives and executive level presentations.
• Stay ahead of industry trends in AI infrastructure, Generative AI, and Agentic AI, continuously assessing emerging technologies and vendors to inform long term strategy and investment decisions.
All About You:
• Bachelor's degree in Computer Science, Electronics, or a related engineering field is required.
• Significant professional history of experience in large scale infrastructure, platform engineering, or systems architecture roles within a complex enterprise environment.
• Proven experience owning infrastructure roadmaps and driving delivery in on premise or private cloud environments at scale.
• Good working knowledge of AI/ML concepts, data science workflows, MLOps practices, and model lifecycle management.
• Familiarity with Generative AI and Agentic AI architectures, including their unique infrastructure, networking, and latency requirements.
• Deep understanding of compute (CPU/GPU), high performance storage, and networking technologies used in modern AI platforms.
• Hands on or architectural exposure to high density, high power AI infrastructure, including cooling, power, and data center design considerations.
• Strong product thinking-able to balance user needs, technical feasibility, cost, and long term platform evolution.
• Demonstrated experience running RFIs/RFPs, evaluating vendor proposals, and partnering with sourcing and finance teams to make informed investment decisions.
• Comfortable navigating and influencing within a large, matrixed organization, working effectively with security, governance, architecture, and compliance stakeholders.
• Executive ready communicator with the ability to present complex technical topics clearly, persuasively, and credibly to senior leaders.
• Strategic, opinionated, and data driven, with the confidence to challenge assumptions and defend well reasoned design decisions.
• Curious, forward looking, and passionate about building the AI foundations that enable enterprise scale innovation.
#AI1
Mastercard is a merit-based, inclusive, equal opportunity employer that considers applicants without regard to gender, gender identity, sexual orientation, race, ethnicity, disabled or veteran status, or any other characteristic protected by law. We hire the most qualified candidate for the role. In the US or Canada, if you require accommodations or assistance to complete the online application process or during the recruitment process, please contact reasonable_accommodation@mastercard.com and identify the type of accommodation or assistance you are requesting. Do not include any medical or health information in this email. The Reasonable Accommodations team will respond to your email promptly.
Corporate Security Responsibility
All activities involving access to Mastercard assets, information, and networks comes with an inherent risk to the organization and, therefore, it is expected that every person working for, or on behalf of, Mastercard is responsible for information security and must:
  • Abide by Mastercard's security policies and practices;
  • Ensure the confidentiality and integrity of the information being accessed;
  • Report any suspected information security violation or breach, and
  • Complete all periodic mandatory security trainings in accordance with Mastercard's guidelines.

In line with Mastercard's total compensation philosophy and assuming that the job will be performed in the US, the successful candidate will be offered a competitive base salary and may be eligible for an annual bonus or commissions depending on the role. The base salary offered may vary depending on multiple factors, including but not limited to location, job-related knowledge, skills, and experience. Mastercard benefits for full time (and certain part time) employees generally include: insurance (including medical, prescription drug, dental, vision, disability, life insurance); flexible spending account and health savings account; paid leaves (including 16 weeks of new parent leave and up to 20 days of bereavement leave); 80 hours of Paid Sick and Safe Time, 25 days of vacation time and 5 personal days, pro-rated based on date of hire; 10 annual paid U.S. observed holidays; 401k with a best-in-class company match; deferred compensation for eligible roles; fitness reimbursement or on-site fitness facilities; eligibility for tuition reimbursement; and many more. Mastercard benefits for interns generally include: 56 hours of Paid Sick and Safe Time; jury duty leave; and on-site fitness facilities in some locations.
Pay Ranges
Arlington, Virginia: $195,000 - $323,000 USD
Atlanta, Georgia: $170,000 - $281,000 USD
Austin, Texas: $170,000 - $281,000 USD
Boston, Massachusetts: $196,000 - $323,000 USD
Miami, Florida: $170,000 - $281,000 USD
New York City, New York: $204,000 - $337,000 USD
O'Fallon, Missouri: $170,000 - $281,000 USD
Purchase, New York: $196,000 - $323,000 USD
San Francisco, California: $204,000 - $337,000 USD