1

Senior Infrastructure Engineer Jobs in Needham, MA

Linux Infrastructure Engineer

Boston, MA · On-site

$120K - $150K/yr

Join our Infrastructure team as a Senior Linux Infrastructure Engineer and help shape the secure, reliable, and high-performing systems that power our business. As a Linux subject matter expert, you ...

Linux Infrastructure Engineer

Boston, MA · On-site

$117K - $153K/yr

Join our Infrastructure team as a Senior Linux Infrastructure Engineer and help shape the secure, reliable, and high-performing systems that power our business. As a Linux subject matter expert, you ...

Senior Platform Engineer

Boston, MA · On-site

$117K - $160K/yr

HCL Global Systems Inc is seeking a Senior Platform Engineer to lead the design, automation, and ... The role involves building and managing modern compute platforms, implementing Infrastructure-as ...

Senior Platform Engineer - Kubernetes

Boston, MA · On-site

$117K - $160K/yr

The Senior Platform Engineer will play a key role in driving large-scale architecture projects and ... AWS infrastructure • Drive architectural decisions to improve scalability, resiliency ...

Additionally, the program features regular networking sessions that facilitate exposure to senior ... Collaborate with infrastructure engineers, application teams, operations teams, architecture ...

New

As a Senior Platform Engineer on the AI Devex team, you will play a key role in driving our cloud ... Design, develop, and operate Kubernetes clusters running on AWS infrastructure * Drive ...

Infrastructure Engineer [2027 EDGE Program]

Boston, MA · On-site

$116K - $153K/yr

Additionally, the program features regular networking sessions that facilitate exposure to senior ... Collaborate with infrastructure engineers, application teams, operations teams, architecture ...

New

As a Senior Platform Engineer on the AI Devex team, you will play a key role in driving our cloud ... Design, develop, and operate Kubernetes clusters running on AWS infrastructure * Drive ...

Showing results 41-60

Senior Infrastructure Engineer information

See Needham, MA salary details

$24.5K

$138.3K

$191.2K

How much do senior infrastructure engineer jobs pay per year?

As of Sep 2, 2026, the average yearly pay for senior infrastructure engineer in Needham, MA is $138,316.00, according to ZipRecruiter salary data. Most workers in this role earn between $118,200.00 and $160,700.00 per year, depending on experience, location, and employer.

What is a senior infrastructure engineer?

Senior Infrastructure Engineers are experienced IT professionals responsible for designing, implementing, maintaining, and optimizing an organization’s core technology infrastructure. This includes servers, networks, cloud environments, and related systems that support business operations. They often lead projects, troubleshoot complex issues, and ensure the reliability, security, and scalability of the infrastructure. In addition to technical expertise, they may mentor junior engineers and collaborate with other departments to align technology with business goals.

What are some common challenges faced by senior infrastructure engineers when supporting large-scale systems?

Senior Infrastructure Engineers often encounter challenges such as ensuring high availability and reliability of systems, managing complex migrations, and optimizing performance under heavy workloads. Coordinating with development and security teams is essential to implement infrastructure changes without disrupting services. Additionally, staying ahead of evolving technologies and automating routine tasks can be demanding but crucial for efficiency and scalability. Successfully navigating these challenges requires strong technical expertise, proactive problem-solving, and effective cross-team communication.

What are the key skills and qualifications needed to thrive as a senior infrastructure engineer, and why are they important?

To thrive as a Senior Infrastructure Engineer, you need deep expertise in network architecture, server management, cloud platforms, and a relevant degree or certifications like AWS Certified Solutions Architect or Microsoft Certified: Azure Administrator. Proficiency with infrastructure-as-code tools (e.g., Terraform, Ansible), virtualization platforms, and monitoring systems is typical in this role. Strong problem-solving skills, leadership, and effective communication help you manage complex projects and collaborate across teams. These skills ensure reliable, secure, and scalable IT environments that support organizational goals.

What is the difference between Senior Infrastructure Engineer vs Network Engineer?

AspectSenior Infrastructure EngineerNetwork Engineer
CredentialsBachelor's in Computer Science or related, certifications like Cisco CCNA/CCNP, AWS, or AzureBachelor's in Computer Science or related, Cisco CCNA/CCNP, CompTIA Network+
Work EnvironmentDesigning, implementing, and maintaining IT infrastructure, servers, cloud servicesConfiguring, managing, and troubleshooting network hardware and connectivity
Employer & Industry UsageTech companies, data centers, large enterprisesTelecommunications, IT service providers, corporate networks

While both roles require networking knowledge and certifications, Senior Infrastructure Engineers focus on overall infrastructure design and cloud integration, whereas Network Engineers specialize in network hardware and connectivity. The Senior Infrastructure Engineer role is broader, often overseeing multiple systems, while Network Engineers concentrate on network-specific tasks.

How much do senior infrastructure engineers make?

Senior infrastructure engineers typically earn between $90,000 and $150,000 annually, depending on experience, location, and industry. They often possess skills in cloud platforms, networking, and automation tools, which can influence salary levels.

What cities near Needham, MA are hiring for Senior Infrastructure Engineer jobs?

Cities near Needham, MA with the most Senior Infrastructure Engineer job openings:

Infographic showing various Senior Infrastructure Engineer job openings in Needham, MA as of August 2026, with employment types broken down into 87% Full Time, 8% Part Time, and 5% Contract. Highlights an 87% Physical, 4% Hybrid, and 9% Remote job distribution, with an average salary of $138,316 per year, or $66.5 per hour.

Senior AI infrastructure engineer - EDA Infrastructure

Nvidia

Westford, MA

$112K - $153K/yr

Full-time

Posted 2 days ago

New


Nvidia rating

9.6

Company rating: 9.6 out of 10

Based on 18 frontline employees who took The Breakroom Quiz

6th of 247 rated software companies


Job description

AI Infrastructure Engineers at NVIDIA build the systems, tooling, and data infrastructure that enable operation of our GPU cloud services. We are enabling engineering teams to innovate while proactively identifying, tracking, and mitigating risks across the entire technical task.

This role is ideal for engineers who thrive at the intersection of product, infrastructure, and software engineering and who want to build automated, intelligence-driven systems that protect NVIDIA's most critical AI platforms.

What you'll be doing:

Telemetry

  • Build and operate scalable telemetry pipelines for metrics, logs, traces, and events across on-premise, CSP, and NCP clusters.

  • Establish common instrumentation, collection, storage, and access patterns so teams can generate and consume telemetry consistently.

  • Deliver dashboards, alerting, and analysis capabilities that improve service visibility, detection, and troubleshooting.

Operational Excellence

  • Standardize and automate incident, maintenance, service on-call, and support on-call workflows across HWInf.

  • Integrate operational data and lifecycle signals to improve ownership, escalation, communication, and post-incident learning.

  • Build reporting and AI-assisted tooling that reduces manual toil and improves operational responsiveness.

Cataloging and Inventory

  • Build and maintain physical hardware and software catalogs as trusted sources of truth for infrastructure inventory, service ownership, dependencies, and documentation.

  • Create consistent data models and integration pipelines that connect clusters, hardware, services, teams, and operational workflows.

  • Provide self-service discovery capabilities so engineers can quickly identify what they operate, who owns it, and how to support it.

What we need to see:

  • BS degree in Computer Science, Computer Engineering, or a related technical field, or equivalent experience.

  • 8+ years of experience in infrastructure security, platform engineering, or security tooling.

  • Proficiency in one or more programming languages such as Python, Go, Typescript, or Java.

  • Strong understanding of software and infrastructure principles, with experience applying them in production environments.

  • Ability to lead cross-functional initiatives that span internal teams and external partners in varying disciplines across engineering, product, finance, and security.

Ways to stand out from the crowd:

  • Experience building and operating incident-management processes with internally built and/or externally vended SaaS tools

  • Experience working with building, deploying, and maintaining ML models in production systems along with familiarity with AI agent frameworks or orchestration tools

  • Experience building and operating modern observability platforms to deliver scalable metrics, logs, traces, and profilingExperience working with service catalog and configuration management databases (CMDB)

NVIDIA is widely considered to be one of the technology world's most desirable employers. We have some of the most forward-thinking and hard-working people in the world working for us. Are you creative and autonomous? Do you love a challenge? If so, we want to hear from you. NVIDIA is leading the way in groundbreaking developments in Artificial Intelligence, High-Performance Computing and Visualization. The GPU, our invention, serves as the visual cortex of modern computers and is at the heart of our products and services. If you're creative and self-motivated, we want to hear from you! NVIDIA is leading the way in groundbreaking developments in Artificial Intelligence, High-Performance Computing and Visualization. The GPU, our invention, serves as the visual cortex of modern computers and is at the heart of our products and services.

Your base salary will be determined based on your location, experience, and the pay of employees in similar positions. The base salary range is 184,000 USD - 287,500 USD for Level 4, and 224,000 USD - 356,500 USD for Level 5.

You will also be eligible for equity and benefits.

Applications for this job will be accepted at least until September 4, 2026.

This posting is for an existing vacancy.

NVIDIA uses AI tools in its recruiting processes.

NVIDIA is committed to fostering an inclusive work environment and proud to be an equal opportunity employer. As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law.

What Nvidia employees say

Pay

Benefits

Hours and flexibility

Workplace

Get the full story on Breakroom


Nvidia logo

About Nvidia

Sourced by ZipRecruiter

NVIDIA has been transforming computer graphics, PC gaming, and accelerated computing for more than 25 years. It's a unique legacy of innovation that's fueled by great technology--and amazing people. Today, we're tapping into the unlimited potential of AI to define the next era of computing. An era in which our GPU acts as the brains of computers, robots, and self-driving cars that can understand the world. Doing what's never been done before takes vision, innovation, and the world's best talent.

Industry

Computer and electronic product manufacturing

Company size

10,000+ Employees

Headquarters location

Santa Clara, CA, US