ZipRecruiter

Log In

1

Distributed Systems Engineer Jobs in Raleigh, NC

SE Engineering, PC

Power System Engineer II

Raleigh, NC · On-site

$83K - $101K/yr

SE Engineering, PC is a specialized power systems engineering firm trusted by industrial, healt ... Design and improve low‐ and medium‐voltage electrical distribution systems * Work with ...

MIT RESOURCE

System Administrator

Raleigh, NC · On-site

Deployments to distributed systems. Software packaging. Testing and working in engineering lab environments. Troubleshooting, identifying, analyzing, and solving problems at customer sites for POS ...

next page

Showing results 1-20

All JobsDistributed Systems Engineer JobsDistributed Systems Engineer Jobs in Raleigh, NC

Distributed Systems Engineer information

See Raleigh, NC salary details

$52K

$123.7K

$162.3K

How much do distributed systems engineer jobs pay per year?

As of Aug 6, 2026, the average yearly pay for distributed systems engineer in Raleigh, NC is $123,656.00, according to ZipRecruiter salary data. Most workers in this role earn between $95,300.00 and $152,600.00 per year, depending on experience, location, and employer.

What are the key skills and qualifications needed to thrive as a distributed systems engineer?

To thrive as a Distributed Systems Engineer, you need a strong background in computer science, experience with large-scale system design, and proficiency in languages such as Java, Go, or Python. Familiarity with cloud platforms (like AWS, GCP, or Azure), container orchestration tools (such as Kubernetes), and distributed databases is commonly required, and certifications in cloud computing can be advantageous. Strong problem-solving abilities, collaboration, and excellent communication skills help you navigate complex issues and work effectively across technical teams. These skills are fundamental for designing, implementing, and maintaining robust distributed systems that perform reliably at scale.

What does a distributed systems engineer do?

A Distributed Systems Engineer designs, builds, and maintains large-scale systems that run across multiple machines or data centers. They ensure reliability, scalability, and fault tolerance by using technologies like cloud computing, containerization, and distributed databases. Their work often involves solving complex problems related to data consistency, network latency, and system coordination.

What are popular job titles related to Distributed Systems Engineer jobs in Raleigh, NC? For Distributed Systems Engineer jobs in Raleigh, NC, the most frequently searched job titles are:
What job categories do people searching Distributed Systems Engineer jobs in Raleigh, NC look for? The top searched job categories for Distributed Systems Engineer jobs in Raleigh, NC are:
Distributed Systems Engineer jobs near you
Infographic showing various Distributed Systems Engineer job openings in Raleigh, NC as of August 2026, with employment types broken down into 94% Full Time, and 6% Contract. Highlights an 87% In-person, and 13% Hybrid job distribution, with an average salary of $123,656 per year, or $59.5 per hour.

Principal Software Engineer, Distributed Systems Engineer - DGX Cloud

NVIDIA

Durham, NC • On-site

Full-time

Re-posted 24 days ago

Nvidia rating

9.6

Company rating: 9.6 out of 10

Based on 17 frontline employees who took The Breakroom Quiz

8th of 242 rated software companies

Job description

Job Summary:
NVIDIA is hiring experienced software engineers with kubernetes experience to help scale up its AI Infrastructure. The role involves working on production systems for large scalable GPU clusters and implementing monitoring capabilities to ensure reliability and performance.
Responsibilities:
• You will be part of an DGX Cloud team responsible for production systems that enable large scalable GPU clusters to be used for a variety of AI workloads. This includes working on custom software related to scheduling GPU resources on kubernetes.
• Implementing monitoring and health management capabilities that enable industry leading reliability, availability, and scalability of GPU assets. You will be harnessing multiple data streams, ranging from GPU hardware diagnostics to cluster and network telemetry.
• Working with teams across NVIDIA to ensure production AI clusters run reliability and consistently with maximum performance. Evaluating system failures and improving services based on a well-defined incident management process.
Qualifications:
Required:
• Significant software engineering experience with kubernetes including cluster operations, operator development, node health monitoring and working with GPU resource scheduling.
• Direct experience in a software engineering role within a highly technical organization with demonstrable impact from your work.
• Software development experience with kubernetes APIs and frameworks not just operating a cluster.
• Highly motivated with strong communication skills, you can work successfully with multi-functional teams, principles, and architects and coordinate effectively across organizational boundaries and geographies.
• 15+ years in similar role and experience on large-scale production systems.
• Experience with common software engineering principles, tools and techniques.
• You possess a BS in Computer Science, Engineering, Physics, Mathematics or a comparable Degree or equivalent experience.
• Technical knowledge, including a systems programming language (Go, Python) and a solid understanding of data structures and algorithms.
Preferred:
• Technical competency in managing and automating large-scale distributed systems independent of cloud providers.
• Advanced hands-on experience and deep understanding of cluster management systems (Kubernetes, Slurm, Bright Cluster Manager).
• Proven operational excellence in maintaining reliable and performant AI infrastructure.
Company:
NVIDIA is a computing platform company operating at the intersection of graphics, HPC, and AI. Founded in 1993, the company is headquartered in Santa Clara, USA, with a team of 10001+ employees. The company is currently Late Stage.

What Nvidia employees say

Pay

Benefits

Hours and flexibility

Workplace

Get the full story on Breakroom

Nvidia logo

About Nvidia

Sourced by ZipRecruiter

NVIDIA has been transforming computer graphics, PC gaming, and accelerated computing for more than 25 years. It's a unique legacy of innovation that's fueled by great technology--and amazing people. Today, we're tapping into the unlimited potential of AI to define the next era of computing. An era in which our GPU acts as the brains of computers, robots, and self-driving cars that can understand the world. Doing what's never been done before takes vision, innovation, and the world's best talent.

Industry

Computer and electronic product manufacturing

Company size

10,000+ Employees

Headquarters location

Santa Clara, CA, US

Year founded

1993

View All Nvidia Jobs

Apply