1

Realtime System Software Engineer Jobs (NOW HIRING)

System Software Engineer - AI

Palo Alto, CA · On-site

$140K - $200K/yr

System Software Engineer - AI About us: We are a stealth‑mode startup building foundational technology to address performance, scalability, and resiliency challenges in large-scale AI data center ...

Collaborate in the software engineering process with documentation, testing, and code review Essential Qualifications * 8+ years of experience in system software engineering and embedded platform

#System Software Engineer - Power

San Diego, CA · On-site

$183K - $217K/yr

Qualcomm's Systems Software Power team is seeking a Power Systems Software Engineer who is passionate about solving complex power challenges and developing innovative solutions to optimize power ...

System/Software Engineer

Lexington, MA · On-site

$194K - $230K/yr

Perform laboratory upgrades (software, desktop components, etc...), create system documentation and author/execute test scripts as needed. Requirement: Role is part of the IT group, deliver work to Q ...

Software Engineer

Jessup, MD · On-site

$170K - $214K/yr

Worker Type Regular Summary The Software Engineer will lead the development, deployment, and ... Strong proficiency in C++ development, including realtime systems and performance optimization.

System Software Engineer (HPC)

Milpitas, CA · On-site

$136K - $231K/yr

## System Software Engineer (HPC)Applylocations: Milpitas, CAtime type: Full timeposted on: Posted Yesterdayjob requisition id: 2637682**Company Overview**KLA is a global leader in diversified ...

System Software Engineer (663286)

Bellevue, WA · On-site

$194K - $230K/yr

Netpace Inc is seeking a System Software Engineer to join their Cloud Storage team, which focuses on the design and implementation of next-generation cloud storage services. The role involves ...

Showing results 41-60

Realtime System Software Engineer information

See salary details

$83K

$177.7K

$206K

How much do realtime system software engineer jobs pay per year?

As of Sep 11, 2026, the average yearly pay for realtime system software engineer in the United States is $177,719.00, according to ZipRecruiter salary data. Most workers in this role earn between $173,000.00 and $205,000.00 per year, depending on experience, location, and employer.

What are popular job titles related to Realtime System Software Engineer jobs?

For Realtime System Software Engineer jobs, the most frequently searched job titles are:

System Software Engineer - AI

Palo Alto, CA • On-site

$140K - $200K/yr

Other

Retirement

Posted 23 days ago


Job description

System Software Engineer - AI

About us:

We are a stealth‑mode startup building foundational technology to address performance, scalability, and resiliency challenges in large-scale AI data center clusters. We are backed by top‑tier VC firms and notable angel investors.

The company is led by experienced builders and operators who have founded companies, taken them to scale, and exited successfully. We work with a strong sense of unity and shared responsibility, and we expect trust, integrity, and respect in how we collaborate and make decisions. We hold ourselves accountable to one another and to the quality of the work we deliver.

We are looking for:

We are looking for a talented System Software Engineer to help us redefine the infrastructure layer of AI. In this role, you will bridge the gap between high‑level AI frameworks and low‑level system software. You will be responsible for designing and implementing the communication and execution primitives that allow large‑scale AI models to run efficiently across thousands of GPUs. We are looking for a "builder" who thrives in the early stages of a product’s lifecycle and is passionate about solving the "hard" systems problems of the generative AI era.

Key Responsibilities:

  • Collaborate across the stack to influence the design of our foundational technology, ensuring it meets the needs of next‑generation AI models.
  • Identify and resolve performance bottlenecks in distributed training and inference workloads through deep‑Dive analysis of the software‑hardware interface.
  • Conduct rigorous performance benchmarking and characterization on multi‑node clusters.

Required Skills and Qualifications:

  • Strong proficiency in C++ and Python, with a deep understanding of systems programming fundamentals (memory management, concurrency, OS internals).
  • Proficient in a Linux development environment.

Desired Skills:

  • Experience with GPU programming (CUDA) and performance optimization for parallel architectures.
  • Familiarity with distributed AI frameworks (PyTorch, JAX, or DeepSpeed) and/or inference engines (vLLM, SGLang, Dynamo/TRT‑LLM).
  • Hands‑on experience with large‑scale cluster orchestration and telemetry tools.

Education:

  • Bachelor's or Master's degree in Computer Engineering, Computer Science, or a related field.

Location:

This is a hybrid role based in Palo Alto or Charlottesville, VA.

Compensation:

Target base salary for this role is $140,000 - $200,000 per year + meaningful equity + benefits + 401k. Our salary ranges are determined by role, level, experience, and location.

We are an equal opportunity employer. We value a range of perspectives and experiences and make employment decisions based on merit and business needs. We do not discriminate on the basis of legally protected characteristics.

#J-18808-Ljbffr