ZipRecruiter

Log In

2

Remote Linux System Engineer Jobs in California (NOW HIRING)

Biohub

Staff HPC Engineer

San Francisco, CA · On-site +1

... remote dev, containerization, MLOps workflows). What You'll Bring Essential * Bachelor's or ... Technical * Advanced Linux systems administration, HPC networking (Infiniband, Ethernet), and ...

Leidos

Software Engineer

San Diego, CA · On-site +1

$87K - $157K/yr

... ocean remote sensing, and high-performance computing . We're looking for a Software Engineer ... Engineer high-performance backend systems for scientific computing and distributed environments.

Leidos

Software Engineer

San Diego, CA · On-site +1

$69K - $125K/yr

... ocean remote sensing, and high-performance computing . We're looking for a Software Engineer ... Engineer high-performance backend systems for scientific computing and distributed environments.

Broadcom

AI Systems Performance Engineer

San Jose, CA · Remote

$141K - $226K/yr

If you possess a deep understanding of Ethernet fabric, machine learning system demands, and Linux ... Experience with RDMA (Remote Direct Memory Access) and RoCEv2 (RDMA over Converged Ethernet)

Qualitest Group

System Quality Engineer

Santa Clara, CA · Remote

US (Remote) Must-haves: 1.Experience in project quality assurance, governance, or systems engineering 2.Strong understanding of risk management, project lifecycle, and quality processes 3.Experience ...

SAIC

MBSE Systems Engineer

San Diego, CA · On-site +1

$160K - $200K/yr

None Potential for Remote Work: ORA_ON_SITE Description SAIC is seeking a cleared MBSE Systems Engineer who is a current Model-Based Engineering practitioner to support a portfolio of Battlespace ...

iXsystems

Tier 2 Support Engineer

Los Angeles, CA · On-site +1

$60K - $80K/yr

This is a remote position in Los Angeles, CA area. Base Pay Range The base pay range of this ... Strong Linux systems administration skills and experience with open source technologies

next page

Showing results 1-20

All JobsLinux System Engineer JobsRemote Linux System Engineer JobsRemote Linux System Engineer Jobs in California

Remote Linux System Engineer information

What is a Remote Linux System Engineer?

A Remote Linux System Engineer is an IT professional who specializes in managing, configuring, and maintaining Linux-based servers and systems while working from a remote location. Their responsibilities include system installation, updates, troubleshooting, security management, and performance tuning. They often work with cloud platforms, automation tools, and scripting to ensure the reliable and secure operation of Linux environments. Remote Linux System Engineers collaborate with other IT staff and may provide technical support to end-users or clients. This role requires strong problem-solving skills and a deep understanding of Linux operating systems.

What are the key skills and qualifications needed to thrive as a Remote Linux System Engineer, and why are they important?

To thrive as a Remote Linux System Engineer, you need in-depth knowledge of Linux operating systems, scripting languages (such as Bash or Python), and a degree in computer science or related field. Familiarity with configuration management tools (like Ansible or Puppet), cloud platforms (such as AWS or Azure), and relevant certifications (e.g., RHCE, CompTIA Linux+) are typically required. Strong problem-solving skills, effective communication, and self-motivation are essential for remote collaboration and troubleshooting. These skills ensure secure, efficient, and reliable system operations in distributed, enterprise environments.

What is the difference between Remote Linux System Engineer vs Remote Network Administrator?

AspectRemote Linux System EngineerRemote Network Administrator
CertificationsLinux certifications (e.g., RHCE, CompTIA Linux+)Network certifications (e.g., Cisco CCNA, CompTIA Network+)
Work EnvironmentServer management, cloud platforms, scriptingNetwork infrastructure, routers, switches, firewalls
Industry UsageIT, cloud services, hosting providersTelecommunications, enterprise networks, data centers

The Remote Linux System Engineer primarily focuses on managing Linux servers, automation, and cloud environments, while the Remote Network Administrator handles network infrastructure, configuration, and security. Both roles require technical certifications and often work remotely in IT and tech industries, but their core responsibilities differ in system versus network management.

What are some common challenges faced by Remote Linux System Engineers, and how can they be addressed?

Remote Linux System Engineers often encounter challenges related to communication and troubleshooting without physical access to hardware. Effective collaboration tools and clear documentation are essential for working efficiently with distributed teams. Additionally, setting up secure remote access and monitoring systems can help quickly identify and resolve issues. Regular virtual meetings and proactive communication with team members also play a crucial role in ensuring operational continuity and minimizing downtime.
What are the most commonly searched types of Linux System Engineer jobs in California? The most popular types of Linux System Engineer jobs in California are:
What are popular job titles related to Remote Linux System Engineer jobs in California? For Remote Linux System Engineer jobs in California, the most frequently searched job titles are:
What job categories do people searching Remote Linux System Engineer jobs in California look for? The top searched job categories for Remote Linux System Engineer jobs in California are:
What cities in California are hiring for Remote Linux System Engineer jobs? Cities in California with the most Remote Linux System Engineer job openings:
Remote Linux System Engineer jobs near you

Staff HPC Engineer

Biohub

San Francisco, CA • On-site, Remote

Full-time

Retirement, PTO

Re-posted 18 days ago

Job description

Biohub is the first large-scale initiative bringing frontier AI models, massive compute, and frontier experimental capabilities under one roof. We're building a general-purpose system to accelerate scientific discovery, integrating frontier AI models, biological foundation models, and lab capabilities, with the ultimate goal of curing disease. Our technology powers scientists around the world, translating AI capabilities into tools that accelerate research everywhere.
The Team
The HPC Engineering team is part of the AI Compute Platform organization at Biohub, a non-profit research lab committed to open science and open-source AI. We own the design, operation, and reliability of hybrid GPU AI clusters that power frontier AI biology research: protein language models, genomic foundation models, and scientific reasoning systems built to be shared. Our infrastructure supports day-to-day AI researcher workflows. The team works at the intersection of AI tooling, distributed systems, HPC, and frontier AI, debugging deep AI infrastructure problems and building AI systems critical to the entire AI organization.
The Opportunity
We seek a Staff HPC Engineer to help lead the evolution of our advanced computing infrastructure into a next-generation hybrid HPC and AI platform. This role will help shape strategy, architecture, and operations for high-performance computing resources - including cutting-edge GPUs, large-scale storage, and high-speed networks - while enabling transformative science through AI and machine learning at scale.
You will design, implement, and optimize a unified HPC-AI ecosystem blending on-prem Slurm-managed clusters, cloud GPU resources, and containerized environments. This hybrid environment will power everything from traditional HPC workloads to large AI training jobs, generative model development, real-time inference, and data-intensive pipelines.
The successful candidate will be a thought leader in HPC infrastructure , capable of partnering with scientists, computational biologists, and software engineers to translate complex research needs into high-impact computing solutions. You will also foster adoption of emerging AI tools, and ensure our systems can scale to meet the demands of next-generation biomedical research.
What You'll Do
HPC Engineering
  • Build and support a hybrid HPC-AI environment with large-scale on-prem compute/storage and elastic cloud GPU clusters (Coreweave, AWS, GCP).
  • Architect and optimize environments for large-scale AI training and tuning, and low-latency scientific workloads.
  • Integrate MLOps and model deployment pipelines into HPC infrastructure, ensuring reproducibility and efficiency.
  • Implement advanced resource scheduling and orchestration (Slurm, Kubernetes, SUNK) optimized for mixed HPC and AI workflows.

Operational Excellence
  • Support researchers with job optimization, GPU utilization best practices, and performance tuning for AI and HPC applications.
  • Evaluate, deploy, and maintain AI/ML software stacks (e.g., PyTorch, TensorFlow, Hugging Face, RAPIDS) and HPC toolchains.
  • Ensure robust data ingest, analysis, and management capabilities for AI and HPC workloads, including integration with parallel file systems and object storage.

Collaboration & Enablement
  • Work with diverse science teams to translate research requirements into hardware/software solutions, from experimental design through publication.
  • Promote best practices for AI model training, validation, and deployment in shared computing environments.
  • Foster a culture of shared learning by running internal workshops on HPC-AI tooling (e.g., VS Code remote dev, containerization, MLOps workflows).
What You'll Bring
Essential
  • Bachelor's or advanced degree in Computer Science, AI/ML, Data Science, Systems Engineering, or related field.
  • 10+ years building and managing HPC infrastructure, with significant experience integrating AI/ML workloads.
  • Proven track record architecting environments for large-scale GPU AI training and inference in hybrid on-prem/cloud environments.
  • Deep expertise with HPC scheduling (Slurm), container orchestration (Kubernetes), and cloud GPU services.
  • Strong hands-on experience with AI frameworks (PyTorch, TensorFlow, JAX) and distributed training strategies (Horovod, DeepSpeed, Ray).
  • Knowledge of MLOps best practices, including CI/CD for ML, model registry, experiment tracking, and performance monitoring.
  • Exceptional ability to collaborate with multidisciplinary teams and communicate complex technical concepts clearly.
  • Demonstrated leadership in guiding infrastructure teams, influencing organizational strategy, and fostering adoption of new technologies.

Technical
  • Advanced Linux systems administration, HPC networking (Infiniband, Ethernet), and storage systems administration (VAST Lustre, Weka and ZFS)
  • Cloud platform expertise (Coreweave, AWS, GCP) including GPU provisioning, storage, and networking for AI workloads.
  • Proficiency in automation tools (Terraform, Ansible, Puppet), containerization (Docker, Singularity), and orchestration frameworks.
  • Strong experience debugging and troubleshooting hardware across the stack (network, GPU, compute and storage systems).
  • Strong scripting/programming skills (Python, Bash) and familiarity with version control (Git).
  • Experience integrating AI LLMs, AI coding assistants, and custom model development into HPC workflows.
Compensation
The San Francisco, CA base pay range for a new hire in this role is for a Staff HPC Engineer 214,000-$268,000 and for a Senior Staff HPC Engineer $241,000-$300,000.New hires are typically hired into the lower portion of the range, enabling employee growth in the range over time. Actual placement in range is based on job-related skills and experience, as evaluated throughout the interview process.
This position may be eligible to participate in our discretionary annual performance bonus program. Bonus eligibility and targets are determined in accordance with our total rewards philosophy and may vary by role.
Better Together
As we grow, we're excited to strengthen in-person connections and cultivate a collaborative, team-oriented environment. This role is a hybrid position requiring you to be onsite for at least 60% of the working month, approximately 3 days a week, with specific in-office days determined by the team's manager. The exact schedule will be at the hiring manager's discretion and communicated during the interview process.
Benefits for the Whole You
We're thankful to have an incredible team behind our work. To honor their commitment, we offer a wide range of benefits to support the people who make all we do possible.
  • Provides a generous employer match on employee 401(k) contributions to support planning for the future.
  • Paid time off to volunteer at an organization of your choice.
  • Funding for select family-forming benefits.
  • Relocation support for employees who need assistance moving

If you're interested in a role but your previous experience doesn't perfectly align with each qualification in the job description, we still encourage you to apply as you may be the perfect fit for this or another role.
#LI-Hybrid

Apply