ZipRecruiter

Log In

2

Remote Hpc System Engineer Jobs in Boston, MA (NOW HIRING)

Databento

Systems Engineer

Boston, MA · On-site +1

We accommodate 100% remote work, with teammates living around the globe and paid in their local ... Prior internship experience or 2+ years in full-time systems engineering or infrastructure roles.

Booz Allen Hamilton, Inc.

IT Systems Engineer

Lexington, MA · On-site +1

$86K - $198K/yr

  • Medical

  • Life

  • Retirement

  • PTO

Remote Work: No Job Number: R0246290 Location: Lexington,MA,US Share job via: Share IT Systems Engineer The Opportunity: Are you looking for an opportunity to combine your technical skills with big ...

Motional

Machine Learning Systems Engineer

Boston, MA · On-site +1

$144K - $192K/yr

  • Medical

  • Dental

  • Vision

  • Life

  • Retirement

... be fully remote. The salary range for this role is an estimate based on a wide range of ... All newly-hired employees are queried through this electronic system established by the DHS and the ...

Motional

Machine Learning Systems Engineer

Boston, MA · On-site +1

$144K - $192K/yr

... be fully remote. The salary range for this role is an estimate based on a wide range of ... All newly-hired employees are queried through this electronic system established by the DHS and the ...

Johnson Controls

Sr. Sales Engineer, Data Center

Burlington, MA · On-site +1

$60 - $77.50/hr

  • Medical

  • Dental

  • Vision

  • Retirement

  • PTO

... AI, HPC, and mission-critical systems. JCI has built the industry's leading thermal management ... This role can be either remote or on-site at our Burlington, MA office. What We Offer:

previous pagenext page

Showing results 21-40

All JobsHpc System Engineer JobsRemote Hpc System Engineer JobsRemote Hpc System Engineer Jobs in Boston, MA

Remote Hpc System Engineer information

See Boston, MA salary details

$58.1K

$138.2K

$181.4K

How much do remote hpc system engineer jobs pay per year?

As of Aug 15, 2026, the average yearly pay for remote hpc system engineer in Boston, MA is $138,206.00, according to ZipRecruiter salary data. Most workers in this role earn between $106,500.00 and $170,600.00 per year, depending on experience, location, and employer.

What are the key skills and qualifications needed to thrive as a remote HPC system engineer?

To thrive as a Remote HPC System Engineer, you need expertise in Linux system administration, parallel computing, networking, and a degree in computer science or related field. Familiarity with job schedulers (like Slurm), cluster management tools, scripting languages (such as Python or Bash), and certifications like CompTIA Linux+ or Red Hat Certified Engineer are highly valuable. Strong problem-solving abilities, effective communication, and self-motivation are essential soft skills for remote collaboration and troubleshooting. These skills ensure the reliable operation, optimization, and scalability of HPC systems in distributed environments.

What are some common challenges faced by remote HPC system engineers, and how can they be managed effectively?

Remote HPC System Engineers often encounter challenges such as troubleshooting complex hardware or software issues without physical access, ensuring seamless system performance, and coordinating with geographically dispersed teams. These can be managed by leveraging strong remote monitoring tools, maintaining clear documentation, and establishing effective communication channels with on-site staff. Proactively scheduling regular system health checks and participating in virtual team meetings can also help address problems quickly and maintain high system reliability.

What is the difference between Remote Hpc System Engineer vs Remote Cloud Infrastructure Engineer?

AspectRemote Hpc System EngineerRemote Cloud Infrastructure Engineer
CredentialsTypically requires Linux certifications, HPC-specific trainingOften requires cloud platform certifications (AWS, Azure, GCP)
Work EnvironmentHigh-performance computing clusters, research labsCloud platforms, data centers, virtualized environments
Industry UsageResearch, scientific computing, academiaTech, finance, enterprise IT
Search/Comparison IntentUnderstanding HPC-specific roles vs cloud rolesComparing on-premise HPC vs cloud infrastructure

The Remote Hpc System Engineer focuses on managing and optimizing high-performance computing clusters, often in research or scientific environments. In contrast, the Remote Cloud Infrastructure Engineer specializes in designing and maintaining cloud-based infrastructure across various industries. While both roles require technical expertise in system management, their environments and certifications differ, catering to distinct operational needs.

What is a remote HPC system engineer?

Remote HPC (High Performance Computing) System Engineers are IT professionals who design, implement, manage, and troubleshoot HPC systems and clusters from a remote location. They work with advanced computing infrastructure that supports scientific research, complex simulations, and large-scale data processing. Their responsibilities include configuring hardware and software, monitoring system performance, ensuring security, and providing technical support to users, all while working off-site. This role requires strong expertise in HPC technologies, operating systems like Linux, networking, and scripting, as well as effective communication skills for collaborating with distributed teams.

What are popular job titles related to Remote Hpc System Engineer jobs in Boston, MA?

For Remote Hpc System Engineer jobs in Boston, MA, the most frequently searched job titles are:

What job categories do people searching Remote Hpc System Engineer jobs in Boston, MA look for?

The top searched job categories for Remote Hpc System Engineer jobs in Boston, MA are:

What cities near Boston, MA are hiring for Remote Hpc System Engineer jobs?

Cities near Boston, MA with the most Remote Hpc System Engineer job openings:

Remote Hpc System Engineer jobs near you
Infographic showing various Remote Hpc System Engineer job openings in Boston, MA as of August 2026, with employment types broken down into 1% As Needed, 82% Full Time, 13% Part Time, and 4% Contract. Highlights an 92% Physical, 2% Hybrid, and 6% Remote job distribution, with an average salary of $138,206 per year, or $66.4 per hour.

AI Infrastructure Engineer

Bright Vision Technologies

Lexington, MA • On-site, Remote

$160K/yr

Full-time

This job post has expired 1 day ago. Applications are no longer accepted.

Job description

AI Infrastructure Engineer – Remote
Bright Vision Technologies is a technology consulting and software development company delivering cloud, AI, data, and enterprise solutions across the United States.
This is a fantastic opportunity to join an established and well-respected organization offering tremendous career growth potential.
Job Title: AI Infrastructure Engineer
Location: 100% Remote (U.S.)
Position Type: Full-time, Direct W2
Salary Range: $100,000–$160,000 Annually
Experience Required: 10+ years
Sponsorship: U.S. Citizens, Green Card Holders, EAD Holders, and H-1B transfer candidates are encouraged to apply. We are unable to sponsor new H-1B visa petitions for this position.
Job Summary:We are seeking an AI Infrastructure Engineer to design, build, and operate the platform layer that powers large-scale AI training and inference workloads. The role focuses on GPU clusters, distributed training frameworks, scheduling, storage performance, and developer experience for ML engineers and researchers, with strong emphasis on reliability, efficiency, and cost control. The ideal candidate has built or operated production AI infrastructure at scale, understands the interaction between hardware, kernel, scheduler, and ML framework, and brings strong software engineering discipline to platform work.
Key Responsibilities
  • Design and operate GPU and accelerator infrastructure for training and inference, spanning on-prem clusters, cloud-managed services, and hybrid configurations.
  • Build scheduling, queueing, and resource-sharing systems that maximize accelerator utilization across many teams.
  • Integrate frameworks such as PyTorch, JAX, DeepSpeed, FSDP, Megatron-LM, and Ray Train into a unified platform offering.
  • Operate high-performance storage systems and data pipelines that keep accelerators fed with training data at near-line-rate.
  • Design networking architectures supporting RDMA, InfiniBand, NCCL, and high-bandwidth collective communication.
  • Build observability for AI workloads including utilization, throughput, training stability, and failure-mode analytics.
  • Implement checkpointing, restart, and fault-tolerance patterns for long-running training jobs at scale.
  • Drive cost optimization across compute, storage, and networking through scheduling, spot capacity, and right-sizing.
  • Develop developer tooling and paved-road workflows that let researchers launch experiments safely and efficiently.
  • Partner with research and applied ML teams to plan capacity for upcoming training runs.
  • Implement security controls, isolation, and access management for multi-tenant AI infrastructure.
  • Drive automation across cluster provisioning, lifecycle management, and configuration enforcement.
  • Maintain runbooks, capacity dashboards, and operational documentation for the AI platform.
  • Stay current with AI infrastructure research, accelerator hardware, and emerging open-source AI tooling.
Required Qualifications
  • Bachelor’s or Master’s degree in Computer Science or a related field.
  • Ten or more years of experience in infrastructure, platform, or HPC engineering.
  • Hands-on experience operating GPU clusters or large-scale ML training infrastructure.
  • Strong proficiency in Python and at least one systems language such as Go or C++.
  • Deep understanding of distributed training, accelerator architectures, and collective communication.
  • Experience with Kubernetes, Slurm, Ray, or similar scheduling systems for ML workloads.
  • Strong understanding of Linux internals, networking, and high-performance storage.
  • Experience with at least one major cloud provider’s ML infrastructure offerings.
  • Strong software engineering practices including testing, CI/CD, and code review.
  • Excellent communication and cross-functional collaboration skills.
Preferred Qualifications
  • Experience operating InfiniBand or RDMA networking at scale.
  • Contributions to open-source ML infrastructure projects.
  • Familiarity with custom orchestrators or research-grade training stacks.
  • Exposure to frontier model training operations.
  • Experience with FinOps for AI workloads.
How to Apply
Would you like to know more about this opportunity? For immediate consideration, please send your resume to venkat.r@bvteck.com or contact us at (908) 505-3899. Learn more about Bright Vision Technologies at www.bvteck.com.
Bright Vision Technologies is an Equal Opportunity Employer.
 

Equal Employment Opportunity (EEO) Statement

Bright Vision Technologies (BV Teck) is committed to equal employment opportunity (EEO) for all employees and applicants without regard to race, color, religion, sex, sexual orientation, gender identity or expression, national origin, age, genetic information, disability, veteran status, or any other protected status as defined by applicable federal, state, or local laws. This commitment extends to all aspects of employment, including recruitment, hiring, training, compensation, promotion, transfer, leaves of absence, termination, layoffs, and recall.

BV Teck expressly prohibits any form of workplace harassment or discrimination. Any improper interference with employees\' ability to perform their job duties may result in disciplinary action up to and including termination of employment.

Apply