2

Remote Linux Engineer Jobs in Boston, MA (NOW HIRING)

Conduct remote calls to discuss prospective business and technical fit with Tufin Solution ... Knowledge & Experience in Linux(desired) * Knowledge & Experience with scripting (Bash, Python ...

Engineering Manager - DevOps

Boston, MA ยท Remote

$54 - $74/hr

LiveData Explained Engineering Manager - Dev Ops LiveData | Remote, United States (Eastern Time ... Strong working knowledge of Linux, networking fundamentals, and shell-based troubleshooting.

Engineering Manager - DevOps

Boston, MA ยท On-site +1

$57.25 - $78.50/hr

LiveData Explained Engineering Manager - Dev Ops LiveData Remote, United States (Eastern Time ... Strong working knowledge of Linux, networking fundamentals, and shell-based troubleshooting.

Strong Linux experience and familiarity with firewall, routing, and DNS security * Understanding ... This is a remote role JR: 2026-8009 #LI-Remote Why You'll Like Working for DigitalOcean * We ...

Systems Engineer

Boston, MA ยท On-site +1

We accommodate 100% remote work, with teammates living around the globe and paid in their local ... Strong Linux knowledge. * Experience with systems configuration and provisioning (PXE, Puppet, and ...

You will also work with cross-functional teams work with developers, Product Managers and Remote QA ... Hands-on experience with Linux/Unix operating systems * Solid understanding of backup and ...

Machine Learning Engineer

Boston, MA ยท On-site +1

$136K - $225K/yr

For positions with Remote-US locations, the actual salary range for the position may differ based ... Linux, cloud, container, and Kubernetes technologies. Spread across 40+ countries, our associates ...

Embedded Software Engineer

Somerville, MA ยท On-site +1

$143K - $188K/yr

C++, Python, Embedded Linux, and the occasional dip into Javascript. You: * Have professional ... remote procedure calls * Architect code that your fellow software engineers are excited to use and ...

Principal DevOps Engineer

Waltham, MA ยท On-site +1

$137K - $220K/yr

Strong understanding of Linux, networking, IAM, and cloud security fundamentals. * Experience using ... This role is based out of Evolv's HQ in Waltham, Massachusetts, with limited flexibility for remote ...

Senior Software Engineer - File System

Boston, MA ยท On-site +1

$133K - $175K/yr

Familiarity with Linux kernel internals, VFS, inode structures, POSIX semantics, FUSE, or eBPF ... Flexible remote work policy * 10 Paid Holidays * Wide array of wellbeing offerings * Pre-tax ...

Showing results 41-60

Remote Linux Engineer information

See Boston, MA salary details

$11

$64

$99

How much do remote linux engineer jobs pay per hour?

As of Aug 17, 2026, the average hourly pay for remote linux engineer in Boston, MA is $64.90, according to ZipRecruiter salary data. Most workers in this role earn between $52.21 and $72.88 per hour, depending on experience, location, and employer.

What is a remote Linux engineer?

A Remote Linux Engineer is an IT professional responsible for designing, implementing, and maintaining Linux-based systems and servers while working remotely. They handle system administration tasks, troubleshoot issues, optimize performance, and ensure security and stability. This role often involves working with cloud platforms, automation tools, and scripting languages to manage infrastructure efficiently. Remote Linux Engineers collaborate with teams using communication tools and may support DevOps, networking, or cybersecurity functions based on business needs.

What are the key skills and qualifications needed to thrive as a remote Linux engineer?

To thrive as a Remote Linux Engineer, you need a solid understanding of Linux systems administration, networking, scripting languages (such as Bash or Python), and troubleshooting, often backed by a degree in computer science or related certifications like RHCE or CompTIA Linux+. Familiarity with tools like Docker, Ansible, Kubernetes, and virtualization platforms is typically required. Excellent problem-solving abilities, self-motivation, and strong written communication are essential soft skills for remote collaboration and effective support. These skills and qualities are vital to ensuring reliable system performance, efficient remote operations, and seamless teamwork across distributed environments.

What are common challenges faced by remote Linux engineers and how are they typically addressed?

Remote Linux Engineers often encounter challenges such as troubleshooting complex system issues without on-site access, maintaining secure remote connections, and staying aligned with distributed team members. These challenges are typically addressed through advanced remote monitoring tools, comprehensive documentation, and regular virtual meetings for knowledge sharing and collaboration. Effective time management and continuous learning are also crucial for staying updated on emerging technologies and best practices. Organizations often provide clear escalation paths and encourage peer support to help engineers resolve critical incidents quickly. Being proactive and adaptable helps ensure both productivity and strong system reliability in a remote environment.

What are the most commonly searched types of Linux Engineer jobs in Boston, MA?

The most popular types of Linux Engineer jobs in Boston, MA are:

What are popular job titles related to Remote Linux Engineer jobs in Boston, MA?

For Remote Linux Engineer jobs in Boston, MA, the most frequently searched job titles are:

What job categories do people searching Remote Linux Engineer jobs in Boston, MA look for?

The top searched job categories for Remote Linux Engineer jobs in Boston, MA are:

What cities near Boston, MA are hiring for Remote Linux Engineer jobs?

Cities near Boston, MA with the most Remote Linux Engineer job openings:

Infographic showing various Remote Linux Engineer job openings in Boston, MA as of August 2026, with employment types broken down into 100% Full Time. Highlights an 100% Remote job distribution, with an average salary of $134,982 per year, or $64.9 per hour.

AI Infrastructure Engineer

Bright Vision Technologies

Andover, MA โ€ข On-site, Remote

$160K/yr

Full-time

This job post hasย expired today.ย Applications are no longer accepted.


Job description

AI Infrastructure Engineer โ€“ Remote
Bright Vision Technologies is a technology consulting and software development company delivering cloud, AI, data, and enterprise solutions across the United States.
This is a fantastic opportunity to join an established and well-respected organization offering tremendous career growth potential.
Job Title: AI Infrastructure Engineer
Location: 100% Remote (U.S.)
Position Type: Full-time, Direct W2
Salary Range: $100,000โ€“$160,000 Annually
Experience Required: 10+ years
Sponsorship: U.S. Citizens, Green Card Holders, EAD Holders, and H-1B transfer candidates are encouraged to apply. We are unable to sponsor new H-1B visa petitions for this position.
Job Summary:We are seeking an AI Infrastructure Engineer to design, build, and operate the platform layer that powers large-scale AI training and inference workloads. The role focuses on GPU clusters, distributed training frameworks, scheduling, storage performance, and developer experience for ML engineers and researchers, with strong emphasis on reliability, efficiency, and cost control. The ideal candidate has built or operated production AI infrastructure at scale, understands the interaction between hardware, kernel, scheduler, and ML framework, and brings strong software engineering discipline to platform work.
Key Responsibilities
  • Design and operate GPU and accelerator infrastructure for training and inference, spanning on-prem clusters, cloud-managed services, and hybrid configurations.
  • Build scheduling, queueing, and resource-sharing systems that maximize accelerator utilization across many teams.
  • Integrate frameworks such as PyTorch, JAX, DeepSpeed, FSDP, Megatron-LM, and Ray Train into a unified platform offering.
  • Operate high-performance storage systems and data pipelines that keep accelerators fed with training data at near-line-rate.
  • Design networking architectures supporting RDMA, InfiniBand, NCCL, and high-bandwidth collective communication.
  • Build observability for AI workloads including utilization, throughput, training stability, and failure-mode analytics.
  • Implement checkpointing, restart, and fault-tolerance patterns for long-running training jobs at scale.
  • Drive cost optimization across compute, storage, and networking through scheduling, spot capacity, and right-sizing.
  • Develop developer tooling and paved-road workflows that let researchers launch experiments safely and efficiently.
  • Partner with research and applied ML teams to plan capacity for upcoming training runs.
  • Implement security controls, isolation, and access management for multi-tenant AI infrastructure.
  • Drive automation across cluster provisioning, lifecycle management, and configuration enforcement.
  • Maintain runbooks, capacity dashboards, and operational documentation for the AI platform.
  • Stay current with AI infrastructure research, accelerator hardware, and emerging open-source AI tooling.
Required Qualifications
  • Bachelorโ€™s or Masterโ€™s degree in Computer Science or a related field.
  • Ten or more years of experience in infrastructure, platform, or HPC engineering.
  • Hands-on experience operating GPU clusters or large-scale ML training infrastructure.
  • Strong proficiency in Python and at least one systems language such as Go or C++.
  • Deep understanding of distributed training, accelerator architectures, and collective communication.
  • Experience with Kubernetes, Slurm, Ray, or similar scheduling systems for ML workloads.
  • Strong understanding of Linux internals, networking, and high-performance storage.
  • Experience with at least one major cloud providerโ€™s ML infrastructure offerings.
  • Strong software engineering practices including testing, CI/CD, and code review.
  • Excellent communication and cross-functional collaboration skills.
Preferred Qualifications
  • Experience operating InfiniBand or RDMA networking at scale.
  • Contributions to open-source ML infrastructure projects.
  • Familiarity with custom orchestrators or research-grade training stacks.
  • Exposure to frontier model training operations.
  • Experience with FinOps for AI workloads.
How to Apply
Would you like to know more about this opportunity? For immediate consideration, please send your resume to venkat.r@bvteck.com or contact us at (908) 505-3899. Learn more about Bright Vision Technologies at www.bvteck.com.
Bright Vision Technologies is an Equal Opportunity Employer.
 

Equal Employment Opportunity (EEO) Statement

Bright Vision Technologies (BV Teck) is committed to equal employment opportunity (EEO) for all employees and applicants without regard to race, color, religion, sex, sexual orientation, gender identity or expression, national origin, age, genetic information, disability, veteran status, or any other protected status as defined by applicable federal, state, or local laws. This commitment extends to all aspects of employment, including recruitment, hiring, training, compensation, promotion, transfer, leaves of absence, termination, layoffs, and recall.

BV Teck expressly prohibits any form of workplace harassment or discrimination. Any improper interference with employees\' ability to perform their job duties may result in disciplinary action up to and including termination of employment.