ZipRecruiter

Log In

2

Remote Infrastructure Engineer Jobs in Boston, MA

MLabs

Senior Infrastructure Engineer

Boston, MA · Remote

$170K - $220K/yr

Remote - Remote - Based In ET+2 / -3, NY Preferred Remote | Full-time Compensation: $170K - $220K ... They are currently seeking a Senior Infrastructure Engineer to design and build an internal ...

MLabs

Senior Infrastructure Engineer

Boston, MA · Remote

$170K - $220K/yr

Remote - Remote - Based In ET+2 / -3, NY Preferred Remote | Full-time Compensation: $170K - $220K ... They are currently seeking a Senior Infrastructure Engineer to design and build an internal ...

Akamai

Platform Infrastructure Engineer II

Cambridge, MA · On-site +1

$95K - $171K/yr

Our engineering teams design resilient infrastructure to power global multi-region systems at massive scale. You will work alongside talented engineers in a collaborative and inclusive environment ...

Wsgr

Principal Cloud Infrastructure Engineer

Boston, MA · On-site +1

$147K - $198K/yr

The Principal Cloud Infrastructure Engineer, under the direction of the Senior manager of ... This role can be hybrid or virtual/remote. Essential Duties and Responsibilities: * Act as the ...

ICONSTAFF

Senior Platform Engineer

Cambridge, MA · Remote

$120K - $200K/yr

Senior Platform/Infrastructure Engineer Location: Fully remote (HQ Cambridge, MA) Hours: 9-5 EST, with 2-day on-site visits every 6 weeks You'll be responsible for designing, scaling, and maintaining ...

LiveData

DevOps Engineering Manager

Boston, MA · Remote

$57.25 - $78.50/hr

Experience supporting remote engineering teams and coordinating operational work across time zones. Tech Environment * Cloud: AWS (serverless-first) * Infrastructure: Infrastructure as code ...

NAVA Software Solutions

AI Engineer - Remote

Boston, MA · On-site +1

AI Engineer Location: 100% Remote Duration: 6+ month contract-to-hire Interviews: 2 rounds Top ... Guide architecture, infrastructure, and tools for AI/ML products. * Develop rapid prototypes and ...

next page

Showing results 1-20

All JobsInfrastructure Engineer JobsRemote Infrastructure Engineer JobsRemote Infrastructure Engineer Jobs in Boston, MA

Remote Infrastructure Engineer information

See Boston, MA salary details

$50.5K

$138K

$197.7K

How much do remote infrastructure engineer jobs pay per year?

As of Aug 3, 2026, the average yearly pay for remote infrastructure engineer in Boston, MA is $138,045.00, according to ZipRecruiter salary data. Most workers in this role earn between $116,800.00 and $153,200.00 per year, depending on experience, location, and employer.

What skills and qualifications are needed to be a remote infrastructure engineer?

To thrive as a Remote Infrastructure Engineer, you need a strong background in network administration, cloud computing, and server management, often paired with a degree in computer science or related field. Familiarity with tools like AWS, Azure, Docker, Kubernetes, and certifications such as AWS Certified Solutions Architect or CompTIA Network+ are typically expected. Excellent problem-solving abilities, proactive communication, and strong organizational skills help you manage tasks independently and collaborate across dispersed teams. These capabilities are crucial for maintaining reliable, secure infrastructure and supporting seamless remote operations for organizations.

What is a remote infrastructure engineer?

A Remote Infrastructure Engineer is responsible for designing, managing, and maintaining an organization's IT infrastructure, including servers, networks, cloud environments, and security systems, while working remotely. They ensure system reliability, optimize performance, troubleshoot issues, and implement new technologies to support business operations. This role requires expertise in networking, cloud computing, automation, and cybersecurity, often working with tools like AWS, Azure, VMware, and monitoring systems. Effective communication and problem-solving skills are essential, as they collaborate with teams to resolve technical challenges.

What does a remote infrastructure engineer do?

As a Remote Infrastructure Engineer, your daily responsibilities generally include monitoring system performance, deploying updates and patches, managing cloud resources, and troubleshooting network or server issues. You'll often work closely with development and security teams to ensure optimal infrastructure performance, automate routine processes, and uphold security standards. Collaboration through project management platforms and remote communication tools is common to keep the team aligned. The role frequently involves both scheduled maintenance and responding to urgent incidents, offering a dynamic and impactful work environment.

What are the most commonly searched types of Infrastructure Engineer jobs in Boston, MA? The most popular types of Infrastructure Engineer jobs in Boston, MA are:
What are popular job titles related to Remote Infrastructure Engineer jobs in Boston, MA? For Remote Infrastructure Engineer jobs in Boston, MA, the most frequently searched job titles are:
What job categories do people searching Remote Infrastructure Engineer jobs in Boston, MA look for? The top searched job categories for Remote Infrastructure Engineer jobs in Boston, MA are:
What cities near Boston, MA are hiring for Remote Infrastructure Engineer jobs? Cities near Boston, MA with the most Remote Infrastructure Engineer job openings:
Remote Infrastructure Engineer jobs near you
Infographic showing various Remote Infrastructure Engineer job openings in Boston, MA as of July 2026, with employment types broken down into 83% Full Time, and 17% Part Time. Highlights an 100% Remote job distribution, with an average salary of $138,045 per year, or $66.4 per hour.

AI Infrastructure Engineer

Bright Vision Technologies

Westford, MA • On-site, Remote

$100K - $150K/yr

Full-time

Posted 8 days ago

Job description

AI Infrastructure Engineer – Remote
Bright Vision Technologies is a technology consulting and software development company delivering cloud, AI, data, and enterprise solutions across the United States.
This is a fantastic opportunity to join an established and well-respected organization offering tremendous career growth potential.
Job Title: AI Infrastructure Engineer
Location: 100% Remote (U.S.)
Position Type: Full-time, Direct W2
Salary Range: $100,000–$150,000 Annually
Experience Required: 6+ years
Sponsorship: U.S. Citizens, Green Card Holders, EAD Holders, and H-1B transfer candidates are encouraged to apply. We are unable to sponsor new H-1B visa petitions for this position.
Job Summary:We are seeking an AI Infrastructure Engineer to design, build, and operate the platform layer that powers large-scale AI training and inference workloads. The role focuses on GPU clusters, distributed training frameworks, scheduling, storage performance, and developer experience for ML engineers and researchers, with strong emphasis on reliability, efficiency, and cost control. The ideal candidate has built or operated production AI infrastructure at scale, understands the interaction between hardware, kernel, scheduler, and ML framework, and brings strong software engineering discipline to platform work.
Key Responsibilities
  • Design and operate GPU and accelerator infrastructure for training and inference, spanning on-prem clusters, cloud-managed services, and hybrid configurations.
  • Build scheduling, queueing, and resource-sharing systems that maximize accelerator utilization across many teams.
  • Integrate frameworks such as PyTorch, JAX, DeepSpeed, FSDP, Megatron-LM, and Ray Train into a unified platform offering.
  • Operate high-performance storage systems and data pipelines that keep accelerators fed with training data at near-line-rate.
  • Design networking architectures supporting RDMA, InfiniBand, NCCL, and high-bandwidth collective communication.
  • Build observability for AI workloads including utilization, throughput, training stability, and failure-mode analytics.
  • Implement checkpointing, restart, and fault-tolerance patterns for long-running training jobs at scale.
  • Drive cost optimization across compute, storage, and networking through scheduling, spot capacity, and right-sizing.
  • Develop developer tooling and paved-road workflows that let researchers launch experiments safely and efficiently.
  • Partner with research and applied ML teams to plan capacity for upcoming training runs.
  • Implement security controls, isolation, and access management for multi-tenant AI infrastructure.
  • Drive automation across cluster provisioning, lifecycle management, and configuration enforcement.
  • Maintain runbooks, capacity dashboards, and operational documentation for the AI platform.
  • Stay current with AI infrastructure research, accelerator hardware, and emerging open-source AI tooling.
Required Qualifications
  • Bachelor’s or Master’s degree in Computer Science or a related field.
  • Six or more years of experience in infrastructure, platform, or HPC engineering.
  • Hands-on experience operating GPU clusters or large-scale ML training infrastructure.
  • Strong proficiency in Python and at least one systems language such as Go or C++.
  • Deep understanding of distributed training, accelerator architectures, and collective communication.
  • Experience with Kubernetes, Slurm, Ray, or similar scheduling systems for ML workloads.
  • Strong understanding of Linux internals, networking, and high-performance storage.
  • Experience with at least one major cloud provider’s ML infrastructure offerings.
  • Strong software engineering practices including testing, CI/CD, and code review.
  • Excellent communication and cross-functional collaboration skills.
Preferred Qualifications
  • Experience operating InfiniBand or RDMA networking at scale.
  • Contributions to open-source ML infrastructure projects.
  • Familiarity with custom orchestrators or research-grade training stacks.
  • Exposure to frontier model training operations.
  • Experience with FinOps for AI workloads.
How to Apply
Would you like to know more about this opportunity? For immediate consideration, please send your resume to venkat.r@bvteck.com or contact us at (908) 505-3899. Learn more about Bright Vision Technologies at www.bvteck.com.
Bright Vision Technologies is an Equal Opportunity Employer.
 

Equal Employment Opportunity (EEO) Statement

Bright Vision Technologies (BV Teck) is committed to equal employment opportunity (EEO) for all employees and applicants without regard to race, color, religion, sex, sexual orientation, gender identity or expression, national origin, age, genetic information, disability, veteran status, or any other protected status as defined by applicable federal, state, or local laws. This commitment extends to all aspects of employment, including recruitment, hiring, training, compensation, promotion, transfer, leaves of absence, termination, layoffs, and recall.

BV Teck expressly prohibits any form of workplace harassment or discrimination. Any improper interference with employees\' ability to perform their job duties may result in disciplinary action up to and including termination of employment.

Apply