2

Remote Ai Infrastructure Engineer Jobs (NOW HIRING)

Infrastructure Engineer (Storage)

New York, NY · On-site +1

$117K - $154K/yr

Who We Are Lightning AI is the company behind PyTorch Lightning. Founded in 2019, we build an end ... This role can work hybrid out of one of our US-based hubs (Seattle, NYC, or SF) or fully remote ...

Infrastructure Engineer

$125K - $165K/yr

... remote. Copy and paste the following link into your browser to learn more about TELCOR and what it ... The Infrastructure Engineer will help build and scale the systems that power AI products. This role ...

... and AI into a single, governed platform. A leader in Enterprise MCP and trusted by 50% of the ... Quartz ranked us the #1 best company for remote workers We are hiring a Senior Infrastructure ...

Infrastructure Engineer

Lincoln, NE · On-site +1

$125K - $165K/yr

... remote. Copy and paste the following link into your browser to learn more about TELCOR and what it ... The Infrastructure Engineer will help build and scale the systems that power AI products. This role ...

next page

Showing results 1-20

Remote Ai Infrastructure Engineer information

See salary details

$46.5K

$127.1K

$182K

How much do remote ai infrastructure engineer jobs pay per year?

As of Jun 7, 2026, the average yearly pay for remote ai infrastructure engineer in the United States is $127,066.00, according to ZipRecruiter salary data. Most workers in this role earn between $107,500.00 and $141,000.00 per year, depending on experience, location, and employer.

What are the key skills and qualifications needed to thrive as a Remote AI Infrastructure Engineer, and why are they important?

To thrive as a Remote AI Infrastructure Engineer, you need expertise in cloud computing, distributed systems, and software engineering, often supported by a degree in computer science or a related field. Familiarity with tools like Kubernetes, Docker, Terraform, and cloud platforms such as AWS, Azure, or GCP is typically required, along with knowledge of CI/CD pipelines and AI/ML frameworks. Strong problem-solving skills, self-motivation, and effective remote communication are essential soft skills for success in this role. These skills ensure robust, scalable AI infrastructure that supports rapid innovation and seamless collaboration across distributed teams.

What is a Remote AI Infrastructure Engineer?

A Remote AI Infrastructure Engineer is a professional who designs, builds, and maintains the systems and tools necessary to support artificial intelligence (AI) projects, all while working remotely. Their responsibilities often include developing and optimizing cloud or on-premise infrastructure, ensuring scalability, managing data pipelines, and supporting machine learning workflows. They work closely with data scientists and software engineers to ensure AI models can be efficiently trained, deployed, and monitored in production environments. The remote aspect allows them to perform these tasks from anywhere, using collaboration tools and cloud platforms.

What are some common challenges faced by Remote AI Infrastructure Engineers, and how can they be addressed?

Remote AI Infrastructure Engineers often encounter challenges such as managing distributed systems, ensuring robust data pipelines, and maintaining high system reliability across different time zones. Collaboration with cross-functional teams can require clear communication and effective use of remote tools. To address these challenges, it's important to establish strong documentation practices, schedule regular check-ins, and utilize automated monitoring and deployment solutions. Staying proactive and adaptable helps ensure seamless infrastructure performance and team alignment.
More about Remote Ai Infrastructure Engineer jobs
What cities are hiring for Remote Ai Infrastructure Engineer jobs? Cities with the most Remote Ai Infrastructure Engineer job openings:
What are the most commonly searched types of Ai Infrastructure Engineer jobs? The most popular types of Ai Infrastructure Engineer jobs are:
What states have the most Remote Ai Infrastructure Engineer jobs? States with the most job openings for Remote Ai Infrastructure Engineer jobs include:
Infographic showing various Remote Ai Infrastructure Engineer job openings in the United States as of May 2026, with employment types broken down into 86% Full Time, 11% Part Time, and 3% Contract. Highlights an 85% Physical, 5% Hybrid, and 10% Remote job distribution, with an average salary of $127,066 per year, or $61.1 per hour.
Software Engineer - AI Infrastructure

Software Engineer - AI Infrastructure

Andromeda

San Francisco, CA • Remote

$203K - $241K/yr

Full-time

This job post has expired 1 day ago. Applications are no longer accepted.


Job description

Location: North America Remote / San Francisco Employment Type: Full-Time About Andromeda Andromeda Cluster, founded by Nat Friedman and Daniel Gross, is on a mission to democratize access to cutting‐edge AI infrastructure previously reserved for hyperscalers. What began with a single managed cluster has quickly evolved into a global platform, connecting leading AI labs, data centers, and cloud providers. Our orchestration layer seamlessly routes training and inference jobs across the world, unlocking flexibility and efficiency in one of the fastest‐growing sectors on earth.

Our long‐term vision is to establish a global marketplace for AI compute—powering AGI with the same fluidity as world financial markets. The Role As an Infrastructure Product Engineer, you will play a pivotal role in building the backbone of Andromeda's platform. You'll transform complex, real‐world infrastructure challenges into scalable product capabilities that benefit our customers.

Positioned at the intersection of infrastructure and product engineering, this role is deeply technical and systems‐oriented, yet laser‐focused on building solutions with broad leverage. What You'll Do Design and develop core platform components, including infrastructure orchestration, provisioning, and lifecycle management solutions. Build robust APIs, services, and control planes that abstract over diverse infrastructure types (VMs, Kubernetes, bare metal, schedulers).

Translate customer usage patterns into product requirements, delivering impactful features and improvements. Create automation and internal tooling to eliminate manual or ad‐hoc operational work. Enhance reliability, performance, and observability at the platform level, emphasizing durable improvements over quick fixes.

Collaborate with peer teams to define clear ownership boundaries between platform capabilities and customer‐specific solutions. Write clean, maintainable, and well‐documented code with a focus on long‐term sustainability. Participate in technical design discussions and contribute to the architectural evolution of our platform.

What We're Looking For 5+ years of experience in Infrastructure, Platform, or Backend Engineering roles. Strong systems fundamentals: deep understanding of Linux, networking, storage, and distributed systems. Proven expertise with Kubernetes, VMs, or bare‐metal environments.

Advanced software engineering skills; capable of building production‐grade APIs and services (Python, Go, or similar). Extensive experience with infrastructure as code and automation tools (Terraform, Ansible, Helm, etc.). Demonstrated ability to navigate ambiguity and distill complex problems into clear, maintainable abstractions.

Product‐focused mindset: care about interfaces, defaults, reliability, and sustainable operations. Excellent written and verbal communication skills; effective collaborator across engineering and product functions. Nice to Have Hands‐on experience with GPU or AI infrastructure.

Experience with control‐plane or orchestration systems. Background spanning both infrastructure and application/backend engineering. Experience architecting multi‐tenant systems.

Strong skills in technical writing and design documentation. Early‐stage startup experience. Why You'll Love It Here This is a true builder's opportunity: you'll have ownership and autonomy to shape our systems, engage directly with customers and providers, and lay the foundations for scalable, reliable AI infrastructure.

Join us at Andromeda and help power the future of AI. #J-18808-Ljbffr