ZipRecruiter

Log In

1

From Home Ai Infrastructure Engineer Jobs (NOW HIRING)

Mango Analytics

AI Infrastructure Engineer

Fort Mill, SC · On-site

$94K - $123K/yr

We are seeking a proactive and innovative AI Infrastructure Engineer to work directly with our LPL infrastructure teams. The ideal candidate will identify opportunities for automation, build AI ...

New

Together AI

AI Infrastructure Engineer

San Francisco, CA · On-site

$126K - $166K/yr

As an AI Infrastructure Engineer, you will be responsible for maintaining user-facing services and ... from the reliability, performance and availability perspectives • Plan the growth of Together AI ...

Together AI

AI Infrastructure Engineer

San Francisco, CA · On-site

$190K - $270K/yr

As an AI Infrastructure Engineer at Together, you are responsible for keeping all user-facing ... Identify improvements for the product architecture from the reliability, performance and ...

ScrumLink, Inc.

AI Infrastructure Engineer

Fort Mill, SC · On-site

$94K - $123K/yr

AI Infrastructure Engineer (Forward Deployed AI Engineer) Location: Fort Mill, SC Duration : 12+ Months Total positions : 8 Roles Responsibilities: * Embed within infrastructure teams to understand ...

New

OVA.Work

AI Infrastructure Engineer

$110K - $144K/yr

Work is seeking an AI Infrastructure Engineer to design, implement, and manage the infrastructure that powers AI and machine learning workloads. The role involves building scalable and secure ...

Wipro Limited

AI Infrastructure Engineer

San Jose, IL · On-site

$45K - $121K/yr

AI Infrastructure Engineer City: San Jose State/Province: California Posting Start Date: 7/9/26 ... Design seamless AI workflows using NC2 on Prem, allowing for rapid bursting of AI workloads from on ...

New

Seekr

Staff AI Infrastructure Engineer

Austin, TX

$106K - $139K/yr

As a Staff AI Infrastructure Engineer, you will design, build, and operate the platforms that ... Architect and optimize high-performance inference platforms capable of serving models ranging from ...

Seekr

Staff AI Infrastructure Engineer

Austin, TX · On-site

$106K - $139K/yr

As a Staff AI Infrastructure Engineer, you will design, build, and operate the platforms that ... Architect and optimize high-performance inference platforms capable of serving models ranging from ...

Analogdevices

Senior AI Infrastructure Engineer

Wilmington, MA · Hybrid

$118K - $161K/yr

Senior AI Infrastructure Engineer, Developer Experience Analog Devices, Inc. (NASDAQ: ADI) is a ... Drive initiatives that reduce friction in the AI development lifecycle-from experimentation through ...

Seekr

Senior AI Infrastructure Engineer

Austin, TX

$107K - $146K/yr

As a Senior AI Infrastructure Engineer, you will design, build, and operate the platforms that ... Architect and optimize high-performance inference platforms capable of serving models ranging from ...

Utilidata

AI Infrastructure Engineer

Ann Arbor, MI · Remote

$170K - $210K/yr

... from existing energy infrastructure. For over a decade, we have applied AI to the electric grid ... The AI Infrastructure Engineer is responsible for designing, building, and owning the end-to-end ...

BNY

AI Infrastructure Engineer

Lake Mary, FL · On-site

$94K - $123K/yr

They are seeking an AI Infrastructure Engineer to support enterprise-grade NVIDIA AI infrastructure, automate operations, and maintain AI training and inference pipelines. Responsibilities : • Be ...

BNY

AI Infrastructure Engineer

Lake Mary, FL · On-site

$94K - $123K/yr

They are seeking an AI Infrastructure Engineer to support enterprise-grade NVIDIA AI infrastructure, automate operations, and maintain AI training and inference pipelines. Responsibilities : • Be ...

MeshyAI

AI Infrastructure Engineer

Sunnyvale, CA · On-site

$125K - $164K/yr

The AI Infrastructure Engineer role involves ensuring the reliability and scalability of the AI model serving stack, while developing core engineering infrastructure to connect models to product ...

Autonomous Solutions

AI Infrastructure Engineer IV

Lehi, UT · On-site

$100K - $132K/yr

As an AI Infrastructure Engineer IV , you will play a critical role in designing, building, and maintaining the systems that power our AI and machine learning capabilities. You will ensure our ...

Seekr

Senior AI Infrastructure Engineer

Austin, TX · On-site

$107K - $146K/yr

As a Senior AI Infrastructure Engineer, you will design, build, and operate the platforms that ... Architect and optimize high-performance inference platforms capable of serving models ranging from ...

next page

Showing results 1-20

All JobsAi Infrastructure Engineer JobsFrom Home Ai Infrastructure Engineer Jobs

From Home Ai Infrastructure Engineer information

See salary details

$46.5K

$127.1K

$182K

How much do from home ai infrastructure engineer jobs pay per year?

As of Jul 17, 2026, the average yearly pay for from home ai infrastructure engineer in the United States is $127,066.00, according to ZipRecruiter salary data. Most workers in this role earn between $107,500.00 and $141,000.00 per year, depending on experience, location, and employer.

What is the difference between From Home Ai Infrastructure Engineer vs From Home Data Engineer?

AspectFrom Home Ai Infrastructure EngineerFrom Home Data Engineer
Required CredentialsBachelor's in Computer Science, AI, or related field; certifications in cloud platforms and AI toolsBachelor's in Computer Science, Data Science, or related; certifications in data management and cloud services
Work EnvironmentRemote, collaborating with AI development teams, cloud infrastructure managementRemote, working with data pipelines, databases, and analytics teams
Employer & Industry UsageTech companies, AI startups, cloud service providersData-driven companies, finance, healthcare, tech firms

From Home Ai Infrastructure Engineers focus on building and maintaining AI infrastructure, including cloud and hardware systems, while From Home Data Engineers primarily develop and manage data pipelines and storage solutions. Both roles require technical skills and often work remotely, but their core responsibilities differ in focus on AI systems versus data management.

What cities are hiring for From Home Ai Infrastructure Engineer jobs? Cities with the most From Home Ai Infrastructure Engineer job openings:
What are the most commonly searched types of Ai Infrastructure Engineer jobs? The most popular types of Ai Infrastructure Engineer jobs are:
What states have the most From Home Ai Infrastructure Engineer jobs? States with the most job openings for From Home Ai Infrastructure Engineer jobs include:
From Home Ai Infrastructure Engineer jobs near you
AI Infrastructure Engineer

AI Infrastructure Engineer

Together AI

San Francisco, CA

$190K - $270K/yr

Other

Medical

Re-posted 19 days ago

Job description

As an AI Infrastructure Engineer at Together, you are responsible for keeping all user-facing services and production systems running smoothly. You are a blend of a pragmatic operator and a software engineer that applies sound engineering principles, operational discipline, and mature automation to our operating environments and codebase.

You specialize in systems (operating systems, storage subsystems, networking), while implementing best practices for availability, reliability and scalability, with varied interests in algorithms and distributed systems.

Responsibilities

  • Participate in on-call rotation (Pagerduty) to respond to production incidents
  • Build and run our infrastructure with Ansible, Terraform, and Kubernetes to enable scaling to a massive number of concurrent users
  • Build monitoring systems to ensure the highest quality service for our customers
  • Design and implement operational processes (such as deployments and upgrades)
  • Debug production issues across all services and levels of the stack
  • Identify improvements for the product architecture from the reliability, performance and availability perspectives
  • Plan the growth of Together AI's infrastructure

Requirements

  • 5+ years of professional AI Infra or related experience
  • Bachelor's degree in Computer Science or a related field or equivalent work experience
  • Knowledge of Ansible (roles, playbooks), Terraform, and Kubernetes
  • Proficiency in programming/scripting languages
  • Direct experience in monitoring and observability practices
  • Knowledge of cloud services
  • Ability to thrive in a collaborative environment involving different stakeholders and subject matter experts

About Together AI

Together AI is a research-driven artificial intelligence company. We believe open and transparent AI systems will drive innovation and create the best outcomes for society, and together we are on a mission to significantly lower the cost of modern AI systems by co-designing software, hardware, algorithms, and models. We have contributed to leading open-source research, models, and datasets to advance the frontier of AI, and our team has been behind technological advancement such as FlashAttention, Hyena, FlexGen, and RedPajama. We invite you to join a passionate group of researchers and engineers in our journey in building the next generation AI infrastructure.

Compensation

We offer competitive compensation, startup equity, health insurance and other competitive benefits. The US base salary range for this full-time position is: $190,000 - $270,000 + equity + benefits. Our salary ranges are determined by location, level and role. Individual compensation will be determined by experience, skills, and job-related knowledge.

Equal Opportunity

Together AI is an Equal Opportunity Employer and is proud to offer equal employment opportunity to everyone regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, citizenship, marital status, disability, gender identity, veteran status, and more.

Apply