ZipRecruiter

Log In

1

Ai Infra Jobs (NOW HIRING)

HealthLeap

AI Infra Engineer

San Francisco, CA · On-site

$200K - $275K/yr

About Healthleap HealthLeap builds AI that helps clinicians prioritize patients, surfaces the right ... Background at an early-stage startup where you owned infra end-to-end This role is NOT for you if

Nastech Global

AI Infra SRE Engineer

San Jose, CA · Remote

$58.25 - $77.50/hr

Position: AI Infra SRE Engineer - DGX Location: Remote Duration: Fulltime Must-have * NVIDIA (DGX) or equivalent high-performance-compute (HPC) clusters (e.g. Cray, HPE, IBM) * Cisco UCS C885A

Pylon Labs

Software Engineer (AI Infra)

San Francisco, CA · On-site

$180K - $300K/yr

Build the platforms that power Pylon's AI features - prompt executions, search infra, and more! * Improve LLM observability - AI evals (online and offline), scorers, and set up Pylon's AI for the ...

Together AI

AI Infrastructure Engineer

San Francisco, CA · On-site

$126K - $166K/yr

Required : • 5+ years of professional AI Infra or related experience • Bachelor's degree in Computer Science or a related field or equivalent work experience • Knowledge of Ansible (roles ...

Pylon

Relocate to SF: Software Engineer (AI Infra)

Provo, UT · On-site

$165K - $196K/yr

Responsibilities : • Build the platforms that power Pylon's AI features - prompt executions, search infra, and more! • Improve LLM observability - AI evals (online and offline), scorers, and set ...

Amperos Health, Inc

AI Research Engineer

New York, NY · On-site

$200K - $300K/yr

About the role As an AI Engineer on our research team, you'll work on our hardest research and AI infra problems. You'll both help prototype new products and also work on turning prototypes into a ...

Pylon

Relocate to SF: Software Engineer (AI Infra)

Chicago, IL · On-site

$178K - $211K/yr

Responsibilities : • Build the platforms that power Pylon's AI features - prompt executions, search infra, and more! • Improve LLM observability - AI evals (online and offline), scorers, and set ...

Rockstar

Founding Go-To-Market Lead

San Francisco, CA · On-site

Why This Role Matters AI infra today is fragmented, opaque, and largely built for researchers-not product teams. The company is changing that. As the first GTM hire, the candidate will define the ...

Microsoft

Group Finance Manager, Core AI

Redmond, WA · On-site

Work across model engineering, AI infra/GPU platform, datacenter operations, and hardware roadmap to drive structurally lower cost per unit of compute. * Lead demand, capacity, and investment ...

Pylon

Relocate to SF: Software Engineer (AI Infra)

Austin, TX · On-site

$171K - $203K/yr

Responsibilities : • Build the platforms that power Pylon's AI features - prompt executions, search infra, and more! • Improve LLM observability - AI evals (online and offline), scorers, and set ...

next page

Showing results 1-20

People also search for

All JobsAi Infra Jobs

Ai Infra information

See salary details

$43K

$88.7K

$139.5K

How much do ai infra jobs pay per year?

As of Jun 10, 2026, the average yearly pay for ai infra in the United States is $88,722.00, according to ZipRecruiter salary data. Most workers in this role earn between $70,000.00 and $101,000.00 per year, depending on experience, location, and employer.
More about Ai Infra jobs
What cities are hiring for Ai Infra jobs? Cities with the most Ai Infra job openings:
What states have the most Ai Infra jobs? States with the most job openings for Ai Infra jobs include:
Ai Infra jobs near you
AI Infra Engineer

AI Infra Engineer

HealthLeap

San Francisco, CA • On-site

$200K - $275K/yr

Full-time

Medical, Retirement, PTO

Posted 12 days ago

Job description

About Healthleap
HealthLeap builds AI that helps clinicians prioritize patients, surfaces the right data, and gets patients the care they need earlier, so they can leave the hospital sooner.
We integrate with hospital electronic health record systems, screen 100% of patients daily, and risk-rank them in real time. Clinicians at Cedars-Sinai and Penn Medicine start every morning with HealthLeap - with Houston Methodist, Emory, and Intermountain Health deploying now.
Real results: 39% more diagnoses. 4 days earlier detection. $11M/year ROI for our first site at Cedars Sinai. 7× revenue growth in 7 months.
We started with malnutrition. We're expanding to every major condition to ensure no patient falls through the cracks. Sequoia and First Round are backing us to build the platform that screens every patient for everything and drives tangible outcomes.
We're ~15 people. >$7M raised. SF-based, hybrid-friendly. Early enough to shape the product. Late enough to know it works. Results that are changing lives.
About the Role
Build the infrastructure that screens every hospital patient, every day.
HealthLeap processes billions of data points from hospital EHRs. Data flows through secure connections, transforms through data pipelines, and powers ML models that clinicians rely on every morning. You'll work alongside our data scientists and ML engineers to build and operate the infrastructure that makes this possible.
Why you
You've built AI infrastructure at a startup where you owned everything. The person who set up the AWS accounts, wrote the Terraform, deployed the ML models, and debugged the VPN at 2am. You've taken models from Jupyter notebooks to production. You're the person who figures things out when the docs don't help.
What you'll do
  • Deploy new hospitals: site-to-site VPNs, networking, container services, data pipelines
  • Build reliable data infrastructure that ingests, transforms, and serves data at scale (S3, Iceberg, Spark, Dagster, Airflow)
  • Partner with data scientists and ML engineers to productionize models and get them running reliably at scale
  • Own AWS infrastructure: multi-account orgs, ECS/EKS, Terraform, networking
  • Set up observability: monitoring, alerting, logging that actually helps debug issues
  • Make hospital deployments faster and more reliable
What we're looking for
  • 5+ years engineering experience, with significant infrastructure work
  • Deep AWS experience: networking, IAM, ECS/EKS, S3, and the rest
  • Solid with Terraform or similar infrastructure-as-code
  • Experience with data pipelines and orchestration (Dagster, Airflow, or similar)
  • You've operated production systems, not just built them
  • You figure things out, even when documentation doesn't exist
Nice to have
  • MLOps experience: deploying and monitoring ML models in production
  • Healthcare data standards (FHIR, HL7v2)
  • Experience with Kubernetes, service mesh, or complex networking
  • Background at an early-stage startup where you owned infra end-to-end
This role is NOT for you if
  • Startup unpredictability feels like chaos to you. We find it exciting.
  • You've never owned something end-to-end. Here, you own outcomes, not tasks.
  • You wait to be told what to do next. We need people who see what's needed and do it.
  • You're looking for a 9-5 with predictable hours. We care about deep work and deep rest (we have a minimum leave policy), but when a hospital go-live is on the line, we show up - even if that means a 60+ hour week.
  • You've only worked on platform teams at large companies. We need someone who's built infra from scratch.
  • You see collaboration as interruption. We see it as leverage. The best engineers here are constantly pulling each other in. If you prefer to work in isolation, this isn't the right fit.
Interview process
  1. Intro call - Get to know each other
  2. Technical - 1-2 interviews
  3. Onsite - Coding, case study, team meet (~4-5 hours)
  4. Decision - Same week as onsite

We respect your time. If there's a fit, you'll know fast.
Compensation & Benefits
  • Salary: $200,000 - $275,000 base
  • Equity: Meaningful ownership in an early-stage company
  • Healthcare: 100% of premiums covered
  • PTO: Unlimited, with a recommended minimum of 20 days
  • 401(k): 4% match
  • Equipment: Laptop + budget for your home office
Location
San Francisco - in person.
If you're passionate about applying frontier AI to real-world impact, join us in building healthcare's future.

Apply