ZipRecruiter

Log In

1

Open Infra Jobs (NOW HIRING)

zaimler

Cloud Infrastructure Engineer

San Mateo, CA

$122K - $160K/yr

Who We're Looking For * We're open to multiple levels of seniority (3-10+ years of engineering experience). What matters most is founder mindset + strong infra chops. * Hands-on with Kubernetes ...

Reducto

Machine Learning Infra Engineer

San Francisco, CA · On-site

$150K - $300K/yr

The Opportunity As an ML Infra Engineer , you'll play a key role in building the inference and ... Have developed in open source training/inference stacks in a meaningful way. * Are excited to set ...

zaimler

Cloud Infrastructure Engineer

San Mateo, CA · On-site

$122K - $160K/yr

Who We're Looking For * We're open to multiple levels of seniority (3-10+ years of engineering experience). What matters most is founder mindset + strong infra chops. * Hands-on with Kubernetes ...

Rockstar

Founding GTM Lead

San Francisco, CA

Why This Role Matters AI infra today is fragmented, opaque, and largely built for researchers-not ... They are also open to exceptional new graduates with strong technical or business foundations ...

LinkedIn

Sr. Software Engineer, AI Infrastructure

Sunnyvale, CA · On-site +1

$203K - $240K/yr

... infra, compute software, and hardware to harness the power of our GPU fleet with thousands of latest GPU cards. The team also works closely with the open source community and has many open source ...

New

Goodfire

Machine Learning Engineer

San Francisco, CA · On-site

Preferred : • Open-source ML infra contributions. • Startup or frontier lab experience in fast-moving teams. Company : Goodfire is an AI research lab using interpretability to turn AI into ...

Goodfire

Machine Learning Engineer

San Francisco, CA · On-site

Preferred : • Open-source ML infra contributions. • Startup or frontier lab experience in fast-moving teams. Company : Goodfire is an AI research lab using interpretability to turn AI into ...

Rockstar

Founding GTM Lead

San Francisco, CA · On-site

Why This Role Matters AI infra today is fragmented, opaque, and largely built for researchers-not ... They are also open to exceptional new graduates with strong technical or business foundations ...

LiveKit

Senior Infrastructure Engineer

$200K - $300K/yr

Open source contributions, especially on infra or developer tools * Experience in realtime, audio/video, or low-latency systems Our Commitment to You * An opportunity to build something truly ...

next page

Showing results 1-20

All JobsOpen Infra Jobs

Open Infra information

See salary details

$43K

$88.7K

$139.5K

How much do open infra jobs pay per year?

As of Jul 19, 2026, the average yearly pay for open infra in the United States is $88,722.00, according to ZipRecruiter salary data. Most workers in this role earn between $70,000.00 and $101,000.00 per year, depending on experience, location, and employer.

What are the key skills and qualifications needed to thrive as an Open Infrastructure (Open Infra) Engineer, and why are they important?

To thrive as an Open Infra Engineer, you need strong expertise in cloud infrastructure, Linux system administration, networking, and open-source platforms, usually backed by a degree in computer science or a related field. Familiarity with tools like OpenStack, Kubernetes, Ansible, Terraform, and relevant certifications (e.g., Certified OpenStack Administrator) is highly valuable. Excellent problem-solving, collaboration, and communication skills set candidates apart in this dynamic environment. These abilities are essential for designing, deploying, and maintaining scalable, reliable, and secure open-source infrastructure solutions.

What is the highest paying networking job?

The highest paying networking jobs typically include roles such as Network Architect and Network Engineering Manager, which often require advanced certifications like Cisco CCIE or Cisco CCNP and extensive experience. These positions involve designing, implementing, and managing complex network infrastructure and can offer salaries exceeding $150,000 annually depending on location and industry.

Who is open infra?

Open Infra is a job title that typically refers to roles involved in managing and maintaining open-source infrastructure or cloud environments. These positions often require skills in cloud platforms, scripting, and system administration, and may involve working with tools like OpenStack or Kubernetes.

What is the difference between Open Infra vs Cloud Engineer?

AspectOpen InfraCloud Engineer
Required CertificationsOpenStack, Linux, NetworkingAWS, Azure, GCP certifications
Work EnvironmentData centers, on-premises infrastructureCloud platforms, virtual environments
Industry UsageTelecom, enterprise data centersTech companies, startups, enterprises
Common Search/ComparisonYesYes

Open Infra professionals focus on managing and deploying open-source infrastructure solutions like OpenStack and Linux-based systems, often in on-premises or hybrid environments. Cloud Engineers work primarily with cloud platforms such as AWS, Azure, or GCP, designing and maintaining cloud-based solutions. While both roles involve infrastructure management, Open Infra roles are more centered on open-source and on-premises systems, whereas Cloud Engineers specialize in cloud services and virtual environments.

What are the typical responsibilities of an Open Infra engineer, and how do they collaborate with other teams?

As an Open Infra engineer, your primary responsibilities include designing, deploying, and maintaining open infrastructure solutions such as cloud platforms, networking, and storage systems using open-source technologies like OpenStack and Kubernetes. You’ll regularly collaborate with development, security, and operations teams to ensure seamless integration, scalability, and security of the infrastructure. Communication and cross-team problem-solving are crucial, as you'll often help troubleshoot complex issues and optimize systems based on evolving organizational needs. This role offers opportunities to gain experience with cutting-edge technologies and contribute to open-source communities, which can support long-term career growth.

What is an Open Infra professional?

An Open Infra professional specializes in designing, building, and maintaining open infrastructure systems, often using open-source technologies for networking, computing, and storage. Their work enables organizations to deploy scalable and flexible IT environments, typically using platforms like OpenStack, Kubernetes, and other cloud-native solutions. They focus on automation, interoperability, and community-driven development to ensure reliable and cost-effective infrastructure. Open Infra professionals often collaborate with developers, IT staff, and the open-source community to implement and support these solutions.

What jobs pay 500,000 a year in the US?

High-paying jobs that can reach or exceed $500,000 annually include executive roles such as CEOs, CFOs, and other C-suite positions, as well as successful entrepreneurs, investment bankers, and certain specialized medical professionals like neurosurgeons. These roles typically require extensive experience, advanced skills, and often involve leadership, strategic decision-making, or ownership responsibilities.

What jobs in the US pay $300,000 a year?

In the US, high-paying roles such as senior software engineers, investment bankers, corporate executives, and specialized medical professionals can earn $300,000 or more annually. These positions often require advanced skills, extensive experience, and relevant certifications, and may involve long hours or high levels of responsibility.
What cities are hiring for Open Infra jobs? Cities with the most Open Infra job openings:
What states have the most Open Infra jobs? States with the most job openings for Open Infra jobs include:
What job categories do people searching Open Infra jobs look for? The top searched job categories for Open Infra jobs are:
Open Infra jobs near you
Infographic showing various Open Infra job openings in the United States as of July 2026, with employment types broken down into 11% Locum Tenens, 32% As Needed, 19% Full Time, 36% Temporary, 1% Contract, and 1% Summer. Highlights an 84% Physical, 3% Hybrid, and 13% Remote job distribution, with an average salary of $88,722 per year, or $42.7 per hour.

Cloud Infrastructure Engineer

zaimler

San Mateo, CA

$122K - $160K/yr

Full-time

Posted 5 days ago

Job description

About zaimler
 
AI agents can't reason over data they don't understand. Enterprise data today is fragmented across dozens of systems with no shared context, meaning, or structure, and that's why most enterprise AI is failing. The shift from copilots to autonomous agents is creating an entirely new infrastructure layer, and we're building it.
 
zaimler is the context infrastructure for the agentic era: a platform that automatically discovers domain knowledge, maps relationships, and gives AI agents the semantic understanding to operate with precision at scale. Imagine knowledge graphs that support real-time inference, built for systems that need to reason, not just retrieve.
 
zaimler was founded by Biswajit Das (ex-VP Engineering, Truera), a Data Infra veteran and former Chief Architect at Visa, and Sofus Macskassy (ex-Director of Engineering, LinkedIn), who built one of the largest knowledge graphs in production in the industry at LinkedIn. We're growing and deploying with major enterprises across insurance, travel, and technology. If you want to build infrastructure that the next decade of enterprise AI runs on, we'd love to talk.

What You’ll Do

As our Founding Cloud Infrastructure Engineer, you’ll design, build, and own the cloud infrastructure that powers zaimler’s semantic platform. This isn’t a maintenance role. It’s a foundational build-from-scratch position, shaping choices we’ll live with for years.
Key Responsibilities
  • Architect & Scale Infra: Design and deploy secure, fault-tolerant cloud infrastructure across AWS/Azure/GCP, using Kubernetes, Terraform, and modern IaC tools.
  • Enable Distributed AI Workloads: Build and optimize compute systems for distributed frameworks like Ray and Kafka, ensuring scalability and reliability.
  • GPU Orchestration: Manage GPU resources and scheduling for ML inference, retrieval, and training workloads.
  • Drive Observability & Reliability: Implement monitoring, security, and best practices for high-availability ML/AI systems.
  • Collaborate Across Teams: Work hand-in-hand with ML researchers and data scientists to ensure infra accelerates, not hinders, development.
Who We’re Looking For
  • We’re open to multiple levels of seniority (3–10+ years of engineering experience). What matters most is founder mindset + strong infra chops.
  • Hands-on with Kubernetes + Terraform (real-world deployments, not just exposure).
  • Experience with distributed systems (Ray, Dask, Spark, or similar).
  • Exposure to Kafka or equivalent MQ systems.
  • Strong programming/scripting in Python, Go, or similar.
  • Track record of building or operating production-grade infra.
Nice to Haves
  • GPU scheduling/optimization experience.
  • Prior startup/early-stage build-from-scratch experience.
  • Experience supporting ML/AI workloads in production.
  • Founder Traits
  • Excited to own infra end-to-end as the first dedicated hire.
  • Comfort with ambiguity; thrives in fast-moving, collaborative teams.
  • Curiosity + grit: hungry to learn where gaps exist.
Why Join
  • A rare chance to be a founding engineer shaping both company and product direction.
  • Competitive salary, benefits, and meaningful equity.
  • Work alongside engineers and researchers from LinkedIn, Visa, Meta, and Branch.
  • Onsite culture in San Mateo, designed for deep collaboration and high-velocity building.
  • We offer competitive compensation, equity, full benefits (Medical, Dental, Vision, 401k)
  • We sponsor H-1B visas and assist with immigration processes
We value builders over résumés. If this role excites you but you don't check every box, we still want to hear from you. zaimler is an equal opportunity employer.

We may use artificial intelligence (AI) tools to support parts of the hiring process, such as reviewing applications, analyzing resumes, or assessing responses and identifying potential inconsistencies or verification signals in application materials based on available information. These tools assist our recruitment team but do not replace human judgment. Final hiring decisions are ultimately made by humans. If you would like more information about how your data is processed, please contact us.