San Francisco, CA · On-site
$180 - $230/hr
About Us Vast.ai's cloud powers AI projects and businesses all over the world. We are democratizing ... About the Role As a Senior Infrastructure Engineer, you will help design and scale the core systems ...
San Francisco, CA · On-site
$180 - $230/hr
About Us Vast.ai's cloud powers AI projects and businesses all over the world. We are democratizing ... About the Role As a Senior Infrastructure Engineer, you will help design and scale the core systems ...
San Francisco, CA · On-site
$100 - $250/hr
Hercules is looking for a senior or staff level infrastructure engineer to help us build the future ... AI Agent , the AI harness that enables anyone to build powerful full‑stack applications. * App ...
New
San Francisco, CA · On-site
$100 - $250/hr
Hercules is looking for a senior or staff level infrastructure engineer to help us build the future ... AI Agent , the AI harness that enables anyone to build powerful full‑stack applications. * App ...
New
If you want to build infrastructure that the AI ecosystem runs on, and earn ownership quickly by ... Partner across engineering, product, and partner teams to ship improvements and unblock work ...
If you want to build infrastructure that the AI ecosystem runs on, and earn ownership quickly by ... Partner across engineering, product, and partner teams to ship improvements and unblock work ...
San Jose, CA · On-site
$60/hr
... multimodal AI systems. Our mission is to provide a robust, scalable, and high-performance ... Engineering, or a related technical discipline in Computer Science, Software Engineering ...
San Jose, CA · On-site
$60/hr
... multimodal AI systems. Our mission is to provide a robust, scalable, and high-performance ... Engineering, or a related technical discipline in Computer Science, Software Engineering ...
If you want to build infrastructure that the AI ecosystem runs on, and earn ownership quickly by ... Partner across engineering, product, and partner teams to ship improvements and unblock work ...
If you want to build infrastructure that the AI ecosystem runs on, and earn ownership quickly by ... Partner across engineering, product, and partner teams to ship improvements and unblock work ...
San Francisco, CA · On-site
$203K - $241K/yr
About the Role We are hiring Software Engineers focused on AI Infrastructure to build the systems that enable frontier multimodal AI to operate reliably at production scale. This role exists because ...
San Francisco, CA · On-site
$203K - $241K/yr
About the Role We are hiring Software Engineers focused on AI Infrastructure to build the systems that enable frontier multimodal AI to operate reliably at production scale. This role exists because ...
San Jose, CA · On-site
$60/hr
... multimodal AI systems. Our mission is to provide a robust, scalable, and high-performance ... Engineering, or a related technical discipline in Computer Science, Software Engineering ...
San Jose, CA · On-site
$60/hr
... multimodal AI systems. Our mission is to provide a robust, scalable, and high-performance ... Engineering, or a related technical discipline in Computer Science, Software Engineering ...
San Jose, CA · On-site
$162K - $387K/yr
... multimodal AI systems. Our mission is to provide a robust, scalable, and high-performance ... Engineering, or a related technical discipline. in Computer Science, Software Engineering ...
San Jose, CA · On-site
$162K - $387K/yr
... multimodal AI systems. Our mission is to provide a robust, scalable, and high-performance ... Engineering, or a related technical discipline. in Computer Science, Software Engineering ...
San Francisco, CA · On-site
$203K - $241K/yr
Netic is the AI revenue engine for essential services who are the backbone of the American economy ... As an Agent Infrastructure Engineer , you'll architect and scale the backbone supporting our ...
San Francisco, CA · On-site
$203K - $241K/yr
Netic is the AI revenue engine for essential services who are the backbone of the American economy ... As an Agent Infrastructure Engineer , you'll architect and scale the backbone supporting our ...
$125K - $175K/yr
You will work alongside top talent, including a founding engineer who did AI research at MILA and at Elon Musk's SpaceX school, a Head of Risk from Mercury, Stripe, and Circle, and a Payments ...
$125K - $175K/yr
You will work alongside top talent, including a founding engineer who did AI research at MILA and at Elon Musk's SpaceX school, a Head of Risk from Mercury, Stripe, and Circle, and a Payments ...
San Francisco, CA · On-site
$125K - $175K/yr
You will work alongside top talent, including a founding engineer who did AI research at MILA and at Elon Musk's SpaceX school, a Head of Risk from Mercury, Stripe, and Circle, and a Payments ...
Quick apply
San Francisco, CA · On-site
$125K - $175K/yr
You will work alongside top talent, including a founding engineer who did AI research at MILA and at Elon Musk's SpaceX school, a Head of Risk from Mercury, Stripe, and Circle, and a Payments ...
San Francisco, CA · On-site
$180 - $250/hr
About LatchBio We build the benchmarks that test whether frontier AI can actually do computational ... We need engineers to build the infrastructure that powers our benchmarking pipeline - data ...
San Francisco, CA · On-site
$180 - $250/hr
About LatchBio We build the benchmarks that test whether frontier AI can actually do computational ... We need engineers to build the infrastructure that powers our benchmarking pipeline - data ...
San Jose, CA · On-site
$162K - $387K/yr
... multimodal AI systems. Our mission is to provide a robust, scalable, and high-performance ... Engineering, or a related technical discipline. in Computer Science, Software Engineering ...
San Jose, CA · On-site
$162K - $387K/yr
... multimodal AI systems. Our mission is to provide a robust, scalable, and high-performance ... Engineering, or a related technical discipline. in Computer Science, Software Engineering ...
Phoenix, AZ · On-site
$125K - $175K/yr
You will work alongside top talent, including a founding engineer who did AI research at MILA and at Elon Musk's SpaceX school, a Head of Risk from Mercury, Stripe, and Circle, and a Payments ...
Phoenix, AZ · On-site
$125K - $175K/yr
You will work alongside top talent, including a founding engineer who did AI research at MILA and at Elon Musk's SpaceX school, a Head of Risk from Mercury, Stripe, and Circle, and a Payments ...
San Francisco, CA · On-site
$126K - $166K/yr
Tamarind Bio is a company that enables scientists to access AI-powered drug discovery. They are seeking two Infrastructure Engineers to lead the scaling of their machine learning inference system ...
San Francisco, CA · On-site
$126K - $166K/yr
Tamarind Bio is a company that enables scientists to access AI-powered drug discovery. They are seeking two Infrastructure Engineers to lead the scaling of their machine learning inference system ...
San Francisco, CA · On-site
$180K - $280K/yr
We build reliable and general AI systems to power economically valuable automation. Our mission is ... About the role We're looking for an Infrastructure Engineer to build and operate the infrastructure ...
San Francisco, CA · On-site
$180K - $280K/yr
We build reliable and general AI systems to power economically valuable automation. Our mission is ... About the role We're looking for an Infrastructure Engineer to build and operate the infrastructure ...
San Francisco, CA · On-site
$180K - $250K/yr
About LatchBio We build the benchmarks that test whether frontier AI can actually do computational ... We need engineers to build the infrastructure that powers our benchmarking pipeline - data ...
San Francisco, CA · On-site
$180K - $250K/yr
About LatchBio We build the benchmarks that test whether frontier AI can actually do computational ... We need engineers to build the infrastructure that powers our benchmarking pipeline - data ...
San Francisco, CA · On-site
$210 - $290/hr
INFRASTRUCTURE ENGINEER, APPLIED AI The Firm Paradigm is a San Francisco-based investment firm focused on frontier technologies across the globe, with over $11 billion in assets under management. We ...
New
San Francisco, CA · On-site
$210 - $290/hr
INFRASTRUCTURE ENGINEER, APPLIED AI The Firm Paradigm is a San Francisco-based investment firm focused on frontier technologies across the globe, with over $11 billion in assets under management. We ...
New
San Francisco, CA · On-site
$250K - $400K/yr
INFRASTRUCTURE ENGINEER, APPLIED AI The Firm Paradigm is a San Francisco-based investment firm focused on frontier technologies across the globe, with over $11 billion in assets under management. We ...
San Francisco, CA · On-site
$250K - $400K/yr
INFRASTRUCTURE ENGINEER, APPLIED AI The Firm Paradigm is a San Francisco-based investment firm focused on frontier technologies across the globe, with over $11 billion in assets under management. We ...
San Francisco, CA · On-site
$125K - $164K/yr
Join a dynamic team as a Machine Learning Infrastructure Engineer at Character ... AI, where you'll enhance infrastructure for machine learning endeavors. This role requires ...
San Francisco, CA · On-site
$125K - $164K/yr
Join a dynamic team as a Machine Learning Infrastructure Engineer at Character ... AI, where you'll enhance infrastructure for machine learning endeavors. This role requires ...
| Aspect | Entry Level Ai Infrastructure Engineer | Data Engineer |
|---|---|---|
| Required Credentials | Bachelor's in CS, EE, or related; familiarity with AI tools | Bachelor's in CS, Data Science, or related; experience with databases |
| Work Environment | AI/ML teams, cloud platforms, infrastructure setup | Data pipelines, database management, cloud services |
| Industry Usage | Tech companies, AI startups, research labs | Finance, healthcare, tech firms, data-driven industries |
Entry Level Ai Infrastructure Engineers focus on building and maintaining AI infrastructure, including cloud and hardware setups, while Data Engineers primarily develop data pipelines and manage data storage. Both roles require technical skills and often overlap in cloud environments, but they serve different core functions within data and AI projects.
The most popular types of Ai Infrastructure Engineer jobs in California are:
For Entry Level Ai Infrastructure Engineer jobs in California, the most frequently searched job titles are:
The top searched job categories for Entry Level Ai Infrastructure Engineer jobs in California are:
Cities in California with the most Entry Level Ai Infrastructure Engineer job openings:
$180 - $230/hr
Other
Medical, Dental, Vision, Life, Retirement
Posted 28 days ago
Vast.ai’s cloud powers AI projects and businesses all over the world. We are democratizing and decentralizing AI computing—reshaping our future for the benefit of humanity.
We are a growing and highly motivated team dedicated to an ambitious technical plan. Our structure is flat, our ambitions are out‑sized, and leadership is earned by shipping excellence.
We seek engineers with strong intrinsic drive, a true passion for advancing the state of the art, and a mix of architecture, coding, and communication skills.
LOCATION: On-site at our office in San Francisco or Westwood, Los Angeles.
As a Senior Infrastructure Engineer, you will help design and scale the core systems that power Vast.ai’s global GPU marketplace.
You’ll work closely with our founders and core engineering team to extend the underlying compute infrastructure — from GPU provisioning and scheduling to billing, orchestration, and marketplace dynamics.
We’re looking for someone who has previously built large-scale infrastructure platforms — systems with similarities to Vast.ai, or distributed compute orchestration frameworks.
Full-time · On-site at either our SF or LA offices
Python, C++, PostgreSQL, Linux, Docker, KVM, Redis, Terraform, AWS, REST/gRPC APIs
Distributed Systems: Experience building high-throughput backend systems or compute clouds
Compute Orchestration: Familiarity with Docker, or custom scheduling frameworks
GPU Infrastructure: Understanding of GPU provisioning, driver management, and workload scheduling
Billing & Metering: Implemented or integrated usage-based billing and account credit systems
Marketplace Dynamics: Knowledge of dynamic pricing, spot instances, or supply-demand balancing mechanisms
Security & Multi‑Tenancy: Experience designing secure, multi‑tenant systems in cloud environments
Programming: Strong programming skills in Python and C++; ability to write performant, maintainable, well-architected code
Database Expertise: Comfortable designing schemas and queries for large-scale data systems (PostgreSQL preferred)
Bonus points for:
Experience with GPU security, virtualization, or zero-trust compute isolation
Prior startup experience or end-to-end product ownership
Improve the backend systems that power Vast.ai’s compute marketplace
Integrate GPU provider onboarding, usage tracking, billing, and orchestration APIs
Develop scalable infrastructure for workload scheduling and resource management
Optimize pricing and marketplace logic for efficiency and transparency
Benchmark, profile, and harden systems for performance, reliability, and fault tolerance
Collaborate with product and infrastructure teams to shape the future of decentralized compute
After submitting your application, our technical team reviews your credentials. If selected, you’ll proceed through the following stages:
15 min – Initial screening with member of your future team (virtual)
40 min – Systems and architectures (virtual)
1 hour – LLM-assisted coding assessment (virtual)
2 hours – Meet and greet with coding assessment (on-site)
Comprehensive health, dental, vision, and life insurance
401(k) with company match
Meaningful early-stage equity
Onsite meals, snacks, and close collaboration with founders/tech leaders
Ambitious, fast-paced startup culture where initiative is rewarded
Sourced by ZipRecruiter
Software development
1 - 10 Employees
Los Angeles, CA, US
2018
