ZipRecruiter

Log In

1

Ai Infrastructure Jobs in San Ramon, CA (NOW HIRING)

NIO USA, INC

AI Infrastructure Engineer

San Jose, CA

$192K - $249K/yr

About the Position We are looking for a senior AI Inference Infrastructure Software Engineer with strong hands-on experience building, optimizing, and deploying high-performance, scalable inference ...

NIO

AI Infrastructure Engineer

San Jose, CA · On-site

$126K - $165K/yr

About the Position We are looking for a senior AI Inference Infrastructure Software Engineer with strong hands-on experience building, optimizing, and deploying high-performance, scalable inference ...

Biohub

Staff AI Infrastructure Engineer

Redwood City, CA · On-site +1

$131K - $172K/yr

Our clusters run Slurm on Kubernetes infrastructure and support everything from day-to-day AI researcher workflows to multi-node hero training runs at thousands of GPUs. The team works at the ...

NIO

AI Infrastructure Engineer

San Jose, CA · On-site

$126K - $165K/yr

About the Position We are looking for a senior AI Inference Infrastructure Software Engineer with strong hands-on experience building, optimizing, and deploying high-performance, scalable inference ...

previous pagenext page

Showing results 21-40

All JobsAi Infrastructure JobsAi Infrastructure Jobs in San Ramon, CA

Ai Infrastructure information

See San Ramon, CA salary details

$31

$66

$97

How much do ai infrastructure jobs pay per hour?

As of Aug 11, 2026, the average hourly pay for ai infrastructure in San Ramon, CA is $66.14, according to ZipRecruiter salary data. Most workers in this role earn between $53.75 and $77.12 per hour, depending on experience, location, and employer.

What is the difference between Ai Infrastructure vs Data Engineer?

AspectAi InfrastructureData Engineer
Required CredentialsBachelor's in CS, Engineering, or related; knowledge of cloud platforms and AI toolsBachelor's in CS, Data Science, or related; programming and database skills
Work EnvironmentCloud environments, AI model deployment, infrastructure setupData pipelines, database management, data processing
Employer & Industry UsageTech companies, AI startups, cloud providersTech firms, finance, healthcare, e-commerce

Ai Infrastructure professionals focus on building and maintaining the hardware and software systems that support AI models, while Data Engineers develop and manage data pipelines and databases. Both roles require technical skills and often collaborate but serve different core functions within AI and data ecosystems.

How much do AI infrastructure engineers make?

AI infrastructure engineers typically earn between $100,000 and $150,000 annually, depending on experience, location, and company size. Senior roles or those with specialized skills in cloud platforms and hardware may earn higher salaries, often exceeding $180,000.

What are AI infrastructure jobs?

AI infrastructure jobs involve designing, building, and maintaining the hardware, software, and network systems necessary to support artificial intelligence applications. These roles often require knowledge of cloud computing, data centers, machine learning frameworks, and system optimization to ensure reliable and efficient AI model deployment and operation.

What are the key skills and qualifications needed to thrive in AI infrastructure?

To thrive in AI Infrastructure, you need expertise in software engineering, distributed systems, cloud platforms, and a solid understanding of machine learning workflows, often supported by degrees in computer science or related fields. Familiarity with tools like Kubernetes, Docker, Terraform, and cloud services (AWS, GCP, Azure), as well as experience with CI/CD pipelines and monitoring systems, is essential. Strong problem-solving abilities, effective communication, and adaptability help professionals excel in cross-functional teams and rapidly evolving environments. These skills and qualities are crucial for building scalable, reliable systems that power AI applications and support organizational innovation.

What are common challenges faced by professionals working in AI infrastructure roles, and how can they be addressed?

Professionals in AI Infrastructure roles often encounter challenges related to scalability, system reliability, and integration with existing IT environments. Managing rapidly growing datasets and ensuring seamless deployment of machine learning models can be complex, requiring robust automation and monitoring tools. Collaboration with data scientists, software engineers, and DevOps teams is critical to ensure infrastructure meets the evolving needs of AI projects. Staying updated with the latest cloud technologies and best practices can help address these challenges and drive successful AI implementations.

What is AI infrastructure?

AI infrastructure refers to the combination of hardware, software, and cloud-based solutions that support the development, deployment, and scaling of artificial intelligence applications. It includes components such as GPUs, CPUs, storage systems, networking, data management tools, and machine learning frameworks. The goal of AI infrastructure is to provide the computational power and resources needed to train, test, and run AI models efficiently, whether on-premises or in the cloud. Organizations invest in robust AI infrastructure to accelerate innovation, manage large datasets, and ensure the reliability of their AI systems.
What are popular job titles related to Ai Infrastructure jobs in San Ramon, CA? For Ai Infrastructure jobs in San Ramon, CA, the most frequently searched job titles are:
What job categories do people searching Ai Infrastructure jobs in San Ramon, CA look for? The top searched job categories for Ai Infrastructure jobs in San Ramon, CA are:
What cities near San Ramon, CA are hiring for Ai Infrastructure jobs? Cities near San Ramon, CA with the most Ai Infrastructure job openings:
Ai Infrastructure jobs near you
Infographic showing various Ai Infrastructure job openings in San Ramon, CA as of August 2026, with employment types broken down into 73% Full Time, 23% Part Time, and 4% Contract. Highlights an 65% Physical, 3% Hybrid, and 32% Remote job distribution, with an average salary of $137,570 per year, or $66.1 per hour.

Solutions Architect - AI Infrastructure

Prime Intellect

San Francisco, CA • On-site

$275K/yr

Full-time

Re-posted 28 days ago

Job description

Own Your Intelligence
Prime Intellect is building the open superintelligence stack: the infrastructure frontier AI labs build internally, made available to every ambitious AI team.
Our platform, Lab, unifies compute, environments, evaluations, secure sandboxes, high-performance training, and deployment into one full-stack system for post-training at frontier scale - from SFT and RL to tool use, agent workflows, and continuously improving production models. We are building open frontier AI: open-source models trained end to end for long-horizon tasks like autonomous research, and the full-stack platform our own research team uses to build them. The next generation of AI companies, enterprises, and research teams do not just need more GPUs. They need the ability to turn their own workflows, tools, data, and feedback loops into superintelligence they own.
Prime Intellect has raised $150M in total funding from Founders Fund, Radical Ventures, NVIDIA, and exceptional AI, infrastructure, and enterprise operators - including Andrej Karpathy, Dwarkesh Patel, and leaders and founders from Ramp, Perplexity, Harvey, Mercor, Zapier, Datadog, Cognition, OpenAI, Thinking Machines, Together AI, SemiAnalysis, LangChain, Browserbase, Cloudflare, Sierra, Databricks, Airbnb, OpenRouter, Standard Intelligence, Fleet, Core Auto, and more. We are looking for people who want to build at the intersection of frontier research, real infrastructure, and go-to-market for a category that does not fully exist yet.
Role Impact
This role sits at the intersection of customer success, technical operations, and AI infrastructure delivery. You will work directly with customers to help them onboard, deploy, and scale on Prime Intellect infrastructure, while also building the internal systems, workflows, and automation that make that experience scalable over time.
Beyond supporting individual accounts, this person will help define how Prime Intellect serves sophisticated technical customers: turning high-touch support and deployment work into repeatable processes, better tooling, and durable operational leverage.
What You'll Do
Customer Success & Account Ownership
  • Serve as a primary point of contact for customers running AI workloads on our infrastructure
  • Own customer onboarding and deployment coordination from post-sale through production readiness
  • Build trusted relationships with customer teams and proactively manage issues, risks, and escalations
  • Partner with engineering and operations to ensure customer needs are translated clearly into internal action
Systems, Tooling & Operational Scale
  • Build and improve the internal systems that support customer onboarding, deployment tracking, escalation management, and account health
  • Identify repetitive manual workflows and turn them into streamlined processes, tooling, or automation
  • Help define the operating cadence, support infrastructure, and service model for managing technical customer accounts at scale
  • Create structure where none exists today, improving both customer experience and internal efficiency as the business grows
Commercial & Cross-Functional Execution
  • Track billing, contract milestones, renewals, and other key account workflows
  • Maintain visibility into deployment timelines, infrastructure commitments, and customer-specific requirements
  • Coordinate across customers, finance, engineering, and leadership to keep accounts running smoothly end-to-end

Requirements
  • 2-5 years of experience in customer success, technical account management, operations, or a similar cross-functional role
  • Strong interest in AI, GPU infrastructure, cloud systems, or technical products serving sophisticated customers
  • Comfortable working directly with customers and internal technical teams
  • Highly organized, detail-oriented, and able to manage multiple workstreams at once
  • Strong written and verbal communication skills
  • High ownership and willingness to operate flexibly when customer needs require urgency
  • Energized by building processes from the ground up in a fast-moving environment

Nice-to-Haves
  • Experience with infrastructure, cloud, DevOps, or enterprise technical products
  • Familiarity with SLAs, support operations, billing, procurement, or contract administration
  • Exposure to AI/ML infrastructure, model training environments, or GPU-based products
  • Experience in startups or high-growth environments

What We Offer
  • $200-275k Cash compensation + equity incentives
  • Flexible work environment
  • Visa sponsorship and relocation support
  • Professional development budget
  • Team off-sites and conference attendance

Apply