1

Infrastructure Operations Manager Jobs in California

About the Role: We're looking for a builder - someone who loves solving hard operational problems ... You'll be accountable for outcomes - building the infrastructure, tools, and processes that let our ...

The Sr. Director of Infrastructure will lead the strategic direction, design, and management of ICANN's on-premise, hybrid, and cloud-based infrastructure and IT operations. This leader will ensure ...

Infrastructure Architect

Rosemead, CA

$67.25 - $86/hr

... infrastructure operations, Data Center and Network or Telecommunications management Desired years of experience*: Above 5 years Education/ Certifications (Required): Bachelor of Science Top 3 ...

Staff Infrastructure Engineer

San Francisco, CA ยท On-site

$126K - $166K/yr

The Staff Software Infrastructure Engineer will manage cloud infrastructure operations, develop automation tools, and support the transition to Kubernetes while ensuring efficient server provisioning ...

next page

Showing results 1-20

Infrastructure Operations Manager information

See California salary details

$79.4K

$152K

$195.4K

How much do infrastructure operations manager jobs pay per year?

As of Jun 20, 2026, the average yearly pay for infrastructure operations manager in California is $152,011.00, according to ZipRecruiter salary data. Most workers in this role earn between $111,500.00 and $194,400.00 per year, depending on experience, location, and employer.

What are some common challenges faced by Infrastructure Operations Managers, and how can they be addressed?

Infrastructure Operations Managers often encounter challenges such as balancing system uptime with maintenance needs, managing diverse teams across shifts, and responding promptly to unexpected outages. Proactively implementing robust monitoring tools, establishing clear incident response protocols, and fostering open communication within the team can help address these issues. Additionally, staying updated on emerging technologies and encouraging staff training ensures the infrastructure operates efficiently and securely.

What is an Infrastructure Operations Manager?

An Infrastructure Operations Manager is a professional responsible for overseeing the daily operations, maintenance, and performance of an organization's IT infrastructure. This includes managing servers, networks, storage, and related hardware and software to ensure systems run efficiently and securely. They lead technical teams, coordinate incident response, and implement best practices for reliability and scalability. Their role is vital in minimizing downtime, optimizing resources, and supporting business objectives through robust IT operations.

What is the difference between Infrastructure Operations Manager vs Network Operations Manager?

AspectInfrastructure Operations ManagerNetwork Operations Manager
CertificationsITIL, CompTIA, Cisco certificationsCCNA, CCNP, CompTIA Network+
Work EnvironmentData centers, cloud environments, enterprise ITNetwork operations centers, enterprise networks
Industry UsageIT service providers, large corporationsTelecommunications, ISPs, large enterprises
Primary FocusManaging overall IT infrastructure, hardware, and cloud systemsManaging network performance, security, and connectivity

The Infrastructure Operations Manager oversees the entire IT infrastructure, including hardware, cloud systems, and data centers, ensuring seamless operation. In contrast, the Network Operations Manager focuses specifically on network performance, security, and connectivity. Both roles require similar certifications and are vital in enterprise IT environments, but their scope and daily responsibilities differ.

What are the key skills and qualifications needed to thrive as an Infrastructure Operations Manager, and why are they important?

To thrive as an Infrastructure Operations Manager, you need expertise in IT infrastructure management, network administration, and a relevant degree or certifications such as ITIL or CompTIA. Familiarity with server management tools, cloud platforms (like AWS or Azure), and monitoring systems is typically required. Strong leadership, strategic problem-solving, and effective communication skills help drive team performance and coordinate complex projects. These skills are crucial for ensuring system reliability, efficient operations, and minimal downtime in critical business environments.
What are the most commonly searched types of Infrastructure Operations jobs in California? The most popular types of Infrastructure Operations jobs in California are:
What are popular job titles related to Infrastructure Operations Manager jobs in California? For Infrastructure Operations Manager jobs in California, the most frequently searched job titles are:
What job categories do people searching Infrastructure Operations Manager jobs in California look for? The top searched job categories for Infrastructure Operations Manager jobs in California are:
What cities in California are hiring for Infrastructure Operations Manager jobs? Cities in California with the most Infrastructure Operations Manager job openings:
AI Infrastructure Operations Engineer

AI Infrastructure Operations Engineer

Cerebras Systems

Sunnyvale, CA โ€ข On-site

$126K - $165K/yr

Full-time

Posted 20 days ago


Job description

Cerebras Systems builds the world's largest AI chip, 56 times larger than GPUs. Our novel wafer-scale architecture provides the AI compute power of dozens of GPUs on a single chip, with the programming simplicity of a single device. This approach allows Cerebras to deliver industry-leading training and inference speeds and empowers machine learning users to effortlessly run large-scale ML applications, without the hassle of managing hundreds of GPUs or TPUs.
Cerebras' current customers include top model labs, global enterprises, and cutting-edge AI-native startups. OpenAI recently announced a multi-year partnership with Cerebras, to deploy 750 megawatts of scale, transforming key workloads with ultra high-speed inference.
Thanks to the groundbreaking wafer-scale architecture, Cerebras Inference offers the fastest Generative AI inference solution in the world, over 10 times faster than GPU-based hyperscale cloud inference services. This order of magnitude increase in speed is transforming the user experience of AI applications, unlocking real-time iteration and increasing intelligence via additional agentic computation.
About The Role
We are seeking a highly skilled and experienced AI Infrastructure Operations Engineer to manage and operate our cutting-edge machine learning compute clusters. These clusters would provide the candidate an opportunity to work with the world's largest computer chip, the Wafer-Scale Engine (WSE), and the systems that harness its unparalleled power.
You will play a critical role in ensuring the health, performance, and availability of our infrastructure, maximizing compute capacity, and supporting our growing AI initiatives. This role requires a deep understanding of Linux-based systems, containerization technologies, and experience with monitoring and troubleshooting complex distributed systems. The ideal candidate is a proactive problem-solver with expertise in large-scale compute infrastructure, dependable and an advocate for customer success.
Responsibilities
  • Manage and operate multiple advanced AI compute infrastructure clusters.
  • Monitor and oversee cluster health, proactively identifying and resolving potential issues.
  • Maximize compute capacity through optimization and efficient resource allocation.
  • Deploy, configure, and debug container-based services using Docker.
  • Provide 24/7 monitoring and support, leveraging automated tools and performing hands-on troubleshooting as needed.
  • Handle engineering escalations and collaborate with other teams to resolve complex technical challenges.
  • Contribute to the development and improvement of our monitoring and support processes.
  • Stay up-to-date with the latest advancements in AI compute infrastructure and related technologies.
Skills And Requirements
  • 6-8 years of relevant experience in managing and operating complex compute infrastructure, preferably in the context of machine learning or high-performance computing.
  • Strong proficiency in Python scripting for automation and system administration.
  • Deep understanding of Linux-based compute systems and command-line tools.
  • Extensive knowledge of Docker containers and container orchestration platforms like k8s and SLURM.
  • Proven ability to troubleshoot and resolve complex technical issues in a timely and efficient manner.
  • Experience with monitoring and alerting systems.
  • Should have a proven track record to own and drive challenges to completion.
  • Excellent communication and collaboration skills.
  • Ability to work effectively in a fast-paced environment.
  • Willingness to participate in a 24/7 on-call rotation.

Preferred Skills And Requirements
  • Operating large scale GPU clusters.
  • Knowledge of technologies like Ethernet, RoCE, TCP/IP, etc. is desired.
  • Knowledge of cloud computing platforms (e.g., AWS, GCP, Azure).
  • Familiarity with machine learning frameworks and tools.
  • Experience with cross-functional team projects.
Location
  • SF Bay Area.
  • Toronto, Canada.
  • Bangalore, India.

Why Join Cerebras
People who are serious about software make their own hardware. At Cerebras we have built a breakthrough architecture that is unlocking new opportunities for the AI industry. With dozens of model releases and rapid growth, we've reached an inflection point in our business. Members of our team tell us there are five main reasons they joined Cerebras:
  1. Build a breakthrough AI platform beyond the constraints of the GPU.
  2. Publish and open source their cutting-edge AI research.
  3. Work on one of the fastest AI supercomputers in the world.
  4. Enjoy job stability with startup vitality.
  5. Our simple, non-corporate work culture that respects individual beliefs.

Read our blog: Five Reasons to Join Cerebras in 2026.
Apply today and become part of the forefront of groundbreaking advancements in AI!
Cerebras Systems is committed to creating an equal and diverse environment and is proud to be an equal opportunity employer. We celebrate different backgrounds, perspectives, and skills. We believe inclusive teams build better products and companies. We try every day to build a work environment that empowers people to do their best work through continuous learning, growth and support of those around them.
This website or its third-party tools process personal data. For more details, click here to review our CCPA disclosure notice.