1

Ai Infrastructure Job Jobs (NOW HIRING)

AI Infrastructure Engineer

New York, NY ยท Remote

$140K - $165K/yr

As vCluster's AI Infrastructure Specialist, you will work directly with customers at the earliest and most critical stage of their journey: from bare metal GPU nodes through to a production-ready ...

We are seeking an Infrastructure Manager with deep expertise in Kubernetes, Terraform, and Ansible to help scale Seekr's AI platform across on-premises, cloud, and SaaS environments. You'll be highly ...

AI Infrastructure Engineer

Fremont, CA ยท On-site

$140 - $190/hr

* Design, build, and operate onโ€‘prem infrastructure that behaves like a cloud environment for internal teams, including AI/ML workloads * Own datacenter and infrastructure operations: compute ...

AI Infrastructure Engineer

Fremont, CA ยท On-site

$126K - $165K/yr

* Design, build, and operate on-prem infrastructure that behaves like a cloud environment for internal teams, including AI/ML workloads * Own datacenter and infrastructure operations: compute, storage ...

AI Infrastructure Engineer

Fremont, CA ยท On-site

$126K - $165K/yr

* Design, build, and operate on-prem infrastructure that behaves like a cloud environment for internal teams, including AI/ML workloads * Own datacenter and infrastructure operations: compute, storage ...

AI Infrastructure Engineer

Los Altos, CA ยท On-site

$110 - $170/hr

Palona's AI agents operate continuously in production, handle real-time guest interactions, integrate with restaurant systems, and face sharp traffic peaks. Infrastructure is therefore part of the ...

New

AI Infrastructure Engineer

Charlotte, NC ยท On-site

$140 - $170/hr

Install, configure, and maintain AI platform and tools. * Design, deploy, and operate infrastructure supporting ML and LLM workloads. * Build, containerize, and deploy AI services using Docker.

New

AI Infrastructure Engineer

Fremont, CA ยท On-site

$117K - $154K/yr

* Design, build, and operate on-prem infrastructure that behaves like a cloud environment for internal teams, including AI/ML workloads * Own datacenter and infrastructure operations: compute, storage ...

AI & HPC Infrastructure Engineer

Des Moines, IA ยท On-site

$104K - $137K/yr

The Global AI Infrastructure team is at the center of enabling infrastructure reinvention for the next era of digital solutions powered by AI, accelerated computing, and high-performance workloads.

Showing results 41-60

Ai Infrastructure Job information

See salary details

$28

$59

$87

How much do ai infrastructure job jobs pay per hour?

As of Aug 21, 2026, the average hourly pay for ai infrastructure job in the United States is $59.18, according to ZipRecruiter salary data. Most workers in this role earn between $48.08 and $68.99 per hour, depending on experience, location, and employer.

What is an AI infrastructure job?

An AI Infrastructure job involves designing, building, and maintaining the foundational systems and tools required to support artificial intelligence and machine learning workloads. These professionals work on scalable computing environments, manage large datasets, and ensure high-performance computing resources are available for AI development and deployment. Their responsibilities often include optimizing hardware (like GPUs and TPUs), developing cloud-based solutions, and establishing reliable pipelines for data and model management. AI Infrastructure specialists collaborate with data scientists, ML engineers, and IT teams to deliver robust, efficient, and secure platforms that power AI applications.

What are some common challenges faced by professionals working in AI infrastructure roles?

Professionals in AI infrastructure roles often encounter challenges such as ensuring scalability and reliability of systems to handle large volumes of data and compute-intensive workloads. Managing the integration of diverse tools and frameworks, optimizing hardware and cloud resources, and maintaining security and compliance are also critical aspects. Additionally, effective collaboration with data scientists, software engineers, and DevOps teams is essential to streamline AI model deployment and monitoring. Staying current with rapidly evolving technologies is key to overcoming these challenges.

What are the key skills and qualifications needed to thrive in an AI infrastructure role, and why are they important?

To excel in an AI Infrastructure role, you need a strong background in computer science, cloud computing, and distributed systems, often supported by a relevant degree and experience with large-scale data environments. Proficiency with tools like Kubernetes, Docker, TensorFlow, PyTorch, and cloud platforms such as AWS, Azure, or Google Cloud is essential, along with familiarity with CI/CD pipelines and automation frameworks. Strong problem-solving, collaboration, and communication skills help drive innovation and facilitate cross-functional teamwork. These abilities ensure the robust, scalable, and efficient deployment of AI solutions that meet organizational needs.

What is the difference between Ai Infrastructure Job vs Data Engineer?

AspectAi Infrastructure JobData Engineer
Required CredentialsBachelor's in CS, Engineering, or related; knowledge of AI frameworksBachelor's in CS, Data Science, or related; programming skills in SQL, Python
Work EnvironmentData centers, cloud platforms, AI labsData pipelines, cloud environments, database systems
Industry UsageAI development, machine learning deploymentData processing, analytics, data pipeline creation

Ai Infrastructure Jobs focus on building and maintaining the hardware and software systems that support AI applications, including cloud and data center infrastructure. Data Engineers primarily develop and manage data pipelines and storage solutions to enable data analysis and machine learning. While both roles require technical skills and work in tech environments, Ai Infrastructure Jobs are more hardware and system-focused, whereas Data Engineers concentrate on data flow and management.

More about Ai Infrastructure Job jobs

What cities are hiring for Ai Infrastructure Job jobs?

Cities with the most Ai Infrastructure Job job openings:

What states have the most Ai Infrastructure Job jobs?

States with the most job openings for Ai Infrastructure Job jobs include:

Infographic showing various Ai Infrastructure Job job openings in the United States as of August 2026, with employment types broken down into 1% As Needed, 70% Full Time, 23% Part Time, and 6% Contract. Highlights an 95% Physical, 1% Hybrid, and 4% Remote job distribution, with an average salary of $123,103 per year, or $59.2 per hour.

AI Infrastructure Engineer

vCluster Labs

New York, NY โ€ข Remote

$140K - $165K/yr

Full-time

Medical, Dental, Vision, Life

Re-posted 23 days ago


Job description

As vCluster’s AI Infrastructure Specialist, you will work directly with customers at the earliest and most critical stage of their journey: from bare metal GPU nodes through to a production-ready deployment. This is not a traditional professional services role; you operate pre-sale as part of a proof of value engagement scoped to reach production. You will be one of the first team members a neocloud or AI Factory engages with at a technical depth, and the playbooks you develop will scale the motion for the next hire and customer.

vCluster is gaining rapid traction with GPU AI Clouds and enterprises building AI Factories: organizations that need to offer Kubernetes as a managed service on bare metal GPU infrastructure, and need to do it fast. This role exists to make that happen.

As an AI Infrastructure Engineer, your role will include:

  • Lead Technical Deployments: Drive end-to-end technical deployments for GPU neocloud and AI Factory customers, from initial bare metal configuration to a validated vCluster environment.

  • Infrastructure Optimization: Configure and troubleshoot bare metal GPU node infrastructure, including CNI configuration, GPU Operator setup, distributed storage backends, and RDMA/InfiniBand.

  • Validation: Deploy and validate Kubernetes and vCluster to provide GPU-powered managed K8s.

  • Knowledge Transfer: Work alongside customer teams to build self-sufficiency, ensuring they can operate and grow the platform independently.

  • Scaling through Documentation: Document reusable playbooks and deployment architectures so your learnings become the next customer's head start.

  • Feedback Loop: Collaborate with Engineering and Product to surface recurring infrastructure challenges, acting as a direct feedback loop from the field into the roadmap.

  • Strategic Partnering: Join Sales in the pre-sales process where deep infrastructure work is required to achieve a meaningful proof of value.

This role could be a fit for you if you bring:

  • Production K8s Mastery: 5+ years of experience deploying and operating Kubernetes in production, ideally on bare metal or in high-complexity environments.

  • GPU Fluency: Practical knowledge of NVIDIA GPU Operators, CUDA tooling, and systems-level configuration for GPU nodes.

  • Networking Fundamentals: Deep understanding of CNI plugins, overlay networks, load balancing, and connectivity diagnosis in layered environments.

  • Storage Expertise: Experience with persistent volume configuration, CSI drivers, and distributed systems like Ceph, Rook, Weka, or Longhorn.

  • Operational Agility: Comfort operating in ambiguous, fast-moving environments where you are often writing the playbook in real time.

  • Modern Tech Mindset: You thrive in environments that reject legacy tech and prefer a modern stack where you can solve a variety of problems from pipelines to internal services.

Bonus points for:
  • Automation Skills: Experience writing automation scripts with Bash, Python, or Go.

  • Kubernetes Depth: Relevant certifications such as CKA (Certified Kubernetes Administrator) or experience writing Kubernetes Operators.

  • AI/ML Familiarity: Experience with inference serving, GPU scheduling, and the tooling around LLM deployment.

  • Documentation: Experience building AI Automation in documentation to contribute to a shared knowledge base.

About vCluster Labs

We are a venture-backed tech startup and the company pioneering Kubernetes virtualization for the AI era. We raised +$30M from top-tier VCs such as Khosla Ventures (first investor in OpenAI, GitLab, Stripe, Doordash) and are in a hyper-growth phase looking for motivated people to complement our team. Our headquarters are in San Francisco (Salesforce Tower), but our team is distributed around the globe and we have a remote-first work culture.

We are the leading platform for operating GPU infrastructure, enabling AI Cloud providers to deliver a hyperscaler-like experience to their customers and AI factories that need to build that same experience for their internal teams. Our platform delivers the full operational stack operators need to run their GPU data centers — managed Kubernetes, fast isolated tenant provisioning, and automated node provisioning and lifecycle management — enabling them to accelerate time to value, reduce operational burden, and maximize the ROI of every GPU.

We're the company behind vCluster, an open-source technology for virtualizing Kubernetes (10k+ GitHub stars, 40M+ virtual clusters created since 2021). Open source is part of our DNA. At KubeCon North America 2025, we launched our Infrastructure Tenancy Platform for AI — a Kubernetes-native framework purpose-built for running AI, ML, and GPU-intensive workloads anywhere, with an NVIDIA-validated reference architecture for DGX systems.

Benefits

We offer the following benefits:

  • Competitive Salary: We offer a competitive compensation package, including equity.

  • Platinum-Level Insurance: Health, dental, vision, and life Insurance, including plans for you and eligible dependents (benefits vary depending on country).

  • Flexible Working Schedule:  You have a doctor’s appointment or need to head to the supermarket to get groceries at 2pm? We won’t have an issue with that. To us, results matter more than clocking in and out at the same time every day.

  • Workplace Flexibility:  We’re very flexible about where you work. We know things can change in life and we’re happy to adjust the work environment for you along the way.

Culture & Values

At vCluster Labs, we value and stand for:

  1. Make it Happen: We have a relentless bias for action and the grit to push through obstacles. We do whatever it takes to figure it out, put in the work, and ruthlessly prioritize the actions that drive measurable impact for the business.

  2. Own the Outcome: We understand that our responsibility doesn't end when a task is checked off; it ends when the value is delivered. We connect our daily individual actions to the broader success of the company and our customers.

  3. Create Wow: We measure success by the experience we generate, both inside and outside the company. For our customers, this means impressive speed and intuitive experiences. For our team, this means going the extra mile to support one another and to continuously drive each other to new heights.

  4. Open Source, Open Mind: We are actively contributing to and maintaining open-source projects. Internally, we foster meritocracy — the strongest ideas win, no matter who or where they come from.

  5. Build Tomorrow’s Standards, Intentionally: We don't just ship software; we define the state-of-the-art of tomorrow. We are fearless in tearing down old approaches to build something better, but we are disciplined in how we do it because we know our users rely on our technology to run mission-critical infrastructure platforms.

Compensation Range: $140K - $165K