1

Ai Infrastructure Hardware Engineer Jobs (NOW HIRING)

AI Infrastructure Engineer

Manhattan, NY ยท On-site

$215K - $350K/yr

Server, Hardware & Platform Operations * Deploy, monitor, and optimize Linux servers, GPU clusters ... Infrastructure Engineering * AI Platform Development * DevOps & Automation * Performance Testing ...

Staff Hardware Engineer

Austin, TX ยท On-site

$122K - $161K/yr

... systems infrastructure that will unlock the next generation of AI breakthroughs and power the ... Job Summary We are seeking a Staff Hardware Engineer to provide advanced operational, diagnostic ...

Senior AI Infrastructure Engineer

Santa Clara, CA ยท On-site

$127K - $173K/yr

About the role We are seeking a Senior AI Infrastructure Engineer to design, build, and scale the ... Networking & Hardware Tuning: Optimize low-level communication (e.g., NCCL tuning, InfiniBand, or ...

Senior AI Infrastructure Engineer

Santa Clara, CA ยท On-site

$127K - $173K/yr

About the role We are seeking a Senior AI Infrastructure Engineer to design, build, and scale the ... Networking & Hardware Tuning: Optimize low-level communication (e.g., NCCL tuning, InfiniBand, or ...

Senior Hardware Engineer

Saratoga, CA ยท On-site

$210K - $265K/yr

... infrastructure solutions that accelerate AI data centers to deliver Faster AI. Today's AI ... Visit our website eridu.ai to learn mo Position Overview As a Hardware Engineer in our Systems ...

AI Infrastructure Engineer

Fremont, CA ยท On-site

$126K - $165K/yr

Development and deployment of AI infrastructure workloads on-prem (GPU scheduling, model serving ... Comfort with hands-on datacenter/hardware work (cabling, rack/stack, hardware troubleshooting) in ...

AI Infrastructure Engineer

Fremont, CA ยท On-site

$117K - $154K/yr

Development and deployment of AI infrastructure workloads on-prem (GPU scheduling, model serving ... Comfort with hands-on datacenter/hardware work (cabling, rack/stack, hardware troubleshooting) in ...

Staff AI Infrastructure Engineer

Austin, TX ยท On-site

$106K - $139K/yr

Evaluate and integrate emerging AI infrastructure technologies, model serving frameworks, hardware ... Collaborate with engineering, research, product, and cross-functional teams to deliver secure ...

AI Infrastructure Engineer

Fremont, CA ยท On-site

$126K - $165K/yr

Development and deployment of AI infrastructure workloads on-prem (GPU scheduling, model serving ... Comfort with hands-on datacenter/hardware work (cabling, rack/stack, hardware troubleshooting) in ...

Staff AI Infrastructure Engineer

Austin, TX ยท On-site

$106K - $139K/yr

Evaluate and integrate emerging AI infrastructure technologies, model serving frameworks, hardware ... Collaborate with engineering, research, product, and cross-functional teams to deliver secure ...

AI Infrastructure Engineer

Ann Arbor, MI ยท Remote

$170K - $210K/yr

The AI Infrastructure Engineer is responsible for designing, building, and owning the end-to-end ... Optimize GPU utilization and inference performance across our hardware fleet, including NVIDIA ...

Senior Hardware Engineer - Infrastructure

San Mateo, CA ยท On-site

$125K - $168K/yr

As a member of the Infrastructure Foundation Hardware Engineering team, you will help develop and ... Familiarity with GPU platforms, AI accelerators, or high-performance compute (HPC) systems is a ...

Senior AI Infrastructure Engineer

Austin, TX ยท On-site

$107K - $146K/yr

Evaluate and integrate emerging AI infrastructure technologies, model serving frameworks, hardware ... Collaborate with engineering, research, product, and cross-functional teams to deliver secure ...

Infrastructure Engineer

San Francisco, CA ยท On-site

$126K - $166K/yr

AI Infrastructure Engineer -- Hardware Systems We're working with an early-stage AI company applying advanced AI agents to semiconductor engineering. They're hiring an infrastructure engineer who ...

New

Hardware Engineer - Liquid Cooling

New York, NY ยท On-site

$120K - $242K/yr

... leading AI labs, startups, and global enterprises, CoreWeave combines superior infrastructure ... CoreWeave is seeking a highly skilled and motivated Infrastructure/Hardware Engineer to join our ...

Hardware Engineer - Liquid Cooling

Bellevue, WA ยท On-site

$120K - $242K/yr

... leading AI labs, startups, and global enterprises, CoreWeave combines superior infrastructure ... CoreWeave is seeking a highly skilled and motivated Infrastructure/Hardware Engineer to join our ...

Showing results 21-40

Ai Infrastructure Hardware Engineer information

See salary details

$46.5K

$127.1K

$182K

How much do ai infrastructure hardware engineer jobs pay per year?

As of Sep 14, 2026, the average yearly pay for ai infrastructure hardware engineer in the United States is $127,066.00, according to ZipRecruiter salary data. Most workers in this role earn between $107,500.00 and $141,000.00 per year, depending on experience, location, and employer.

What are popular job titles related to Ai Infrastructure Hardware Engineer jobs?

For Ai Infrastructure Hardware Engineer jobs, the most frequently searched job titles are:

Infographic showing various Ai Infrastructure Hardware Engineer job openings in the United States as of June 2026, with employment types broken down into 95% Full Time, 3% Part Time, and 2% Contract. Highlights an 66% Physical, 3% Hybrid, and 31% Remote job distribution, with an average salary of $127,066 per year, or $61.1 per hour.

AI Infrastructure Engineer

Manhattan, NY โ€ข On-site

$215K - $350K/yr

Other

Medical, Dental, Vision, Life, Retirement, PTO

Posted 12 days ago


Job description

We are seeking an AI Infrastructure Engineer to build, operate, and continuously enhance the Linux and GPU-based infrastructure that powers our AI platforms and performance testing environments. This is a highly hands-on infrastructure, automation, and performance engineering role. You will design and maintain benchmarking frameworks, ensure the reliability and security of lab and compute environments, and develop internal AI platform services that support customer demonstrations, proof-of-concepts, competitive evaluations, and technical sales efforts. Your work will play a key role in helping secure new customer opportunities by enabling rapid validation of customer requirements and showcasing the performance and capabilities of our AI solutions.

Key ResponsibilitiesAI Infrastructure & Performance Engineering
  • Operate, maintain, and enhance automated performance testing services that benchmark throughput, latency, scalability, and resource utilization.
  • Develop new testing frameworks, automation, and validation methodologies as requirements evolve.
  • Analyze performance data and recommend improvements to reliability, scalability, and operational efficiency.
Server, Hardware & Platform Operations
  • Deploy, monitor, and optimize Linux servers, GPU clusters, virtualization platforms, and lab hardware.
  • Support availability and utilization of compute resources for engineering, testing, and AI workloads.
  • Evaluate and integrate new hardware technologies to improve performance and efficiency.
Reliability Engineering & AI Platform Development
  • Implement monitoring, logging, alerting, failover, and incident response for critical infrastructure.
  • Develop, deploy, and maintain internal AI server applications and shared compute platforms.
  • Improve operational efficiency through automation and proactive issue identification; troubleshoot complex system/network/application issues.
Laboratory Administration
  • Support day-to-day lab operations: access control, network administration, resource allocation, and capacity planning.
  • Contribute to operational standards and best practices for lab governance.
Documentation & Knowledge Sharing
  • Create and maintain technical documentation: benchmarking reports, design notes, and internal runbooks.
  • Share technical insights and best practices with the broader engineering organization.
Required Qualifications (Must-Have)

.

  • Hands-on Linux systems administration and infrastructure experience (servers, networking fundamentals, virtualization).
  • Experience with KVM or containerization (Docker/Kubernetes).
  • Familiarity with DevOps toolchains (CI/CD, IaC, monitoring/observability stacks).
  • Strong scripting/automation ability in Python and/or Bash, applied to infrastructure or testing workflows.
  • Practical experience with GPU-based compute environments or AI/ML infrastructure.
Preferred Qualifications
  • Bachelor's degree in Computer Science, Computer Engineering, or a related field (equivalent experience welcome).
  • Experience with performance testing, benchmarking, or traffic-generation methodologies.
  • Exposure to network security concepts and enterprise security technologies.
  • Experience with Fortinet products (FortiGate, FortiManager, FortiAnalyzer) or similar enterprise security/networking solutions - a plus, not required.
  • Experience in customer-facing technical work: proof-of-concept support, demos, or technical presentations.
  • Experience creating technical documentation, white papers, or delivering internal training.
Core Competencies
  • Infrastructure Engineering
  • AI Platform Development
  • DevOps & Automation
  • Performance Testing & Benchmarking
  • Technical Documentation

Fortinet offers employees a variety of benefits, including medical, dental, vision, life and disability insurance, 401(k), 11 paid holidays, vacation time, and sick time as well as a comprehensive leave program.

Wage ranges are based on various factors including the labor market, job type, and job level. On target earnings for this position is expected to be $215,000 - $350,000 per year. Exact salary offers will be determined by factors such as the candidate's subject knowledge, skill level, qualifications, experience, and geographic location.

All roles are eligible to participate in the Fortinet equity program, and this position is also eligible for commissions based on the terms of the Sales Compensation Plan

Fortinet makes possible a digital world that we can always trust through its mission to protect people, devices, and data everywhere. This is why the world's largest enterprises, service providers, and government organizations choose Fortinet to securely accelerate their digital journey. The Fortinet Security Fabric platform delivers broad, integrated, and automated protections across the entire digital attack surface, securing critical devices, data, applications, and connections from the data center to the cloud to the home office. Ranking #1 in the most security appliances shipped worldwide, more than 615,000 customers trust Fortinet to protect their businesses. And the Fortinet NSE Training Institute, an initiative of Fortinet's Training Advancement Agenda (TAA), provides one of the largest and broadest training programs in the industry to make cyber training and new career opportunities available to everyone.
#J-18808-Ljbffr