1

Ai Infrastructure Jobs (NOW HIRING)

AI Infrastructure Engineer

Manhattan, NY ยท On-site

$215 - $350/hr

We are seeking an AI Infrastructure Engineer to build, operate, and continuously enhance the Linux and GPU-based infrastructure that powers our AI platforms and performance testing environments. This ...

Staff AI Infrastructure Engineer

Austin, TX

$106K - $139K/yr

As a Staff AI Infrastructure Engineer, you will design, build, and operate the platforms that enable large-scale training, serving, evaluation, and deployment of foundation models and autonomous AI ...

Senior AI Infrastructure Engineer

Santa Clara, CA ยท On-site

$127K - $173K/yr

About the role We are seeking a Senior AI Infrastructure Engineer to design, build, and scale the high-performance AI platform powering our autonomous driving models. While researchers focus on ...

Staff AI Infrastructure Engineer

Austin, TX ยท On-site

$106K - $139K/yr

As a Staff AI Infrastructure Engineer, you will design, build, and operate the platforms that enable large-scale training, serving, evaluation, and deployment of foundation models and autonomous AI ...

AI Infrastructure Engineer

New York, NY ยท On-site

$215K - $350K/yr

We are seeking an AI Infrastructure Engineer to build, operate, and continuously enhance the Linux and GPU-based infrastructure that powers our AI platforms and performance testing environments. This ...

AI Infrastructure Engineer

New York, NY ยท On-site

$215K - $350K/yr

We are seeking an AI Infrastructure Engineer to build, operate, and continuously enhance the Linux and GPU-based infrastructure that powers our AI platforms and performance testing environments. This ...

Senior AI Infrastructure Engineer

Austin, TX ยท On-site

$107K - $146K/yr

As a Senior AI Infrastructure Engineer, you will design, build, and operate the platforms that enable large-scale training, serving, evaluation, and deployment of foundation models and autonomous AI ...

AI Infrastructure Engineer L3

Santa Clara, CA ยท On-site

$125K - $164K/yr

AI Infrastructure Engineer L3 Location: Santa Clara, CA Experience: 10 plus Years Employment Type: Full-Time About HCLTech HCLTech is a global technology company with over 220,000 professionals ...

AI Infrastructure Engineer

New York, NY ยท On-site

$215K - $350K/yr

We are seeking an AI Infrastructure Engineer to build, operate, and continuously enhance the Linux and GPU-based infrastructure that powers our AI platforms and performance testing environments. This ...

Senior AI Infrastructure Engineer

Santa Clara, CA ยท On-site

$127K - $173K/yr

About the role We are seeking a Senior AI Infrastructure Engineer to design, build, and scale the high-performance AI platform powering our autonomous driving models. While researchers focus on ...

AI Infrastructure Lead

San Francisco, CA ยท On-site

$120 - $170/hr

We need an AI Infrastructure Lead to own the design and operation of our GPU cluster management layer, model serving pipeline, and low-latency routing system. You will work directly with the CTO and ...

Senior AI Infrastructure Engineer

Austin, TX

$107K - $146K/yr

As a Senior AI Infrastructure Engineer, you will design, build, and operate the platforms that enable large-scale training, serving, evaluation, and deployment of foundation models and autonomous AI ...

AI Infrastructure Engineer

New York, NY ยท Remote

$140K - $165K/yr

As vCluster's AI Infrastructure Specialist, you will work directly with customers at the earliest and most critical stage of their journey: from bare metal GPU nodes through to a production-ready ...

AI Infrastructure Engineer

Manhattan, NY ยท On-site

$215 - $350/hr

We are seeking an AI Infrastructure Engineer to build, operate, and continuously enhance the Linux and GPU-based infrastructure that powers our AI platforms and performance testing environments. This ...

AI Infrastructure Engineer

New York, NY ยท On-site

$117K - $154K/yr

YOUR ROLE AND IMPACT As an AI-Enabled Infrastructure and Systems Engineer, you will combine deep infrastructure expertise with modern software engineering practices to design, build, and operate the ...

AI Infrastructure Engineer

New York, NY ยท On-site

$117K - $154K/yr

YOUR ROLE AND IMPACT As an AI-Enabled Infrastructure and Systems Engineer, you will combine deep infrastructure expertise with modern software engineering practices to design, build, and operate the ...

Showing results 21-40

Ai Infrastructure information

See salary details

$28

$59

$87

How much do ai infrastructure jobs pay per hour?

As of Sep 6, 2026, the average hourly pay for ai infrastructure in the United States is $59.18, according to ZipRecruiter salary data. Most workers in this role earn between $48.08 and $68.99 per hour, depending on experience, location, and employer.

What is AI infrastructure?

AI infrastructure refers to the combination of hardware, software, and cloud-based solutions that support the development, deployment, and scaling of artificial intelligence applications. It includes components such as GPUs, CPUs, storage systems, networking, data management tools, and machine learning frameworks. The goal of AI infrastructure is to provide the computational power and resources needed to train, test, and run AI models efficiently, whether on-premises or in the cloud. Organizations invest in robust AI infrastructure to accelerate innovation, manage large datasets, and ensure the reliability of their AI systems.

What are the key skills and qualifications needed to thrive in AI infrastructure?

To thrive in AI Infrastructure, you need expertise in software engineering, distributed systems, cloud platforms, and a solid understanding of machine learning workflows, often supported by degrees in computer science or related fields. Familiarity with tools like Kubernetes, Docker, Terraform, and cloud services (AWS, GCP, Azure), as well as experience with CI/CD pipelines and monitoring systems, is essential. Strong problem-solving abilities, effective communication, and adaptability help professionals excel in cross-functional teams and rapidly evolving environments. These skills and qualities are crucial for building scalable, reliable systems that power AI applications and support organizational innovation.

What are common challenges faced by professionals working in AI infrastructure roles, and how can they be addressed?

Professionals in AI Infrastructure roles often encounter challenges related to scalability, system reliability, and integration with existing IT environments. Managing rapidly growing datasets and ensuring seamless deployment of machine learning models can be complex, requiring robust automation and monitoring tools. Collaboration with data scientists, software engineers, and DevOps teams is critical to ensure infrastructure meets the evolving needs of AI projects. Staying updated with the latest cloud technologies and best practices can help address these challenges and drive successful AI implementations.

What is the difference between Ai Infrastructure vs Data Engineer?

AspectAi InfrastructureData Engineer
Required CredentialsBachelor's in CS, Engineering, or related; knowledge of cloud platforms and AI toolsBachelor's in CS, Data Science, or related; programming and database skills
Work EnvironmentCloud environments, AI model deployment, infrastructure setupData pipelines, database management, data processing
Employer & Industry UsageTech companies, AI startups, cloud providersTech firms, finance, healthcare, e-commerce

Ai Infrastructure professionals focus on building and maintaining the hardware and software systems that support AI models, while Data Engineers develop and manage data pipelines and databases. Both roles require technical skills and often collaborate but serve different core functions within AI and data ecosystems.

What are AI infrastructure jobs?

AI infrastructure jobs involve designing, building, and maintaining the hardware, software, and network systems necessary to support artificial intelligence applications. These roles often require knowledge of cloud computing, data centers, machine learning frameworks, and system optimization to ensure reliable and efficient AI model deployment and operation.
More about Ai Infrastructure jobs

What cities are hiring for Ai Infrastructure jobs?

Cities with the most Ai Infrastructure job openings:

What states have the most Ai Infrastructure jobs?

States with the most job openings for Ai Infrastructure jobs include:

Infographic showing various Ai Infrastructure job openings in the United States as of August 2026, with employment types broken down into 76% Full Time, 20% Part Time, and 4% Contract. Highlights an 66% Physical, 4% Hybrid, and 30% Remote job distribution, with an average salary of $123,103 per year, or $59.2 per hour.

AI Infrastructure Engineer

Fortinet, Inc.

Manhattan, NY โ€ข On-site

$215 - $350/hr

Other

Medical, Dental, Vision, Life, Retirement, PTO

Posted 9 days ago


Job description

We are seeking an AI Infrastructure Engineer to build, operate, and continuously enhance the Linux and GPU-based infrastructure that powers our AI platforms and performance testing environments. This is a highly hands-on infrastructure, automation, and performance engineering role. You will design and maintain benchmarking frameworks, ensure the reliability and security of lab and compute environments, and develop internal AI platform services that support customer demonstrations, proof-of-concepts, competitive evaluations, and technical sales efforts. Your work will play a key role in helping secure new customer opportunities by enabling rapid validation of customer requirements and showcasing the performance and capabilities of our AI solutions.

Key Responsibilities AI Infrastructure & Performance Engineering
  • Operate, maintain, and enhance automated performance testing services that benchmark throughput, latency, scalability, and resource utilization.
  • Develop new testing frameworks, automation, and validation methodologies as requirements evolve.
  • Analyze performance data and recommend improvements to reliability, scalability, and operational efficiency.
Server, Hardware & Platform Operations
  • Deploy, monitor, and optimize Linux servers, GPU clusters, virtualization platforms, and lab hardware.
  • Support availability and utilization of compute resources for engineering, testing, and AI workloads.
  • Evaluate and integrate new hardware technologies to improve performance and efficiency.
Reliability Engineering & AI Platform Development
  • Implement monitoring, logging, alerting, failover, and incident response for critical infrastructure.
  • Develop, deploy, and maintain internal AI server applications and shared compute platforms.
  • Improve operational efficiency through automation and proactive issue identification; troubleshoot complex system/network/application issues.
Laboratory Administration
  • Support day-to-day lab operations: access control, network administration, resource allocation, and capacity planning.
  • Contribute to operational standards and best practices for lab governance.
Documentation & Knowledge Sharing
  • Create and maintain technical documentation: benchmarking reports, design notes, and internal runbooks.
  • Share technical insights and best practices with the broader engineering organization.
Required Qualifications (Must-Have)
  • Hands-on Linux systems administration and infrastructure experience (servers, networking fundamentals, virtualization).
  • Experience with KVM or containerization (Docker/Kubernetes).
  • Familiarity with DevOps toolchains (CI/CD, IaC, monitoring/observability stacks).
  • Strong scripting/automation ability in Python and/or Bash, applied to infrastructure or testing workflows.
  • Practical experience with GPU-based compute environments or AI/ML infrastructure.
Preferred Qualifications
  • Bachelor's degree in Computer Science, Computer Engineering, or a related field (equivalent experience welcome).
  • Experience with performance testing, benchmarking, or traffic-generation methodologies.
  • Exposure to network security concepts and enterprise security technologies.
  • Experience with Fortinet products (FortiGate, FortiManager, FortiAnalyzer) or similar enterprise security/networking solutions โ€” a plus, not required.
  • Experience in customer-facing technical work: proof-of-concept support, demos, or technical presentations.
  • Experience creating technical documentation, white papers, or delivering internal training.
Core Competencies
  • Infrastructure Engineering
  • AI Platform Development
  • DevOps & Automation
  • Performance Testing & Benchmarking
  • Technical Documentation

Fortinet offers employees a variety of benefits, including medical, dental, vision, life and disability insurance, 401(k), 11paid holidays, vacation time, and sick time as well as a comprehensive leave program.

Wage ranges are based on various factors including the labor market, job type, and job level. On target earnings for this position is expected to be $215,000 - $350,000 per year. Exact salary offers will be determined by factors such as the candidate's subject knowledge, skill level, qualifications, experience, and geographic location.

All roles are eligible to participate in the Fortinet equity program, and this position is also eligible for commissions based on the terms of the Sales Compensation Plan

#J-18808-Ljbffr