ZipRecruiter

Log In

1

Ai Infrastructure Job Jobs (NOW HIRING)

Gatik AI

Senior AI Infrastructure Engineer

Mountain View, CA · On-site

$128K - $174K/yr

About the role We are seeking a Senior AI Infrastructure Engineer to design, build, and scale the high-performance AI platform powering our autonomous driving models. While researchers focus on ...

BNY Mellon

AI Infrastructure Engineer

Lake Mary, FL · On-site

$94K - $123K/yr

AI Infrastructure Engineer At BNY, our culture allows us to run our company better and enables employees' growth and success. As a leading global financial services company at the heart of the global ...

BNY

AI Infrastructure Engineer

Lake Mary, FL · Hybrid

$94K - $123K/yr

AI Infrastructure Engineer At BNY, our culture allows us to run our company better and enables employees' growth and success. As a leading global financial services company at the heart of the global ...

BNY

AI Infrastructure Engineer

Lake Mary, FL · Hybrid

$94K - $123K/yr

AI Infrastructure Engineer At BNY, our culture allows us to run our company better and enables employees' growth and success. As a leading global financial services company at the heart of the global ...

MeshyAI

AI Infrastructure Engineer

Sunnyvale, CA · On-site

$125K - $164K/yr

The AI Infrastructure Engineer role involves ensuring the reliability and scalability of the AI model serving stack, while developing core engineering infrastructure to connect models to product ...

BNY Mellon

AI Infrastructure Engineer

Lake Mary, FL · On-site

$94K - $123K/yr

AI Infrastructure Engineer At BNY, our culture allows us to run our company better and enables employees' growth and success. As a leading global financial services company at the heart of the global ...

Analogdevices

Senior AI Infrastructure Engineer

Wilmington, MA · Hybrid

$118K - $161K/yr

Senior AI Infrastructure Engineer, Developer Experience Analog Devices, Inc. (NASDAQ: ADI) is a global semiconductor leader that bridges the physical and digital worlds to enable breakthroughs at the ...

Percepta

AI Infrastructure Engineer

$110K - $144K/yr

They are seeking an AI Infrastructure Engineer to own the infrastructure and operational reliability that powers their AI systems, focusing on defining infrastructure patterns and building ...

Autonomous Solutions

AI Infrastructure Engineer IV

Lehi, UT · On-site

$100K - $132K/yr

As an AI Infrastructure Engineer IV , you will play a critical role in designing, building, and maintaining the systems that power our AI and machine learning capabilities. You will ensure our ...

vCluster Labs

AI Infrastructure Engineer

New York, NY · Remote

$150K - $200K/yr

As vCluster's AI Infrastructure Specialist, you will work directly with customers at the earliest and most critical stage of their journey: from bare metal GPU nodes through to a production-ready ...

next page

Showing results 1-20

All JobsAi Infrastructure Job Jobs

Ai Infrastructure Job information

See salary details

$28

$59

$87

How much do ai infrastructure job jobs pay per hour?

As of Jun 28, 2026, the average hourly pay for ai infrastructure job in the United States is $59.18, according to ZipRecruiter salary data. Most workers in this role earn between $48.08 and $68.99 per hour, depending on experience, location, and employer.

What are some common challenges faced by professionals working in AI infrastructure roles?

Professionals in AI infrastructure roles often encounter challenges such as ensuring scalability and reliability of systems to handle large volumes of data and compute-intensive workloads. Managing the integration of diverse tools and frameworks, optimizing hardware and cloud resources, and maintaining security and compliance are also critical aspects. Additionally, effective collaboration with data scientists, software engineers, and DevOps teams is essential to streamline AI model deployment and monitoring. Staying current with rapidly evolving technologies is key to overcoming these challenges.

What is an AI Infrastructure job?

An AI Infrastructure job involves designing, building, and maintaining the foundational systems and tools required to support artificial intelligence and machine learning workloads. These professionals work on scalable computing environments, manage large datasets, and ensure high-performance computing resources are available for AI development and deployment. Their responsibilities often include optimizing hardware (like GPUs and TPUs), developing cloud-based solutions, and establishing reliable pipelines for data and model management. AI Infrastructure specialists collaborate with data scientists, ML engineers, and IT teams to deliver robust, efficient, and secure platforms that power AI applications.

What are the key skills and qualifications needed to thrive in an AI Infrastructure role, and why are they important?

To excel in an AI Infrastructure role, you need a strong background in computer science, cloud computing, and distributed systems, often supported by a relevant degree and experience with large-scale data environments. Proficiency with tools like Kubernetes, Docker, TensorFlow, PyTorch, and cloud platforms such as AWS, Azure, or Google Cloud is essential, along with familiarity with CI/CD pipelines and automation frameworks. Strong problem-solving, collaboration, and communication skills help drive innovation and facilitate cross-functional teamwork. These abilities ensure the robust, scalable, and efficient deployment of AI solutions that meet organizational needs.

What is the difference between Ai Infrastructure Job vs Data Engineer?

AspectAi Infrastructure JobData Engineer
Required CredentialsBachelor's in CS, Engineering, or related; knowledge of AI frameworksBachelor's in CS, Data Science, or related; programming skills in SQL, Python
Work EnvironmentData centers, cloud platforms, AI labsData pipelines, cloud environments, database systems
Industry UsageAI development, machine learning deploymentData processing, analytics, data pipeline creation

Ai Infrastructure Jobs focus on building and maintaining the hardware and software systems that support AI applications, including cloud and data center infrastructure. Data Engineers primarily develop and manage data pipelines and storage solutions to enable data analysis and machine learning. While both roles require technical skills and work in tech environments, Ai Infrastructure Jobs are more hardware and system-focused, whereas Data Engineers concentrate on data flow and management.

More about Ai Infrastructure Job jobs
What cities are hiring for Ai Infrastructure Job jobs? Cities with the most Ai Infrastructure Job job openings:
What states have the most Ai Infrastructure Job jobs? States with the most job openings for Ai Infrastructure Job jobs include:
What job categories do people searching Ai Infrastructure Job jobs look for? The top searched job categories for Ai Infrastructure Job jobs are:
Ai Infrastructure Job jobs near you
Infographic showing various Ai Infrastructure Job job openings in the United States as of June 2026, with employment types broken down into 100% Part Time. Highlights an 100% In-person job distribution, with an average salary of $123,103 per year, or $59.2 per hour.

Software Engineer, AI Infrastructure

Fireworks AI

New York, NY

$189K - $224K/yr

Other

Posted 24 days ago

Job description

The Role:

As a Software Engineer on our AI Infrastructure team, you will help design the core systems that power Fireworks AI's generative AI platform. You will help build infrastructure and tools that ensure the reliability, performance, quality, and availability of our AI system. 

Our mission is to make Fireworks AI the most reliable and user friendly generative AI platform in the world. You will partner closely with our cloud infrastructure team, product team, and performance team to deliver infrastructure that bridges the gap between our customer and the ultra-performant proprietary Fireworks inference engine. 

Key Responsibilities:
  • Contribute to the design and development of scalable backend infrastructure that supports distributed training, inference, and data pipelines
  • Build and maintain core backend services such as LLM CI/CD pipeline, control plane, and model serving systems
  • Support performance optimization, cost efficiency, and reliability improvements across compute, storage, and networking layers
  • Building frameworks and safeguards to ensure Fireworks AI has the best model quality in the industry
  • Collaborate with performance, training, and product teams to translate research and product needs into infrastructure solutions
  • Participate in code reviews, technical discussions, and continuous integration and deployment processes
Minimum Qualifications:
  • Bachelor's degree in Computer Science, Engineering, or a related technical field (or equivalent practical experience)
  • 3 years of experience in software engineering, with a focus on infrastructure or machine learning systems
  • Strong programming skills in Python, Go, or a similar language
  • Proven experience in ML infrastructure and tooling (e.g., PyTorch, MLflow, Vertex AI, SageMaker, Kubernetes, etc.).
  • Basic understanding of LLM knowledge (e.g., context length, disaggregated prefill, KV cache memory estimation, etc) 
Preferred Qualifications:
  • 5+ years of experience in software engineering, with a focus on infrastructure or machine learning systems
  •  Experience with open source inference engine like vLLM, Sglang, or TRT-LLM
  •  Contributions to open-source infrastructure or ML projects
  •  Experience in building large scale ML/MLOps infrastructure

Apply