ZipRecruiter

Log In

1

Ai Infrastructure Engineer Jobs (NOW HIRING)

AMAX

AI Infrastructure Engineer

Fremont, CA · On-site

$126K - $165K/yr

Development and deployment of AI infrastructure workloads on-prem (GPU scheduling, model serving ... infra engineering Benefits * Medical Insurance * Dental Insurance * Vision Insurance * 401(k)

AMAX

AI Infrastructure Engineer

Fremont, CA

$117K - $154K/yr

Development and deployment of AI infrastructure workloads on-prem (GPU scheduling, model serving ... infra engineering Benefits * Medical Insurance * Dental Insurance * Vision Insurance * 401(k)

Spellbrush

AI Infrastructure Engineer

San Francisco, CA · On-site

$126K - $166K/yr

Spellbrush, the world's leading generative AI studio behind niji・journey , is looking for an AI Infrastructure Engineer to join us in building out end-to-end ML infrastructure to run our models on ...

Spellbrush

AI Infrastructure Engineer

San Francisco, CA · On-site

$126K - $166K/yr

Spellbrush, the world's leading generative AI studio behind niji・journey , is looking for an AI Infrastructure Engineer to join us in building out end-to-end ML infrastructure to run our models on ...

NIO USA, INC

AI Infrastructure Engineer

San Jose, CA

$192K - $249K/yr

About the Position We are looking for a senior AI Inference Infrastructure Software Engineer with strong hands-on experience building, optimizing, and deploying high-performance, scalable inference ...

The Josef Group

AI Infrastructure Engineer

Chantilly, VA

$110K - $144K/yr

AI Infrastructure Engineer Top Secret or TS/SCI is required to start $200K to $250K Chantilly, VA What You'll Do * Deploy and optimize self-hosted LLM inference servers (vLLM, Ollama, and similar)

NIO

AI Infrastructure Engineer

San Jose, CA · On-site

$126K - $165K/yr

About the Position We are looking for a senior AI Inference Infrastructure Software Engineer with strong hands-on experience building, optimizing, and deploying high-performance, scalable inference ...

NIO

AI Infrastructure Engineer

San Jose, CA · On-site

$126K - $165K/yr

About the Position We are looking for a senior AI Inference Infrastructure Software Engineer with strong hands-on experience building, optimizing, and deploying high-performance, scalable inference ...

previous page

Showing results 41-60

All JobsAi Infrastructure Engineer Jobs

Ai Infrastructure Engineer information

See salary details

$46.5K

$127.1K

$182K

How much do ai infrastructure engineer jobs pay per year?

As of Aug 2, 2026, the average yearly pay for ai infrastructure engineer in the United States is $127,066.00, according to ZipRecruiter salary data. Most workers in this role earn between $107,500.00 and $141,000.00 per year, depending on experience, location, and employer.

How much do AI infra engineers make?

AI infrastructure engineers typically earn between $100,000 and $150,000 annually, with salaries increasing based on experience, skills in cloud platforms, and knowledge of machine learning frameworks. Senior roles or those with specialized expertise can earn over $180,000 per year.

What does a typical day look like for an AI Infrastructure Engineer?

A typical day for an AI Infrastructure Engineer often involves designing and maintaining the underlying systems that support machine learning and AI workloads, such as setting up scalable cloud environments, automating workflows with CI/CD pipelines, and troubleshooting performance bottlenecks. You might collaborate closely with data scientists and software engineers to ensure seamless integration between AI models and production infrastructure. Daily activities can include writing and reviewing infrastructure-as-code, monitoring system health, and responding to incidents or scaling requests as needed. This role offers a dynamic mix of hands-on technical work, problem-solving, and teamwork, providing opportunities to refine your skills and contribute meaningfully to cutting-edge AI projects.

What is a $900000 AI job?

A $900,000 AI job typically refers to a high-level position in artificial intelligence, such as senior AI engineer, research scientist, or AI director, often offering top-tier compensation due to expertise, experience, and the strategic importance of AI projects. These roles usually require advanced skills in machine learning, deep learning, and data infrastructure, along with significant industry experience and sometimes advanced degrees or certifications.

What are the key skills and qualifications needed to thrive in the Ai Infrastructure Engineer position, and why are they important?

To thrive as an AI Infrastructure Engineer, a strong background in computer science, cloud computing, and distributed systems is typically required, often supported by a degree in a related field. Familiarity with tools like Kubernetes, Docker, TensorFlow, and cloud platforms (AWS, Azure, or GCP), along with certifications in cloud technologies or DevOps, is highly valuable. Strong problem-solving abilities, collaboration, and effective communication skills are essential to excel within multidisciplinary engineering teams. These competencies ensure the reliable deployment, scaling, and optimization of AI workloads in dynamic production environments.

What does an AI Infrastructure Engineer do?

An AI Infrastructure Engineer designs, builds, and maintains the computing systems that support AI and machine learning workloads. They manage cloud services, optimize hardware and software performance, and ensure scalability for AI models. Their work involves configuring GPUs, CPUs, storage, and networking, as well as automating workflows with DevOps and MLOps tools. They collaborate with data scientists and engineers to streamline AI development and deployment. Their goal is to create reliable, efficient, and scalable AI infrastructure.

What do AI infrastructure engineers do?

AI infrastructure engineers design, build, and maintain the hardware and software systems that support artificial intelligence models and applications. They work with cloud platforms, high-performance computing, and data storage solutions, often using tools like Kubernetes and Docker, to ensure scalable and efficient AI operations.

What engineers make $500,000?

Senior AI Infrastructure Engineers, cloud architects, and machine learning engineers with extensive experience and advanced skills in AI systems, cloud platforms, and distributed computing can reach or exceed $500,000 in total compensation, especially in high-demand industries or companies. Achieving this level often requires specialized certifications, leadership roles, and a strong track record of impactful projects.
More about Ai Infrastructure Engineer jobs
What cities are hiring for Ai Infrastructure Engineer jobs? Cities with the most Ai Infrastructure Engineer job openings:
What are the most commonly searched types of Ai Infrastructure Engineer jobs? The most popular types of Ai Infrastructure Engineer jobs are:
What states have the most Ai Infrastructure Engineer jobs? States with the most job openings for Ai Infrastructure Engineer jobs include:
What job categories do people searching Ai Infrastructure Engineer jobs look for? The top searched job categories for Ai Infrastructure Engineer jobs are:
Ai Infrastructure Engineer jobs near you
Infographic showing various Ai Infrastructure Engineer job openings in the United States as of July 2026, with employment types broken down into 73% Full Time, 24% Part Time, and 3% Contract. Highlights an 65% Physical, 3% Hybrid, and 32% Remote job distribution, with an average salary of $127,066 per year, or $61.1 per hour.

AI Infrastructure Engineer

AMAX

Fremont, CA • On-site

$126K - $165K/yr

Full-time

Medical, Dental, Vision, Retirement

Posted 20 days ago

Job description

  • Design, build, and operate on-prem infrastructure that behaves like a cloud environment for internal teams, including AI/ML workloads
  • Own datacenter and infrastructure operations: compute, storage, networking, and the automation layered on top
  • Build and maintain Infrastructure-as-Code using Terraform (Terragrunt), Ansible, etc.
  • Deploy, secure, and operate our HashiCorp stack (Vault, Boundary) alongside identity/access via Keycloak
  • Build and maintain observability with Prometheus, Grafana, and Alertmanager
  • Deploy and manage containerized workloads via Docker and Kubernetes
  • Design and maintain networking infrastructure: VLANs, routing, firewall rules, and load balancers
  • Write scripts/tools (and contribute code where useful) to automate operational toil
  • Provide general datacenter support for customers colocated in the HostMax datacenter - things like cabling, hardware swaps, rack/stack work, and basic troubleshooting
  • Participate in business-hours (M-F) on-call rotation for customer and infrastructure support
  • Participate in an SDLC/Scrum-based workflow, using Jira and Confluence for planning and documentation
  • Help define standards, runbooks, and best practices as the team grows
  • Development and deployment of AI infrastructure workloads on-prem (GPU scheduling, model serving infra, self-hosted AI tooling, etc.)

Requirements
  • Solid experience with Infrastructure-as-Code and Configuration-as-Code
  • Real-world on-prem/datacenter operations experience - this is explicitly not a cloud-native (AWS/GCP/Azure) role, though the environment is designed to feel cloud-like
  • Working knowledge of networking fundamentals: VLANs, routing, firewalls, and load balancers
  • Hands-on experience with containerization and orchestration (Docker, Kubernetes)
  • Proficiency with Git and standard version control workflows
  • Development/scripting skills sufficient to build internal tooling and automation (not just run existing playbooks)
  • Comfort with hands-on datacenter/hardware work (cabling, rack/stack, hardware troubleshooting) in addition to infra engineering

Benefits
  • Medical Insurance
  • Dental Insurance
  • Vision Insurance
  • 401(k)
  • Flexible spending account
  • Commuter benefits
  • Disability insurance

We also have a perfect location for all types of commuters: AMAX is located right between I-680 and I-880. Warm Springs/South Fremont BART station and bus stops are within a 10-minute walking distance. 5 grocery stores, 6+ coffee/tea places, and numerous restaurants within 1 mile. Feel free to try the delicious fusions or grab your daily groceries after work!
About AMAX
Established in 1979, AMAX is a globally recognized leader in GPU-accelerated IT infrastructure, specializing in transforming standard IT systems into advanced, high-performance computing solutions. Catering to industries such as AI, cloud computing, autonomous vehicles, and high-performance computing, AMAX has set benchmarks in innovation, including pioneering liquid-cooled HPC systems for the semiconductor industry. With a global footprint spanning North America, Europe, and Asia, AMAX offers end-to-end services from design and manufacturing to deployment. Committed to addressing the growing demands of AI, AMAX delivers advanced solutions that help organizations achieve their technology goal and drive progress on a global scale.
Join Us
Become part of a diverse and inclusive team that values your technical expertise and innovative thinking. Together, we'll push the boundaries of what's possible in the hardware industry.
AMAX is proud to be an equal-opportunity employer. We welcome all applicants and provide equal employment opportunities regardless of age, race, gender, or other legally protected characteristics.

Apply