1

Senior Ai Infrastructure Engineer Jobs (NOW HIRING)

Senior AI Infrastructure Engineer

Wilmington, MA · Hybrid

$118K - $161K/yr

Senior AI Infrastructure Engineer, Developer Experience Analog Devices, Inc. (NASDAQ: ADI) is a global semiconductor leader that bridges the physical and digital worlds to enable breakthroughs at the ...

Senior AI Infrastructure Engineer

Mountain View, CA · On-site

$128K - $174K/yr

About the role We are seeking a Senior AI Infrastructure Engineer to design, build, and scale the high-performance AI platform powering our autonomous driving models. While researchers focus on ...

Senior AI Infrastructure Engineer

Mountain View, CA · On-site

$128K - $174K/yr

About the role We are seeking a Senior AI Infrastructure Engineer to design, build, and scale the high-performance AI platform powering our autonomous driving models. While researchers focus on ...

Senior AI Infrastructure Engineer

Ann Arbor, MI · On-site

$106K - $144K/yr

They are seeking a Senior AI Infrastructure Engineer to develop modern AI models that detect nanoscale defects and drive the development of intelligent systems for semiconductor technology.

... engineers, and senior product technology process engineers. Central Engineering is KLA's largest ... This is your opportunity to shape the future of AI in the semiconductor industry! We're looking for ...

... engineers, and senior product technology process engineers. Central Engineering is KLA's largest ... This is your opportunity to shape the future of AI in the semiconductor industry! We're looking for ...

We are hiring multiple AI Infrastructure Engineers across data center infrastructure teams. Exact level, scope, and team placement may vary based on experience and business needs. AI Foundry is an AI ...

As an AI Infrastructure Engineer at Together, you are responsible for keeping all user-facing services and production systems running smoothly. You are a blend of a pragmatic operator and a software ...

next page

Showing results 1-20

Senior Ai Infrastructure Engineer information

See salary details

$22.5K

$127K

$175.5K

How much do senior ai infrastructure engineer jobs pay per year?

As of Jun 9, 2026, the average yearly pay for senior ai infrastructure engineer in the United States is $126,969.00, according to ZipRecruiter salary data. Most workers in this role earn between $108,500.00 and $147,500.00 per year, depending on experience, location, and employer.

What does a Senior AI Infrastructure Engineer do?

A Senior AI Infrastructure Engineer is responsible for designing, building, and maintaining the large-scale computing systems that support artificial intelligence (AI) and machine learning (ML) workloads. They work on optimizing data pipelines, managing cloud or on-premise infrastructure, ensuring scalability, and enabling efficient training and deployment of AI models. These professionals collaborate closely with data scientists, software engineers, and IT teams to create robust, high-performance environments that support the rapid development and deployment of AI solutions.

What are some typical challenges faced by Senior AI Infrastructure Engineers when scaling AI systems for production?

Senior AI Infrastructure Engineers often encounter challenges related to managing large-scale data pipelines, ensuring low-latency model serving, and maintaining system reliability as user demand grows. Balancing resource allocation for compute-intensive workloads, optimizing infrastructure costs, and implementing robust monitoring are common hurdles. Collaboration with data scientists, DevOps, and product teams is crucial to streamline deployment cycles and rapidly address issues as they arise. Mastery of distributed systems and cloud platforms often distinguishes top performers in this role.

What are the key skills and qualifications needed to thrive as a Senior AI Infrastructure Engineer, and why are they important?

To thrive as a Senior AI Infrastructure Engineer, you need deep expertise in computer science, cloud computing, distributed systems, and AI/ML frameworks, often supported by a relevant degree and significant experience. Proficiency with tools such as Kubernetes, Docker, TensorFlow, PyTorch, and cloud platforms like AWS or Azure—as well as experience with CI/CD pipelines—is typically required. Strong problem-solving abilities, collaboration, and effective communication are standout soft skills for this role. These competencies are crucial for designing scalable, reliable AI infrastructure that supports complex machine learning workflows and organizational goals.
More about Senior Ai Infrastructure Engineer jobs
What cities are hiring for Senior Ai Infrastructure Engineer jobs? Cities with the most Senior Ai Infrastructure Engineer job openings:
What are the most commonly searched types of Ai Infrastructure Engineer jobs? The most popular types of Ai Infrastructure Engineer jobs are:
What states have the most Senior Ai Infrastructure Engineer jobs? States with the most job openings for Senior Ai Infrastructure Engineer jobs include:

Senior AI Infrastructure Engineer

Analogdevices

Wilmington, MA • Hybrid

$118K - $161K/yr

Full-time

Medical, Dental, Vision, Retirement, PTO

Posted 23 days ago


Job description

About Analog Devices

Analog Devices, Inc. (NASDAQ:ADI) is a global semiconductor leader that bridges the physical and digital worlds to enable breakthroughs at the Intelligent Edge. ADI combines analog, digital, and software technologies into solutions that help drive advancements in digitized factories, mobility, and digital healthcare, combat climate change, and reliably connect humans and the world. With revenue of more than $9 billion in FY24 and approximately 24,000 people globally, ADI ensures today's innovators stay Ahead of What's Possible. Learn more atwww.analog.comand onLinkedInandTwitter (X).

Senior AI Infrastructure Engineer, Developer Experience

Analog Devices, Inc. (NASDAQ: ADI) is a global semiconductor leader that bridges the physical and digital worlds to enable breakthroughs at the Intelligent Edge. ADI combines analog, digital, and software technologies into solutions that help drive advancements in digitized factories, mobility, and digital healthcare, combat climate change, and reliably connect humans and the world. With revenue of more than$9 billionin FY24 and approximately24,000 peopleglobally, ADI ensures today's innovators stay Ahead of What's Possible. Learn more at www.analog.com and on LinkedIn and Twitter (X).

This role is within the global Developer Experience (DevEx) team, specifically the Model Developer Experience (MDX) sub-team - whose mission is to deliver world-class infrastructure and platforms that enable AI builders across ADI to move faster, with confidence, and at scale. You will join a high-performance, mission-driven interdisciplinary team that spans data science, software engineering, platform architecture, cloud infrastructure, and securityexpertise. We believe in a culture founded on trust, mutual respect, growth mindsets, and an obsessionforbuilding extraordinary products with extraordinary people.

Role Summary

As a Senior AI Infrastructure Engineer (individual contributor), you will bring deep technicalexpertisein building scalable AI infrastructure across diverse deployment environments, and the ability to design elegant solutions that absorb operational complexity on behalf of AI builders across the organization. You will work embedded with data science and ML engineering teams to understand their infrastructure needs at thecutting edge, then translate those learnings into reusable, org-wide architecturalpatternsand platforms.You'lldesign andimplementatcritical infrastructure capabilities that span on-prem, hybrid, and cloud environments-from model serving and orchestration, to compute optimization, cost efficiency, and governance.

You will work at the intersection of research, technical architecture, and developer enablement-translating research and product goals into infrastructure systems that reduce complexity and accelerate innovation.

Key Responsibilities

AI Developer Experience

  • Partner directly with AI builder teams (data scientists, ML engineers, researchers) as an embedded technical advisor, understanding their infrastructure bottlenecks and platform needs at the point of creation.

  • Translate specific team engagements into generalizable patterns, standards, and architectural guidance that can be adopted across the organization.

  • Drive initiatives that reduce friction in the AI development lifecycle-from experimentation through production-by removing operational and technical barriers for builders.

  • Design and advocate for developer-friendly abstractions and APIs that hide infrastructure complexity whilemaintainingflexibility for advanced use cases.

  • Collaborate with cross-functional stakeholders to define what "excellent developer experience" means for AI infrastructure, then measure and iterate.

  • Contribute to org-wide standards for AI governance, model versioning, experiment tracking, and deployment workflows that balance flexibility with reliability.

On-Prem, Hybrid, and Cloud AI Infrastructure Engineering

  • Design andoptimizeAI infrastructure strategies that span heterogeneous environments-on-premiseGPU clusters, hybrid cloud-edge deployments, and cloud-native architectures-ensuring seamless developer experience across all.

  • Architectcompute orchestration and scheduling solutions (Kubernetes, Ray, or equivalent) that efficientlyallocateresources across multiple environments and workload types.

  • Own infrastructure for model serving, inference optimization, and real-time inference pipelines supporting low-latency, edge-deployed AI models.

  • Define and implement cost optimization strategies across cloud and on-prem resources, including resource allocation, auto-scaling policies, and workload consolidation.

  • Build reusable Infrastructure-as-Code frameworks and tooling that other teams can adopt to provision and manage AI workloads consistently across environments.

  • Establish observability and monitoring strategies for AI infrastructure, including resourceutilization, cost tracking, and performance metrics that enable proactive problem-solving.

  • Drive security and compliance standards for AI infrastructure, ensuring data residency, access control, and auditability across deployment environments.

  • Mentor engineers on infrastructure best practices, distributed systems concepts, and optimization techniques that improve platform reliability and developer productivity

Required Skills & Experience

  • Deepexpertisein designing and operating AI infrastructure across multiple deployment paradigms (on-premises, hybrid, cloud-native).

  • Proven ability to work embedded with technical teams, understand complex requirements, and translate them into scalable architectural solutions.

  • Strong experience with Kubernetes, container orchestration, and distributed compute frameworks (Ray, Spark, or equivalent) at production scale.

  • Expert-level Infrastructure-as-Codeproficiency(Terraform, CDK, or equivalent) withdemonstratedability to build reusable, multi-team infrastructure templates.

  • Deep knowledge of GPU/accelerator resource management, including scheduling, optimization, and cost tracking across heterogeneous hardware.

  • Experience designing model serving infrastructure and inference optimization pipelines forproductionAI workloads.

  • Strong understanding of modern cloud platforms (AWS, Azure, or equivalent) with hands-on experience building multi-cloud or hybrid strategies.

  • Demonstrated ability to solve complex infrastructure problems through systematic analysis and creative engineering.

  • Strong communicationskills and ability to translate technical concepts for both engineering and non-technical audiences.

  • Mentoring orientation withdemonstratedsuccessupskilling engineers on infrastructure and platform topics.

Preferred Skills - Physical Intelligence and Industrial AI

  • Experience building or scaling AI infrastructure for robotics, autonomous systems, or industrialperceptionapplications.

  • Familiarity with ROS/ROS2 ecosystems and the infrastructure challenges of deploying ML models in robotic systems.

  • Background in edge AI deployment, including optimization for low-latency inference on resource-constrained devices.

  • Experience designing ML infrastructure that supports rapid iteration and few-shot adaptation in physical systems.

  • Knowledge of heterogeneouscomputearchitectures combining CPUs, GPUs, and specialized processors (NPUs, FPGAs, etc.).

  • Experience with real-time operating systems or hard real-time constraints in distributed systems.

  • Understanding ofmanufacturing, autonomousvehicle, or healthcare domains and their infrastructure requirements for AI applications.

For positions requiring access to technical data, Analog Devices, Inc. may have to obtain export licensing approval from the U.S. Department of Commerce - Bureau of Industry and Security and/or the U.S. Department of State - Directorate of Defense Trade Controls. As such, applicants for this position - except US Citizens, US Permanent Residents, and protected individuals as defined by 8 U.S.C. 1324b(a)(3) - may have to go through an export licensing review process.

Analog Devices is an equal opportunity employer. We foster a culture where everyone has an opportunity to succeed regardless of their race, color, religion, age, ancestry, national origin, social or ethnic origin, sex, sexual orientation, gender, gender identity, gender expression, marital status, pregnancy, parental status, disability, medical condition, genetic information, military or veteran status, union membership, and political affiliation, or any other legally protected group.

EEO is the Law: Notice of Applicant Rights Under the Law.

Job Req Type: ExperiencedRequired Travel: Yes, 10% of the timeShift Type: 1st Shift/DaysThe expected wage range for a new hire into this position is $144,000 to $198,000.
  • Actual wage offered may vary depending on work location, experience, education, training, external market data, internal pay equity, or other bona fide factors.

  • This position qualifies for a discretionary performance-based bonus which is based on personal and company factors.

  • This position includes medical, vision and dental coverage, 401k, paid vacation, holidays, and sick time, and other benefits.