1

Senior Ai Infrastructure Engineer Jobs in Raleigh, NC

Adopt best engineering practices in automation, HPC and AI/GenAI infrastructure and design patterns ... Work You'll Do As a Senior AI Engineer, you'll work cross-functionally with data scientists ...

Senior AI Engineer

Raleigh, NC · On-site

$161K - $249K/yr

  • Medical

  • Dental

  • Vision

  • Life

  • Retirement

  • PTO

As a Senior AI Engineer, you will lead the design and delivery of complex AI solutions that ... Own and evolve critical AI infrastructure, ensuring reliability, scalability, and observability ...

Senior Infrastructure Engineer

Durham, NC

$104K - $142K/yr

As a Senior Infrastructure Engineer, you'll design and operate the large-scale distributed systems, data infrastructure, and deployment platforms that serve tens of billions of daily events. You'll ...

AI & HPC Infrastructure Engineer

Raleigh, NC

$104K - $137K/yr

  • Medical

  • Dental

  • Vision

  • Life

  • Retirement

  • PTO

The Global AI Infrastructure team is at the center of enabling infrastructure reinvention for the next era of digital solutions powered by AI, accelerated computing, and high-performance workloads.

New

Senior AI Developer

Raleigh, NC · On-site

$118K - $158K/yr

NCDIT-T Web Systems is seeking a Senior AI Enablement Engineer with strong experience in C#, Vue.js ... Bicep/Terraform and Azure infrastructure automation. * Azure DevOps and CI/CD pipelines. * Azure ...

Senior Cloud Infrastructure Engineer

Raleigh, NC · On-site

$95K - $130K/yr

Highly skilled Sr. Cloud Infrastructure Engineer with expertise in Shell scripting, Linux system administration, Kickstart, Cobbler, VMware, and multi-cloud environments including AWS, Azure, and ...

Highly skilled Sr. Cloud Infrastructure Engineer with expertise in Shell scripting, Linux system administration, Kickstart, Cobbler, VMware, and multi-cloud environments including AWS, Azure, and ...

Senior Cloud Infrastructure Engineer

Raleigh, NC · On-site

$95K - $130K/yr

Highly skilled Sr. Cloud Infrastructure Engineer with expertise in Shell scripting, Linux system administration, Kickstart, Cobbler, VMware, and multi-cloud environments including AWS, Azure, and ...

Senior Cloud Infrastructure Engineer

Raleigh, NC · On-site

$105K - $143K/yr

Highly skilled Sr. Cloud Infrastructure Engineer with expertise in Shell scripting, Linux system administration, Kickstart, Cobbler, VMware, and multi-cloud environments including AWS, Azure, and ...

Senior AI/LLM Engineer - Remote

Raleigh, NC · On-site

$53.75 - $69.25/hr

  • Dental

  • Vision

  • Life

  • Retirement

REMOTE - Senior AI/LLM Engineer (Generative AI Solutions) Job Title: Senior AI/LLM Engineer ... We are one of the leading providers of digital and AI infrastructure in the world. NTT DATA is a ...

Sr AI/ML Engineer

Durham, NC · On-site

$180K - $220K/yr

  • Medical

Description The Senior AI/ML Engineer helps move AI from consultant-led pilots to a sustainable ... on shared infrastructure. Mentor junior engineers and contribute to the AI/ML specialization ...

Sr AI/ML Engineer

Durham, NC · Hybrid

$180K - $220K/yr

  • Medical

Description The Senior AI/ML Engineer helps move AI from consultant-led pilots to a sustainable ... infrastructure. • Mentor junior engineers and contribute to the AI/ML specialization pathway.

Sr AI/ML Engineer

Durham, NC · Hybrid

$180K - $220K/yr

  • Medical

Description The Senior AI/ML Engineer helps move AI from consultant-led pilots to a sustainable ... infrastructure. • Mentor junior engineers and contribute to the AI/ML specialization pathway.

Senior AI Systems Engineer

Raleigh, NC · On-site +1

$92K - $126K/yr

Design, implement, monitor, and optimize AI infrastructure, working with server, cloud, and platform engineering teams. * Operationalize machine learning workflows and support AI-enabled applications ...

next page

Showing results 1-20

Senior Ai Infrastructure Engineer information

See Raleigh, NC salary details

$21.9K

$123.4K

$170.6K

How much do senior ai infrastructure engineer jobs pay per year?

As of Aug 18, 2026, the average yearly pay for senior ai infrastructure engineer in Raleigh, NC is $123,424.00, according to ZipRecruiter salary data. Most workers in this role earn between $105,500.00 and $143,400.00 per year, depending on experience, location, and employer.

What does a senior AI infrastructure engineer do?

A Senior AI Infrastructure Engineer is responsible for designing, building, and maintaining the large-scale computing systems that support artificial intelligence (AI) and machine learning (ML) workloads. They work on optimizing data pipelines, managing cloud or on-premise infrastructure, ensuring scalability, and enabling efficient training and deployment of AI models. These professionals collaborate closely with data scientists, software engineers, and IT teams to create robust, high-performance environments that support the rapid development and deployment of AI solutions.

What are the key skills and qualifications needed to thrive as a senior AI infrastructure engineer?

To thrive as a Senior AI Infrastructure Engineer, you need deep expertise in computer science, cloud computing, distributed systems, and AI/ML frameworks, often supported by a relevant degree and significant experience. Proficiency with tools such as Kubernetes, Docker, TensorFlow, PyTorch, and cloud platforms like AWS or Azure—as well as experience with CI/CD pipelines—is typically required. Strong problem-solving abilities, collaboration, and effective communication are standout soft skills for this role. These competencies are crucial for designing scalable, reliable AI infrastructure that supports complex machine learning workflows and organizational goals.

What are some typical challenges faced by senior AI infrastructure engineers when scaling AI systems for production?

Senior AI Infrastructure Engineers often encounter challenges related to managing large-scale data pipelines, ensuring low-latency model serving, and maintaining system reliability as user demand grows. Balancing resource allocation for compute-intensive workloads, optimizing infrastructure costs, and implementing robust monitoring are common hurdles. Collaboration with data scientists, DevOps, and product teams is crucial to streamline deployment cycles and rapidly address issues as they arise. Mastery of distributed systems and cloud platforms often distinguishes top performers in this role.

What are the most commonly searched types of Ai Infrastructure Engineer jobs in Raleigh, NC?

The most popular types of Ai Infrastructure Engineer jobs in Raleigh, NC are:

What are popular job titles related to Senior Ai Infrastructure Engineer jobs in Raleigh, NC?

For Senior Ai Infrastructure Engineer jobs in Raleigh, NC, the most frequently searched job titles are:

What job categories do people searching Senior Ai Infrastructure Engineer jobs in Raleigh, NC look for?

The top searched job categories for Senior Ai Infrastructure Engineer jobs in Raleigh, NC are:

What cities near Raleigh, NC are hiring for Senior Ai Infrastructure Engineer jobs?

Cities near Raleigh, NC with the most Senior Ai Infrastructure Engineer job openings:

Infographic showing various Senior Ai Infrastructure Engineer job openings in Raleigh, NC as of August 2026, with employment types broken down into 77% Full Time, 20% Part Time, and 3% Contract. Highlights an 69% Physical, 4% Hybrid, and 27% Remote job distribution, with an average salary of $123,424 per year, or $59.3 per hour.

Senior AI Engineer - SFL Scientific

Deloitte

Raleigh, NC

$101K - $139K/yr

Full-time

Re-posted 29 days ago


Deloitte rating

8.2

Company rating: 8.2 out of 10

Based on 92 frontline employees who took The Breakroom Quiz

44th of 150 rated financial services


Job description

Our Deloitte Strategy & Transactions team helps guide clients through their most critical moments and transformational initiatives. From strategy to execution, this team delivers integrated, end-to-end support and advisory services covering valuation modeling, cost optimization, restructuring, business design and transformation, infrastructure and real estate, mergers and acquisitions (M&A), and sustainability. Work alongside clients every step of the way, helping them navigate new challenges, avoid financial pitfalls, and provide practical solutions at every stage of their journey-before, during, and after any major transformational projects or transactions.
Are you eager to shape the future of emerging technologies? Imagine joining an acclaimed team where career paths span from account executives and data scientists to AI strategists, machine learning specialists, and data engineers. SFL Scientific, a Deloitte Business, is looking to add a Senior AI Engineer to their vibrant environment. SFL Scientific is part of our broader Strategy Offering within the Strategy & Transactions practice, whose specialized team brings together key capabilities to design integrated solutions that drive transformational change for our clients. Take the next step in your technical journey-develop your leadership, consulting acumen, and reputation as a trailblazer within the AI engineering field by joining our team!

Recruiting for this role ends on 8/31/2026.

Work You'll Do
As a Senior AI Engineer, you'll work cross-functionally with data scientists, machine learning engineers, project managers, and industry experts to develop robust AI infrastructure and deployment services for our novel machine learning applications. Key to this role is the ability to demonstrate both traditional data engineering expertise, leveraging cloud/enterprise/open-source solutions, and constructing IT infrastructure for organizations across a wide variety of industries.

In our consultative approach, we are platform agnostic and committed to providing the best technical solutions for each client and solution. Our engineering team leverages emerging technologies and best practices across data security, documentation, cloud services and engineering architecture to create solutions and products that address complex issues and business problems faced by global organizations. Some of our novel use cases include cancer detection, drug discovery, optimizing population health and clinical trials, autonomous systems and edge AI, and renewable energy. Key responsibilities:

  • Work with clients to design, develop, and deploy new architectures to support machine learning & automation applications
  • Leverage advanced technical skills in modern data architecture, data science engineering, data transformation, and management of structured and unstructured data sources using cloud computing or on-prem technologies
  • Design and lead development on scalable, high-performance data architecture solutions that supports both the client business as well as AI/GenAI use cases
  • Support and enhance data architecture, and data pipelines, and define database schemas (Graph, SQL, NoSQL) to develop algorithm scalability and deployment based on agile business priorities and initiatives
  • Participate in architectural and deployment discussions to ensure solutions are designed for successful scale, security, and high availability in the cloud or on prem
  • Adopt best engineering practices in automation, HPC and AI/GenAI infrastructure and design patterns
  • Define and lead technology proof of concepts to ensure feasibility of new data and cloud technology solutions
  • Display strong thought leadership and execution in pursuit of modern data architecture principles and technology modernization
  • Mentor, motivate, and coach junior members on technical best practices and inspire professional development

A successful candidate would possess these skills:

  • Ability to work independently and collaborate as part of a team
  • Effective written and verbal communication skills
  • Meticulous attention to detail and quality of work product
  • Ability to build and sustain professional relationships
  • Ability to lead projects or workstreams
  • Ability to manage and prioritize multiple tasks in a fast-paced and dynamic environment
  • Strong interpersonal skills and professional demeanor
  • Ability to meet deadlines
  • Ability to provide clear guidance to others

The Team

Our Strategy offering architects bold strategies to achieve business and mission goals, enabling growth, competitive advantage, technology modernization, and continuous digital and AI transformation.
Specifically, SFL Scientific, a Deloitte Business, is a data science professional services practice focused on strategy, technology, and solving business challenges with Artificial Intelligence (AI). The team has a proven track record serving large, market-leading organizations in the private and public sectors, successfully delivering high-quality, novel and complex projects, and offering deep domain and scientific capabilities. Made up of experienced AI strategists, data scientists, and AI engineers, they serve as trusted advisors to executives, helping them understand and evaluate new and essential areas for AI investment and identify unique opportunities to transform their businesses.
Qualifications

Required:

  • Bachelor's degree in a STEM field (Computer Science, Engineering, Physics, etc.) or equivalent experience
  • 4+ years of experience working in data engineering, data science, software engineering, MLOps specializing in AI and Machine Learning deployment
  • 4+ years of experience in designing cloud solutions and supporting production projects, including hands-on experience with AWS services (or Azure, GCP equivalents)
  • 4+ years of programming experience with Linux Shell/CLI, Python, SQL, PowerShell, etc.
  • 2+ years of experience managing teams in technical delivery and delivering complex and critical projects
  • 2+ years of experience in DevOps and leveraging CI/CD services: Puppet, Ansible, Chef, Airflow, Terraform, Jenkins
  • 2+ years of experience with database development and ETL/ELT pipelines (relational, NoSQL, Neo4j)
  • 2+ years of experience with deployment and optimization: Kubernetes, Docker, NVIDIA TensorRT/Triton, RAPIDs, Kubeflow, MLflow, Kafka, etc.
  • Live within commuting distance to one of Deloitte's consulting offices
  • Ability to travel 10%, on average, based on the work you do and the clients and industries/sectors you serve
  • Limited immigration sponsorship may be available

Preferred:

  • Master's degree in Computer Science, Engineering, Physics, etc. or related STEM field
  • AWS/Azure Certifications (AWS/Azure Certified: SysOps Administrator, DevOps Engineer, Solutions Architect)
  • 2+ years of experience with GPU computing (CUDA, OpenCL) and HPC system software stack

The wage range for this role takes into account the wide range of factors that are considered in making compensation decisions including but not limited to skill sets; experience and training; licensure and certifications; and other business and organizational needs. The disclosed range estimate has not been adjusted for the applicable geographic differential associated with the location at which the position may be filled. At Deloitte, it is not typical for an individual to be hired at or near the top of the range for their role and compensation decisions are dependent on the facts and circumstances of each case. A reasonable estimate of the current range is $128,000 to $252,500.

You may also be eligible to participate in a discretionary annual incentive program, subject to the rules governing the program, whereby an award, if any, depends on various factors, including, without limitation, individual and organizational performance.

Qualifications:

Our Deloitte Strategy & Transactions team helps guide clients through their most critical moments and transformational initiatives. From strategy to execution, this team delivers integrated, end-to-end support and advisory services covering valuation modeling, cost optimization, restructuring, business design and transformation, infrastructure and real estate, mergers and acquisitions (M&A), and sustainability. Work alongside clients every step of the way, helping them navigate new challenges, avoid financial pitfalls, and provide practical solutions at every stage of their journey-before, during, and after any major transformational projects or transactions.
Are you eager to shape the future of emerging technologies? Imagine joining an acclaimed team where career paths span from account executives and data scientists to AI strategists, machine learning specialists, and data engineers. SFL Scientific, a Deloitte Business, is looking to add a Senior AI Engineer to their vibrant environment. SFL Scientific is part of our broader Strategy Offering within the Strategy & Transactions practice, whose specialized team brings together key capabilities to design integrated solutions that drive transformational change for our clients. Take the next step in your technical journey-develop your leadership, consulting acumen, and reputation as a trailblazer within the AI engineering field by joining our team!

Recruiting for this role ends on 8/31/2026.

Work You'll Do
As a Senior AI Engineer, you'll work cross-functionally with data scientists, machine learning engineers, project managers, and industry experts to develop robust AI infrastructure and deployment services for our novel machine learning applications. Key to this role is the ability to demonstrate both traditional data engineering expertise, leveraging cloud/enterprise/open-source solutions, and constructing IT infrastructure for organizations across a wide variety of industries.

In our consultative approach, we are platform agnostic and committed to providing the best technical solutions for each client and solution. Our engineering team leverages emerging technologies and best practices across data security, documentation, cloud services and engineering architecture to create solutions and products that address complex issues and business problems faced by global organizations. Some of our novel use cases include cancer detection, drug discovery, optimizing population health and clinical trials, autonomous systems and edge AI, and renewable energy. Key responsibilities:

  • Work with clients to design, develop, and deploy new architectures to support machine learning & automation applications
  • Leverage advanced technical skills in modern data architecture, data science engineering, data transformation, and management of structured and unstructured data sources using cloud computing or on-prem technologies
  • Design and lead development on scalable, high-performance data architecture solutions that supports both the client business as well as AI/GenAI use cases
  • Support and enhance data architecture, and data pipelines, and define database schemas (Graph, SQL, NoSQL) to develop algorithm scalability and deployment based on agile business priorities and initiatives
  • Participate in architectural and deployment discussions to ensure solutions are designed for successful scale, security, and high availability in the cloud or on prem
  • Adopt best engineering practices in automation, HPC and AI/GenAI infrastructure and design patterns
  • Define and lead technology proof of concepts to ensure feasibility of new data and cloud technology solutions
  • Display strong thought leadership and execution in pursuit of modern data architecture principles and technology modernization
  • Mentor, motivate, and coach junior members on technical best practices and inspire professional development

A successful candidate would possess these skills:

  • Ability to work independently and collaborate as part of a team
  • Effective written and verbal communication skills
  • Meticulous attention to detail and quality of work product
  • Ability to build and sustain professional relationships
  • Ability to lead projects or workstreams
  • Ability to manage and prioritize multiple tasks in a fast-paced and dynamic environment
  • Strong interpersonal skills and professional demeanor
  • Ability to meet deadlines
  • Ability to provide clear guidance to others

The Team

Our Strategy offering architects bold strategies to achieve business and mission goals, enabling growth, competitive advantage, technology modernization, and continuous digital and AI transformation.
Specifically, SFL Scientific, a Deloitte Business, is a data science professional services practice focused on strategy, technology, and solving business challenges with Artificial Intelligence (AI). The team has a proven track record serving large, market-leading organizations in the private and public sectors, successfully delivering high-quality, novel and complex projects, and offering deep domain and scientific capabilities. Made up of experienced AI strategists, data scientists, and AI engineers, they serve as trusted advisors to executives, helping them understand and evaluate new and essential areas for AI investment and identify unique opportunities to transform their businesses.
Qualifications

Required:

  • Bachelor's degree in a STEM field (Computer Science, Engineering, Physics, etc.) or equivalent experience
  • 4+ years of experience working in data engineering, data science, software engineering, MLOps specializing in AI and Machine Learning deployment
  • 4+ years of experience in designing cloud solutions and supporting production projects, including hands-on experience with AWS services (or Azure, GCP equivalents)
  • 4+ years of programming experience with Linux Shell/CLI, Python, SQL, PowerShell, etc.
  • 2+ years of experience managing teams in technical delivery and delivering complex and critical projects
  • 2+ years of experience in DevOps and leveraging CI/CD services: Puppet, Ansible, Chef, Airflow, Terraform, Jenkins
  • 2+ years of experience with database development and ETL/ELT pipelines (relational, NoSQL, Neo4j)
  • 2+ years of experience with deployment and optimization: Kubernetes, Docker, NVIDIA TensorRT/Triton, RAPIDs, Kubeflow, MLflow, Kafka, etc.
  • Live within commuting distance to one of Deloitte's consulting offices...

What Deloitte employees say

Pay

Benefits

Hours and flexibility

Workplace

Get the full story on Breakroom