ZipRecruiter

Log In

1

Senior Ai Infrastructure Engineer Jobs in Raleigh, NC

ARA

Senior AI Systems Engineer

Raleigh, NC · On-site

$92K - $126K/yr

Design, implement, monitor, and optimize AI infrastructure, working with server, cloud, and platform engineering teams. * Operationalize machine learning workflows and support AI-enabled applications ...

Epic Games

Senior AI Engineer

Cary, NC · On-site

$106K - $146K/yr

  • Medical

  • Dental

  • Vision

  • Life

  • Retirement

  • PTO

As a Senior Gameplay AI Engineer, you'll play a critical role on a small, focused team. You'll own core AI features and drive collaborative development between programmers, designers, and artists ...

Epic Games

Senior AI Engineer

Cary, NC · On-site

$96K - $132K/yr

  • Medical

  • Dental

  • Vision

  • Life

  • Retirement

  • PTO

As a Senior Gameplay AI Engineer, you'll play a critical role on a small, focused team. You'll own core AI features and drive collaborative development between programmers, designers, and artists ...

CAPTRUST

Azure Infrastructure Engineer

Raleigh, NC · On-site

$104K - $137K/yr

  • Medical

  • Dental

  • Vision

  • Life

  • Retirement

  • PTO

CAPTRUST is seeking a Azure Infrastructure Engineer to own implementation of Azure infrastructure ... senior This position will remain open until filled.

CAPTRUST

Azure Infrastructure Engineer

Raleigh, NC · On-site

$104K - $137K/yr

  • Medical

  • Dental

  • Vision

  • Life

  • Retirement

  • PTO

CAPTRUST is seeking a Azure Infrastructure Engineer to own implementation of Azure infrastructure ... senior This position will remain open until filled.

Western Governors University

Staff AI Engineer

Raleigh, NC · On-site +1

  • Medical

  • Dental

  • Vision

  • Life

  • Retirement

  • PTO

Proven mentorship of Senior and/or II-level engineers * Experience designing and operating shared AI platforms or internal AI infrastructure * Experience owning LLMOps or MLOps practices including ...

Western Governors University

Staff AI Engineer

Raleigh, NC · On-site

  • Medical

  • Dental

  • Vision

  • Life

  • Retirement

  • PTO

Proven mentorship of Senior and/or II-level engineers * Experience designing and operating shared AI platforms or internal AI infrastructure * Experience owning LLMOps or MLOps practices including ...

Western Governors University

Staff AI Engineer

Raleigh, NC · On-site

  • Medical

  • Dental

  • Vision

  • Life

  • Retirement

  • PTO

Proven mentorship of Senior and/or II-level engineers * Experience designing and operating shared AI platforms or internal AI infrastructure * Experience owning LLMOps or MLOps practices including ...

Qualcomm

CI Infrastructure Engineer

Raleigh, NC · On-site

$76K - $102K/yr

We are looking for an experienced CI Infrastructure Engineer to own and evolve the continuous ... Clear communication skills and comfort working with senior engineers and technical leads * Passion ...

Qualcomm Technologies

CI Infrastructure Engineer

Raleigh, NC · On-site

$76K - $102K/yr

We are looking for an experienced CI Infrastructure Engineer to own and evolve the continuous ... Clear communication skills and comfort working with senior engineers and technical leads * Passion ...

Nvidia

Senior Applied AI Engineer

Durham, NC · On-site

$101K - $138K/yr

Design, develop, and improve scalable infrastructure to support the next generation of AI ... Strong Python engineering skills are preferred, with the ability to design, prototype, and ...

previous pagenext page

Showing results 21-40

All JobsAi Infrastructure Engineer JobsSenior Ai Infrastructure Engineer JobsSenior Ai Infrastructure Engineer Jobs in Raleigh, NC

Senior Ai Infrastructure Engineer information

See Raleigh, NC salary details

$21.9K

$123.4K

$170.6K

How much do senior ai infrastructure engineer jobs pay per year?

As of Aug 18, 2026, the average yearly pay for senior ai infrastructure engineer in Raleigh, NC is $123,424.00, according to ZipRecruiter salary data. Most workers in this role earn between $105,500.00 and $143,400.00 per year, depending on experience, location, and employer.

What does a senior AI infrastructure engineer do?

A Senior AI Infrastructure Engineer is responsible for designing, building, and maintaining the large-scale computing systems that support artificial intelligence (AI) and machine learning (ML) workloads. They work on optimizing data pipelines, managing cloud or on-premise infrastructure, ensuring scalability, and enabling efficient training and deployment of AI models. These professionals collaborate closely with data scientists, software engineers, and IT teams to create robust, high-performance environments that support the rapid development and deployment of AI solutions.

What are the key skills and qualifications needed to thrive as a senior AI infrastructure engineer?

To thrive as a Senior AI Infrastructure Engineer, you need deep expertise in computer science, cloud computing, distributed systems, and AI/ML frameworks, often supported by a relevant degree and significant experience. Proficiency with tools such as Kubernetes, Docker, TensorFlow, PyTorch, and cloud platforms like AWS or Azure—as well as experience with CI/CD pipelines—is typically required. Strong problem-solving abilities, collaboration, and effective communication are standout soft skills for this role. These competencies are crucial for designing scalable, reliable AI infrastructure that supports complex machine learning workflows and organizational goals.

What are some typical challenges faced by senior AI infrastructure engineers when scaling AI systems for production?

Senior AI Infrastructure Engineers often encounter challenges related to managing large-scale data pipelines, ensuring low-latency model serving, and maintaining system reliability as user demand grows. Balancing resource allocation for compute-intensive workloads, optimizing infrastructure costs, and implementing robust monitoring are common hurdles. Collaboration with data scientists, DevOps, and product teams is crucial to streamline deployment cycles and rapidly address issues as they arise. Mastery of distributed systems and cloud platforms often distinguishes top performers in this role.

What are the most commonly searched types of Ai Infrastructure Engineer jobs in Raleigh, NC?

The most popular types of Ai Infrastructure Engineer jobs in Raleigh, NC are:

What are popular job titles related to Senior Ai Infrastructure Engineer jobs in Raleigh, NC?

For Senior Ai Infrastructure Engineer jobs in Raleigh, NC, the most frequently searched job titles are:

What job categories do people searching Senior Ai Infrastructure Engineer jobs in Raleigh, NC look for?

The top searched job categories for Senior Ai Infrastructure Engineer jobs in Raleigh, NC are:

What cities near Raleigh, NC are hiring for Senior Ai Infrastructure Engineer jobs?

Cities near Raleigh, NC with the most Senior Ai Infrastructure Engineer job openings:

Senior Ai Infrastructure Engineer jobs near you
Infographic showing various Senior Ai Infrastructure Engineer job openings in Raleigh, NC as of August 2026, with employment types broken down into 77% Full Time, 20% Part Time, and 3% Contract. Highlights an 69% Physical, 4% Hybrid, and 27% Remote job distribution, with an average salary of $123,424 per year, or $59.3 per hour.

Senior AI Systems Engineer

ARA

Raleigh, NC • On-site

$92K - $126K/yr

Full-time

Re-posted 15 days ago

Job description

Essential Functions:
  • Lead the deployment, integration, and operational support of AI platforms, tools, and services, ensuring compatibility with existing systems and enterprise processes.
  • Design, implement, monitor, and optimize AI infrastructure, working with server, cloud, and platform engineering teams.
  • Operationalize machine learning workflows and support AI-enabled applications from development through production deployment and sustainment.
  • Build and maintain CI/CD and MLOps pipelines for model packaging, testing, deployment, rollback, and lifecycle management.
  • Implement infrastructure automation using scripting, Infrastructure as Code, and configuration management practices.
  • Provide ongoing technical support, troubleshooting, root cause analysis, and documentation for AI platforms and user-facing AI services.
  • Maintain observability across AI systems through logging, metrics, performance monitoring, alerting, and incident response practices.
  • Ensure security, compliance, and governance requirements are met, including participation in audits, vulnerability management, and secure architecture reviews.
  • Assess and implement system enhancements to improve performance, scalability, reliability, and cost efficiency.
  • Collaborate across divisions to support diverse AI initiatives and align technical implementations with mission and business objectives.
  • Evaluate emerging AI tools, frameworks, and infrastructure approaches for operational fit, supportability, and long-term value.
  • Develop and maintain technical documentation, runbooks, architecture diagrams, and operational procedures.

Experience and Skills Required:
  • Bachelor's degree in computer science, Engineering, Information Technology, or a related STEM field with 8-10 years of engineering experience.
  • 2+ years of experience supporting AI/ML platforms, MLOps workflows, model deployment, or AI-enabled infrastructure.
  • Strong coding and automation skills in Python, Bash, or similar scripting languages.
  • Experience with AI/ML frameworks and tooling such as PyTorch, Hugging Face, or similar ecosystems.
  • Proficiency with DevOps and MLOps practices, including CI/CD pipelines, Git-based workflows, containerization, and Kubernetes.
  • Experience deploying AI/ML models or AI services into operational environments, including containerized, cloud, or high-performance computing environments.
  • Familiarity with security frameworks and compliance standards such as NIST and CMMC.
  • Familiarity with AI security functionality in enterprise environments including OAuth
  • Strong communication skills and the ability to collaborate effectively across technical and non-technical teams.

Preferred:
  • Advanced degree or certifications related to AI or machine learning.
  • Experience integrating AI models into scientific workflows.
  • Familiarity with large language model (LLM) APIs and orchestration frameworks such as OpenAI, Hugging Face, LangGraph, or LangChain.
  • Experience with model serving, inference optimization, or AI platform tools such as MLflow, Kubeflow, vLLM, or similar.
  • Experience with simulations for scientific or engineering projects, particularly physical systems simulations.
  • Experience with GPU-based systems or running AI models in HPC environments.
  • Experience writing and deploying MCP Servers on Kubernetes
  • DoD experience
  • Secret Security Clearance - Active or Inactive

Education:
  • Bachelor's degree in CS, Software Engineering or other IT-related field or equivalent experience

REMOTE WORK NOTICE: This position may be performed fully remote, hybrid, or onsite at an ARA office. Preference will be given to candidates located onsite in the Albuquerque, NM and Raleigh, NC area.
Equal Opportunity Employer/Protected Veterans/Individuals with Disabilities
This employer is required to notify all applicants of their rights pursuant to federal employment laws.
For further information, please review the Know Your Rights notice from the Department of Labor.

Apply