ZipRecruiter

Log In

2

Remote Ai Infrastructure Engineer Jobs in Raleigh, NC

Berriehill Research

Senior AI Systems Engineer

Raleigh, NC · On-site +1

$92K - $126K/yr

Design, implement, monitor, and optimize AI infrastructure, working with server, cloud, and ... This position may be performed fully remote, hybrid, or onsite at an ARA office. Preference will be ...

Redhat

Senior Software Engineer, AI Inference

Raleigh, NC · On-site +1

$133K - $220K/yr

Manage and scale multi-cloud GPU infrastructure using Terraform and Ansible, including both bare ... For positions with Remote-US locations, the actual salary range for the position may differ based ...

VAST Data

DevOps Engineer (East Coast)

Raleigh, NC · On-site +1

$51.25 - $70.25/hr

... the AI era. We are building the enterprise software infrastructure to capture, catalog, refine ... Engineer position is a sales engineering operations role and is an integrated part of our sales ...

New

OptiTrack

Machine Learning & Operations Engineer

Durham, NC · Remote

$67K - $90K/yr

Passion for building scalable AI infrastructure Why Join OptiTrack? * Work on cutting-edge motion ... Remote-first flexibility * Opportunity to shape the next-generation of motion capture technology ...

OptiTrack

Machine Learning & Operations Engineer

Durham, NC · Remote

$71K - $96K/yr

Passion for building scalable AI infrastructure Why Join OptiTrack? * Work on cutting-edge motion ... Remote-first flexibility * Opportunity to shape the next-generation of motion capture technology ...

OptiTrack

Machine Learning & Operations Engineer

Durham, NC · Remote

$67K - $90K/yr

Passion for building scalable AI infrastructure Why Join OptiTrack? * Work on cutting-edge motion ... Remote-first flexibility * Opportunity to shape the next-generation of motion capture technology ...

Cherry Bekaert

AI Architect

Raleigh, NC · On-site +1

$61.25 - $80.75/hr

This role sits at the intersection of AI engineering and professional services workflow design. The ... Demonstrated ability to build reusable, modular AI infrastructure (prompt libraries, skill ...

VAST Data

Customer Support Engineer

Raleigh, NC · On-site +1

... and AI infrastructure across data center, edge, and cloud. Our success has been built through ... Summary As a Customer Support Engineering team you will be regarded as a VAST Data technical expert ...

SpotOn: Sales

Staff AI Engineer

Raleigh, NC · On-site +1

$210K - $290K/yr

If you're looking to make an impact with heart and hustle, SpotOn is the place for you. (Remote ... Required experience: * 5+ years building developer tools, infrastructure, or platform engineering ...

SpotOn

Staff AI Engineer

Raleigh, NC · Remote

$210K - $290K/yr

If you're looking to make an impact with heart and hustle, SpotOn is the place for you. (Remote ... Required experience: * 5+ years building developer tools, infrastructure, or platform engineering ...

next page

Showing results 1-20

All JobsAi Infrastructure Engineer JobsRemote Ai Infrastructure Engineer JobsRemote Ai Infrastructure Engineer Jobs in Raleigh, NC

Remote Ai Infrastructure Engineer information

See Raleigh, NC salary details

$45.2K

$123.5K

$176.9K

How much do remote ai infrastructure engineer jobs pay per year?

As of Jun 10, 2026, the average yearly pay for remote ai infrastructure engineer in Raleigh, NC is $123,519.00, according to ZipRecruiter salary data. Most workers in this role earn between $104,500.00 and $137,100.00 per year, depending on experience, location, and employer.

What are the key skills and qualifications needed to thrive as a Remote AI Infrastructure Engineer, and why are they important?

To thrive as a Remote AI Infrastructure Engineer, you need expertise in cloud computing, distributed systems, and software engineering, often supported by a degree in computer science or a related field. Familiarity with tools like Kubernetes, Docker, Terraform, and cloud platforms such as AWS, Azure, or GCP is typically required, along with knowledge of CI/CD pipelines and AI/ML frameworks. Strong problem-solving skills, self-motivation, and effective remote communication are essential soft skills for success in this role. These skills ensure robust, scalable AI infrastructure that supports rapid innovation and seamless collaboration across distributed teams.

What is a Remote AI Infrastructure Engineer?

A Remote AI Infrastructure Engineer is a professional who designs, builds, and maintains the systems and tools necessary to support artificial intelligence (AI) projects, all while working remotely. Their responsibilities often include developing and optimizing cloud or on-premise infrastructure, ensuring scalability, managing data pipelines, and supporting machine learning workflows. They work closely with data scientists and software engineers to ensure AI models can be efficiently trained, deployed, and monitored in production environments. The remote aspect allows them to perform these tasks from anywhere, using collaboration tools and cloud platforms.

What are some common challenges faced by Remote AI Infrastructure Engineers, and how can they be addressed?

Remote AI Infrastructure Engineers often encounter challenges such as managing distributed systems, ensuring robust data pipelines, and maintaining high system reliability across different time zones. Collaboration with cross-functional teams can require clear communication and effective use of remote tools. To address these challenges, it's important to establish strong documentation practices, schedule regular check-ins, and utilize automated monitoring and deployment solutions. Staying proactive and adaptable helps ensure seamless infrastructure performance and team alignment.
What are the most commonly searched types of Ai Infrastructure Engineer jobs in Raleigh, NC? The most popular types of Ai Infrastructure Engineer jobs in Raleigh, NC are:
What are popular job titles related to Remote Ai Infrastructure Engineer jobs in Raleigh, NC? For Remote Ai Infrastructure Engineer jobs in Raleigh, NC, the most frequently searched job titles are:
What job categories do people searching Remote Ai Infrastructure Engineer jobs in Raleigh, NC look for? The top searched job categories for Remote Ai Infrastructure Engineer jobs in Raleigh, NC are:
What cities near Raleigh, NC are hiring for Remote Ai Infrastructure Engineer jobs? Cities near Raleigh, NC with the most Remote Ai Infrastructure Engineer job openings:
Remote Ai Infrastructure Engineer jobs near you

Senior AI Systems Engineer

Berriehill Research

Raleigh, NC • On-site, Remote

$92K - $126K/yr

Full-time

Posted 7 days ago

Job description

Essential Functions:

  • Lead the deployment, integration, and operational support of AI platforms, tools, and services, ensuring compatibility with existing systems and enterprise processes.
  • Design, implement, monitor, and optimize AI infrastructure, working with server, cloud, and platform engineering teams.
  • Operationalize machine learning workflows and support AI-enabled applications from development through production deployment and sustainment.
  • Build and maintain CI/CD and MLOps pipelines for model packaging, testing, deployment, rollback, and lifecycle management.
  • Implement infrastructure automation using scripting, Infrastructure as Code, and configuration management practices.
  • Provide ongoing technical support, troubleshooting, root cause analysis, and documentation for AI platforms and user-facing AI services.
  • Maintain observability across AI systems through logging, metrics, performance monitoring, alerting, and incident response practices.
  • Ensure security, compliance, and governance requirements are met, including participation in audits, vulnerability management, and secure architecture reviews.
  • Assess and implement system enhancements to improve performance, scalability, reliability, and cost efficiency.
  • Collaborate across divisions to support diverse AI initiatives and align technical implementations with mission and business objectives.
  • Evaluate emerging AI tools, frameworks, and infrastructure approaches for operational fit, supportability, and long-term value.
  • Develop and maintain technical documentation, runbooks, architecture diagrams, and operational procedures.

Experience and Skills Required:

  • Bachelor’s degree in computer science, Engineering, Information Technology, or a related STEM field with 8-10 years of engineering experience. 
  • 2+ years of experience supporting AI/ML platforms, MLOps workflows, model deployment, or AI-enabled infrastructure.
  • Strong coding and automation skills in Python, Bash, or similar scripting languages.
  • Experience with AI/ML frameworks and tooling such as PyTorch, Hugging Face, or similar ecosystems.
  • Proficiency with DevOps and MLOps practices, including CI/CD pipelines, Git-based workflows, containerization, and Kubernetes.
  • Experience deploying AI/ML models or AI services into operational environments, including containerized, cloud, or high-performance computing environments.
  • Familiarity with security frameworks and compliance standards such as NIST and CMMC.
  • Familiarity with AI security functionality in enterprise environments including OAuth
  • Strong communication skills and the ability to collaborate effectively across technical and non-technical teams.

Preferred:

  • Advanced degree or certifications related to AI or machine learning.
  • Experience integrating AI models into scientific workflows.
  • Familiarity with large language model (LLM) APIs and orchestration frameworks such as OpenAI, Hugging Face, LangGraph, or LangChain.
  • Experience with model serving, inference optimization, or AI platform tools such as MLflow, Kubeflow, vLLM, or similar.
  • Experience with simulations for scientific or engineering projects, particularly physical systems simulations.
  • Experience with GPU-based systems or running AI models in HPC environments.
  • Experience writing and deploying MCP Servers on Kubernetes
  • DoD experience
  • Secret Security Clearance – Active or Inactive

Education:

  • Bachelor’s degree in CS, Software Engineering or other IT-related field or equivalent experience

REMOTE WORK NOTICE: This position may be performed fully remote, hybrid, or onsite at an ARA office. Preference will be given to candidates located onsite in the Albuquerque, NM and Raleigh, NC area.

Apply