ZipRecruiter

Log In

1

Ai Devops Engineer Jobs in Raleigh, NC (NOW HIRING)

ACA Group

AI Operations Engineer

Durham, NC · Hybrid

$67K - $90K/yr

About the Role We are seeking an AI Operations Engineer to help support and optimize our next-generation AI platform focused on compliance, surveillance, and intelligent workflow automation.This role ...

Motion Recruitment

Lead Azure DevOps Engineer

Raleigh, NC · On-site

$49.25 - $67.50/hr

The organization is heavily investing in Azure cloud, DevOps engineering, and Infrastructure as Code using Bicep and YAML pipelines to support a growing platform used across multiple development ...

ACA Group

AI Operations Engineer

Durham, NC · On-site

$67K - $90K/yr

About the Role We are seeking an AI Operations Engineer to help support and optimize our next-generation AI platform focused on compliance, surveillance, and intelligent workflow automation.This role ...

eClerx

Site Reliability / DevOps Engineer

Raleigh, NC · On-site

$120K - $137K/yr

Site Reliability / DevOps Engineer Location: Raleigh, North Carolina, US Type: Full-time Department: BFSI Job Summary eClerx is seeking a motivated SRE/DevOps Engineer with strong observability ...

eClercx

Site Reliability / DevOps Engineer

Raleigh, NC · On-site

$120K - $137K/yr

Site Reliability / DevOps Engineer Location: Raleigh, North Carolina, US Type: Full-time Department: BFSI Job Summary eClerx is seeking a motivated SRE/DevOps Engineer with strong observability ...

Labcorp

Director of DevOps Engineering

Durham, NC · On-site

$51 - $69.75/hr

Evaluate and integrate AI-powered tools into DevOps workflows (code generation, automated testing, incident response, predictive analytics) * Evaluate and implement emerging tools that improve ...

Labcorp

Director of DevOps Engineering

Durham, NC

$51 - $69.75/hr

Evaluate and integrate AI-powered tools into DevOps workflows (code generation, automated testing, incident response, predictive analytics) * Evaluate and implement emerging tools that improve ...

ACA Group

Senior DevOps Engineer

Durham, NC · Hybrid

$125K - $161K/yr

You'll contribute to building thoughtful, well-architected infrastructure using IaC, automation, and DevOps best practices, while having room to experiment, bring forward new ideas, and continuously ...

ACA Group

Senior DevOps Engineer

Durham, NC · On-site

$125K - $161K/yr

You'll contribute to building thoughtful, well-architected infrastructure using IaC, automation, and DevOps best practices, while having room to experiment, bring forward new ideas, and continuously ...

McNeil & Co.

Manager of DevOps Engineering

Raleigh, NC · On-site

$130 - $223.70/hr

Manager of DevOps Engineering -Skip to main contentThis website stores cookies on your computer. These cookies are used to collect information about how you interact with our website. We use this ...

Arch Capital Group

Manager of DevOps Engineering -

Raleigh, NC · On-site

$51.25 - $70.25/hr

The Manager of DevOps Engineering is responsible for leading the design, implementation, and operational excellence of enterprise-scale CI/CD systems, infrastructure automation, and engineering. This ...

Archgroup

Manager of DevOps Engineering -

Raleigh, NC · Hybrid

$51.25 - $70.25/hr

The Manager of DevOps Engineering is responsible for leading the design, implementation, and operational excellence of enterprise-scale CI/CD systems, infrastructure automation, and engineering. This ...

previous page

Showing results 41-60

All JobsAi Devops Engineer JobsAi Devops Engineer Jobs in Raleigh, NC

Ai Devops Engineer information

See Raleigh, NC salary details

$15

$58

$83

How much do ai devops engineer jobs pay per hour?

As of Aug 9, 2026, the average hourly pay for ai devops engineer in Raleigh, NC is $58.84, according to ZipRecruiter salary data. Most workers in this role earn between $49.28 and $67.55 per hour, depending on experience, location, and employer.

What are the key skills and qualifications needed to thrive as an AI DevOps engineer?

To thrive as an AI DevOps Engineer, you need expertise in software engineering, machine learning pipelines, and cloud infrastructure, often backed by a degree in computer science or a related field. Familiarity with tools like Docker, Kubernetes, CI/CD systems, version control (e.g., Git), and cloud platforms (AWS, Azure, GCP), as well as certifications such as AWS Certified DevOps Engineer, are highly valuable. Strong problem-solving, collaboration, and communication skills help you work effectively with cross-functional teams and adapt to evolving project requirements. These competencies are essential to ensure robust, scalable, and efficient deployment of AI solutions in production environments.

What is an AI DevOps engineer?

AI DevOps Engineers are professionals who blend expertise in artificial intelligence (AI) and DevOps practices to streamline the development, deployment, and maintenance of AI-powered applications. They automate and manage the continuous integration and continuous deployment (CI/CD) pipelines for machine learning models, ensuring scalability, reliability, and efficiency in production environments. Their role also includes monitoring AI systems, managing model versions, and collaborating with data scientists, software engineers, and IT teams to bridge the gap between development and operations. This position is crucial for organizations looking to operationalize AI solutions at scale.

How does an AI DevOps engineer typically collaborate with data scientists and software engineers on AI projects?

An AI DevOps Engineer plays a crucial role in bridging the gap between data scientists and software engineers by streamlining the deployment and monitoring of AI models. They often work closely with data scientists to automate model training, testing, and deployment pipelines, ensuring that models move smoothly from development to production. Additionally, they collaborate with software engineers to integrate models into scalable applications, manage infrastructure, and set up monitoring systems to track performance and reliability. This role requires strong communication skills and a proactive approach to troubleshooting issues that arise in cross-functional teams.

What is the difference between Ai Devops Engineer vs Data Engineer?

AspectAi Devops EngineerData Engineer
Required CredentialsCertifications in cloud platforms, DevOps tools, AI/ML frameworksCertifications in data management, SQL, cloud platforms
Work EnvironmentCollaborates with AI/ML teams, DevOps, cloud infrastructureWorks with data pipelines, databases, big data tools
Employer & Industry UsageTech companies, AI startups, cloud service providersFinance, healthcare, e-commerce, data-driven industries

Ai Devops Engineers focus on deploying and maintaining AI/ML models in production using DevOps practices, while Data Engineers build and manage data pipelines and infrastructure. Both roles require cloud and scripting skills but serve different stages of data and AI workflows.

What are popular job titles related to Ai Devops Engineer jobs in Raleigh, NC? For Ai Devops Engineer jobs in Raleigh, NC, the most frequently searched job titles are:
What job categories do people searching Ai Devops Engineer jobs in Raleigh, NC look for? The top searched job categories for Ai Devops Engineer jobs in Raleigh, NC are:
Ai Devops Engineer jobs near you
Infographic showing various Ai Devops Engineer job openings in Raleigh, NC as of August 2026, with employment types broken down into 92% Full Time, and 8% Contract. Highlights an 80% In-person, and 20% Remote job distribution, with an average salary of $122,386 per year, or $58.8 per hour.

AI Operations Engineer

ACA Group

Durham, NC • Hybrid

$67K - $90K/yr

Full-time

Medical, Dental, Retirement, PTO

Re-posted 6 days ago

Job description

About the Role

We are seeking an AI Operations Engineer to help support and optimize our next-generation AI platform focused on compliance, surveillance, and intelligent workflow automation.This role will work closely with AI engineers, product managers, and domain experts to evaluate AI outputs, manage training and evaluation datasets, improve prompts and agent behaviors, and help operationalize LLM-powered systems across the platform.

** Work Location: Durham, NC/Hybrid-2 days in office**

The ideal candidate is detail-oriented, analytical, and excited about working hands-on with modern AI technologies including agents, MCP servers, vector search, RAG pipelines, document/media processing, and large language models.

Responsibilities

  • Test and evaluate AI agents, prompts, and workflows across multiple use cases
  • Create, maintain, and curate labeled datasets for AI evaluation and tuning
  • Review AI-generated outputs for quality, accuracy, safety, and consistency
  • Update and optimize prompts, agent instructions, and AI "skills"
  • Help improve retrieval quality for vector search and RAG pipelines
  • Assist with evaluation frameworks and benchmark creation for LLM systems
  • Work with engineering teams to validate MCP connectors and integrations
  • Analyze model failures, hallucinations, and edge cases to improve system performance
  • Participate in human-in-the-loop review workflows for AI-generated content
  • Document testing procedures, findings, and recommended improvements
  • Collaborate with compliance and domain experts to refine AI behaviors and detection logic

What working at ACA offers: 

We offer a competitive compensation package where you'll be rewarded based on your performance and recognized for the value you bring to our business. Our Total Rewards package includes medical and dental coverage and 401(k) plans, and a wide range of paid time off options as well as a flexible work environment.You'll also be granted time off for designated ACA Paid Holidays, Summer Fridays, Personal/Family Care, and other leaves of absence when needed to support your physical, financial, and emotional well-being. We also offer unique benefits such as Student Debt Forgiveness and Pet Insurance. 

About ACA: 

ACA Group is the leading governance, risk, and compliance (GRC) advisor in financial services. We empower our clients to reimagine GRC and protect and grow their business. Our innovative approach integrates consulting, managed services, and our ComplianceAlphatechnology platform with the specialized expertise of former regulators and practitioners and our deep understanding of the global regulatory landscape. 

What we commit to: 

ACA is firmly committed to a policy of nondiscrimination, which applies to recruiting, hiring, placement, promotions, training, discipline, terminations, layoffs, transfers, leaves of absence, compensation and all other terms and conditions of employment. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, age, disability or protected veteran status, or any other legally protected basis, in accordance with applicable law. 

VISA SPONSORSHIP IS NOT AVAILABLE FOR THIS ROLE
C2C IS NOT AVAILABLE - W2 ONLY

Apply