ZipRecruiter

Log In

2

Remote Ai Infrastructure Engineer Jobs in Raleigh, NC

Archgroup

AVP, AI Engineering (Remote - EST)

Raleigh, NC · Remote

$185K - $235K/yr

... Software Engineer to lead the build-out of true multi-agent systems within Strategic Analytics ... any infrastructure-side connectors. Key Responsibilities * Design and build multi-agent ...

Archgroup

AVP, AI Engineering (Remote - EST)

Raleigh, NC · Remote

$185K - $235K/yr

... Software Engineer to lead the build-out of true multi-agent systems within Strategic Analytics ... any infrastructure-side connectors. Key Responsibilities * Design and build multi-agent ...

Quora

AI Automation Engineer -Remote

Durham, NC · On-site +1

$202K - $234K/yr

About the Team and Role: We're hiring our first AI Automation Engineer to lead how we apply AI ... remote work reimbursement, paid time off, employee assistance programs, and more. Benefits are ...

Quora

AI Automation Engineer -Remote

Raleigh, NC · On-site +1

$202K - $234K/yr

About the Team and Role: We're hiring our first AI Automation Engineer to lead how we apply AI ... remote work reimbursement, paid time off, employee assistance programs, and more. Benefits are ...

Eliassen Group

Senior AI/ML Engineer

Raleigh, NC · Remote

$90 - $100/hr

Remote Reference ID: JN -052026-107129 Date Posted: 05/26/2026 Shortcut: * Description * Recommended Jobs Description: Remote Our client seeks a Senior AI/ML Engineer to design and deliver cloud ...

HedgeServ

Senior ITSMA Observability Engineer

Raleigh, NC · On-site +1

$101K - $139K/yr

HedgeServ supports employees through a variety of offerings, including remote and hybrid working ... Build Elastic and AWS observability AI solutions that enable infrastructure engineering and ...

Redhat

Software Engineer

Raleigh, NC · On-site +1

$96K - $195K/yr

Solid understanding of infrastructure systems and networks * Customer empathy with a clear ... Demonstrated adoption of AI methodologies and tools to enhance efficiency, elevate code quality ...

DataAnnotation

SDLC Engineer - AI Trainer

Raleigh, NC · Remote

$40 - $75/hr

Contribute to developing cutting-edge AI systems, while enjoying the flexibility of remote work and ... other engineers -- who are driving real-world impact in AI development. Our platform offers an ...

DataAnnotation

SDLC Engineer - AI Trainer

Cary, NC · Remote

$40 - $75/hr

Contribute to developing cutting-edge AI systems, while enjoying the flexibility of remote work and ... other engineers -- who are driving real-world impact in AI development. Our platform offers an ...

next page

Showing results 1-20

People also search for

All JobsAi Infrastructure Engineer JobsRemote Ai Infrastructure Engineer JobsRemote Ai Infrastructure Engineer Jobs in Raleigh, NC

Remote Ai Infrastructure Engineer information

See Raleigh, NC salary details

$45.2K

$123.5K

$176.9K

How much do remote ai infrastructure engineer jobs pay per year?

As of Jun 10, 2026, the average yearly pay for remote ai infrastructure engineer in Raleigh, NC is $123,519.00, according to ZipRecruiter salary data. Most workers in this role earn between $104,500.00 and $137,100.00 per year, depending on experience, location, and employer.

What are the key skills and qualifications needed to thrive as a Remote AI Infrastructure Engineer, and why are they important?

To thrive as a Remote AI Infrastructure Engineer, you need expertise in cloud computing, distributed systems, and software engineering, often supported by a degree in computer science or a related field. Familiarity with tools like Kubernetes, Docker, Terraform, and cloud platforms such as AWS, Azure, or GCP is typically required, along with knowledge of CI/CD pipelines and AI/ML frameworks. Strong problem-solving skills, self-motivation, and effective remote communication are essential soft skills for success in this role. These skills ensure robust, scalable AI infrastructure that supports rapid innovation and seamless collaboration across distributed teams.

What is a Remote AI Infrastructure Engineer?

A Remote AI Infrastructure Engineer is a professional who designs, builds, and maintains the systems and tools necessary to support artificial intelligence (AI) projects, all while working remotely. Their responsibilities often include developing and optimizing cloud or on-premise infrastructure, ensuring scalability, managing data pipelines, and supporting machine learning workflows. They work closely with data scientists and software engineers to ensure AI models can be efficiently trained, deployed, and monitored in production environments. The remote aspect allows them to perform these tasks from anywhere, using collaboration tools and cloud platforms.

What are some common challenges faced by Remote AI Infrastructure Engineers, and how can they be addressed?

Remote AI Infrastructure Engineers often encounter challenges such as managing distributed systems, ensuring robust data pipelines, and maintaining high system reliability across different time zones. Collaboration with cross-functional teams can require clear communication and effective use of remote tools. To address these challenges, it's important to establish strong documentation practices, schedule regular check-ins, and utilize automated monitoring and deployment solutions. Staying proactive and adaptable helps ensure seamless infrastructure performance and team alignment.
What are the most commonly searched types of Ai Infrastructure Engineer jobs in Raleigh, NC? The most popular types of Ai Infrastructure Engineer jobs in Raleigh, NC are:
What are popular job titles related to Remote Ai Infrastructure Engineer jobs in Raleigh, NC? For Remote Ai Infrastructure Engineer jobs in Raleigh, NC, the most frequently searched job titles are:
What job categories do people searching Remote Ai Infrastructure Engineer jobs in Raleigh, NC look for? The top searched job categories for Remote Ai Infrastructure Engineer jobs in Raleigh, NC are:
What cities near Raleigh, NC are hiring for Remote Ai Infrastructure Engineer jobs? Cities near Raleigh, NC with the most Remote Ai Infrastructure Engineer job openings:
Remote Ai Infrastructure Engineer jobs near you

AVP, AI Engineering (Remote - EST)

Arch Capital Group

Raleigh, NC • On-site, Remote

$185K - $235K/yr

Full-time

Medical, Dental, Vision, Life, Retirement, PTO

Posted 15 days ago

Job description

With a company culture rooted in collaboration, expertise and innovation, we aim to promote progress and inspire our clients, employees, investors and communities to achieve their greatest potential. Our work is the catalyst that helps others achieve their goals. In short, We Enable Possibility℠.
Job Summary
Strategic Analytics is a dynamic and growing team at Arch that drives innovation and transforms how the business operates. We build AI-first, agent-driven products that change how Arch underwrites, services, and learns from its book - combining frontier LLMs, multi-agent orchestration (MCP, A2A), retrieval-augmented generation, evaluation harnesses, and traditional ML where it still wins. Our mission is broad: agentic automation, decision support, AI-driven insights, and the platform engineering required to make all of it production-grade.
We have a strong track record of success (productionalizing dozens of gen AI products over the last 3 years) - we aim to continue scaling these efforts and are seeking an AVP AI Engineering Senior Agentic Software Engineer to lead the build-out of true multi-agent systems within Strategic Analytics. Reporting to the VP of AI & Automation, you will design and operate orchestrations where agents communicate directly with one another - not just sequential, hand-off-driven workflows - to deliver underwriting and claims automations end-to-end.
This role sits at the seam between automation engineering (AE) and implementation engineering (IE). You will own everything from the master agent down through worker agents, while partnering with IE on the orchestration entry points and any infrastructure-side connectors.
Key Responsibilities
  • Design and build multi-agent orchestration patterns (master-orchestrator + specialized worker agents) using protocols such as MCP and A2A.
  • Lead end-to-end delivery of agentic underwriting and claims automations, from prototype through production hardening.
  • Partner with IE on orchestration entry-point design (e.g., Azure Function endpoints, master-agent gateways) so the AE/IE seam is clean and scalable.
  • Lead offshore engineers and team members on agentic patterns, prompt engineering, and reliability practices.
  • Establish coding, evaluation, and observability standards for agentic systems within the AI & Automation Center of Excellence.
  • Translate business intent into working agentic systems - not just systems that compile, but systems that deliver measurable business outcomes.

Required Skills / Experience
  • 7+ years of software engineering and/or automation engineering experience.
  • 3+ years of people leadership experience
  • Demonstrated experience building production grade multi-agent or agentic systems (not just POCs that did not ship).
  • Strong track record of shipping AI, analytics, and/or automation products that have a financially measurable impact on the business
  • Strong Python experience with API development, async patterns, and service orchestration.
  • Hands-on experience with at least one agentic framework (e.g., LangGraph, Claude Cowork / Agent SDK, OpenAI Agents, AutoGen) and at least one inter-agent protocol (MCP, A2A).
  • Resilient problem solving - comfortable with ambiguous problems and capable of breaking them into shippable increments.
  • Strong written and verbal communication; able to operate across IE, AE, DS, and business stakeholders.
  • Demonstrated, hands-on production experience (not POC-only) with the current AI stack: RAG, MCP / A2A or equivalent agent-to-agent protocols, agentic orchestration frameworks, and the ability to articulate where each is the right tool. Comfort scanning for and trialing new tooling as the space evolves.

Desired Skills / Experience
  • Background that includes a stretch of "real" software engineering before moving into analytics or AI (e.g., SWE for a few years, then a master's in analytics, then 5+ years in the AI/ML space).
  • P&C insurance domain familiarity - underwriting, claims, or submission lifecycle.
  • Experience with retrieval-augmented generation (RAG), evaluation harnesses, and structured-output patterns.
  • Cloud experience in Azure (preferred for our stack) and/or AWS; familiarity with private endpoints and enterprise-grade safeguards.
  • Experience leading multidisciplinary teams (onshore + offshore) for technology delivery.
  • Visible track record of self-directed learning in the AI space - side projects, contributions to agentic frameworks, write-ups, conference talks, or other evidence that the candidate is investing personal time staying ahead of the curve.

Education
  • College degree in Computer Science, Software Engineering, Data Analytics, or equivalent practical experience.

#LI-LH1
#LI-REMOTE
For individuals assigned or hired to work in the location(s) indicated below, the base salary range is provided. Range is as of the time of posting. Position is incentive eligible.
$185,000 - $235,000/year
  • Total individual compensation (base salary, short & long-term incentives) offered will take into account a number of factors including but not limited to geographic location, scope & responsibilities of the role, qualifications, talent availability & specialization as well as business needs. The above pay range may be modified in the future.
  • Arch is committed to helping employees succeed through our comprehensive benefits package that includes multiple medical plans plus dental, vision and prescription drug coverage; a competitive 401k with generous matching; PTO beginning at 20 days per year; up to 12 paid company holidays per year plus 2 paid days of Volunteer Time Offer; basic Life and AD&D Insurance as well as Short and Long-Term Disability; Paid Parental Leave of up to 10 weeks; Student Loan Assistance and Tuition Reimbursement, Backup Child and Elder Care; and more. Click here to learn more on available benefits.

Do you like solving complex business problems, working with talented colleagues and have an innovative mindset? Arch may be a great fit for you. If this job isn't the right fit but you're interested in working for Arch, create a job alert! Simply create an account and opt in to receive emails when we have job openings that meet your criteria. Join our talent community to share your preferences directly with Arch's Talent Acquisition team.
10200 Arch Capital Services LLC

Apply