ZipRecruiter

Log In

1

Mlops Engineer Jobs in Raleigh, NC (NOW HIRING)

First Citizens Bank

Principal AI Architect

Raleigh, NC · On-site

$160K - $240K/yr

AI Platform Engineering & MLOps * Prototype and operationalize advanced AI solutions, including GenAI and LLM-based systems. Architect end-to-end MLOps capabilities, including model lifecycle ...

First Citizens Bank

Principal AI Architect

Raleigh, NC · On-site

$160K - $240K/yr

AI Platform Engineering & MLOps * Prototype and operationalize advanced AI solutions, including GenAI and LLM-based systems. Architect end-to-end MLOps capabilities, including model lifecycle ...

First Citizens Bank

Principal AI Architect

Raleigh, NC · On-site

$160K - $240K/yr

AI Platform Engineering & MLOps * Prototype and operationalize advanced AI solutions, including GenAI and LLM-based systems. Architect end-to-end MLOps capabilities, including model lifecycle ...

Redhat

Senior Data Engineer

Raleigh, NC · Remote

$103K - $140K/yr

... and engineering teams. * Design and deploy intelligent retrieval architecture and AI-driven ... Operationalize MLOps methodologies using MLflow for experiment tracking and model registry ...

Red River

Senior Data Engineer

Raleigh, NC · Remote

$103K - $140K/yr

... and engineering teams. * Design and deploy intelligent retrieval architecture and AI-driven ... Operationalize MLOps methodologies using MLflow for experiment tracking and model registry ...

Pearson

Software Engineer III

Durham, NC · On-site

$80K - $140K/yr

Exposure to Agentic Operations, MLOps, or AI Operations practices. * UiPath Developer Certification, Microsoft Power Platform Certification, or equivalent. * Experience with Azure OpenAI, Copilot ...

previous pagenext page

Showing results 21-40

All JobsMlops Engineer JobsMlops Engineer Jobs in Raleigh, NC

Mlops Engineer information

Are MLOps engineers in demand?

MLOps engineers are in high demand due to the increasing adoption of machine learning and AI across industries. They are needed to develop, deploy, and maintain scalable ML systems, often requiring skills in cloud platforms, automation, and tools like Docker and Kubernetes. The role offers strong job growth prospects and competitive salaries.

What is an MLOps engineer?

An MLOps Engineer is responsible for deploying, monitoring, and maintaining machine learning models in production. They bridge the gap between data science and operations by automating workflows, optimizing infrastructure, and ensuring model reliability. Their role includes CI/CD for ML models, data pipeline management, and performance monitoring. They also work with cloud platforms, containerization, and orchestration tools to scale ML systems efficiently.

What are some common challenges MLOps engineers face in their daily work?

Mlops Engineers often encounter challenges in integrating new machine learning models into existing production systems while ensuring minimal downtime and maintaining data integrity. Managing the scaling and orchestration of models across various cloud or on-prem environments can be complex, requiring close coordination with data scientists and DevOps teams. Staying up to date with rapidly evolving tools and best practices is also essential in this field. Addressing these challenges provides valuable opportunities to innovate and improve both technical processes and team collaboration.

What are the key skills and qualifications needed to thrive as an MLOps engineer, and why are they important?

To thrive as an Mlops Engineer, you need strong skills in software engineering, machine learning pipelines, and cloud infrastructure, often backed by a degree in computer science, engineering, or a related field. Familiarity with tools such as Docker, Kubernetes, TensorFlow, AWS/GCP/Azure, and CI/CD systems is essential, and certifications like AWS Certified Machine Learning or Kubernetes Administrator are often valued. Effective communication, problem-solving, and teamwork are crucial soft skills for collaborating across data science and IT teams. These abilities enable Mlops Engineers to efficiently deploy, manage, and scale machine learning models in dynamic production environments.

What does an MLOps engineer do?

An MLOps engineer is responsible for deploying, managing, and maintaining machine learning models in production environments. They work with tools like Docker, Kubernetes, and cloud platforms to automate workflows, ensure model reliability, and monitor performance. Their role combines software engineering, data science, and DevOps practices to streamline the deployment and lifecycle management of machine learning systems.
What are popular job titles related to Mlops Engineer jobs in Raleigh, NC? For Mlops Engineer jobs in Raleigh, NC, the most frequently searched job titles are:
What job categories do people searching Mlops Engineer jobs in Raleigh, NC look for? The top searched job categories for Mlops Engineer jobs in Raleigh, NC are:
What cities near Raleigh, NC are hiring for Mlops Engineer jobs? Cities near Raleigh, NC with the most Mlops Engineer job openings:
Mlops Engineer jobs near you
Infographic showing various Mlops Engineer job openings in Raleigh, NC as of August 2026, with employment types broken down into 87% Full Time, 7% Part Time, and 6% Contract. Highlights an 85% Physical, 5% Hybrid, and 10% Remote job distribution.

Principal AI Architect

First Citizens Bank

Raleigh, NC • On-site

$160K - $240K/yr

Full-time

Re-posted 7 days ago

First Citizens Bank rating

7.4

Company rating: 7.4 out of 10

Based on 106 frontline employees who took The Breakroom Quiz

109th of 171 rated banks

Job description

Overview

The Principal AI Architect is a senior technical leadership role responsible for defining and governing enterprise-wide AI, GenAI, and MLOps architecture. This role sets the long-term vision, reference architectures, and reusable patterns for scalable, secure, and responsible AI adoption across the organization. This role combines strong hands-on engineering with strategic innovation to design, prototype, and deliver intelligent, data-driven solutions that power analytics, machine learning, and next-generation AI applications.


Responsibilities

Enterprise AI & GenAI Architecture

  • Define and own enterprise AI and GenAI reference architectures, including LLM platforms, RAG patterns, agentic systems, and multimodal solutions.
  • Establish standardized architectural patterns for model serving, prompt management, orchestration, tool use, and agent frameworks.
  • Lead architecture decisions for buy vs. build, model selection, hosting strategies, and vendor integrations.
  • Ensure AI architectures align with enterprise standards, cloud strategy, security, and governance.

AI Platform Engineering & MLOps

  • Prototype and operationalize advanced AI solutions, including GenAI and LLM-based systems.
    Architect end-to-end MLOps capabilities, including model lifecycle management, CI/CD for ML, feature stores, model monitoring, and drift detection.
  • Define enterprise patterns for training, fine-tuning, deployment, and observability of ML and GenAI workloads.
  • Guide teams on productionizing PoCs into scalable, resilient, and supportable AI systems.
  • Partner with platform teams to evolve a shared enterprise AI platform.


AWS-Centric AI Architecture

  • Design AI and GenAI solutions using AWS-native services, including (but not limited to):
  • Amazon Bedrock, SageMaker, Lambda, ECS/EKS
  • S3, DynamoDB, Aurora, OpenSearch
  • IAM, KMS, VPC, CloudWatch
  • Define cost, performance, and scalability guardrails for AI workloads on AWS.
  • Ensure architectures follow Well-Architected Framework principles.

Governance, Risk, and Responsible AI

  • Partner with security, legal, and compliance teams to define AI governance, guardrails, and controls.
  • Embed responsible AI principles, data privacy, and explainability into enterprise designs.
  • Establish standards for model access, auditability, and risk management.

Technical Leadership & Influence

  • Act as a principal-level advisor to senior technology and business leaders.
    Champion hands-on experimentation and rapid solution delivery while maintaining technical excellence.
  • Mentor architects and senior engineers on AI architecture and MLOps best practices.
  • Drive alignment across teams by publishing reference architecture, design standards, and decision frameworks.
  • Represent the organization in architecture forums, reviews, and strategic initiatives.

Qualifications

Bachelor's Degree and 10 years of experience in Application Development, Systems Engineering, or Information Technology management OR High School Diploma or GED and 14 years of experience in Application Development, Systems Engineering, or Information Technology management

Preferred Qualifications:
• 10+ years of experience in enterprise architecture, data platforms, or distributed systems.
• Deep expertise in AI/ML architecture, including GenAI and LLM-based systems.
• Strong experience designing MLOps platforms and enterprise AI foundations.
• Proven experience architecting solutions on AWS.
• Experience with Snowflake Cortex AI, Snowflake Native AI capabilities
• Strong understanding of cloud security, networking, and governance.
• Proficiency in Python, SQL, and modern data frameworks (e.g., Databricks, Airflow, Snowflake, Vertex AI).
• Relevant AWS certifications in cloud architecture, AI/ML, generative AI, or related domains.
• Experience with agentic AI design patterns, including tool-use orchestration, autonomous workflow agents, or AI copilots.
• Proficiency in API design, microservices, and containerization (Docker, Kubernetes).
• Demonstrated ability to rapidly prototype new AI concepts and transition successful PoCs into production-grade systems.

#LI-XG1

If hired in NC, the base pay for this position is generally between $160,000 and $240,000. Actual starting base pay will be determined based on skills, experience, location, and other non-discriminatory factors permitted by law. For some roles, total compensation may also include variable incentives, bonuses, benefits, and/or other awards as outlined in the offer of employment.

Benefits are an integral part of total rewards and First Citizens Bank is committed to providing a competitive, thoughtfully designed and quality benefits program to meet the needs of our associates. More information can be found at https://jobs.firstcitizens.com/benefits.

Qualifications:

Bachelor's Degree and 10 years of experience in Application Development, Systems Engineering, or Information Technology management OR High School Diploma or GED and 14 years of experience in Application Development, Systems Engineering, or Information Technology management

Preferred Qualifications:
• 10+ years of experience in enterprise architecture, data platforms, or distributed systems.
• Deep expertise in AI/ML architecture, including GenAI and LLM-based systems.
• Strong experience designing MLOps platforms and enterprise AI foundations.
• Proven experience architecting solutions on AWS.
• Experience with Snowflake Cortex AI, Snowflake Native AI capabilities
• Strong understanding of cloud security, networking, and governance.
• Proficiency in Python, SQL, and modern data frameworks (e.g., Databricks, Airflow, Snowflake, Vertex AI).
• Relevant AWS certifications in cloud architecture, AI/ML, generative AI, or related domains.
• Experience with agentic AI design patterns, including tool-use orchestration, autonomous workflow agents, or AI copilots.
• Proficiency in API design, microservices, and containerization (Docker, Kubernetes).
• Demonstrated ability to rapidly prototype new AI concepts and transition successful PoCs into production-grade systems.

#LI-XG1

If hired in NC, the base pay for this position is generally between $160,000 and $240,000. Actual starting base pay will be determined based on skills, experience, location, and other non-discriminatory factors permitted by law. For some roles, total compensation may also include variable incentives, bonuses, benefits, and/or other awards as outlined in the offer of employment.

Benefits are an integral part of total rewards and First Citizens Bank is committed to providing a competitive, thoughtfully designed and quality benefits program to meet the needs of our associates. More information can be found at https://jobs.firstcitizens.com/benefits.

Education:UNAVAILABLEEmployment Type: FULL_TIME

What First Citizens Bank employees say

Pay

Benefits

Hours and flexibility

Workplace

Get the full story on Breakroom

Apply