1

Prompt Manager Jobs in Raleigh, NC (NOW HIRING)

Establish standardized architectural patterns for model serving, prompt management, orchestration, tool use, and agent frameworks. * Lead architecture decisions for buy vs. build, model selection ...

Establish standardized architectural patterns for model serving, prompt management, orchestration, tool use, and agent frameworks. * Lead architecture decisions for buy vs. build, model selection ...

Establish standardized architectural patterns for model serving, prompt management, orchestration, tool use, and agent frameworks. * Lead architecture decisions for buy vs. build, model selection ...

Experience with MLOps/LLMOps practices: evaluation frameworks, model monitoring, and prompt management * Experience with SageMaker fine-tuning (SFT and RFT) for domain SLMs * Experience integrating ...

Experience with MLOps/LLMOps practices: evaluation frameworks, model monitoring, and prompt management * Experience with SageMaker fine-tuning (SFT and RFT) for domain SLMs * Experience integrating ...

Experience with MLOps/LLMOps practices: evaluation frameworks, model monitoring, and prompt management * Experience with SageMaker fine-tuning (SFT and RFT) for domain SLMs * Experience integrating ...

next page

Showing results 1-20

Prompt Manager information

See Raleigh, NC salary details

$22.4K

$59.6K

$99.6K

How much do prompt manager jobs pay per year?

As of Sep 13, 2026, the average yearly pay for prompt manager in Raleigh, NC is $59,638.00, according to ZipRecruiter salary data. Most workers in this role earn between $42,800.00 and $67,100.00 per year, depending on experience, location, and employer.

What is a prompt manager?

A Prompt Manager is a professional responsible for creating, organizing, and optimizing prompts used in artificial intelligence systems, such as chatbots or language models. Their role involves designing prompts that elicit accurate and relevant responses from AI, maintaining prompt libraries, and analyzing AI performance to improve prompt effectiveness. Prompt Managers often collaborate with product teams, developers, and data scientists to ensure that AI interactions meet user needs and business goals. This position is increasingly important as organizations rely more on AI-driven applications.

How does a prompt manager typically collaborate with cross-functional teams to improve prompt effectiveness?

A Prompt Manager frequently works alongside product managers, data scientists, engineers, and UX designers to refine and optimize AI-generated responses. They solicit feedback from these teams to understand user needs and technical limitations, then iterate on prompt design to enhance clarity and accuracy. Regular meetings and shared documentation are common, ensuring everyone stays aligned on project goals and updates. This collaboration helps create more effective and user-friendly AI interactions.

What are the key skills and qualifications needed to thrive as a prompt manager, and why are they important?

To thrive as a Prompt Manager, you need expertise in prompt engineering, natural language processing, and a solid understanding of AI language models, often supported by experience in computer science or data science. Familiarity with tools like OpenAI's API, prompt optimization platforms, and version control systems is typically required. Strong analytical thinking, communication, and problem-solving abilities set standout Prompt Managers apart. These skills ensure the effective development and refinement of AI interactions, optimizing user experience and model performance.

What is the difference between Prompt Manager vs Prompt Engineer?

AspectPrompt ManagerPrompt Engineer
CredentialsExperience with AI workflows, basic scripting, project managementTechnical expertise in AI, programming, and prompt design
Work EnvironmentCollaborative teams, project-based tasks, client interactionsTechnical teams, AI development labs, research settings
Industry UsageUsed in AI project management, content workflowsUsed in AI model development, prompt optimization
Search & ComparisonOften compared for roles managing prompts and workflowsCompared for technical prompt creation and tuning

Prompt Managers focus on overseeing AI prompt workflows, coordinating teams, and ensuring project goals are met. Prompt Engineers are more technically skilled, designing and refining prompts to optimize AI model performance. While both roles work with prompts, the Prompt Manager handles project management aspects, whereas the Prompt Engineer concentrates on technical prompt development.

What are popular job titles related to Prompt Manager jobs in Raleigh, NC?

For Prompt Manager jobs in Raleigh, NC, the most frequently searched job titles are:

What cities near Raleigh, NC are hiring for Prompt Manager jobs?

Cities near Raleigh, NC with the most Prompt Manager job openings:

Infographic showing various Prompt Manager job openings in Raleigh, NC as of August 2026, with employment types broken down into 83% Full Time, 15% Part Time, and 2% Contract. Highlights an 84% Physical, 3% Hybrid, and 13% Remote job distribution, with an average salary of $59,638 per year, or $28.7 per hour.

Principal AI Architect

Raleigh, NC • On-site

Full-time

Re-posted 10 days ago


First Citizens Bank rating

7.3

Company rating: 7.3 out of 10

Based on 107 frontline employees who took The Breakroom Quiz


Job description

Overview

The Principal AI Architect is a senior technical leadership role responsible for defining and governing enterprise-wide AI, GenAI, and MLOps architecture. This role sets the long-term vision, reference architectures, and reusable patterns for scalable, secure, and responsible AI adoption across the organization. This role combines strong hands-on engineering with strategic innovation to design, prototype, and deliver intelligent, data-driven solutions that power analytics, machine learning, and next-generation AI applications.


Responsibilities & Qualifications

Enterprise AI & GenAI Architecture

  • Define and own enterprise AI and GenAI reference architectures, including LLM platforms, RAG patterns, agentic systems, and multimodal solutions.
  • Establish standardized architectural patterns for model serving, prompt management, orchestration, tool use, and agent frameworks.
  • Lead architecture decisions for buy vs. build, model selection, hosting strategies, and vendor integrations.
  • Ensure AI architectures align with enterprise standards, cloud strategy, security, and governance.

AI Platform Engineering & MLOps

  • Prototype and operationalize advanced AI solutions, including GenAI and LLM-based systems.
    Architect end-to-end MLOps capabilities, including model lifecycle management, CI/CD for ML, feature stores, model monitoring, and drift detection.
  • Define enterprise patterns for training, fine-tuning, deployment, and observability of ML and GenAI workloads.
  • Guide teams on productionizing PoCs into scalable, resilient, and supportable AI systems.
  • Partner with platform teams to evolve a shared enterprise AI platform.


AWS-Centric AI Architecture

  • Design AI and GenAI solutions using AWS-native services, including (but not limited to):
  • Amazon Bedrock, SageMaker, Lambda, ECS/EKS
  • S3, DynamoDB, Aurora, OpenSearch
  • IAM, KMS, VPC, CloudWatch
  • Define cost, performance, and scalability guardrails for AI workloads on AWS.
  • Ensure architectures follow Well-Architected Framework principles.

Governance, Risk, and Responsible AI

  • Partner with security, legal, and compliance teams to define AI governance, guardrails, and controls.
  • Embed responsible AI principles, data privacy, and explainability into enterprise designs.
  • Establish standards for model access, auditability, and risk management.

Technical Leadership & Influence

  • Act as a principal-level advisor to senior technology and business leaders.
    Champion hands-on experimentation and rapid solution delivery while maintaining technical excellence.
  • Mentor architects and senior engineers on AI architecture and MLOps best practices.
  • Drive alignment across teams by publishing reference architecture, design standards, and decision frameworks.
  • Represent the organization in architecture forums, reviews, and strategic initiatives.



Qualifications:

Bachelor's Degree and 10 years of experience in Application Development, Systems Engineering, or Information Technology management OR High School Diploma or GED and 14 years of experience in Application Development, Systems Engineering, or Information Technology management

Key Responsibilities:

Enterprise AI & GenAI Architecture

  • Define and own enterprise AI and GenAI reference architectures, including LLM platforms, RAG patterns, agentic systems, and multimodal solutions.
  • Establish standardized architectural patterns for model serving, prompt management, orchestration, tool use, and agent frameworks.
  • Lead architecture decisions for buy vs. build, model selection, hosting strategies, and vendor integrations.
  • Ensure AI architectures align with enterprise standards, cloud strategy, security, and governance.


AI Platform Engineering & MLOps

  • Prototype and operationalize advanced AI solutions, including GenAI and LLM-based systems.
    Architect end-to-end MLOps capabilities, including model lifecycle management, CI/CD for ML, feature stores, model monitoring, and drift detection.
  • Define enterprise patterns for training, fine-tuning, deployment, and observability of ML and GenAI workloads.
  • Guide teams on productionizing PoCs into scalable, resilient, and supportable AI systems.
  • Partner with platform teams to evolve a shared enterprise AI platform.

AWS-Centric AI Architecture

  • Design AI and GenAI solutions using AWS-native services, including (but not limited to):
  • Amazon Bedrock, SageMaker, Lambda, ECS/EKS
  • S3, DynamoDB, Aurora, OpenSearch
  • IAM, KMS, VPC, CloudWatch
  • Define cost, performance, and scalability guardrails for AI workloads on AWS.
  • Ensure architectures follow Well-Architected Framework principles.

Governance, Risk, and Responsible AI

  • Partner with security, legal, and compliance teams to define AI governance, guardrails, and controls.
  • Embed responsible AI principles, data privacy, and explainability into enterprise designs.
  • Establish standards for model access, auditability, and risk management.

Technical Leadership & Influence

  • Act as a principal-level advisor to senior technology and business leaders.
  • Champion hands-on experimentation and rapid solution delivery while maintaining technical excellence.
  • Mentor architects and senior engineers on AI architecture and MLOps best practices.
  • Drive alignment across teams by publishing reference architecture, design standards, and decision frameworks
  • Represent the organization in architecture forums, reviews, and strategic initiatives.

Qualifications:
10+ years of experience in enterprise architecture, data platforms, or distributed systems.
Deep expertise in AI/ML architecture, including GenAI and LLM-based systems.
Strong experience designing MLOps platforms and enterprise AI foundations.
Proven experience architecting solutions on AWS.
Experience with Snowflake Cortex AI, Snowflake Native AI capabilities
Strong understanding of cloud security, networking, and governance.
Proficiency in Python, SQL, and modern data frameworks (e.g., Databricks, Airflow, Snowflake, Vertex AI).

Bachelor’s or Master’s degree in Computer Science, Engineering, or a related field

Preferred:

Relevant AWS certifications in cloud architecture, AI/ML, generative AI, or related domains.
Experience with agentic AI design patterns, including tool-use orchestration, autonomous workflow agents, or AI copilots.
Proficiency in API design, microservices, and containerization (Docker, Kubernetes).
Demonstrated ability to rapidly prototype new AI concepts and transition successful PoCs into production-grade systems.


Additional Information

If hired in NC, the base pay for this position is generally between $160,000 and $240,000. Actual starting base pay will be determined based on skills, experience, location, and other non-discriminatory factors permitted by law. For some roles, total compensation may also include variable incentives, bonuses, benefits, and/or other awards as outlined in the offer of employment.

Benefits are an integral part of total rewards and First Citizens Bank is committed to providing a competitive, thoughtfully designed and quality benefits program to meet the needs of our associates. More information can be found at https://jobs.firstcitizens.com/benefits.

Qualifications:

If hired in NC, the base pay for this position is generally between $160,000 and $240,000. Actual starting base pay will be determined based on skills, experience, location, and other non-discriminatory factors permitted by law. For some roles, total compensation may also include variable incentives, bonuses, benefits, and/or other awards as outlined in the offer of employment.

Benefits are an integral part of total rewards and First Citizens Bank is committed to providing a competitive, thoughtfully designed and quality benefits program to meet the needs of our associates. More information can be found at https://jobs.firstcitizens.com/benefits.

Education:UNAVAILABLEEmployment Type: FULL_TIME

What First Citizens Bank employees say

Pay

Benefits

Hours and flexibility

Workplace

Get the full story on Breakroom