1

Prompt Engineer Jobs in Durham, NC (NOW HIRING)

Senior Software Engineer

Raleigh, NC · Remote

$119K - $157K/yr

Implement LLM-based capabilities, including prompt engineering, fine-tuning, Retrieval Augmented Generation (RAG), vector databases/indexing, evaluation frameworks, and safety/guardrails to ensure ...

Senior Software Engineer

Raleigh, NC · On-site

$119K - $157K/yr

Implement LLM-based capabilities, including prompt engineering, fine-tuning, Retrieval Augmented Generation (RAG), vector databases/indexing, evaluation frameworks, and safety/guardrails to ensure ...

Build and maintain AI solutions leveraging Azure AI Foundry, including model selection, prompt ... Use Azure DevOps and GitHub for source control, pull requests, code reviews, branching strategies ...

AI Developer- Senior

Raleigh, NC · On-site

$90 - $95/hr

Support teams with prompt engineering, API design, and secure AI adoption. Ensure scalable, performant AI workloads across Azure platforms. Collaborate with DevOps/SRE on observability, governance ...

AI Developer- Senior

Raleigh, NC · On-site

$90 - $95/hr

Support teams with prompt engineering, API design, and secure AI adoption. * Ensure scalable, performant AI workloads across Azure platforms. * Collaborate with DevOps/SRE on observability ...

Software Engineer III

Durham, NC · On-site

$80K - $140K/yr

Exposure to AI Agent development, prompt engineering, Retrieval-Augmented Generation (RAG), or LLM-based applications is highly desirable. * Experience with Microsoft Copilot Studio, Azure AI ...

Senior AI Developer

Raleigh, NC · On-site

$118K - $158K/yr

NCDIT-T Web Systems is seeking a Senior AI Enablement Engineer with strong experience in C#, Vue.js ... Guide development teams on AI integration, prompt engineering, API design, and secure AI adoption

Principal DevOps Engineer

Raleigh, NC · On-site +1

$163K - $185K/yr

Applied use prompt engineering to effectively leverage AI across the SDLC Base Salary Range: $163,850 - $185,000 This position is also eligible to participate in our performance-based annual ...

Principal DevOps Engineer

Raleigh, NC · Hybrid

$163K - $185K/yr

Applied use prompt engineering to effectively leverage AI across the SDLC Base Salary Range: $163,850 - $185,000 This position is also eligible to participate in our performance-based annual ...

Applied use prompt engineering to effectively leverage AI across the SDLC Base Salary Range: $163,850 - $185,000 This position is also eligible to participate in our performance-based annual ...

Principal DevOps Engineer

Raleigh, NC · Hybrid

$163K - $185K/yr

Applied use prompt engineering to effectively leverage AI across the SDLC Base Salary Range: $163,850 - $185,000 This position is also eligible to participate in our performance-based annual ...

You'll spend your days prompt engineering, building with AI tools, and learning how AI products come to life in a fast-paced venture environment. This role is ideal for someone who may not be a ...

Senior Software Engineer

Durham, NC · On-site

$118K - $156K/yr

Strong prompt engineering for structured outputs, nested schemas, and multi-agent coordination. * You read, edit, and contribute to a real platform codebase-APIs, runtime, storage-not just an SDK.

Showing results 21-40

Prompt Engineer information

See Durham, NC salary details

$9

$45

$85

How much do prompt engineer jobs pay per hour?

As of Aug 23, 2026, the average hourly pay for prompt engineer in Durham, NC is $45.50, according to ZipRecruiter salary data. Most workers in this role earn between $34.62 and $58.75 per hour, depending on experience, location, and employer.

What is a prompt engineer?

A Prompt Engineer is a professional who designs, refines, and optimizes prompts to improve interactions with AI models, such as ChatGPT. Their role involves understanding model behavior, crafting precise queries, and experimenting with phrasing to achieve desired outputs. They may work in AI research, software development, or content generation to maximize AI efficiency. Strong skills in language, logic, and sometimes coding are essential for success in this role.

What does a prompt engineer do?

A typical day for a Prompt Engineer involves designing, testing, and refining prompts to enhance the performance of AI language models, often collaborating closely with data scientists, software engineers, and product managers. You might analyze the results of model outputs, integrate user or stakeholder feedback, and iterate on prompt strategies to solve diverse business challenges. Your role will usually include documentation, troubleshooting, and keeping up with the latest advances in AI technologies. Expect a mix of independent work and regular team meetings in a dynamic, fast-evolving environment focused on innovation and improvement.

What skills and qualifications are needed to be a prompt engineer?

To thrive as a Prompt Engineer, you need a strong grasp of natural language processing (NLP), machine learning concepts, and experience crafting effective prompts for large language models, usually supported by a technical degree or relevant experience. Familiarity with tools such as OpenAI's API, Hugging Face, or other AI platforms, as well as knowledge of programming languages like Python, is highly valuable. Creative thinking, analytical problem-solving, and cross-functional communication skills help differentiate top candidates in this field. These abilities are crucial for optimizing AI outcomes and ensuring collaboration with both technical and non-technical teams.

Are prompt engineers still in demand?

Prompt engineers are currently in demand as organizations seek professionals skilled in designing effective prompts for AI language models. The role often requires knowledge of natural language processing, machine learning, and familiarity with AI tools like GPT. Demand is expected to grow as AI integration expands across industries.

How much do prompt engineers make?

Prompt engineers typically earn between $80,000 and $150,000 annually, depending on experience, location, and industry. Senior roles or those with specialized skills in AI and machine learning can command higher salaries, especially in tech hubs or companies investing heavily in AI development.

What exactly is prompt engineer work?

A prompt engineer designs and optimizes prompts used to interact with AI language models, ensuring accurate and relevant responses. This role involves understanding AI behavior, crafting clear instructions, and often requires knowledge of machine learning, programming, or data analysis.

What are the most commonly searched types of Prompt Engineer jobs in Durham, NC?

The most popular types of Prompt Engineer jobs in Durham, NC are:

What are popular job titles related to Prompt Engineer jobs in Durham, NC?

For Prompt Engineer jobs in Durham, NC, the most frequently searched job titles are:

What job categories do people searching Prompt Engineer jobs in Durham, NC look for?

The top searched job categories for Prompt Engineer jobs in Durham, NC are:

What cities near Durham, NC are hiring for Prompt Engineer jobs?

Cities near Durham, NC with the most Prompt Engineer job openings:

Infographic showing various Prompt Engineer job openings in Durham, NC as of August 2026, with employment types broken down into 67% Full Time, and 33% Contract. Highlights an 100% In-person job distribution, with an average salary of $94,640 per year, or $45.5 per hour.

AI Engineer (LLMs for Healthcare)

Keebler Health

Durham, NC • On-site

Full-time

Re-posted 18 days ago


Job description

Job Summary:
Keebler Health is building the operating system for value-based care, aiming to empower healthcare organizations with data-driven insights. The role involves developing and fine-tuning large language models for healthcare applications, collaborating with healthcare professionals, and optimizing AI workflows.
Responsibilities:
• Fine-tune and optimize large language models (LLMs) to address specific healthcare applications.
• Develop and apply advanced prompt engineering techniques to enhance model outputs for clinical scenarios.
• Implement Retrieval-Augmented Generation (RAG) systems to improve knowledge retrieval from large datasets.
• Work with knowledge graphs to organize and integrate healthcare-specific data for enhanced decision-making.
• Evaluate black-box models using precision, recall, and other performance metrics, ensuring robustness and reliability.
• Collaborate with healthcare professionals to understand workflows and identify opportunities for AI-driven enhancements.
• Design and build AI models that align with healthcare standards and regulations (e.g., HIPAA compliance).
• Integrate domain-specific knowledge of healthcare data, including FHIR and interoperability standards, into AI solutions.
• Develop and maintain scalable, production-ready AI pipelines using MLOps tools.
• Deploy and monitor AI models in production environments to ensure performance and compliance.
• Optimize infrastructure for efficient training, testing, and deployment of models.
• Stay at the forefront of advancements in AI, especially in healthcare applications.
• Identify and resolve performance bottlenecks in AI workflows.
• Explore emerging trends and technologies in LLMs and healthcare to continually improve solutions.
• Partner with cross-functional teams, including data engineers and clinicians, to ensure seamless integration of AI into healthcare workflows.
• Communicate technical results and insights effectively to non-technical stakeholders.
Qualifications:
Required:
• Proven experience in LLM fine-tuning and advanced prompt engineering.
• Strong background in Python and modern ML frameworks (e.g., Huggingface, pyTorch).
• Familiarity with healthcare workflows and regulatory requirements (e.g., HIPAA, FHIR standards).
• Hands-on experience with retrieval-augmented generation (RAG) techniques.
• Expertise in evaluating AI models using performance metrics like precision, and recall.
Preferred:
• Experience with MLOps frameworks such as MLflow, Langfuse, or similar tools.
• Understanding of healthcare data standards, including HL7 and HEDIS metrics.
• Strong problem-solving skills in integrating AI with complex healthcare datasets.
• Familiarity with cloud platforms (e.g., AWS, GCP, or Azure) and containerization (Docker, Kubernetes).
Company:
Keebler Health develops an AI-powered healthcare analytics platform focused on risk adjustment and clinical decision support. Founded in 2023, the company is headquartered in Durham, USA, with a team of 11-50 employees. The company is currently Early Stage.