ZipRecruiter

Log In

1

Llm Prompt Engineer Jobs in Raleigh, NC (NOW HIRING)

UnitedHealth Group

Senior Software Engineer

Raleigh, NC · Remote

$119K - $157K/yr

Implement LLM-based capabilities, including prompt engineering, fine-tuning, Retrieval Augmented Generation (RAG), vector databases/indexing, evaluation frameworks, and safety/guardrails to ensure ...

E-Solutions, Inc.

Gen AI Engineer

Raleigh, NC · On-site

Prompt engineering & prompt chaining * Conversational AI design patterns * Strong programming ... Exposure to LLM fine-tuning, embeddings, vector databases * Experience building enterprise copilots ...

Data Direct Networks

Senior/Staff AI Engineer

Raleigh, NC · On-site

$150K - $250K/yr

Build and optimize LLM serving and inference systems for production environments * Improve ... This is not a "prompt engineering" job. * This is not an "AI wrapper" job. * This is not a generic ...

Elsevier

Principal Software Engineer-Agentic AI

Raleigh, NC

$131K - $175K/yr

Experience with prompt engineering, evaluation, and guardrails for production-grade AI systems ... Define and implement LLM-powered architectures Design scalable solutions leveraging large language ...

RELX

Principal Software Engineer-Agentic AI

Raleigh, NC

$131K - $175K/yr

Experience with prompt engineering, evaluation, and guardrails for production-grade AI systems ... Define and implement LLM-powered architectures Design scalable solutions leveraging large language ...

Deloitte

Lead Forward Deployed Engineer, Snowflake

Raleigh, NC · On-site

$99K - $131K/yr

... prompt management * Experience integrating LLM solutions with enterprise systems via APIs ... At Deloitte, Forward Deployed Engineers (FDE) don't just build AI solutions, they help clients turn ...

CCube Solutions

AI & ML Tech Lead/Architect

Raleigh, NC · On-site

$150K - $225K/yr

Familiarity with AI/ML concepts, especially LLMs, prompt engineering, and AI agents. Understanding of LangChain, Agentic AI, or similar LLM orchestration frameworks . Experience integrating with AI ...

CoVar

Software Engineer

Durham, NC

This is a software engineering role and not a prompt engineering role. Candidates with strong LLM prompting skills but limited understanding of software engineering fundamentals will not be ...

Ccube

AI & ML Tech Lead/Architect

Durham, NC · On-site

$150K - $225K/yr

Familiarity with AI/ML concepts, especially LLMs, prompt engineering, and AI agents. Understanding of LangChain, Agentic AI, or similar LLM orchestration frameworks . Experience integrating with AI ...

Kobie Marketing

AI Engineer

Raleigh, NC · Remote

Build evaluation harnesses (golden datasets, LLM-as-judge, regression suites) using AgentCore ... Implement guardrails around tool execution: auth scoping, input/output validation, PII and prompt ...

Kobie Marketing

AI Engineer

Raleigh, NC · Remote

Build evaluation harnesses (golden datasets, LLM-as-judge, regression suites) using AgentCore ... Implement guardrails around tool execution: auth scoping, input/output validation, PII and prompt ...

Pendo

GTM AI Engineer

Raleigh, NC

Hands-on experience building LLM-powered applications, including prompt engineering, output validation, and iterative improvement in a live environment. * Strong judgment about when AI is the right ...

next page

Showing results 1-20

All JobsLlm Prompt Engineer JobsLlm Prompt Engineer Jobs in Raleigh, NC

Llm Prompt Engineer information

See Raleigh, NC salary details

$36

$56

$82

How much do llm prompt engineer jobs pay per hour?

As of Jul 15, 2026, the average hourly pay for llm prompt engineer in Raleigh, NC is $56.59, according to ZipRecruiter salary data. Most workers in this role earn between $44.18 and $69.18 per hour, depending on experience, location, and employer.

What are some common challenges faced by LLM Prompt Engineers when designing effective prompts for large language models?

LLM Prompt Engineers often encounter challenges such as ensuring prompts are both clear and unambiguous to elicit accurate model responses, as well as avoiding bias or unintended outputs. Balancing creativity and specificity in prompt design can be tricky, especially when tailoring prompts for diverse user intents or specialized domains. Additionally, prompt engineers must frequently iterate and test their prompts, collaborating closely with data scientists and product teams to continually refine them based on observed model behavior and user feedback.

Which LLM is good for prompt engineering?

For a prompt engineer, large language models like OpenAI's GPT-4, Anthropic's Claude, and Google's PaLM are popular choices due to their advanced capabilities and flexibility. Selecting an LLM depends on factors such as API accessibility, customization options, and the specific application requirements. Familiarity with prompt design and understanding model limitations are essential skills for effective prompt engineering.

What is an LLM Prompt Engineer?

An LLM Prompt Engineer is a professional who specializes in designing, testing, and optimizing prompts for large language models (LLMs) such as GPT-4. Their role involves crafting effective instructions and queries to guide the model's output for specific applications, ensuring accuracy, relevance, and reliability. They may also analyze model behavior, implement prompt-based workflows, and collaborate with developers to integrate LLMs into products or services. The goal is to maximize the performance and efficiency of language models in various real-world contexts.

How much do LLM engineers make?

LLM (Large Language Model) engineers typically earn between $100,000 and $180,000 annually, depending on experience, location, and company size. Senior roles or those with specialized skills in deep learning and NLP can command higher salaries, often exceeding $200,000. Compensation may also include bonuses and stock options in tech companies.

Are prompt engineers still in demand?

Prompt engineers are currently in demand as organizations seek to optimize AI language models for various applications. The role requires skills in natural language processing, prompt design, and familiarity with large language models, making it a valuable position in AI development teams.

What engineer makes $500,000 a year?

Senior AI engineers, including those working as prompt engineers or machine learning engineers, can earn $500,000 or more annually, especially with extensive experience, specialized skills, and in high-demand industries. Compensation often includes base salary, bonuses, and stock options, particularly at leading tech companies or startups focused on artificial intelligence and large language models.

What are the key skills and qualifications needed to thrive as an LLM Prompt Engineer, and why are they important?

To thrive as an LLM Prompt Engineer, you need a deep understanding of natural language processing, prompt engineering strategies, and proficiency in programming languages such as Python, often supported by a degree in computer science or a related field. Familiarity with machine learning frameworks (like TensorFlow or PyTorch), large language model APIs, and version control systems is typically required. Strong analytical thinking, creativity, and effective communication are crucial soft skills for crafting precise prompts and collaborating with cross-functional teams. These skills ensure the development of effective, ethical, and high-performing AI-powered solutions that meet diverse user needs.

What is the difference between Llm Prompt Engineer vs Data Scientist?

AspectLlm Prompt EngineerData Scientist
Required CredentialsBachelor's in CS, AI, or related fields; familiarity with NLP and AI toolsBachelor's or higher in CS, Statistics, or related fields; strong programming and statistical skills
Work EnvironmentAI labs, tech companies, startups focusing on NLP and AI modelsData analysis, modeling, and visualization in various industries like finance, healthcare, tech
Employer & Industry UsagePrimarily in AI development, NLP projects, and machine learning teamsAcross industries for data analysis, predictive modeling, and decision support

While both roles involve working with data and AI, Llm Prompt Engineers focus on designing prompts for language models, whereas Data Scientists analyze data to derive insights. The roles share similar educational backgrounds and work environments but differ in their core tasks and industry applications.

What are popular job titles related to Llm Prompt Engineer jobs in Raleigh, NC? For Llm Prompt Engineer jobs in Raleigh, NC, the most frequently searched job titles are:
What job categories do people searching Llm Prompt Engineer jobs in Raleigh, NC look for? The top searched job categories for Llm Prompt Engineer jobs in Raleigh, NC are:
What cities near Raleigh, NC are hiring for Llm Prompt Engineer jobs? Cities near Raleigh, NC with the most Llm Prompt Engineer job openings:
Llm Prompt Engineer jobs near you
Senior Software Engineer (Pipeline team)

Senior Software Engineer (Pipeline team)

Foundation AI

Raleigh, NC • On-site

$119K - $157K/yr

Full-time

Posted 9 days ago

Job description

About Us

Foundation AI is the only AI Native document intake automation platform serving the claims and litigation industries. Founded in 2019 by a team of lawyers and data scientists, Foundation AI processes millions of documents each month for hundreds of US law firms, including many of the largest and most respected plaintiff and injury law firms in the country.

Job Overview

We're looking for a Senior AI/ML Engineer to help expand our next-generation document intelligence system. Working in close collaboration with our Data Science team, you'll bring deep technical rigor to a system that gets smarter with every document it digests, across hundreds of customers at scale. The system draws on a combination of ML, LLM, RAG, applied mathematics, and smart algorithm design to deliver results at a high level of accuracy.
this is a remote job.

Key Responsibilities
  • Retrieval-Augmented Generation: Design and build RAG architectures for document understanding, classification, and extraction — from chunking and indexing through retrieval quality and grounding.
  • LLM Feature Development: Ship production LLM-powered features end-to-end, from prompt design through evaluation — not just prototypes.
  • Evaluation-Driven Development: Build regression suites, confidence calibration methods, and evaluation frameworks that make AI output quality measurable.
  • Collaboration with Data Science: Partner closely with our Data Science team to bring research-grade techniques into production.
  • ML Pipeline & MLOps: Own model, data, and prompt versioning; build reproducible pipelines for ingestion, training, evaluation, and serving.
  • Rollout Automation & A/B Testing: Implement canary deployments, side-by-side A/B testing, and rollback mechanisms for safe model and prompt releases.
  • Monitoring & Observability: Implement drift detection, data quality monitoring, and alerting; define SLOs for model and pipeline health.
  • System Architecture & Leadership: Design secure, high-performance ML infrastructure; evaluate tooling (Bedrock, MLflow, Airflow); mentor engineers and influence best practices.
Skills and Tools
  • Experience: 5+ years in software engineering, with 2–3 years focused on ML/AI in production systems.
  • LLM & RAG Fundamentals: Hands-on experience with prompt engineering, RAG architectures, and evaluation-driven development — with a track record of shipping LLM-powered features real users rely on.
  • MLOps & Pipeline Tooling: Practical experience with model/data/prompt versioning, experiment tracking, and deployment automation; proficiency with Airflow, MLflow, and Bedrock or equivalents.
  • Programming: Proficient in Python; comfortable with SQL and data engineering patterns.
  • Strongly Preferred: Working understanding of classical ML methods (gradient boosting, embeddings, calibration) sufficient to collaborate closely with Data Science; AWS infrastructure experience (S3, ECS/EKS, Lambda); familiarity with agent frameworks (LangChain, MCP) is a bonus.
Education

A B.Tech degree in Computer Science or equivalent experience relevant to the functional area.

Our Commitment

Foundation AI is an equal opportunity employer committed to diversity and inclusion in the workplace. We prohibit discrimination and harassment of any kind based on race, color, sex, religion, sexual orientation, national origin, disability, genetic information, pregnancy, or any other protected characteristic. Our hiring decisions are based solely on qualifications, merit, and business needs at the time.

For any feedback or inquiries, please contact us at careers@foundationai.com. Learn more at www.foundationai.com.

Powered by JazzHR

87cD3hRNJj