ZipRecruiter

Log In

1

Llm Developer Jobs in Raleigh, NC (NOW HIRING)

Redhat

Senior Software Engineer, AI Inference

Raleigh, NC · On-site +1

$133K - $220K/yr

As leading developers and maintainers of the vLLM project, and inventors of state-of-the-art ... Understanding of LLM evaluation methodology, including accuracy benchmarks such as MMLU, GSM8K, and ...

Deloitte

AI Engineer Consultant

Raleigh, NC · Hybrid

Build and operationalize LLM-enabled products (copilots, HR knowledge assistant, summarization ... DevOps/DevSecOps experience (CI/CD, IaC such as Terraform/CloudFormation, Docker/Kubernetes ...

Lenovo

Machine Learning Engineer

Morrisville, NC · On-site

Software Engineering Country/Region: United States of America State: North Carolina City ... Design and ship agentic LLM pipelines: multi-step reasoning, tool use, reflection loops, and long ...

RIT Solutions, Inc.

Sr Machine Learning Engineer

Raleigh, NC · On-site

$101K - $139K/yr

Job Summary : RIT Solutions, Inc. is seeking a Senior Machine Learning Engineer to work on ... The role involves deploying LLM/GenAI/RAG systems and requires expertise in cloud technologies and ...

LangChain

Deployed Engineer (Raleigh)

Raleigh, NC · On-site

... developer audiences • Surface field feedback and contribute reusable patterns, cookbooks, and ... based or LLM-powered applications beyond simple API calls, including multi-step workflows ...

Kobie Marketing

AI Engineer

Raleigh, NC · Remote

Build evaluation harnesses (golden datasets, LLM-as-judge, regression suites) using AgentCore ... Hands-on experience with Amazon Bedrock and/or AgentCore as a developer: runtime, gateways, memory ...

Kobie Marketing

AI Engineer

Raleigh, NC · Remote

Build evaluation harnesses (golden datasets, LLM-as-judge, regression suites) using AgentCore ... Hands-on experience with Amazon Bedrock and/or AgentCore as a developer: runtime, gateways, memory ...

next page

Showing results 1-20

All JobsLlm Developer JobsLlm Developer Jobs in Raleigh, NC

Llm Developer information

See Raleigh, NC salary details

$24

$48

$77

How much do llm developer jobs pay per hour?

As of Jun 23, 2026, the average hourly pay for llm developer in Raleigh, NC is $48.76, according to ZipRecruiter salary data. Most workers in this role earn between $38.32 and $59.13 per hour, depending on experience, location, and employer.

What does an LLM Developer do?

An LLM Developer designs, fine-tunes, and implements large language models (LLMs) for various applications, such as chatbots, content generation, and AI-driven tools. They work with machine learning frameworks, optimize model performance, and ensure efficient deployment. This role requires expertise in natural language processing (NLP), deep learning, and programming languages like Python.

What are the key skills and qualifications needed to thrive in the Llm Developer position, and why are they important?

To excel as an LLM Developer, you need strong expertise in natural language processing (NLP), deep learning frameworks, and programming languages such as Python, typically supported by a degree in computer science or a related field. Familiarity with machine learning libraries (like TensorFlow or PyTorch), cloud computing platforms, and experience with prompt engineering or fine-tuning large language models is crucial. Excellent problem-solving abilities, collaboration, and effective communication skills help you design solutions and work efficiently within multidisciplinary teams. These qualifications are essential for successfully building, deploying, and optimizing large language models that drive impactful AI applications.

What are the typical daily tasks and responsibilities of an LLM Developer?

As an LLM Developer, your daily responsibilities often include designing, fine-tuning, and evaluating large language models to meet specific application needs. You may work on tasks such as data preprocessing, model training, performance benchmarking, and error analysis, frequently collaborating with data scientists, research engineers, and product managers. Keeping up to date with the latest advancements in NLP and integrating new techniques into production models is also a key part of the role. These tasks are usually performed in a team-oriented environment where clear communication and iterative experimentation are highly valued.

What are popular job titles related to Llm Developer jobs in Raleigh, NC? For Llm Developer jobs in Raleigh, NC, the most frequently searched job titles are:
What job categories do people searching Llm Developer jobs in Raleigh, NC look for? The top searched job categories for Llm Developer jobs in Raleigh, NC are:
What cities near Raleigh, NC are hiring for Llm Developer jobs? Cities near Raleigh, NC with the most Llm Developer job openings:
Llm Developer jobs near you
Infographic showing various Llm Developer job openings in Raleigh, NC as of June 2026, with employment types broken down into 96% Full Time, 3% Part Time, and 1% Contract. Highlights an 77% Physical, 5% Hybrid, and 18% Remote job distribution, with an average salary of $101,425 per year, or $48.8 per hour.

Senior Machine Learning Engineer III ***Raleigh, NC***

LexisNexis

Raleigh, NC • Hybrid

$118K - $219K/yr

Full-time

Posted 3 days ago

LexisNexis rating

7.6

Company rating: 7.6 out of 10

Based on 12 frontline employees who took The Breakroom Quiz

150th of 428 rated business services

Job description

Are you looking to develop your Machine Learning Engineer career?

Do you enjoy coaching others to achieve high standards?

This is a full-time position based in Raleigh, NC.

(Hybrid - 3 days in office)

About the Role

We are seeking a Consultant-level Machine Learning Engineer to lead the implementation and scaling of AI systems for legal products. This role focuses on how to build and scale-owning system architecture, infrastructure, and productionization of ML/LLM solutions.

You will partner with Data Scientists to turn validated models and prototypes into reliable, high-performance, customer-facing systems.

Key Responsibilities

  • Architect and implement scalable ML/LLM systems in production.
  • Build and deploy LLM applications, including RAG pipelines and agentic systems.
  • Implement hybrid search systems (semantic + lexical) using embeddings and search platforms.
  • Develop and maintain APIs, microservices, and model serving infrastructure.
  • Build data pipelines and streaming systems for large-scale data processing.
  • Define and develop reusable frameworks, libraries, and infrastructure for AI/ML across teams.
  • Optimize systems for latency, scalability, reliability, and cost efficiency.
  • Establish best practices for deployment, monitoring, observability, and CI/CD.
  • Collaborate with Data Scientists to productionize models and integrate into products.
  • Provide technical leadership in system design and engineering standards.

Required Qualifications

  • Bachelor's degree in Computer Science, Engineering, or a related field.
  • Strong experience implementing and scaling production ML/LLM systems.
  • Deep experience with LLM application development, including RAG and prompt orchestration.
  • Strong experience designing and implementing agentic systems using agent frameworks (e.g., LangChain, LangGraph, AutoGen, Google ADK), including orchestration of multi-step workflows in production environments.
  • Strong experience with hybrid search (semantic + lexical), embeddings, and search platforms (e.g., Solr, OpenSearch).
  • Expertise in distributed systems and cloud-native development, including AWS (S3, DynamoDB).
  • Experience with streaming and messaging systems (e.g., Kafka, SQS) and caching (e.g., Redis).
  • Proficiency in Python and experience with systems languages (e.g., Rust, Go, Scala).
  • Experience building scalable APIs (REST/GraphQL).
  • Experience with containerization and orchestration (Docker, Kubernetes).
  • Strong software engineering fundamentals (system design, testing, CI/CD).

Preferred Qualifications

  • Experience with LLM platforms (e.g., ChatGPT/OpenAI, Claude, Gemini, LangChain, Google ADK).
  • Experience with DevOps and infrastructure as code (e.g., Terraform, CloudFormation, Jenkins).
  • Experience with big data technologies (e.g., Spark, Hadoop).
  • Familiarity with graph databases (e.g., Dgraph, Neo4j, Neptune).
  • Experience building high-availability, low-latency systems.
  • Experience in legal or regulatory domains.

Key Competencies

  • Strong system architecture and scalability mindset.
  • Ownership of implementation, performance, and reliability.
  • Ability to translate data science solutions into production systems.
  • Cross-functional collaboration with DS, product, and platform teams.
  • Excellent debugging, optimization, and operational skills.
  • Clear communication of technical designs and trade-offs.

#AIFluent

U.S. National Base Pay Range: $118,300 - $219,800. Geographic differentials may apply in some locations to better reflect local market rates. This job is eligible for an annual incentive bonus.

We know your well-being and happiness are key to a long and successful career. We are delighted to offer country specific benefits. Click here to access benefits specific to your location.

We are committed to providing a fair and accessible hiring process. If you have a disability or other need that requires accommodation or adjustment, please let us know by completing our Applicant Request Support Formor please contact 1-855-833-5120.

Criminals may pose as recruiters asking for money or personal information. We never request money or banking details from job applicants. Learn more about spotting and avoiding scams here.

Please read our Candidate Privacy Policy.

We are an equal opportunity employer: qualified applicants are considered for and treated during employment without regard to race, color, creed, religion, sex, national origin, citizenship status, disability status, protected veteran status, age, marital status, sexual orientation, gender identity, genetic information, or any other characteristic protected by law.

USA Job Seekers:

EEO Know Your Rights.

What LexisNexis employees say

Pay

Hours and flexibility

Workplace

Get the full story on Breakroom

Apply