ZipRecruiter

Log In

1

Python Llm Jobs in Cary, NC (NOW HIRING)

Kobie Marketing

AI Engineer

Raleigh, NC · Remote

... clients an LLM-native way to work with complex loyalty logic. We're looking for a hands-on AI ... Build agent harnesses in Python using LangChain and LangGraph, including tool-calling, structured ...

LexisNexis

Senior Machine Learning Engineer III

Raleigh, NC · Hybrid

$118K - $219K/yr

Build and deploy LLM applications, including RAG pipelines and agentic systems. * Implement hybrid ... Proficiency in Python and experience with systems languages (e.g., Rust, Go, Scala). * Experience ...

Kobie Marketing

AI Engineer

Raleigh, NC · Remote

... clients an LLM-native way to work with complex loyalty logic. We're looking for a hands-on AI ... Build agent harnesses in Python using LangChain and LangGraph, including tool-calling, structured ...

First Citizens Bank

Senior AI Architect

Raleigh, NC · On-site

Proven ability to design and scale large-language-model (LLM) and generative AI systems. * Proficiency in Python, SQL, and modern data frameworks * Design AI and GenAI solutions using AWS-native ...

Jaggaer

Architect, Data AI

Durham, NC · On-site

$61.50 - $79.25/hr

... LLM-based, RAG-based, and Agentic AI solutions. • Experience with LangChain, LangGraph, LangFlow, or similar agent frameworks. • Strong proficiency in Python for machine learning, data ...

First Citizens Bank

Senior AI Architect

Raleigh, NC · On-site

Proven ability to design and scale large-language-model (LLM) and generative AI systems. * Proficiency in Python, SQL, and modern data frameworks * Design AI and GenAI solutions using AWS-native ...

Jaggaer

Architect, Data AI

Durham, NC

$61.50 - $79.25/hr

... LLM-based, RAG-based, and Agentic AI solutions. Experience with LangChain, LangGraph, LangFlow, or similar agent frameworks. Strong proficiency in Python for machine learning, data manipulation, and ...

UnitedHealth Group

Senior Software Engineer

Raleigh, NC · Remote

$119K - $157K/yr

... Python (pandas, NumPy), and SQL aligned to enterprise engineering standards * Implement LLM-based capabilities, including prompt engineering, fine-tuning, Retrieval Augmented Generation (RAG), vector ...

Jaggaer

Architect, Data AI

Durham, NC

$61.50 - $79.25/hr

... LLM-based, RAG-based, and Agentic AI solutions. • Experience with LangChain, LangGraph, LangFlow, or similar agent frameworks. • Strong proficiency in Python for machine learning, data ...

LangChain

Deployed Engineer (Raleigh)

Raleigh, NC · On-site

... Strong Python, JavaScript and systems fundamentals • Have designed agent-based or LLM-powered applications beyond simple API calls, including multi-step workflows, orchestration, and failure ...

Bandwidth

Internal Applications Engineer

Raleigh, NC

Write scripts in Python and JavaScript to automate repetitive tasks, integrate APIs, and extend ... Familiarity with LLM APIs and AI-assisted development tools as practical engineering instruments.

New

Accenture

AI Engineering Consultant - Utilities

Raleigh, NC · On-site

$70K - $205K/yr

You develop LLM-powered applications, APIs, and pipelines - implementing RAG, prompt orchestration ... Engineer with modern tooling - use Python, API integration, vector databases, and orchestration ...

New

next page

Showing results 1-20

All JobsPython Llm JobsPython Llm Jobs in Cary, NC

Python Llm information

See Cary, NC salary details

$12

$54

$79

How much do python llm jobs pay per hour?

As of Jul 17, 2026, the average hourly pay for python llm in Cary, NC is $54.31, according to ZipRecruiter salary data. Most workers in this role earn between $44.76 and $61.68 per hour, depending on experience, location, and employer.

What is a Python LLM job?

A Python LLM job involves working with Large Language Models (LLMs) using Python to develop, fine-tune, and deploy AI models. Responsibilities may include data preprocessing, prompt engineering, model optimization, and integration with applications. Professionals in this role often work with frameworks like TensorFlow, PyTorch, or Hugging Face Transformers. They may also contribute to improving model efficiency, reducing bias, and ensuring ethical AI usage.

What are the key skills and qualifications needed to thrive in the Python Llm position, and why are they important?

To excel as a Python LLM (Large Language Model) Engineer, you need strong skills in Python programming, machine learning, and natural language processing, typically supported by a degree in computer science or a related field. Proficiency with libraries such as TensorFlow, PyTorch, Hugging Face Transformers, and experience with model deployment platforms are often essential, alongside certifications in AI or data science. Effective communication, problem-solving abilities, and collaboration are important soft skills for working in interdisciplinary teams and delivering results in dynamic environments. These skills ensure the development, fine-tuning, and deployment of advanced language models that meet both technical and business objectives.

What are some common challenges faced by Python LLM Engineers in their daily work?

Python LLM Engineers often encounter challenges related to optimizing model performance, managing large datasets, and adapting models to specific business needs. Working with large-scale language models requires balancing computational resource limitations with the need for high accuracy and efficiency. Collaboration with data scientists, product managers, and DevOps engineers is routine to ensure seamless model integration and deployment. Staying updated on the latest advancements in NLP and continuously improving models based on user feedback are also important aspects of the role.

What are popular job titles related to Python Llm jobs in Cary, NC? For Python Llm jobs in Cary, NC, the most frequently searched job titles are:
What job categories do people searching Python Llm jobs in Cary, NC look for? The top searched job categories for Python Llm jobs in Cary, NC are:
What cities near Cary, NC are hiring for Python Llm jobs? Cities near Cary, NC with the most Python Llm job openings:
Python Llm jobs near you
Senior Machine Learning Engineer III ***Raleigh, NC***

Senior Machine Learning Engineer III ***Raleigh, NC***

RELX

Raleigh, NC • Hybrid

$118K - $219K/yr

Full-time

Posted 26 days ago

Job description

Are you looking to develop your Machine Learning Engineer career?

Do you enjoy coaching others to achieve high standards?

This is a full-time position based in Raleigh, NC.

(Hybrid - 3 days in office)

About the Role

We are seeking a Consultant-level Machine Learning Engineer to lead the implementation and scaling of AI systems for legal products. This role focuses on how to build and scale-owning system architecture, infrastructure, and productionization of ML/LLM solutions.

You will partner with Data Scientists to turn validated models and prototypes into reliable, high-performance, customer-facing systems.

Key Responsibilities

  • Architect and implement scalable ML/LLM systems in production.
  • Build and deploy LLM applications, including RAG pipelines and agentic systems.
  • Implement hybrid search systems (semantic + lexical) using embeddings and search platforms.
  • Develop and maintain APIs, microservices, and model serving infrastructure.
  • Build data pipelines and streaming systems for large-scale data processing.
  • Define and develop reusable frameworks, libraries, and infrastructure for AI/ML across teams.
  • Optimize systems for latency, scalability, reliability, and cost efficiency.
  • Establish best practices for deployment, monitoring, observability, and CI/CD.
  • Collaborate with Data Scientists to productionize models and integrate into products.
  • Provide technical leadership in system design and engineering standards.

Required Qualifications

  • Bachelor's degree in Computer Science, Engineering, or a related field.
  • Strong experience implementing and scaling production ML/LLM systems.
  • Deep experience with LLM application development, including RAG and prompt orchestration.
  • Strong experience designing and implementing agentic systems using agent frameworks (e.g., LangChain, LangGraph, AutoGen, Google ADK), including orchestration of multi-step workflows in production environments.
  • Strong experience with hybrid search (semantic + lexical), embeddings, and search platforms (e.g., Solr, OpenSearch).
  • Expertise in distributed systems and cloud-native development, including AWS (S3, DynamoDB).
  • Experience with streaming and messaging systems (e.g., Kafka, SQS) and caching (e.g., Redis).
  • Proficiency in Python and experience with systems languages (e.g., Rust, Go, Scala).
  • Experience building scalable APIs (REST/GraphQL).
  • Experience with containerization and orchestration (Docker, Kubernetes).
  • Strong software engineering fundamentals (system design, testing, CI/CD).

Preferred Qualifications

  • Experience with LLM platforms (e.g., ChatGPT/OpenAI, Claude, Gemini, LangChain, Google ADK).
  • Experience with DevOps and infrastructure as code (e.g., Terraform, CloudFormation, Jenkins).
  • Experience with big data technologies (e.g., Spark, Hadoop).
  • Familiarity with graph databases (e.g., Dgraph, Neo4j, Neptune).
  • Experience building high-availability, low-latency systems.
  • Experience in legal or regulatory domains.

Key Competencies

  • Strong system architecture and scalability mindset.
  • Ownership of implementation, performance, and reliability.
  • Ability to translate data science solutions into production systems.
  • Cross-functional collaboration with DS, product, and platform teams.
  • Excellent debugging, optimization, and operational skills.
  • Clear communication of technical designs and trade-offs.

#AIFluent

U.S. National Base Pay Range: $118,300 - $219,800. Geographic differentials may apply in some locations to better reflect local market rates. This job is eligible for an annual incentive bonus.

We know your well-being and happiness are key to a long and successful career. We are delighted to offer country specific benefits. Click here to access benefits specific to your location.

We are committed to providing a fair and accessible hiring process. If you have a disability or other need that requires accommodation or adjustment, please let us know by completing our Applicant Request Support Formor please contact 1-855-833-5120.

Criminals may pose as recruiters asking for money or personal information. We never request money or banking details from job applicants. Learn more about spotting and avoiding scams here.

Please read our Candidate Privacy Policy.

We are an equal opportunity employer: qualified applicants are considered for and treated during employment without regard to race, color, creed, religion, sex, national origin, citizenship status, disability status, protected veteran status, age, marital status, sexual orientation, gender identity, genetic information, or any other characteristic protected by law.

USA Job Seekers:

EEO Know Your Rights.

Apply