ZipRecruiter

Log In

1

Python Llm Jobs in Cary, NC (NOW HIRING)

ACA Group

Python/AI Product Engineer

Durham, NC · On-site

The role involves architecting and developing enterprise-grade AI systems using Python and modern LLM frameworks while mentoring engineers and driving technical innovation. Responsibilities : • ...

ACA Group

Python/AI Product Engineer

Durham, NC · Hybrid

... LLM frameworks and cloud-native technologies. This is a hybrid role (2-3 days in the office ... OR Pittsburgh The ideal candidate has deep expertise in Python development, distributed cloud ...

ACA Group

Python/AI Product Engineer

Durham, NC · On-site

... LLM frameworks and cloud-native technologies. This is a hybrid role (2-3 days in the office ... OR Pittsburgh The ideal candidate has deep expertise in Python development, distributed cloud ...

CCube Solutions

AI/ML Tech Lead

Raleigh, NC · On-site

$140K - $180K/yr

Architect and design scalable, secure, and high-performance microservices using Python OR Java. Collaborate with AI/ML teams to integrate LLM-based tools and frameworks into enterprise applications.

Ccube

AI/ML Tech Lead

Raleigh, NC · On-site

$140K - $180K/yr

Architect and design scalable, secure, and high-performance microservices using Python OR Java. Collaborate with AI/ML teams to integrate LLM-based tools and frameworks into enterprise applications.

Ccube

AI/ML Tech Lead

Raleigh, NC · Hybrid

Architect and design scalable, secure, and high-performance microservices using Python OR Java. Collaborate with AI/ML teams to integrate LLM-based tools and frameworks into enterprise applications.

Pwc

GenAI Python Systems Engineer-Director

Raleigh, NC · On-site

$155K - $410K/yr

... is a plus - Proficient in Python and structured/unstructured data - Proficient in SQL and ... LLM outputs - Developing scalable data storage solutions using cloud services - Designing and ...

Pwc

GenAI Python Systems Engineer-Manager

Raleigh, NC · On-site

$99K - $232K/yr

... Python and SQL - Experience with Docker and containerized deployments - Skilled in AI techniques ... LLM optimization - Implementing data integration solutions using AWS, Azure, GCP - Utilizing AWS ...

next page

Showing results 1-20

People also search for

All JobsPython Llm JobsPython Llm Jobs in Cary, NC

Python Llm information

See Cary, NC salary details

$12

$54

$79

How much do python llm jobs pay per hour?

As of May 29, 2026, the average hourly pay for python llm in Cary, NC is $54.31, according to ZipRecruiter salary data. Most workers in this role earn between $44.76 and $61.68 per hour, depending on experience, location, and employer.

What is a Python LLM job?

A Python LLM job involves working with Large Language Models (LLMs) using Python to develop, fine-tune, and deploy AI models. Responsibilities may include data preprocessing, prompt engineering, model optimization, and integration with applications. Professionals in this role often work with frameworks like TensorFlow, PyTorch, or Hugging Face Transformers. They may also contribute to improving model efficiency, reducing bias, and ensuring ethical AI usage.

What are the key skills and qualifications needed to thrive in the Python Llm position, and why are they important?

To excel as a Python LLM (Large Language Model) Engineer, you need strong skills in Python programming, machine learning, and natural language processing, typically supported by a degree in computer science or a related field. Proficiency with libraries such as TensorFlow, PyTorch, Hugging Face Transformers, and experience with model deployment platforms are often essential, alongside certifications in AI or data science. Effective communication, problem-solving abilities, and collaboration are important soft skills for working in interdisciplinary teams and delivering results in dynamic environments. These skills ensure the development, fine-tuning, and deployment of advanced language models that meet both technical and business objectives.

What are some common challenges faced by Python LLM Engineers in their daily work?

Python LLM Engineers often encounter challenges related to optimizing model performance, managing large datasets, and adapting models to specific business needs. Working with large-scale language models requires balancing computational resource limitations with the need for high accuracy and efficiency. Collaboration with data scientists, product managers, and DevOps engineers is routine to ensure seamless model integration and deployment. Staying updated on the latest advancements in NLP and continuously improving models based on user feedback are also important aspects of the role.
More about Python Llm jobs
What are popular job titles related to Python Llm jobs in Cary, NC? For Python Llm jobs in Cary, NC, the most frequently searched job titles are:
What job categories do people searching Python Llm jobs in Cary, NC look for? The top searched job categories for Python Llm jobs in Cary, NC are:
What cities near Cary, NC are hiring for Python Llm jobs? Cities near Cary, NC with the most Python Llm job openings:
Python Llm jobs near you

Python - AI Engineer Contractor

Omm IT Solutions

Cary, NC • On-site

Full-time

Posted 4 days ago

Job description

Job Description
PLEASE NOTE:
  • It is a 100% on-site position, Carry, NC.
  • 5 days/week.
  • Local candidates.
  • HackerRank assessment required

Job Description:
  • Build GenAI applications leveraging foundation models and advanced architectures such as GraphRAG.
  • Develop autonomous AI agents using modern Agentic frameworks.
  • Design and deploy RAG and GenAI services using Python (FastAPI), Docker, and cloud platforms (AWS, Azure, or GCP).
  • Build scalable REST APIs that power LLM-driven applications integrated with enterprise data sources.
  • Implement LLM evaluation frameworks using tools such as Ragas, LangSmith, or custom benchmarks to measure answer relevance, groundedness, and hallucination rates.
  • Apply LLMOps/MLOps practices, including CI/CD pipelines, prompt/version management, automated testing, and monitoring of latency, cost, and response quality.
  • Develop systems leveraging Embeddings at scale, knowledge graphs, and ontology extraction.
  • Collaborate across engineering teams, mentor developers, and help drive innovation in GraphRAG and Agentic AI architectures.

SKILL SET:
  • Focus on building AI-driven solutions using Python, including LLMs, Embeddings, knowledge graphs, and RAG Architecture.

Requirements
Required Qualifications:
  • Degree in Computer Science, AI/ML, or related field.
  • 5+ years of AI/ML-focused software engineering experience.
  • Production experience building LLM-based or Agentic AI systems.
  • Strong expertise in Python and modern AI frameworks.
  • Experience with Embeddings, knowledge graphs, ontology extraction, and advanced RAG/GraphRAG implementations.
  • Full-stack development experience (Python back end + modern front end).
  • Experience deploying AI workloads to AWS, Azure, or GCP.
  • Familiarity with LLMOps/MLOps tooling and model evaluation frameworks.
  • Strong problem-solving, communication, and collaboration skills.

Apply