ZipRecruiter

Log In

2

Remote Large Language Model Llm Jobs in Raleigh, NC

Berriehill Research

Senior AI Systems Engineer

Raleigh, NC · On-site +1

$92K - $126K/yr

Familiarity with large language model (LLM) APIs and orchestration frameworks such as OpenAI ... This position may be performed fully remote, hybrid, or onsite at an ARA office. Preference will be ...

Deloitte

AI and Data Science Engineer III

Raleigh, NC · On-site +1

$111K - $133K/yr

Build and operationalize large language model-enabled capabilities, including copilots, knowledge ... LLM applications using Claude-, GPT/Codex-, and Gemini-class models, and more implemented with ...

Well

Product Manager

Chapel Hill, NC · On-site +1

$115K - $140K/yr

Remote candidates may be considered Compensation: Product Manager ($115,000-$140,000) per year ... Identify and evaluate opportunities to apply generative AI, large language models, and other ...

IQVIA

Senior AI Scientist

Durham, NC · Remote

$88K - $120K/yr

... on Large Language Models (LLMs) and agentic AI solutions. This role will be responsible for ... Key Responsibilities 1. LLM Evaluation & Benchmarking * Design and implement scalable evaluation ...

IQVIA

Senior AI Scientist

Durham, NC · Remote

$88K - $120K/yr

... on Large Language Models (LLMs) and agentic AI solutions. This role will be responsible for ... Key Responsibilities 1. LLM Evaluation & Benchmarking * Design and implement scalable evaluation ...

LexisNexis

Manager Data Science

Raleigh, NC · On-site +1

... for remote locations. ** Are you looking to develop your Data Scientist career? Do you enjoy ... Experience working directly with large language models and Transformer based architectures ...

Redhat

Software Engineer

Raleigh, NC · On-site +1

$135K - $154K/yr

... and Large Language Models (LLMs). * Perform SRE functions and technical support within an ... For positions with Remote-US locations, the actual salary range for the position may differ based ...

LexisNexis

Senior Data Scientist II

Raleigh, NC · On-site +1

$125K - $209K/yr

... and large language models (LLMs) to solve complex legal workflows. You will help drive ... Develop and implement NLP, LLM, and generative AI approaches (e.g., RAG, prompt strategies)

Well

Senior Software Engineer

Chapel Hill, NC · On-site +1

$160K - $180K/yr

... integration of Large Language Models (LLMs) into our core platform. We are looking for an ... Prototype and deploy LLM-powered features to enhance the member experience. This includes ...

Varsity Tutors

ChatGPT Tutor

Durham, NC · Remote

$40/hr

... of large language model limitations. Ability to explain effective prompt construction, context window management, and responsible AI usage while preparing students for productive and ethical AI ...

Varsity Tutors

ChatGPT Tutor

Raleigh, NC · Remote

$40/hr

... of large language model limitations. Ability to explain effective prompt construction, context window management, and responsible AI usage while preparing students for productive and ethical AI ...

next page

Showing results 1-20

All JobsLarge Language Model Llm JobsRemote Large Language Model Llm JobsRemote Large Language Model Llm Jobs in Raleigh, NC

Remote Large Language Model Llm information

See Raleigh, NC salary details

$14

$23

$37

How much do remote large language model llm jobs pay per hour?

As of Jun 10, 2026, the average hourly pay for remote large language model llm in Raleigh, NC is $23.66, according to ZipRecruiter salary data. Most workers in this role earn between $18.46 and $28.27 per hour, depending on experience, location, and employer.

What is a Remote Large Language Model (LLM) job?

A Remote Large Language Model (LLM) job involves working with advanced AI models, like GPT or similar, from a remote location. Professionals in these roles may develop, train, fine-tune, or implement large language models for various applications such as natural language processing, chatbots, or content generation. Remote LLM jobs can include positions like machine learning engineer, research scientist, or AI product manager. The work typically requires strong programming skills, experience with AI frameworks, and the ability to collaborate virtually with global teams.

How does a Remote Large Language Model (LLM) Engineer typically collaborate with cross-functional teams while working remotely?

Remote LLM Engineers often work closely with data scientists, product managers, and software engineers through virtual meetings, collaborative coding platforms, and shared documentation tools. Regular communication is key, with daily stand-ups or weekly syncs to align on project goals, update progress, and address challenges. They may also participate in code reviews, contribute to design discussions, and support model deployment efforts, all within a distributed team environment. This remote structure encourages self-motivation and proactive communication to ensure project success.

What are the key skills and qualifications needed to thrive as a Remote Large Language Model (LLM) Engineer, and why are they important?

To thrive as a Remote Large Language Model (LLM) Engineer, you need a strong background in computer science, machine learning, and natural language processing, typically supported by a relevant degree and experience with large-scale models. Proficiency with programming languages like Python, deep learning frameworks such as PyTorch or TensorFlow, and familiarity with cloud platforms and distributed systems are essential. Excellent problem-solving, communication, and collaboration skills are critical for remote teamwork and translating complex requirements into scalable solutions. These skills ensure the effective development, deployment, and maintenance of advanced language models in fast-evolving, distributed environments.

What is the difference between Remote Large Language Model Llm vs Data Scientist?

AspectRemote Large Language Model LlmData Scientist
Required CredentialsAdvanced degrees in AI, NLP, or related fields; experience with machine learning frameworksDegree in Data Science, Statistics, Computer Science, or related fields; strong analytical skills
Work EnvironmentPrimarily remote, focused on developing and fine-tuning language modelsRemote or on-site, analyzing data, building models, and generating insights
Employer & Industry UsageTech companies, AI research labs, startups working on NLP productsTech firms, finance, healthcare, marketing, and research organizations

While both roles involve data and machine learning, a Remote Large Language Model Llm specializes in developing and refining language models, whereas a Data Scientist focuses on analyzing data, building predictive models, and deriving insights across various domains.

What are the most commonly searched types of Large Language Model Llm jobs in Raleigh, NC? The most popular types of Large Language Model Llm jobs in Raleigh, NC are:
What are popular job titles related to Remote Large Language Model Llm jobs in Raleigh, NC? For Remote Large Language Model Llm jobs in Raleigh, NC, the most frequently searched job titles are:
What job categories do people searching Remote Large Language Model Llm jobs in Raleigh, NC look for? The top searched job categories for Remote Large Language Model Llm jobs in Raleigh, NC are:
What cities near Raleigh, NC are hiring for Remote Large Language Model Llm jobs? Cities near Raleigh, NC with the most Remote Large Language Model Llm job openings:
Remote Large Language Model Llm jobs near you

Senior AI Systems Engineer

Berriehill Research

Raleigh, NC • On-site, Remote

$92K - $126K/yr

Full-time

Posted 7 days ago

Job description

Essential Functions:

  • Lead the deployment, integration, and operational support of AI platforms, tools, and services, ensuring compatibility with existing systems and enterprise processes.
  • Design, implement, monitor, and optimize AI infrastructure, working with server, cloud, and platform engineering teams.
  • Operationalize machine learning workflows and support AI-enabled applications from development through production deployment and sustainment.
  • Build and maintain CI/CD and MLOps pipelines for model packaging, testing, deployment, rollback, and lifecycle management.
  • Implement infrastructure automation using scripting, Infrastructure as Code, and configuration management practices.
  • Provide ongoing technical support, troubleshooting, root cause analysis, and documentation for AI platforms and user-facing AI services.
  • Maintain observability across AI systems through logging, metrics, performance monitoring, alerting, and incident response practices.
  • Ensure security, compliance, and governance requirements are met, including participation in audits, vulnerability management, and secure architecture reviews.
  • Assess and implement system enhancements to improve performance, scalability, reliability, and cost efficiency.
  • Collaborate across divisions to support diverse AI initiatives and align technical implementations with mission and business objectives.
  • Evaluate emerging AI tools, frameworks, and infrastructure approaches for operational fit, supportability, and long-term value.
  • Develop and maintain technical documentation, runbooks, architecture diagrams, and operational procedures.

Experience and Skills Required:

  • Bachelor’s degree in computer science, Engineering, Information Technology, or a related STEM field with 8-10 years of engineering experience. 
  • 2+ years of experience supporting AI/ML platforms, MLOps workflows, model deployment, or AI-enabled infrastructure.
  • Strong coding and automation skills in Python, Bash, or similar scripting languages.
  • Experience with AI/ML frameworks and tooling such as PyTorch, Hugging Face, or similar ecosystems.
  • Proficiency with DevOps and MLOps practices, including CI/CD pipelines, Git-based workflows, containerization, and Kubernetes.
  • Experience deploying AI/ML models or AI services into operational environments, including containerized, cloud, or high-performance computing environments.
  • Familiarity with security frameworks and compliance standards such as NIST and CMMC.
  • Familiarity with AI security functionality in enterprise environments including OAuth
  • Strong communication skills and the ability to collaborate effectively across technical and non-technical teams.

Preferred:

  • Advanced degree or certifications related to AI or machine learning.
  • Experience integrating AI models into scientific workflows.
  • Familiarity with large language model (LLM) APIs and orchestration frameworks such as OpenAI, Hugging Face, LangGraph, or LangChain.
  • Experience with model serving, inference optimization, or AI platform tools such as MLflow, Kubeflow, vLLM, or similar.
  • Experience with simulations for scientific or engineering projects, particularly physical systems simulations.
  • Experience with GPU-based systems or running AI models in HPC environments.
  • Experience writing and deploying MCP Servers on Kubernetes
  • DoD experience
  • Secret Security Clearance – Active or Inactive

Education:

  • Bachelor’s degree in CS, Software Engineering or other IT-related field or equivalent experience

REMOTE WORK NOTICE: This position may be performed fully remote, hybrid, or onsite at an ARA office. Preference will be given to candidates located onsite in the Albuquerque, NM and Raleigh, NC area.

Apply