ZipRecruiter

Log In

1

Director Llm Training Jobs (NOW HIRING)

Sciforium

LLM Training Engineer

San Francisco, CA · On-site

$155K - $220K/yr

Backed by multi-million-dollar funding and direct sponsorship from AMD with hands-on support from ... About the Role As an LLM Training Engineer , you'll work across the full foundation-model stack ...

Turing

Client Director, Frontier Data - US

Palo Alto, CA

$255K - $325K/yr

This leader would partner with our clients (leading LLM labs) research teams to: * Identify opportunities for building training datasets to improve model capabilities and performance * Generate these ...

Turing

Client Director, Frontier Data - US

Palo Alto, CA · On-site

$255K - $325K/yr

This leader would partner with our clients (leading LLM labs) research teams to: * Identify opportunities for building training datasets to improve model capabilities and performance * Generate these ...

Cerebras

Client Director, Frontier Data - US

Palo Alto, CA · On-site

$255 - $325/hr

This leader would partner with our clients (leading LLM labs) research teams to: * Identify opportunities for building training datasets to improve model capabilities and performance * Generate these ...

Sciforium

Foundation Model Data Engineer

San Francisco, CA · On-site

$155K - $210K/yr

Backed by multi-million-dollar funding and direct sponsorship from AMD with hands-on support from ... Experience building massive LLM training sets from scratch , including raw web crawls (e.g., Common ...

next page

Showing results 1-20

All JobsEducation JobsBusiness Education JobsCorporate Training Manager JobsDirector Llm Training Jobs

Director Llm Training information

See salary details

$57K

$186.4K

$331K

How much do director llm training jobs pay per year?

As of Aug 29, 2026, the average yearly pay for director llm training in the United States is $186,382.00, according to ZipRecruiter salary data. Most workers in this role earn between $115,500.00 and $249,500.00 per year, depending on experience, location, and employer.
More about Director Llm Training jobs

What cities are hiring for Director Llm Training jobs?

Cities with the most Director Llm Training job openings:

What are the most commonly searched types of Llm Training jobs?

The most popular types of Llm Training jobs are:

What states have the most Director Llm Training jobs?

States with the most job openings for Director Llm Training jobs include:

What job categories do people searching Director Llm Training jobs look for?

The top searched job categories for Director Llm Training jobs are:

Director Llm Training jobs near you
Infographic showing various Director Llm Training job openings in the United States as of August 2026, with employment types broken down into 1% As Needed, 83% Full Time, 15% Part Time, and 1% Contract. Highlights an 86% Physical, 1% Hybrid, and 13% Remote job distribution, with an average salary of $186,382 per year, or $89.6 per hour.

LLM Training Engineer

Sciforium

San Francisco, CA • On-site

$155K - $220K/yr

Full-time

Medical, Dental, Vision, Retirement

Re-posted 24 days ago

Job description

Sciforium is an AI infrastructure company developing next-generation multimodal AI models and a proprietary, high-efficiency serving platform. Backed by multi-million-dollar funding and direct sponsorship from AMD with hands-on support from AMD engineers the team is scaling rapidly to build the full stack powering frontier AI models and real-time applications.
About the Role
As an LLM Training Engineer, you'll work across the full foundation-model stack: pretraining and scaling, post-training and Reinforcement Learning, sandbox environments for evaluation and agentic learning, and deployment + inference optimization. You'll build and iterate quickly on research ideas, contribute production-grade infrastructure, and help deliver models that can serve real-world use cases at scale.
What you'll work on
This role spans multiple tracks - candidates may focus on one or contribute across several. Examples include:
Pretraining & Scaling
  • Train large byte-native foundation models across massive, heterogeneous corpora
  • Design stable training recipes and scaling laws for novel architectures
  • Improve throughput, memory efficiency, and utilization on large GPU clusters
  • Build and maintain distributed training infrastructure and fault-tolerant pipelines

Post-training & RL
  • Develop post-training pipelines (SFT, preference optimization, RLHF/RLAIF, RL)
  • Curate and generate targeted datasets to improve specific model capabilities
  • Build reward models and evaluation frameworks to drive iterative improvement
  • Explore inference-time learning and compute techniques to enhance performance

Sandbox Environments & Evaluation
  • Build scalable sandbox environments for agent evaluation and learning
  • Create realistic, high-signal automated evals for reasoning, tool use, and safety
  • Design offline + online environments that support RL-style training at scale
  • Instrument environments for observability, reproducibility, and iteration speed

Deployment & Inference Optimization
  • Optimize inference throughput/latency for byte-native architectures
  • Build high-performance serving pipelines (KV caching, batching, quantization, etc.)
  • Improve end-to-end model efficiency, cost, and reliability in production
  • Profile and optimize GPU kernels, runtime bottlenecks, and memory behavior

Ideal candidate credentials
Technical strength
  • Strong general software engineering skills (writing robust, performant systems)
  • Experience with training or serving large neural networks (LLMs or similar)
  • Solid grasp of deep learning fundamentals and modern literature
  • Comfort working in high-performance environments (GPU, distributed systems, etc.)

Relevant experience (one or more)
  • Pretraining / large-scale distributed training (FSDP/ZeRO/Megatron-style systems)
  • Post-training pipelines (SFT, RLHF/RLAIF, preference optimization, eval loops)
  • Building RL environments, simulators, or agent frameworks
  • Inference optimization, model compression, quantization, kernel-level profiling
  • Building large ETL pipelines for internet-scale data ingestion and cleaning
  • Owning end-to-end production ML systems with monitoring and reliability

Research orientation
  • Ability to propose and evaluate research ideas quickly
  • Strong experimental hygiene: ablations, metrics, reproducibility, analysis
  • Bias toward building - you can turn ideas into working code and results

Education
  • MS or PhD in Computer Science, Machine Learning, AI, Mathematics, or related field

Benefits include
  • Medical, dental, and vision insurance
  • 401k plan
  • Daily lunch, snacks, and beverages
  • Flexible time off
  • Competitive salary and equity

Equal opportunity
Sciforium is an equal opportunity employer. All applicants will be considered for employment without attention to race, color, religion, sex, sexual orientation, gender identity, national origin, veteran or disability status.

Apply