1

Director Llm Training Jobs (NOW HIRING)

LLM Training Engineer

San Francisco, CA · On-site

$155K - $220K/yr

Backed by multi-million-dollar funding and direct sponsorship from AMD with hands-on support from ... About the Role As an LLM Training Engineer , you'll work across the full foundation-model stack ...

LLM Training Engineer

San Francisco, CA · Remote

$200K - $275K/yr

Backed by multi-million-dollar funding and direct sponsorship from AMD with hands‑on support from ... Design stable training recipes and scaling laws for novel architectures * Improve throughput ...

This leader would partner with our clients (leading LLM labs) research teams to: * Identify opportunities for building training datasets to improve model capabilities and performance * Generate these ...

LLM Dataset Engineer

San Francisco, CA · On-site

$155K - $210K/yr

Backed by multi-million-dollar funding and direct sponsorship from AMD with hands-on support from ... Post-Training & Alignment Data: Lead the development of high-quality post-training datasets ...

next page

Showing results 1-20

Director Llm Training information

See salary details

$57K

$186.4K

$331K

How much do director llm training jobs pay per year?

As of Jun 17, 2026, the average yearly pay for director llm training in the United States is $186,382.00, according to ZipRecruiter salary data. Most workers in this role earn between $115,500.00 and $249,500.00 per year, depending on experience, location, and employer.
More about Director Llm Training jobs
What cities are hiring for Director Llm Training jobs? Cities with the most Director Llm Training job openings:
What are the most commonly searched types of Llm Training jobs? The most popular types of Llm Training jobs are:
What states have the most Director Llm Training jobs? States with the most job openings for Director Llm Training jobs include:
Infographic showing various Director Llm Training job openings in the United States as of June 2026, with employment types broken down into 100% Full Time. Highlights an 67% In-person, and 33% Remote job distribution, with an average salary of $186,382 per year, or $89.6 per hour.

LLM Training Engineer

Sciforium

San Francisco, CA • On-site

$155K - $220K/yr

Full-time

Medical, Dental, Vision, Retirement

Posted 11 days ago


Job description

Sciforium is an AI infrastructure company developing next-generation multimodal AI models and a proprietary, high-efficiency serving platform. Backed by multi-million-dollar funding and direct sponsorship from AMD with hands-on support from AMD engineers the team is scaling rapidly to build the full stack powering frontier AI models and real-time applications.
About the Role
As an LLM Training Engineer, you'll work across the full foundation-model stack: pretraining and scaling, post-training and Reinforcement Learning, sandbox environments for evaluation and agentic learning, and deployment + inference optimization. You'll build and iterate quickly on research ideas, contribute production-grade infrastructure, and help deliver models that can serve real-world use cases at scale.
What you'll work on
This role spans multiple tracks - candidates may focus on one or contribute across several. Examples include:
Pretraining & Scaling
  • Train large byte-native foundation models across massive, heterogeneous corpora
  • Design stable training recipes and scaling laws for novel architectures
  • Improve throughput, memory efficiency, and utilization on large GPU clusters
  • Build and maintain distributed training infrastructure and fault-tolerant pipelines

Post-training & RL
  • Develop post-training pipelines (SFT, preference optimization, RLHF/RLAIF, RL)
  • Curate and generate targeted datasets to improve specific model capabilities
  • Build reward models and evaluation frameworks to drive iterative improvement
  • Explore inference-time learning and compute techniques to enhance performance

Sandbox Environments & Evaluation
  • Build scalable sandbox environments for agent evaluation and learning
  • Create realistic, high-signal automated evals for reasoning, tool use, and safety
  • Design offline + online environments that support RL-style training at scale
  • Instrument environments for observability, reproducibility, and iteration speed

Deployment & Inference Optimization
  • Optimize inference throughput/latency for byte-native architectures
  • Build high-performance serving pipelines (KV caching, batching, quantization, etc.)
  • Improve end-to-end model efficiency, cost, and reliability in production
  • Profile and optimize GPU kernels, runtime bottlenecks, and memory behavior

Ideal candidate credentials
Technical strength
  • Strong general software engineering skills (writing robust, performant systems)
  • Experience with training or serving large neural networks (LLMs or similar)
  • Solid grasp of deep learning fundamentals and modern literature
  • Comfort working in high-performance environments (GPU, distributed systems, etc.)

Relevant experience (one or more)
  • Pretraining / large-scale distributed training (FSDP/ZeRO/Megatron-style systems)
  • Post-training pipelines (SFT, RLHF/RLAIF, preference optimization, eval loops)
  • Building RL environments, simulators, or agent frameworks
  • Inference optimization, model compression, quantization, kernel-level profiling
  • Building large ETL pipelines for internet-scale data ingestion and cleaning
  • Owning end-to-end production ML systems with monitoring and reliability

Research orientation
  • Ability to propose and evaluate research ideas quickly
  • Strong experimental hygiene: ablations, metrics, reproducibility, analysis
  • Bias toward building - you can turn ideas into working code and results

Education
  • MS or PhD in Computer Science, Machine Learning, AI, Mathematics, or related field

Benefits include
  • Medical, dental, and vision insurance
  • 401k plan
  • Daily lunch, snacks, and beverages
  • Flexible time off
  • Competitive salary and equity

Equal opportunity
Sciforium is an equal opportunity employer. All applicants will be considered for employment without attention to race, color, religion, sex, sexual orientation, gender identity, national origin, veteran or disability status.