Role Specifics As the Applied LLM Systems Engineer, your mission is to design, build, and operate ... Direct experience delivering at least one production AI system with measurable adoption by its ...
Role Specifics As the Applied LLM Systems Engineer, your mission is to design, build, and operate ... Direct experience delivering at least one production AI system with measurable adoption by its ...
Director AI or ML Engineering Remote Nationwide or Office-Based in MN or DC
San Diego, CA · On-site +1
$176K - $302K/yr
The Optum Insight Engineering team is seeking a Director of AI/ML Engineering to define and execute ... Define and execute the strategic roadmap for LLM engineering, generative AI systems, and agentic ...
New
Director AI or ML Engineering Remote Nationwide or Office-Based in MN or DC
San Diego, CA · On-site +1
$176K - $302K/yr
The Optum Insight Engineering team is seeking a Director of AI/ML Engineering to define and execute ... Define and execute the strategic roadmap for LLM engineering, generative AI systems, and agentic ...
New
Director AI or ML Engineering Remote Nationwide or Office-Based in MN or DC
San Diego, CA · On-site +1
$176K - $302K/yr
The Optum Insight Engineering team is seeking a Director of AI/ML Engineering to define and execute ... Define and execute the strategic roadmap for LLM engineering, generative AI systems, and agentic ...
New
Director AI or ML Engineering Remote Nationwide or Office-Based in MN or DC
San Diego, CA · On-site +1
$176K - $302K/yr
The Optum Insight Engineering team is seeking a Director of AI/ML Engineering to define and execute ... Define and execute the strategic roadmap for LLM engineering, generative AI systems, and agentic ...
New
Principal Software Engineer - LLM Optimization
Jersey City, NJ · On-site
$204K - $285K/yr
... direct, measurable impact on the firm's AI capabilities Job Responsibilities * Own systematic ... engineering concepts and 7+ years applied experience * Deep, hands-on experience with LLM inference ...
Principal Software Engineer - LLM Optimization
Jersey City, NJ · On-site
$204K - $285K/yr
... direct, measurable impact on the firm's AI capabilities Job Responsibilities * Own systematic ... engineering concepts and 7+ years applied experience * Deep, hands-on experience with LLM inference ...
Principal Software Engineer - LLM Optimization
Jersey City, NJ · On-site
$147K - $198K/yr
... direct, measurable impact on the firm's AI capabilities Job Responsibilities * Own systematic ... engineering concepts and 7+ years applied experience * Deep, hands-on experience with LLM inference ...
Principal Software Engineer - LLM Optimization
Jersey City, NJ · On-site
$147K - $198K/yr
... direct, measurable impact on the firm's AI capabilities Job Responsibilities * Own systematic ... engineering concepts and 7+ years applied experience * Deep, hands-on experience with LLM inference ...
Principal Software Engineer - LLM Optimization
Jersey City, NJ · On-site
$147K - $198K/yr
... direct, measurable impact on the firm's AI capabilities Job Responsibilities * Own systematic ... engineering concepts and 7+ years applied experience * Deep, hands-on experience with LLM inference ...
Principal Software Engineer - LLM Optimization
Jersey City, NJ · On-site
$147K - $198K/yr
... direct, measurable impact on the firm's AI capabilities Job Responsibilities * Own systematic ... engineering concepts and 7+ years applied experience * Deep, hands-on experience with LLM inference ...
Principal Software Engineer - LLM Optimization
Jersey City, NJ · On-site
$140K - $188K/yr
... direct, measurable impact on the firm's AI capabilities Job Responsibilities * Own systematic ... engineering concepts and 7+ years applied experience * Deep, hands-on experience with LLM inference ...
Principal Software Engineer - LLM Optimization
Jersey City, NJ · On-site
$140K - $188K/yr
... direct, measurable impact on the firm's AI capabilities Job Responsibilities * Own systematic ... engineering concepts and 7+ years applied experience * Deep, hands-on experience with LLM inference ...
Principal Software Engineer - LLM Optimization
Jersey City, NJ · On-site
$190 - $240/hr
... direct, measurable impact on the firm's AI capabilities Job Responsibilities * Own systematic ... engineering concepts and 7+ years applied experience * Deep, hands-on experience with LLM inference ...
Principal Software Engineer - LLM Optimization
Jersey City, NJ · On-site
$190 - $240/hr
... direct, measurable impact on the firm's AI capabilities Job Responsibilities * Own systematic ... engineering concepts and 7+ years applied experience * Deep, hands-on experience with LLM inference ...
Principal Software Engineer - LLM Optimization
Jersey City, NJ · On-site
$180 - $240/hr
... direct, measurable impact on the firm's AI capabilities Job Responsibilities * Own systematic ... engineering concepts and 7+ years applied experience * Deep, hands‑on experience with LLM ...
Principal Software Engineer - LLM Optimization
Jersey City, NJ · On-site
$180 - $240/hr
... direct, measurable impact on the firm's AI capabilities Job Responsibilities * Own systematic ... engineering concepts and 7+ years applied experience * Deep, hands‑on experience with LLM ...
Intern, AI Engineering
San Francisco, CA · On-site
... direct impact on production systems serving enterprise customers. We are now filling intern ... LLM Agent Systems : Design and implement intelligent agent architectures for complex enterprise ...
Intern, AI Engineering
San Francisco, CA · On-site
... direct impact on production systems serving enterprise customers. We are now filling intern ... LLM Agent Systems : Design and implement intelligent agent architectures for complex enterprise ...
Sr. Software Engineer - Engineering Enablement
$150K - $190K/yr
Prior Engineering Enablement, Platform Engineering, or Developer Productivity role with direct measurement of developer velocity * Experience building MCP servers or tool-integration layers for LLM ...
Sr. Software Engineer - Engineering Enablement
$150K - $190K/yr
Prior Engineering Enablement, Platform Engineering, or Developer Productivity role with direct measurement of developer velocity * Experience building MCP servers or tool-integration layers for LLM ...
Applied LLM Systems Engineer
Costa Mesa, CA · On-site
$191K - $253K/yr
Role Specifics As the Applied LLM Systems Engineer, your mission is to design, build, and operate ... Direct experience delivering at least one production AI system with measurable adoption by its ...
Applied LLM Systems Engineer
Costa Mesa, CA · On-site
$191K - $253K/yr
Role Specifics As the Applied LLM Systems Engineer, your mission is to design, build, and operate ... Direct experience delivering at least one production AI system with measurable adoption by its ...
AI/LLM Safety Engineer
Overland Park, KS · On-site
... direct experience working on-or securing-ML/LLM systems. * Strong software engineering skills with the ability to write production-grade code (primarily Python), beyond scripting or notebook ...
AI/LLM Safety Engineer
Overland Park, KS · On-site
... direct experience working on-or securing-ML/LLM systems. * Strong software engineering skills with the ability to write production-grade code (primarily Python), beyond scripting or notebook ...
LLM Specialist
Columbia, MD · On-site
$93K - $100K/yr
Our engineers, designers, and strategists cut through complexity to create intuitive products and ... Expected hours are 9:00 AM to 5:00 PM Eastern unless otherwise directed by manager. Occasional ...
LLM Specialist
Columbia, MD · On-site
$93K - $100K/yr
Our engineers, designers, and strategists cut through complexity to create intuitive products and ... Expected hours are 9:00 AM to 5:00 PM Eastern unless otherwise directed by manager. Occasional ...
AI/LLM Safety Engineer
Overland Park, KS · On-site
... direct experience working on--or securing--ML/LLM systems. * Strong software engineering skills with the ability to write production-grade code (primarily Python), beyond scripting or notebook ...
Quick apply
AI/LLM Safety Engineer
Overland Park, KS · On-site
... direct experience working on--or securing--ML/LLM systems. * Strong software engineering skills with the ability to write production-grade code (primarily Python), beyond scripting or notebook ...
LLM Specialist
Columbia, MD · On-site +1
$93K - $100K/yr
Our engineers, designers, and strategists cut through complexity to create intuitive products and ... Expected hours are 9:00 AM to 5:00 PM Eastern unless otherwise directed by manager. Occasional ...
LLM Specialist
Columbia, MD · On-site +1
$93K - $100K/yr
Our engineers, designers, and strategists cut through complexity to create intuitive products and ... Expected hours are 9:00 AM to 5:00 PM Eastern unless otherwise directed by manager. Occasional ...
Senior Staff LLM Inference Engineer
Santa Clara, CA · On-site
$180 - $280/hr
We value humility and believe in direct communication. Our team is inclusive , and our differing ... LLM, ONNX Runtime, or similar) at a contributor level. * Familiarity with GPU kernel programming ...
Senior Staff LLM Inference Engineer
Santa Clara, CA · On-site
$180 - $280/hr
We value humility and believe in direct communication. Our team is inclusive , and our differing ... LLM, ONNX Runtime, or similar) at a contributor level. * Familiarity with GPU kernel programming ...
LLM Specialist
Columbia, MD · On-site
$93K - $100K/yr
Our engineers, designers, and strategists cut through complexity to create intuitive products and ... Expected hours are 9:00 AM to 5:00 PM Eastern unless otherwise directed by manager. Occasional ...
Quick apply
LLM Specialist
Columbia, MD · On-site
$93K - $100K/yr
Our engineers, designers, and strategists cut through complexity to create intuitive products and ... Expected hours are 9:00 AM to 5:00 PM Eastern unless otherwise directed by manager. Occasional ...
AI/LLM Safety Engineer
Overland Park, KS · On-site +1
... direct experience working on-or securing-ML/LLM systems. * Strong software engineering skills with the ability to write production-grade code (primarily Python), beyond scripting or notebook ...
AI/LLM Safety Engineer
Overland Park, KS · On-site +1
... direct experience working on-or securing-ML/LLM systems. * Strong software engineering skills with the ability to write production-grade code (primarily Python), beyond scripting or notebook ...
Harness Engineering: Directing the build of robust agent harnesses - orchestration layers, evaluation frameworks, guardrails, and observability - that make LLM systems reliable, safe, and measurable ...
Harness Engineering: Directing the build of robust agent harnesses - orchestration layers, evaluation frameworks, guardrails, and observability - that make LLM systems reliable, safe, and measurable ...
Director Llm Engineer information
See salary details
$37.26 - $41.63
11% of jobs
$45.17 is the 25th percentile. Wages below this are outliers.
$41.63 - $46
18% of jobs
The median wage is $49.58 / hr.
$46 - $50.37
26% of jobs
$50.37 - $54.74
6% of jobs
$54.74 - $59.11
3% of jobs
$59.11 - $63.48
2% of jobs
$63.48 - $67.85
4% of jobs
$69.54 is the 75th percentile. Wages above this are outliers.
$67.85 - $72.22
12% of jobs
$72.22 - $76.60
2% of jobs
$76.60 - $80.97
7% of jobs
$80.97 - $85.34
8% of jobs
$37
$58
$85
How much do director llm engineer jobs pay per hour?
What is the difference between Director Llm Engineer vs Machine Learning Engineer?
| Aspect | Director Llm Engineer | Machine Learning Engineer |
|---|---|---|
| Credentials | Advanced degrees in CS, AI, or related fields; extensive experience in NLP and LLMs | Bachelor's or Master's in CS, AI, or related fields; strong programming skills |
| Work Environment | Leadership roles overseeing teams, strategic planning, and project management in AI/ML projects | Hands-on development, model training, and algorithm implementation in AI/ML projects |
| Industry Usage | Used in organizations with large AI teams, focusing on LLM strategy and architecture | Common across tech companies, startups, and research labs for developing ML models |
The main difference is that a Director Llm Engineer focuses on leading AI teams and strategic oversight of LLM projects, while a Machine Learning Engineer is more involved in the technical development and implementation of ML models. Both roles require strong technical skills, but the Director Llm Engineer emphasizes leadership and vision in the AI domain.
What cities are hiring for Director Llm Engineer jobs?
Cities with the most Director Llm Engineer job openings:
What are the most commonly searched types of Llm Engineer jobs?
The most popular types of Llm Engineer jobs are:
What states have the most Director Llm Engineer jobs?
States with the most job openings for Director Llm Engineer jobs include:
What job categories do people searching Director Llm Engineer jobs look for?
The top searched job categories for Director Llm Engineer jobs are:

Anduril rating
9.1
Anduril
Based on 17 frontline employees who took The Breakroom Quiz
7.4
Manufacturers average
Based on 76,674 frontline employees who took The Breakroom Quiz
Job description
Anduril's Technical Publications organization supports complex hardware, software, autonomy, and defense systems across multiple divisions, business lines, and programs. The Product Manager, Technical Writing Systems, owns the authoring and publishing platform. This role builds the AI systems that extend that platform so the documentation pipeline handles more work at lower cost and lower latency.
Role SpecificsAs the Applied LLM Systems Engineer, your mission is to design, build, and operate production AI systems that improve how technical documentation is created, transformed, validated, maintained, and delivered. You will build and maintain AI-assisted authoring, automated publishing, and multi-agent coordination tooling for the Technical Publications pipeline. This is not a prompt-writing role. It is a systems-engineering role for someone who has already delivered production AI systems, understands evaluation and rollback, and knows how to make probabilistic systems useful in enterprise environments with structured content, strict review requirements, security boundaries, and real operational consequences. The right candidate can expand system capability while managing token usage, context efficiency, and cost at scale.
What You'll Do- Build production-grade LLM applications for documentation and knowledge-work workflows.
- Design orchestration for multi-step workflows that coordinate models, tools, and deterministic services safely.
- Optimize context management, token usage, caching, and workflow design for cost, latency, and task success.
- Build retrieval, structured-output, and tool-integrated systems that safely interact with enterprise content, source control, issue tracking, and documentation systems.
- Design evaluation frameworks and regression testing for prompts, models, tools, retrieval pipelines, and end-to-end workflows.
- Establish observability, auditability, rollback, and safe failure modes for AI-assisted workflows.
- Work directly with technical writers, illustrators, engineers, and documentation leadership to identify the highest-value places to apply AI and where human judgment should remain primary.
- Preserve provenance between source material, generated output, validation results, and human decisions so outputs remain reviewable, correctable, and attributable.
- 5+ years of professional software engineering experience, including building and operating production services.
- Direct experience delivering at least one production AI system with measurable adoption by its intended users.
- Experience optimizing cost, latency, and context usage in production LLM or workflow systems.
- Experience designing evaluation, observability, rollback, and failure-handling for nondeterministic systems.
- Strong proficiency in Python and modern API, data, and service-development practices, including software architecture, security boundaries, identity and access management, and data protection.
- Sound judgment about where probabilistic AI is appropriate and where deterministic software or human review is required.
- Must be eligible for Secret and higher security clearance (US).
- In this role, you will be subject to pre-employment and randomized substance screening, as required by the Company.
- Experience designing multi-step orchestration or coordination systems across models, tools, and deterministic services.
- Experience with retrieval-augmented generation, structured outputs, tool calling, or other production LLM workflow patterns.
- Experience integrating AI capabilities into desktop or enterprise applications with limited native APIs.
- Experience in defense, aerospace, manufacturing, robotics, autonomy, aviation, or another regulated environment.
- Familiarity with technical documentation, structured authoring, content management, or comparable documentation-heavy workflows.
- Familiarity with S1000D, DITA, MIL-STD-40051, or comparable documentation frameworks.
- Experience with containerized services, cloud infrastructure, CI/CD, queues, event-driven architectures, or production monitoring.
Working at Anduril
About Anduril, in their own words
From Anduril
As the world enters an era of strategic competition, Anduril delivers cutting-edge autonomy, AI, computer vision, sensor fusion, and networking technology to the warfighter in months, not years.
About Anduril Industries
Sourced by ZipRecruiter
Anduril Industries is a trailblazer in the technology industry based in Costa Mesa, CA, US. Founded in 2017 by Palmer Luckey, the creator of Oculus VR, the company focuses on developing innovative technology to equip and empower those in the defense sector. Its primary products include cutting-edge autonomous systems and AI software that assist in combating threats to national and global security. The mission of Anduril Industries is to integrate technology and defense by building transformative, scalable solutions that ensure a safer world.
Industry
Guided missile and space vehicle manufacturing
Company size
501 - 1,000 Employees
Headquarters location
Costa Mesa, CA, US
Year founded
2017