... systems. • 3+ years of direct experience working with OpenAI APIs, GPT models, and LLM ... prompt engineering. • Proficiency in Docker, AWS IAM, and secure deployment practices. • ...
... systems. • 3+ years of direct experience working with OpenAI APIs, GPT models, and LLM ... prompt engineering. • Proficiency in Docker, AWS IAM, and secure deployment practices. • ...
Directing the build of robust agent harnesses - orchestration layers, evaluation frameworks ... Strong expertise in generative AI/LLM engineering - context engineering, agent harnesses, RAG, and ...
Directing the build of robust agent harnesses - orchestration layers, evaluation frameworks ... Strong expertise in generative AI/LLM engineering - context engineering, agent harnesses, RAG, and ...
Director, AI Engineering
Manhattan, NY · On-site
Directing the build of robust agent harnesses - orchestration layers, evaluation frameworks ... Strong expertise in generative AI/LLM engineering - context engineering, agent harnesses, RAG, and ...
Director, AI Engineering
Manhattan, NY · On-site
Directing the build of robust agent harnesses - orchestration layers, evaluation frameworks ... Strong expertise in generative AI/LLM engineering - context engineering, agent harnesses, RAG, and ...
We're seeking a Senior Director of Discoverability to own how Bryan Johnson and Blueprint are found ... engineer, content writer, transcript pipeline engineer, schema vendor, LLM tracking vendor ...
We're seeking a Senior Director of Discoverability to own how Bryan Johnson and Blueprint are found ... engineer, content writer, transcript pipeline engineer, schema vendor, LLM tracking vendor ...
Director, AI Engineering
Manhattan, NY · On-site
Directing the build of robust agent harnesses - orchestration layers, evaluation frameworks ... Strong expertise in generative AI/LLM engineering - context engineering, agent harnesses, RAG, and ...
Director, AI Engineering
Manhattan, NY · On-site
Directing the build of robust agent harnesses - orchestration layers, evaluation frameworks ... Strong expertise in generative AI/LLM engineering - context engineering, agent harnesses, RAG, and ...
Director, AI Engineering
Manhattan, NY · On-site
Directing the build of robust agent harnesses - orchestration layers, evaluation frameworks ... Strong expertise in generative AI/LLM engineering - context engineering, agent harnesses, RAG, and ...
Director, AI Engineering
Manhattan, NY · On-site
Directing the build of robust agent harnesses - orchestration layers, evaluation frameworks ... Strong expertise in generative AI/LLM engineering - context engineering, agent harnesses, RAG, and ...
AI / LLM Software Engineer
$175K - $225K/yr
AI/LLM Systems Software Engineer Location: San Francisco, CA Work Type: In-person Employment ... Direct impact on reducing clinician burnout and improving healthcare outcomes * Small, high-trust ...
AI / LLM Software Engineer
$175K - $225K/yr
AI/LLM Systems Software Engineer Location: San Francisco, CA Work Type: In-person Employment ... Direct impact on reducing clinician burnout and improving healthcare outcomes * Small, high-trust ...
... direct impact on production systems serving enterprise customers. We are now filling intern ... LLM Agent Systems : Design and implement intelligent agent architectures for complex enterprise ...
... direct impact on production systems serving enterprise customers. We are now filling intern ... LLM Agent Systems : Design and implement intelligent agent architectures for complex enterprise ...
Sr. Software Engineer - Engineering Enablement
$150K - $190K/yr
Prior Engineering Enablement, Platform Engineering, or Developer Productivity role with direct measurement of developer velocity * Experience building MCP servers or tool-integration layers for LLM ...
Sr. Software Engineer - Engineering Enablement
$150K - $190K/yr
Prior Engineering Enablement, Platform Engineering, or Developer Productivity role with direct measurement of developer velocity * Experience building MCP servers or tool-integration layers for LLM ...
AI/LLM Product Director - Executive Director
Palo Alto, CA · On-site
$180K - $285K/yr
As a Product Director leading AI / LLM initiatives, you will assist in delivering a business ... Partner with internal stakeholders, including business leaders, data scientists, engineers, and ...
AI/LLM Product Director - Executive Director
Palo Alto, CA · On-site
$180K - $285K/yr
As a Product Director leading AI / LLM initiatives, you will assist in delivering a business ... Partner with internal stakeholders, including business leaders, data scientists, engineers, and ...
AI/LLM Product Director - Executive Director
$267K - $280K/yr
As a Product Director leading AI / LLM initiatives, you will assist in delivering a business ... Partner with internal stakeholders, including business leaders, data scientists, engineers, and ...
AI/LLM Product Director - Executive Director
$267K - $280K/yr
As a Product Director leading AI / LLM initiatives, you will assist in delivering a business ... Partner with internal stakeholders, including business leaders, data scientists, engineers, and ...
AI/LLM Product Director - Executive Director
$254K - $266K/yr
Partner with internal stakeholders, including business leaders, data scientists, engineers, and ... Knowledge of AI/LLM and data product lifecycle, including discovery, data processing, model ...
AI/LLM Product Director - Executive Director
$254K - $266K/yr
Partner with internal stakeholders, including business leaders, data scientists, engineers, and ... Knowledge of AI/LLM and data product lifecycle, including discovery, data processing, model ...
10x Java Developer/AI Engineer
Berkeley Heights, NJ · On-site
$54 - $74/hr
LLM & AI Application Building: Design, implement, and deploy application layers that integrate LLMs ... This is a full-time, direct-hire position, and no contract options for unsolicited agency ...
10x Java Developer/AI Engineer
Berkeley Heights, NJ · On-site
$54 - $74/hr
LLM & AI Application Building: Design, implement, and deploy application layers that integrate LLMs ... This is a full-time, direct-hire position, and no contract options for unsolicited agency ...
AI/LLM Product Director - Executive Director
$267K - $280K/yr
As a Product Director leading AI / LLM initiatives, you will assist in delivering a business ... Partner with internal stakeholders, including business leaders, data scientists, engineers, and ...
AI/LLM Product Director - Executive Director
$267K - $280K/yr
As a Product Director leading AI / LLM initiatives, you will assist in delivering a business ... Partner with internal stakeholders, including business leaders, data scientists, engineers, and ...
Lead Prompt Engineer: Strategic LLM Migration
Charleston, WV · Remote
$94K - $124K/yr
... LLM performance? Welo Data is seeking a Lead Prompt Engineer to spearhead the technical migration ... Direct the use of APG and APO tools, providing the high-level intervention needed when automated ...
Quick apply
Lead Prompt Engineer: Strategic LLM Migration
Charleston, WV · Remote
$94K - $124K/yr
... LLM performance? Welo Data is seeking a Lead Prompt Engineer to spearhead the technical migration ... Direct the use of APG and APO tools, providing the high-level intervention needed when automated ...
AI/LLM Safety Engineer
Overland Park, KS · On-site
... direct experience working on-or securing-ML/LLM systems. * Strong software engineering skills with the ability to write production-grade code (primarily Python), beyond scripting or notebook ...
AI/LLM Safety Engineer
Overland Park, KS · On-site
... direct experience working on-or securing-ML/LLM systems. * Strong software engineering skills with the ability to write production-grade code (primarily Python), beyond scripting or notebook ...
AI/LLM Safety Engineer
Overland Park, KS · On-site +1
... direct experience working on-or securing-ML/LLM systems. * Strong software engineering skills with the ability to write production-grade code (primarily Python), beyond scripting or notebook ...
AI/LLM Safety Engineer
Overland Park, KS · On-site +1
... direct experience working on-or securing-ML/LLM systems. * Strong software engineering skills with the ability to write production-grade code (primarily Python), beyond scripting or notebook ...
Harness Engineering: Directing the build of robust agent harnesses - orchestration layers, evaluation frameworks, guardrails, and observability - that make LLM systems reliable, safe, and measurable ...
Harness Engineering: Directing the build of robust agent harnesses - orchestration layers, evaluation frameworks, guardrails, and observability - that make LLM systems reliable, safe, and measurable ...
Director, AI & Data Science
Manhattan, NY · On-site
Harness Engineering: Directing the build of robust agent harnesses - orchestration layers, evaluation frameworks, guardrails, and observability - that make LLM systems reliable, safe, and measurable ...
Director, AI & Data Science
Manhattan, NY · On-site
Harness Engineering: Directing the build of robust agent harnesses - orchestration layers, evaluation frameworks, guardrails, and observability - that make LLM systems reliable, safe, and measurable ...
AI/LLM Safety Engineer
Leawood, KS · On-site
... direct experience working on--or securing--ML/LLM systems. * Strong software engineering skills with the ability to write production-grade code (primarily Python), beyond scripting or notebook ...
Quick apply
AI/LLM Safety Engineer
Leawood, KS · On-site
... direct experience working on--or securing--ML/LLM systems. * Strong software engineering skills with the ability to write production-grade code (primarily Python), beyond scripting or notebook ...
Director Llm Engineer information
See salary details
$37.26 - $41.63
11% of jobs
$45.17 is the 25th percentile. Wages below this are outliers.
$41.63 - $46
18% of jobs
The median wage is $49.58 / hr.
$46 - $50.37
26% of jobs
$50.37 - $54.74
6% of jobs
$54.74 - $59.11
3% of jobs
$59.11 - $63.48
2% of jobs
$63.48 - $67.85
4% of jobs
$69.54 is the 75th percentile. Wages above this are outliers.
$67.85 - $72.22
12% of jobs
$72.22 - $76.60
2% of jobs
$76.60 - $80.97
7% of jobs
$80.97 - $85.34
8% of jobs
$37
$58
$85
How much do director llm engineer jobs pay per hour?
As of Aug 1, 2026, the average hourly pay for director llm engineer in the United States is $58.21, according to ZipRecruiter salary data. Most workers in this role earn between $45.43 and $71.15 per hour, depending on experience, location, and employer.
What is the difference between Director Llm Engineer vs Machine Learning Engineer?
| Aspect | Director Llm Engineer | Machine Learning Engineer |
|---|---|---|
| Credentials | Advanced degrees in CS, AI, or related fields; extensive experience in NLP and LLMs | Bachelor's or Master's in CS, AI, or related fields; strong programming skills |
| Work Environment | Leadership roles overseeing teams, strategic planning, and project management in AI/ML projects | Hands-on development, model training, and algorithm implementation in AI/ML projects |
| Industry Usage | Used in organizations with large AI teams, focusing on LLM strategy and architecture | Common across tech companies, startups, and research labs for developing ML models |
The main difference is that a Director Llm Engineer focuses on leading AI teams and strategic oversight of LLM projects, while a Machine Learning Engineer is more involved in the technical development and implementation of ML models. Both roles require strong technical skills, but the Director Llm Engineer emphasizes leadership and vision in the AI domain.
More about Director Llm Engineer jobs
What cities are hiring for Director Llm Engineer jobs? Cities with the most Director Llm Engineer job openings:
What are the most commonly searched types of Llm Engineer jobs? The most popular types of Llm Engineer jobs are:
What states have the most Director Llm Engineer jobs? States with the most job openings for Director Llm Engineer jobs include:
What job categories do people searching Director Llm Engineer jobs look for? The top searched job categories for Director Llm Engineer jobs are:
Job description
Job Summary:
BigRio is a Boston-based, remote-first technology consulting firm specializing in advanced data, cloud, and software engineering solutions. They are seeking a hands-on Generative AI Engineer (LLM Expert) who combines strong AWS development experience with deep expertise in applied LLM engineering, focusing on building, shipping, and scaling LLM applications using OpenAI models and AWS infrastructure.
Responsibilities:
• Design, develop, and deploy AWS-based applications (Lambda, API Gateway, ECS, RDS, S3, Secrets Manager) that integrate LLM-powered features.
• Implement OpenAI-driven workflows, leveraging reasoning and non-reasoning models, temperature settings, and model versioning best practices.
• Apply prompt engineering and prompt chaining techniques to improve LLM accuracy and performance for production workloads.
• Build retrieval-augmented generation (RAG) pipelines using LangChain, ChromaDB, or similar frameworks.
• Develop FastAPI or Flask-based backends that connect to OpenAI APIs and vector databases.
• Build interactive front-ends and tools using Gradio or Streamlit for rapid prototyping and testing.
• Ensure secure, containerized deployments using Docker and integrate SSO and role-based access controls.
• Automate data pipelines and document workflows via Google Drive, AWS SDKs, or REST APIs.
• Write production-grade Python code, following clean architecture, documentation, and CI/CD best practices.
• Collaborate closely with AI engineers, DevOps teams, and clients to deliver enterprise-ready LLM applications.
Qualifications:
Required:
• 5+ years of experience in professional software development, with a strong focus on AWS cloud and backend systems.
• 3+ years of direct experience working with OpenAI APIs, GPT models, and LLM application development.
• Proven ability to build and deploy LLM-powered applications, not just experiment with models.
• Knowledge of vector databases like Pinecone or FAISS is required.
• Expertise in Python, FastAPI, and API-driven architecture.
• Strong practical experience with LangChain, ChromaDB, RAG, and prompt engineering.
• Proficiency in Docker, AWS IAM, and secure deployment practices.
• Excellent communication skills — ability to explain LLM behavior, tradeoffs, and reasoning clearly to both technical and non-technical teams.
• Comfortable working independently in a fast-paced, client-facing environment across time zones.
Preferred:
• Experience with LangGraph or other LLM orchestration frameworks.
• Familiarity with MLOps, CI/CD pipelines, and observability for LLM workloads.
• Exposure to healthcare, biotech, or regulated data environments.
• Demonstrated experience explaining and documenting AI system design and decision-making for non-AI stakeholders.
Company:
Saviance is a modern consulting firm providing a variety of professional services to its clients in the US. Founded in 1999, the company is headquartered in Metuchen, USA, with a team of 201-500 employees. The company is currently Growth Stage.
BigRio is a Boston-based, remote-first technology consulting firm specializing in advanced data, cloud, and software engineering solutions. They are seeking a hands-on Generative AI Engineer (LLM Expert) who combines strong AWS development experience with deep expertise in applied LLM engineering, focusing on building, shipping, and scaling LLM applications using OpenAI models and AWS infrastructure.
Responsibilities:
• Design, develop, and deploy AWS-based applications (Lambda, API Gateway, ECS, RDS, S3, Secrets Manager) that integrate LLM-powered features.
• Implement OpenAI-driven workflows, leveraging reasoning and non-reasoning models, temperature settings, and model versioning best practices.
• Apply prompt engineering and prompt chaining techniques to improve LLM accuracy and performance for production workloads.
• Build retrieval-augmented generation (RAG) pipelines using LangChain, ChromaDB, or similar frameworks.
• Develop FastAPI or Flask-based backends that connect to OpenAI APIs and vector databases.
• Build interactive front-ends and tools using Gradio or Streamlit for rapid prototyping and testing.
• Ensure secure, containerized deployments using Docker and integrate SSO and role-based access controls.
• Automate data pipelines and document workflows via Google Drive, AWS SDKs, or REST APIs.
• Write production-grade Python code, following clean architecture, documentation, and CI/CD best practices.
• Collaborate closely with AI engineers, DevOps teams, and clients to deliver enterprise-ready LLM applications.
Qualifications:
Required:
• 5+ years of experience in professional software development, with a strong focus on AWS cloud and backend systems.
• 3+ years of direct experience working with OpenAI APIs, GPT models, and LLM application development.
• Proven ability to build and deploy LLM-powered applications, not just experiment with models.
• Knowledge of vector databases like Pinecone or FAISS is required.
• Expertise in Python, FastAPI, and API-driven architecture.
• Strong practical experience with LangChain, ChromaDB, RAG, and prompt engineering.
• Proficiency in Docker, AWS IAM, and secure deployment practices.
• Excellent communication skills — ability to explain LLM behavior, tradeoffs, and reasoning clearly to both technical and non-technical teams.
• Comfortable working independently in a fast-paced, client-facing environment across time zones.
Preferred:
• Experience with LangGraph or other LLM orchestration frameworks.
• Familiarity with MLOps, CI/CD pipelines, and observability for LLM workloads.
• Exposure to healthcare, biotech, or regulated data environments.
• Demonstrated experience explaining and documenting AI system design and decision-making for non-AI stakeholders.
Company:
Saviance is a modern consulting firm providing a variety of professional services to its clients in the US. Founded in 1999, the company is headquartered in Metuchen, USA, with a team of 201-500 employees. The company is currently Growth Stage.
About Saviance
Sourced by ZipRecruiter
Saviance is a modern consulting firm providing a variety of professional services to its clients in the US. We bring twenty three years of experience to the table. Our consultants are qualified experts and extremely talented. We understand the business behind the technology, and work with many of the top Fortune 100 companies and provide innovative, scalable, robust and secure solutions. At the forefront of the Staffing and IT Solutions industry, Saviance is certified by NMSDC as a Tier 1, Minority Business Enterprise (MBE) . We are a self- certified Small Business and self- certified Woman Owned Business committed to maximizing global workforce solutions on behalf of our clients, empowering businesses and talent through applied human intelligence. We are a Diversity Supplier with global reach specializing in a business services blend of talent, technology, and a relentless commitment to customer success. It’s our diversity that’s acts as a core component of our culture, our approach to business, and the opportunities we provide to our clients and our employees.
Industry
It services
Company size
201 - 500 Employees
Headquarters location
East Rutherford, NJ, US
Year founded
1999