... and LLM-enabled applications. This role blends governance and privacy expertise with enough ... Integrating governance checkpoints into product and engineering delivery through architecture ...
... and LLM-enabled applications. This role blends governance and privacy expertise with enough ... Integrating governance checkpoints into product and engineering delivery through architecture ...
Senior Software Engineer
Indianapolis, IN · On-site
$117K - $154K/yr
Senior Software Engineer Department & Team : Genesys Cloud CX and Core Services, Core AI Team Job ... test their LLM powered features, integrate with AWS Bedrock, and provide enterprise-grade ...
Senior Software Engineer
Indianapolis, IN · On-site
$117K - $154K/yr
Senior Software Engineer Department & Team : Genesys Cloud CX and Core Services, Core AI Team Job ... test their LLM powered features, integrate with AWS Bedrock, and provide enterprise-grade ...
Work you'll do As a Snowflake FDE, you will work side by side with senior functional and technical ... Cortex AI, Cortex LLM Functions, Cortex Agents, Arctic Embed * 1+ years of experience leading ...
Work you'll do As a Snowflake FDE, you will work side by side with senior functional and technical ... Cortex AI, Cortex LLM Functions, Cortex Agents, Arctic Embed * 1+ years of experience leading ...
Senior Agent Architect
Florence, IN · On-site
You will also shape the conversational experience layer, using prompt engineering and your ... Use your knowledge of LLM internals (e.g., embeddings) to analyze customer requirements and design ...
Senior Agent Architect
Florence, IN · On-site
You will also shape the conversational experience layer, using prompt engineering and your ... Use your knowledge of LLM internals (e.g., embeddings) to analyze customer requirements and design ...
US Tech - AI Engineering Senior Associate
$55K - $187K/yr
Industry/Sector Not Applicable Specialism Data Science Management Level Senior Associate & Summary ... LLM evaluation frameworks using defined metrics - Working with data scientists and ML engineers ...
US Tech - AI Engineering Senior Associate
$55K - $187K/yr
Industry/Sector Not Applicable Specialism Data Science Management Level Senior Associate & Summary ... LLM evaluation frameworks using defined metrics - Working with data scientists and ML engineers ...
Design extensible functionality, support sprint sizing, and align solutions with senior team ... Experience integrating LLM solutions with enterprise systems via APIs, microservices, or event ...
Design extensible functionality, support sprint sizing, and align solutions with senior team ... Experience integrating LLM solutions with enterprise systems via APIs, microservices, or event ...
Work you'll do As a Frontier GenAI FDE, you will work side by side with senior functional and ... Experience integrating LLM solutions with enterprise systems via APIs, microservices, or event ...
Work you'll do As a Frontier GenAI FDE, you will work side by side with senior functional and ... Experience integrating LLM solutions with enterprise systems via APIs, microservices, or event ...
Lead Forward Deployed Engineer - AWS
$98K - $129K/yr
Work you'll do As an AWS AI&Data FDE, you will work side by side with senior functional and ... Experience integrating LLM solutions with enterprise systems via APIs, microservices, or event ...
Lead Forward Deployed Engineer - AWS
$98K - $129K/yr
Work you'll do As an AWS AI&Data FDE, you will work side by side with senior functional and ... Experience integrating LLM solutions with enterprise systems via APIs, microservices, or event ...
Senior Consultant - Forward Deployed Engineer (FDE) - Databricks Forward Deployed Engineers at ... Experience integrating LLM-based solutions with enterprise systems through APIs, microservices, or ...
Senior Consultant - Forward Deployed Engineer (FDE) - Databricks Forward Deployed Engineers at ... Experience integrating LLM-based solutions with enterprise systems through APIs, microservices, or ...
Lead Forward Deployed Engineer, Palantir
$98K - $129K/yr
Client Engagement * Serve as the senior client-facing presence, building trusted advisor ... Architect and oversee delivery of LLM-enabled applications including copilots, agentic workflows ...
Lead Forward Deployed Engineer, Palantir
$98K - $129K/yr
Client Engagement * Serve as the senior client-facing presence, building trusted advisor ... Architect and oversee delivery of LLM-enabled applications including copilots, agentic workflows ...
Lead Forward Deployed Engineer - Databricks
Indianapolis, IN · On-site
$98K - $129K/yr
Client Engagement * Serve as the senior client-facing presence, building trusted advisor ... Architect and oversee delivery of LLM-enabled applications including copilots, agentic workflows ...
Lead Forward Deployed Engineer - Databricks
Indianapolis, IN · On-site
$98K - $129K/yr
Client Engagement * Serve as the senior client-facing presence, building trusted advisor ... Architect and oversee delivery of LLM-enabled applications including copilots, agentic workflows ...
Lead Forward Deployed Engineer, Frontier GenAI
Indianapolis, IN · On-site
$98K - $129K/yr
Client Engagement * Serve as the senior client-facing presence, building trusted advisor ... Architect and oversee delivery of LLM-enabled applications including copilots, agentic workflows ...
Lead Forward Deployed Engineer, Frontier GenAI
Indianapolis, IN · On-site
$98K - $129K/yr
Client Engagement * Serve as the senior client-facing presence, building trusted advisor ... Architect and oversee delivery of LLM-enabled applications including copilots, agentic workflows ...
Lead Forward Deployed Engineer, Microsoft AI & Data
Indianapolis, IN · On-site
$98K - $129K/yr
Client Engagement * Serve as the senior client-facing presence, building trusted advisor ... Architect and oversee delivery of LLM-enabled applications including copilots, agentic workflows ...
Lead Forward Deployed Engineer, Microsoft AI & Data
Indianapolis, IN · On-site
$98K - $129K/yr
Client Engagement * Serve as the senior client-facing presence, building trusted advisor ... Architect and oversee delivery of LLM-enabled applications including copilots, agentic workflows ...
Forward Deployed Engineer, Microsoft AI & Data
$109K - $131K/yr
Work you'll do As a Microsoft AI&Data FDE, you will work side by side with senior functional and ... Experience integrating LLM solutions with enterprise systems via APIs, microservices, or event ...
Forward Deployed Engineer, Microsoft AI & Data
$109K - $131K/yr
Work you'll do As a Microsoft AI&Data FDE, you will work side by side with senior functional and ... Experience integrating LLM solutions with enterprise systems via APIs, microservices, or event ...
Sr. Applied AI Engineer (Claude/Codex)
Carmel, IN · On-site
$122K - $161K/yr
Maintain strong knowledge of the latest developments in LLM capabilities and implementation ... Minimum of 5 years of experience in engineering teams with one or more programming languages and ...
Sr. Applied AI Engineer (Claude/Codex)
Carmel, IN · On-site
$122K - $161K/yr
Maintain strong knowledge of the latest developments in LLM capabilities and implementation ... Minimum of 5 years of experience in engineering teams with one or more programming languages and ...
This is a senior-level role based in North America with global responsibilities across Canadian ... LLM performance, cost, governance, and scalability * Collaborate with data engineering teams to ...
This is a senior-level role based in North America with global responsibilities across Canadian ... LLM performance, cost, governance, and scalability * Collaborate with data engineering teams to ...
Work you'll do As a Palantir FDE, you will work side by side with senior functional and technical ... Experience integrating LLM solutions with enterprise systems via APIs, microservices, or event ...
Work you'll do As a Palantir FDE, you will work side by side with senior functional and technical ... Experience integrating LLM solutions with enterprise systems via APIs, microservices, or event ...
Forward Deployed Engineer (FDE) - Public Sector, Nonprofit & Education
Indianapolis, IN · On-site
$101K - $137K/yr
You'll work alongside Senior Forward Deployed Engineers and a Deployment Strategist. You'll own ... LLM techniques. * Own technical components end-to-end: from architecture choice to deployed ...
Forward Deployed Engineer (FDE) - Public Sector, Nonprofit & Education
Indianapolis, IN · On-site
$101K - $137K/yr
You'll work alongside Senior Forward Deployed Engineers and a Deployment Strategist. You'll own ... LLM techniques. * Own technical components end-to-end: from architecture choice to deployed ...
Senior Systems Integration Designer
Carmel, IN · On-site
$96K - $103K/yr
Bachelor's degree in Engineering preferred; equivalent experience will be considered. * Experience ... Large Language Models (LLM's), familiarity with Deltek VantagePoint preferred; Architecture CAD, ...
Quick apply
Senior Systems Integration Designer
Carmel, IN · On-site
$96K - $103K/yr
Bachelor's degree in Engineering preferred; equivalent experience will be considered. * Experience ... Large Language Models (LLM's), familiarity with Deltek VantagePoint preferred; Architecture CAD, ...
Senior Systems Integration Designer
Carmel, IN · On-site
$96K - $103K/yr
Bachelor's degree in Engineering preferred; equivalent experience will be considered. * Experience ... Large Language Models (LLM's), familiarity with Deltek VantagePoint preferred; Architecture CAD, ...
Quick apply
Senior Systems Integration Designer
Carmel, IN · On-site
$96K - $103K/yr
Bachelor's degree in Engineering preferred; equivalent experience will be considered. * Experience ... Large Language Models (LLM's), familiarity with Deltek VantagePoint preferred; Architecture CAD, ...
Senior Llm Developer information
What are the key skills and qualifications needed to thrive as a senior LLM developer?
What is the difference between Senior Llm Developer vs Machine Learning Engineer?
| Aspect | Senior Llm Developer | Machine Learning Engineer |
|---|---|---|
| Credentials | Advanced degrees in CS, NLP, or AI; experience with LLMs | Degrees in CS, Data Science, or related fields; experience with ML frameworks |
| Work Environment | Research labs, AI startups, tech companies focusing on NLP | Tech companies, startups, industries applying ML solutions |
| Industry Usage | Primarily in NLP, AI research, and language model development | Broader across AI applications, including vision, speech, and data analysis |
While both roles require strong AI and ML knowledge, Senior Llm Developers specialize in language models and NLP, whereas Machine Learning Engineers work across various AI domains. The roles often overlap but differ in focus and application areas.
What are some common challenges senior LLM developers face when deploying large language models in production environments?
What is a senior LLM developer?

Full-time
Re-posted 15 days ago
Deloitte rating
8.2
Based on 92 frontline employees who took The Breakroom Quiz
45th of 150 rated financial services
Job description
We are seeking an AI Governance and Privacy Specialist who can operationalize responsible AI in real systems-especially agentic AI and LLM-enabled applications. This role blends governance and privacy expertise with enough software development fluency to create developer-ready guidance, implement controls-as-code patterns, and stand up measurable evaluation and monitoring workflows.
As a Senior Consultant, you will help clients and internal delivery teams move from AI principles to practices: risk tiering, model and agent inventories, technical guardrails, governance workflows integrated into the SDLC, and evidence artifacts suitable for audits and regulators.
Recruiting for this role ends on 12/31/2026.
Work you'll do
As a Senior Consultant, Strategy, Growth and Transformation on the Cyber team, you will be responsible for:
- Designing and implementing AI governance operating models, intake workflows, risk tiering, approvals, documentation standards, exception handling, and audit-ready evidence processes for generative AI and agentic AI deployments.
- Building and maintaining inventories for models, agents, tools, data sources, and integrations, with defined ownership, intended use, risk classification, and change-control requirements.
- Conducting risk assessments across privacy, security, model risk, and misuse scenarios, including prompt injection, sensitive data exposure, excessive agency, and overreliance, and translating findings into implementable mitigations.
- Establishing technical control guidance for teams building agentic AI solutions, including human-in-the-loop patterns, tool access controls, retrieval and grounding practices, logging, monitoring, token and data minimization, and incident response playbooks.
- Integrating governance checkpoints into product and engineering delivery through architecture reviews, release gates, evaluation requirements, documentation automation, evidence capture, dashboards, and cross-functional collaboration with Cybersecurity, Privacy, Legal, Risk, Engineering, and Data Science teams.
A successful candidate would possess these skills:
- Ability to work independently and collaborate as part of a team
- Effective written and verbal communication skills
- Meticulous attention to detail and quality of work product
- Ability to build and sustain professional relationships
- Ability to lead projects or workstreams
- Ability to manage and prioritize multiple tasks in a fast-paced and dynamic environment
- Strong interpersonal skills and professional demeanor
- Ability to meet deadlines
- Ability to provide clear guidance to others
The team
You will join a cross-functional group working at the intersection of cyber, privacy, governance, and emerging AI delivery. The team helps organizations scale AI responsibly by combining governance and engineering patterns so teams can innovate faster without compromising trust.
Qualifications
Required:
- Bachelor's degree or equivalent practical experience.
- 4+ years of experience in AI governance, data privacy, security risk management, compliance and controls, AI product risk, model risk management, or technology risk consulting.
- Experience translating policies and regulatory expectations into operational workflows and artifacts, including intake processes, inventories, decision logs, risk registers, responsibility assignment matrices, playbooks, privacy impact assessments, and data protection impact assessments.
- Experience assessing AI, machine learning, and LLM deployment patterns, including training, retrieval-augmented generation, fine-tuning, tool use, data dependencies, and integration patterns, and defining mitigations for privacy, security, model risk, and misuse.
- Experience prototyping or automating governance workflows using Python or Structured Query Language and working with continuous integration and continuous deployment pipelines and cloud deployment basics.
- Ability to travel 0-50%, on average, based on the work you do and the clients and industries/sectors you serve.
- Limited immigration sponsorship may be available.
Preferred:
- Experience in consulting or a Big 4 environment.
- Experience operationalizing AI governance aligned to the National Institute of Standards and Technology AI Risk Management Framework or ISO/IEC 42001.
- Experience with generative AI safety and evaluation practices, including prompt injection testing, jailbreak resilience, hallucination measurement, toxicity scoring, harm scoring, and grounding effectiveness.
- Experience with governance, workflow, or ticketing platforms, including OneTrust and governance, risk, and compliance systems, and integrating those platforms into engineering delivery processes.
- Certifications such as Certified Information Privacy Professional/United States, Certified Information Privacy Manager, International Association of Privacy Professionals AI Governance Professional, Certified Information Security Manager, or Certified Information Systems Security Professional.
- Experience in cyber or enterprise security environments, including data security, identity, audit logging, secure software development lifecycle practices, human-in-the-loop escalation pathways, exception handling, and automated safety protocols for autonomous systems.
The wage range for this role takes into account the wide range of factors that are considered in making compensation decisions including but not limited to skill sets; experience and training; licensure and certifications; and other business and organizational needs. The disclosed range estimate has not been adjusted for the applicable geographic differential associated with the location at which the position may be filled. At Deloitte, it is not typical for an individual to be hired at or near the top of the range for their role and compensation decisions are dependent on the facts and circumstances of each case. A reasonable estimate of the current range is $105,400 to $207,800.
You may also be eligible to participate in a discretionary annual incentive program, subject to the rules governing the program, whereby an award, if any, depends on various factors, including, without limitation, individual and organizational performance.
#CyberDTP27
We are seeking an AI Governance and Privacy Specialist who can operationalize responsible AI in real systems-especially agentic AI and LLM-enabled applications. This role blends governance and privacy expertise with enough software development fluency to create developer-ready guidance, implement controls-as-code patterns, and stand up measurable evaluation and monitoring workflows.
As a Senior Consultant, you will help clients and internal delivery teams move from AI principles to practices: risk tiering, model and agent inventories, technical guardrails, governance workflows integrated into the SDLC, and evidence artifacts suitable for audits and regulators.
Recruiting for this role ends on 12/31/2026.
Work you'll do
As a Senior Consultant, Strategy, Growth and Transformation on the Cyber team, you will be responsible for:
- Designing and implementing AI governance operating models, intake workflows, risk tiering, approvals, documentation standards, exception handling, and audit-ready evidence processes for generative AI and agentic AI deployments.
- Building and maintaining inventories for models, agents, tools, data sources, and integrations, with defined ownership, intended use, risk classification, and change-control requirements.
- Conducting risk assessments across privacy, security, model risk, and misuse scenarios, including prompt injection, sensitive data exposure, excessive agency, and overreliance, and translating findings into implementable mitigations.
- Establishing technical control guidance for teams building agentic AI solutions, including human-in-the-loop patterns, tool access controls, retrieval and grounding practices, logging, monitoring, token and data minimization, and incident response playbooks.
- Integrating governance checkpoints into product and engineering delivery through architecture reviews, release gates, evaluation requirements, documentation automation, evidence capture, dashboards, and cross-functional collaboration with Cybersecurity, Privacy, Legal, Risk, Engineering, and Data Science teams.
A successful candidate would possess these skills:
- Ability to work independently and collaborate as part of a team
- Effective written and verbal communication skills
- Meticulous attention to detail and quality of work product
- Ability to build and sustain professional relationships
- Ability to lead projects or workstreams
- Ability to manage and prioritize multiple tasks in a fast-paced and dynamic environment
- Strong interpersonal skills and professional demeanor
- Ability to meet deadlines
- Ability to provide clear guidance to others
The team
You will join a cross-functional group working at the intersection of cyber, privacy, governance, and emerging AI delivery. The team helps organizations scale AI responsibly by combining governance and engineering patterns so teams can innovate faster without compromising trust.
Qualifications
Required:
- Bachelor's degree or equivalent practical experience.
- 4+ years of experience in AI governance, data privacy, security risk management, compliance and controls, AI product risk, model risk management, or technology risk consulting.
- Experience translating policies and regulatory expectations into operational workflows and artifacts, including intake processes, inventories, decision logs, risk registers, responsibility assignment matrices, playbooks, privacy impact assessments, and data protection impact assessments.
- Experience assessing AI, machine learning, and LLM deployment patterns, including training, retrieval-augmented generation, fine-tuning, tool use, data dependencies, and integration patterns, and defining mitigations for privacy, security, model risk, and misuse.
- Experience prototyping or automating governance workflows using Python or Structured Query Language and working with continuous integration and continuous deployment pipelines and cloud deployment basics.
- Ability to travel 0-50%, on average, based on the work you do and the clients and industries/sectors you serve.
- Limited immigration sponsorship may be available.
Preferred:
- Experience in consulting or a Big 4 environment.
- Experience operationalizing AI governance aligned to the National Institute of Standards and Technology AI Risk Management Framework or ISO/IEC 42001.
- Experience with generative AI safety and evaluation practices, including prompt injection testing, jailbreak resilience, hallucination measurement, toxicity scoring, harm scoring, and grounding effectiveness.
- Experience with governance, workflow, or ticketing platforms, including OneTrust and governance, risk, and compliance systems, and integrating those platforms into engineering delivery processes.
- Certifications such as Certified Information Privacy Professional/United States, Certified Information Privacy Manager, International Association of Privacy Professionals AI Governance Professional, Certified Information Security Manager, or Certified Information Systems Security Professional.
- Experience in cyber or enterprise security environments, including data security, identity, audit logging, secure software development lifecycle practices, human-in-the-loop escalation pathways, exception handling, and automated safety protocols for autonomous systems.
The wage range for this role takes into account the wide range of factors that are considered in making compensation decisions including but not limited to skill sets; experience and training; licensure and certifications; and other business and organizational needs. The disclosed range estimate has not been adjusted for the applicable geographic differential associated with the location at which the position may be filled. At Deloitte, it is not typical for an individual to be hired at or near the top of the range for their role and compensation decisions are dependent on the facts and circumstances of each case. A reasonable estimate of the current range is $105,400 to $207,800.
You may also be eligible to participate in a discretionary annual incentive program, subject to the rules governing the program, whereby an award, if any, depends on various factors, including, without limitation, individual and organizational performance.
#CyberDTP27