... ML: how models work, prompt engineering, and the safety implications of fine-tuning and RAG (e.g ... Familiarity with the LLM attack surface-prompt injection, jailbreaks, data poisoning, and supply ...
... ML: how models work, prompt engineering, and the safety implications of fine-tuning and RAG (e.g ... Familiarity with the LLM attack surface-prompt injection, jailbreaks, data poisoning, and supply ...
AI/LLM Safety Engineer
Overland Park, KS · On-site +1
... ML: how models work, prompt engineering, and the safety implications of fine-tuning and RAG (e.g ... Familiarity with the LLM attack surface-prompt injection, jailbreaks, data poisoning, and supply ...
AI/LLM Safety Engineer
Overland Park, KS · On-site +1
... ML: how models work, prompt engineering, and the safety implications of fine-tuning and RAG (e.g ... Familiarity with the LLM attack surface-prompt injection, jailbreaks, data poisoning, and supply ...
AI/LLM Safety Engineer
Leawood, KS · On-site
LLM Safety Evaluation & Red Teaming * Design and maintain a safety evaluation framework ... ML: how models work, prompt engineering, and the safety implications of fine-tuning and RAG (e.g ...
Quick apply
AI/LLM Safety Engineer
Leawood, KS · On-site
LLM Safety Evaluation & Red Teaming * Design and maintain a safety evaluation framework ... ML: how models work, prompt engineering, and the safety implications of fine-tuning and RAG (e.g ...
... AI/ML or Data Science at massive scale. * Demonstrable hands-on experience in LLM engineering (fine-tuning, prompt engineering, deployment), RAG, and developing agentic workflows. * Proven track ...
... AI/ML or Data Science at massive scale. * Demonstrable hands-on experience in LLM engineering (fine-tuning, prompt engineering, deployment), RAG, and developing agentic workflows. * Proven track ...
Principal AI Agent / ML Software Engineer (OCI)
Topeka, KS · On-site
$114.60 - $234.60/hr
Deep understanding of LLM application patterns, including prompt design, structured outputs ... RAG, memory, tool safety, and evaluation. * Strong programming skills in Python and ability to ...
New
Principal AI Agent / ML Software Engineer (OCI)
Topeka, KS · On-site
$114.60 - $234.60/hr
Deep understanding of LLM application patterns, including prompt design, structured outputs ... RAG, memory, tool safety, and evaluation. * Strong programming skills in Python and ability to ...
New
Senior Data Platform Engineer
Manhattan, KS · On-site +1
$100K - $125K/yr
Establish patterns for safely, reliably, and cost-effectively operating LLM- and ML-backed features ... RAG, embeddings/vector search, tool/function calling, evaluation, and cost/latency optimization.
New
Senior Data Platform Engineer
Manhattan, KS · On-site +1
$100K - $125K/yr
Establish patterns for safely, reliably, and cost-effectively operating LLM- and ML-backed features ... RAG, embeddings/vector search, tool/function calling, evaluation, and cost/latency optimization.
New
Senior Data Platform Engineer
$104K - $137K/yr
Establish patterns for safely, reliably, and cost-effectively operating LLM- and ML-backed features ... RAG, embeddings/vector search, tool/function calling, evaluation, and cost/latency optimization.
New
Senior Data Platform Engineer
$104K - $137K/yr
Establish patterns for safely, reliably, and cost-effectively operating LLM- and ML-backed features ... RAG, embeddings/vector search, tool/function calling, evaluation, and cost/latency optimization.
New
Senior Analyst, Finance Data and AI
Wichita, KS · On-site
$76K - $95K/yr
... with LLM-based agents, RAG patterns, or semantic layers over enterprise data • Experience building or deploying AI/ML or agentic solutions in finance, accounting, or adjacent function • ...
Senior Analyst, Finance Data and AI
Wichita, KS · On-site
$76K - $95K/yr
... with LLM-based agents, RAG patterns, or semantic layers over enterprise data • Experience building or deploying AI/ML or agentic solutions in finance, accounting, or adjacent function • ...
... LLM APIs. * A solid understanding of business process analysis and re-engineering ... Solid understanding of Natural Language Processing (NLP), LLMs, and ML principles. * Experience ...
... LLM APIs. * A solid understanding of business process analysis and re-engineering ... Solid understanding of Natural Language Processing (NLP), LLMs, and ML principles. * Experience ...
Design and build AI-powered product features, including LLM-based agents, intelligent automation ... building AI/ML-powered product features, including working with LLMs, prompt engineering, RAG ...
Design and build AI-powered product features, including LLM-based agents, intelligent automation ... building AI/ML-powered product features, including working with LLMs, prompt engineering, RAG ...
Solutions Architect II
Lenexa, KS · On-site
$59.25 - $78/hr
... workflows, RAG, and structured output Contribute to architecture decision records (ADRs) and ... NET * Demonstrated curiosity about AI/ML: prompt engineering, LLM integration, agent patterns, or ...
Solutions Architect II
Lenexa, KS · On-site
$59.25 - $78/hr
... workflows, RAG, and structured output Contribute to architecture decision records (ADRs) and ... NET * Demonstrated curiosity about AI/ML: prompt engineering, LLM integration, agent patterns, or ...
Solutions Architect II
Lenexa, KS · On-site +1
$59.25 - $78/hr
... workflows, RAG, and structured output Contribute to architecture decision records (ADRs) and ... NET * Demonstrated curiosity about AI/ML: prompt engineering, LLM integration, agent patterns, or ...
Solutions Architect II
Lenexa, KS · On-site +1
$59.25 - $78/hr
... workflows, RAG, and structured output Contribute to architecture decision records (ADRs) and ... NET * Demonstrated curiosity about AI/ML: prompt engineering, LLM integration, agent patterns, or ...
$159K - $285K/yr
... LLM-as-a-Judge techniques, human-in-the-loop evaluations, and quality measurement for non ... Experience working on or adjacent to AI/ML-powered products - especially those with ...
$159K - $285K/yr
... LLM-as-a-Judge techniques, human-in-the-loop evaluations, and quality measurement for non ... Experience working on or adjacent to AI/ML-powered products - especially those with ...
$108K - $143K/yr
About You: 5+ years in product management with shipped and validated AI or ML features in a B2B ... Fluent in LLM-specific product patterns: RAG, evaluation frameworks, prompt versioning, latency ...
$108K - $143K/yr
About You: 5+ years in product management with shipped and validated AI or ML features in a B2B ... Fluent in LLM-specific product patterns: RAG, evaluation frameworks, prompt versioning, latency ...
$108K - $143K/yr
About You: 5+ years in product management with shipped and validated AI or ML features in a B2B ... Fluent in LLM-specific product patterns: RAG, evaluation frameworks, prompt versioning, latency ...
$108K - $143K/yr
About You: 5+ years in product management with shipped and validated AI or ML features in a B2B ... Fluent in LLM-specific product patterns: RAG, evaluation frameworks, prompt versioning, latency ...
Senior/Staff Forward Deployment Engineer (Java & AI Integration, Gen AI) - Full Time Role
Overland Park, KS · On-site
$121K - $159K/yr
... LLMs, RAG, agentic workflows). You bring real breadth and adapt quickly to the right tool for the ... Experience deploying AI/ML or LLM-based solutions in an enterprise setting. * Cloud experience (AWS ...
Quick apply
Senior/Staff Forward Deployment Engineer (Java & AI Integration, Gen AI) - Full Time Role
Overland Park, KS · On-site
$121K - $159K/yr
... LLMs, RAG, agentic workflows). You bring real breadth and adapt quickly to the right tool for the ... Experience deploying AI/ML or LLM-based solutions in an enterprise setting. * Cloud experience (AWS ...
Senior AI Platform Engineer
Overland Park, KS · On-site
$103K - $141K/yr
Deep hands-on experience building and deploying agentic AI systems, including LLM APIs, RAG, prompt ... ML systems, software engineering, or cybersecurity, with hands-on experience building, securing ...
Senior AI Platform Engineer
Overland Park, KS · On-site
$103K - $141K/yr
Deep hands-on experience building and deploying agentic AI systems, including LLM APIs, RAG, prompt ... ML systems, software engineering, or cybersecurity, with hands-on experience building, securing ...
Senior/Staff Forward Deployment Engineer (Java & AI Integration, Gen AI) - Full Time Role
Overland Park, KS · On-site
$115K - $152K/yr
... LLMs, RAG, agentic workflows). You bring real breadth and adapt quickly to the right tool for the ... Experience deploying AI/ML or LLM-based solutions in an enterprise setting. * Cloud experience (AWS ...
Senior/Staff Forward Deployment Engineer (Java & AI Integration, Gen AI) - Full Time Role
Overland Park, KS · On-site
$115K - $152K/yr
... LLMs, RAG, agentic workflows). You bring real breadth and adapt quickly to the right tool for the ... Experience deploying AI/ML or LLM-based solutions in an enterprise setting. * Cloud experience (AWS ...
Llm Ml Rag information
What are some typical challenges faced when working on Retrieval-Augmented Generation (RAG) systems in large language model (LLM) machine learning roles?
What is the difference between Llm Ml Rag vs Data Scientist?
| Aspect | Llm Ml Rag | Data Scientist |
|---|---|---|
| Required Credentials | Master's or PhD in ML, AI, or related fields; certifications in ML frameworks | Degree in Computer Science, Statistics, or related; certifications in data analysis or ML |
| Work Environment | Research labs, AI development teams, tech companies | Business analytics, research, product development teams |
| Employer & Industry Usage | Tech firms, AI startups, research institutions | Finance, healthcare, tech, consulting firms |
| Common Search & Comparison | Often compared for ML specialization and research focus | Compared for data analysis, modeling, and business insights |
While both roles involve working with machine learning, Llm Ml Rag typically focuses on research and development of large language models, requiring advanced ML expertise. Data Scientists often work on analyzing data, building predictive models, and deriving insights for business decisions. The roles overlap in skills but differ in focus and application areas.
What are the key skills and qualifications needed to thrive as an LLM ML RAG (Retrieval-Augmented Generation) Engineer, and why are they important?
What are LLM ML RAG jobs?

Propio rating
6.1
Based on 9 frontline employees who took The Breakroom Quiz
371st of 488 rated business services
Job description
Description
We are seeking an AI/LLM Safety Engineer to join our AI team and take ownership of how safely our models and agents behave in production; with a focus on AI Safety, Trust & Safety, and Responsible AI. You will design the evaluations that catch unsafe behavior, build the guardrails that stop it, and lead the red-teaming that finds the gaps before our users-or attackers-do. Agent safety is the primary focus of this role: you will help ensure that as our systems gain the ability to call tools and take actions, they do so within well-defined, well-tested boundaries.
Key Responsibilities:
LLM Safety Evaluation & Red Teaming
- Design and maintain a safety evaluation framework-adversarial prompt sets, scenario-based test suites, and regression suites-so that every model and agent update is validated before it ships.
- Lead structured red-teaming exercises covering jailbreaks, prompt injection, tool misuse, and data exfiltration; document findings and drive each issue through to remediation and closure.
Guardrails & Runtime Controls
- Build and iterate on guardrail logic, including input/output filtering, tool-boundary constraints, action validation, sensitive-data redaction, and policy prompting.
- Integrate safety checks into CI/CD and runtime so that unsafe behavior is intercepted before it reaches users.
Agent Safety (primary focus of this role)
- Perform threat modeling for agentic scenarios: tool-call boundaries, sandbox isolation, and least-privilege access, with particular attention to preventing agents from exfiltrating data or executing irreversible actions through chained tool calls.
- Conduct safety reviews of reinforcement-learning (RL) environments and trajectory data, partnering with environment and agent engineering teams to embed safety constraints directly into the environments themselves.
Monitoring & Observability
- Instrument AI features for safety with structured logging, tracing, and metrics, enabling detection of unsafe patterns and regressions in production.
Governance & Collaboration
- Prepare evidence for governance reviews-test reports, evaluation summaries, and mitigation validation-aligned with internal Responsible AI standards.
- Collaborate with Product and UX to improve safety interactions (warnings, confirmations, refusal messaging, and feedback collection), and align evaluation goals with the Research and Data teams.
Requirements
- Bachelor's or Master's degree in Computer Science, Software Engineering, Cybersecurity, or a related technical field-or equivalent practical experience.
- 4+ years building production software, with direct experience working on-or securing-ML/LLM systems.
- Strong software engineering skills with the ability to write production-grade code (primarily Python), beyond scripting or notebook prototyping.
- Solid understanding of LLMs and ML: how models work, prompt engineering, and the safety implications of fine-tuning and RAG (e.g., unsafe retrieval, tool misuse, and data exfiltration).
- A security mindset with demonstrated threat-modeling ability; able to threat-model AI workflows and familiar with the fundamentals of access control, data retention, and incident response.
- Familiarity with the LLM attack surface-prompt injection, jailbreaks, data poisoning, and supply-chain risk-and working knowledge of the OWASP LLM Top 10.
- Hands-on experience with at least one of safety evaluation or red teaming, with the ability to walk through a real finding and how it was remediated.
Preferred Qualifications
- Hands-on experience with industry safety tooling such as garak, PyRIT, promptfoo, Giskard, and NeMo Guardrails, and the ability to articulate the trade-offs between them.
- Visible output in AI safety or security: publications at relevant venues (e.g., the NeurIPS AI Safety Workshop, USENIX Security, or DEF CON AI Village), open-source contributions, or responsible disclosures on frontier models with public write-ups.
- Familiarity with AI governance and compliance frameworks (NIST AI RMF, ISO/IEC 42001, EU AI Act) and the ability to translate compliance requirements into concrete engineering tasks.
- Engineering experience with agents, RL environments, and/or tool use.
- Practical experience with threat-modeling methodologies such as MITRE ATLAS and STRIDE/PASTA.
About Propio
Propio is on a mission to make communication accessible to everyone. As a leader in real-time interpretation and multilingual language services, we connect people with the information they need across language, culture, and modality. We are committed to building AI-powered tools that enhance interpreter workflows, automate multilingual insights, and scale communication quality across industries.
About Propio
Sourced by ZipRecruiter
Industry
Recruiting and staffing services
Company size
1 - 10 Employees
Headquarters location
Washington, DC, US
Year founded
2022