Director Databricks Data Engineer Jobs in Bethesda, MD

• Collaborative Teamwork: Partner with engineers, program managers, and domain specialists to conceive, architect, build, and maintain applications that meet AFS clients' needs.
• Data Synthesis: Understand a client's most critical objectives and synthesize disparate information into a cohesive vision and actionable roadmap, interpreting what the data signifies and outlining an impact-based plan to rapidly go from use case to prototype to scaled deployment.
• Rapid Iteration: Quickly iterate, build from scratch, and help transform clients' operations at uncommon speed. You won't just deploy software-you'll help reshape how entire organizations work by putting powerful tools in the hands of executives and real operators.
• Production-Grade Solutions: Develop production-grade solutions that make sense of the client's data and process it through an actionable workflow that can help clients make better decisions.
• Collaboration: Collaborate with technical and non-technical colleagues to define solution requirements, iterate on the solution, and ship code.

Key Responsibilities:

• Deliver endtoend, production-grade data and AI solutions on Databricks platforms.
• Design and build scalable data pipelines, APIs, and user-facing applications using Spark and modern bigdata engines.
• Design and build Databricks Apps, including both frontend and backend components.
• Integrate LLMs and AI APIs (OpenAI, Anthropic, Gemini) into applications and data workflows.
• Deploy solutions to cloud environments (AWS, Azure, GCP) and monitor production systems for performance, reliability, and cost efficiency.
• Debug complex issues across the full stack, including data pipelines, application services, cloud infrastructure, and AI integrations.
• Implement CI/CD workflows, automated testing, and secure, repeatable production deployments.
• Ensure data governance, quality, and security through best practices and tools like Unity Catalog.
• Partner directly with customer stakeholders to define requirements, architect solutions, and provide hands-on technical guidance.
• Produce clear documentation, runbooks, and technical enablement materials for long-term maintainability.

• Client Success Obsession: A deep commitment to helping clients succeed, even beyond the original scope. You thrive on solving hard customer problems and take pride in delivering solutions that drive real value.
• Analytical & Problem-Solving Skills: Strong abilities in breaking down complex problems and constructing end-to-end solutions that work.
• Technical Proficiency: Proficiency in relevant programming languages (e.g., Python, TypeScript) and the ability to build applications that utilize large structured and unstructured datasets in production environments.
• Independent Ownership: Capability to work autonomously while owning outcomes, with support available but a desire to take the driver's seat.
• Real-World Impact Delivery: A proven track record of delivering meaningful outcomes through software and analytical products.
• Collaborative Skills: Strong ability to collaborate with teammates and clients of varying technical proficiency, embedding with clients and joining their teams.
• Willingness to Travel: Flexibility to travel as needed for client implementation work.

In this role, you'll iterate quickly, build from scratch, and help organizations transform their operations at uncommon speed. You won't just deploy software-you'll help reshape how entire organizations function by providing powerful tools to those who can drive change.

Here is what you need: 

• Full-stack engineering with Databricks platforms including experience building scalable data pipelines, APIs, and user-facing applications
• Experience delivering customer-facing technical solutions
• Familiar with AI-assisted development tools and modern AI frameworks
• Experience with cloud platforms (AWS, Azure, or GCP)
• Familiar with CI/CD pipelines and production deployment workflows
• Ability to obtain Databricks Data Engineer Professional certification 
• Ability to travel, dependent on client and team
• Must be a US Citizen and ability to obtain federal security clearance 

Bonus points if you have: 

• Experience with Databricks on both E2 and PVC
• Hands-on integration of LLMs and AI APIs (OpenAI, Anthropic, Gemini) into applications 
• Active Federal security clearance