Job Summary (List Format):
- Serve as a hands-on Lead Solutions Architect specializing in Databricks and Application Integration.
- Design, document, and actively build end-to-end integration solutions linking Databricks with enterprise applications, microservices, BI tools, and external APIs.
- Develop and maintain reusable platform libraries and abstraction layers to accelerate development.
- Architect and enforce data quality frameworks, including automated DLT Expectations and data lineage tracking.
- Lead architectural review boards, oversee code/design reviews, and provide direct technical mentorship to data engineers.
- Optimize real-time streaming data pipelines and implement performance tuning strategies to balance throughput with cloud costs.
- Design and govern enterprise-grade CI/CD and Infrastructure as Code (IaC) deployment strategies for Databricks environments.
- Collaborate with platform, cloud infrastructure, and engineering teams to ensure seamless integration and technical alignment.
- Operate within a SAFe (Scaled Agile) framework, participating in agile ceremonies and on-site PI planning in Washington, D.C.
- Leverage 8+ years of IT solution architecture, application design, or senior data engineering experience with a focus on cloud data ecosystems.
- Demonstrate advanced expertise in Databricks, PySpark, SQL, Delta Lake, and structured streaming architectures.
- Exhibit leadership, consensus building, and the ability to communicate complex technical concepts to non-technical stakeholders.
- Ensure compliance with agile methodologies and contribute to iterative planning and execution.