Manager Databricks Data Engineer Jobs in Capitol Heights, MD

Databricks Data Engineer – Databricks Certified

We are seeking an experienced Databricks Data Engineer to design, develop, optimize, and support enterprise-scale data engineering solutions using the Databricks Lakehouse Platform.

The ideal candidate will have advanced, hands-on experience with Databricks, Apache Spark, PySpark, Python, SQL, Delta Lake, Unity Catalog, and cloud data platforms, with a demonstrated record of delivering complex, production-grade data engineering solutions.

Databricks Certified Data Engineer Professional certification is required for this position.

Key Responsibilities

• Design and develop scalable, production-grade data pipelines using Databricks, Apache Spark, PySpark, Python, and SQL.
• Build and optimize ETL/ELT pipelines supporting batch and streaming workloads.
• Develop and maintain Delta Lake solutions using Bronze, Silver, and Gold data layers.
• Design scalable Lakehouse architectures supporting enterprise analytics and data modernization.
• Develop and manage Databricks Jobs, Workflows, notebooks, and automated data-processing pipelines.
• Apply advanced Spark optimization and performance-tuning techniques, including partitioning, joins, caching, query optimization, and cluster configuration.
• Troubleshoot complex Spark jobs, pipeline failures, data-processing issues, and production incidents.
• Implement data-quality controls, validation, reconciliation, error handling, and monitoring.
• Implement data governance and secure access using Unity Catalog, RBAC, permissions, and appropriate security controls.
• Integrate Databricks with cloud storage, databases, APIs, enterprise applications, and downstream analytics platforms.
• Develop reusable frameworks, libraries, notebooks, and engineering standards.
• Implement and support CI/CD pipelines for Databricks notebooks, jobs, workflows, and application deployments.
• Support migration and modernization initiatives from legacy data platforms to the Databricks Lakehouse.
• Collaborate with Data Architects, Data Scientists, Business Analysts, Cloud Engineers, and DevOps teams.
• Conduct technical design and code reviews and provide recommendations regarding scalability, performance, security, cost optimization, and engineering best practices.
• Maintain technical documentation covering data architecture, pipelines, mappings, workflows, and operating procedures.
• Provide production support, root-cause analysis, and resolution of critical data-platform issues.

Required Qualifications

• Databricks Certified Data Engineer Professional certification – REQUIRED
• 7+ years of experience in data engineering and data-platform development.
• 3+ years of hands-on experience developing production solutions on Databricks.
• Demonstrated experience delivering multiple enterprise-scale Databricks/Lakehouse implementations.
• Advanced proficiency with Apache Spark, PySpark, Python, and SQL.
• Strong hands-on experience with Delta Lake and Lakehouse architecture.
• Strong understanding of Spark distributed computing, execution plans, partitioning, shuffles, joins, and performance optimization.
• Experience with Databricks Jobs, Workflows, and production pipeline orchestration.
• Experience with Unity Catalog, data governance, security, and access management.
• Strong experience with at least one major cloud platform: AWS, Microsoft Azure, or Google Cloud Platform (GCP).
• Experience implementing CI/CD and DevOps practices for data-engineering solutions.
• Strong experience troubleshooting and optimizing production data pipelines.
• Excellent analytical, problem-solving, communication, and collaboration skills.
• Must be a U.S. Citizen.

Preferred Qualifications

• Working knowledge of a second major cloud platform.
• Bachelor's degree in Computer Science, Information Technology, Engineering, Data Science, or a related field.
• Active U.S. Government security clearance is welcome but not required.

Work Environment

This position is primarily remote, with limited onsite support required based on customer or project needs.

Tenacity Solutions, LLC (Tenacity) is a Service-Disabled Veteran Owned Small Business (SDVOSB) founded by our CEO, Gabriel Brown, CAPT, USN (Ret). Tenacity is an innovative company, leveraging talent, skill, and knowledge with cutting-edge and proven practices to deliver solutions and products that exceed customers’ requirements and surpasses their expectations. Tenacity immediately has become a leading technology and management solutions provider with a mission to advance healthcare services for specialized populations including Veterans and their families. Headquartered in North, Bethesda, Maryland (DMV), our talented resources are located across the United States. We bring diverse talent to design solutions that help customers with their greatest challenges.