Job Summary:
Deloitte is a leading professional services firm, and they are seeking a Senior Databricks Data Engineer to design, build, and optimize scalable data engineering solutions. The role involves leading the implementation of enterprise data pipelines and advising stakeholders on architecture decisions to drive business outcomes.
Responsibilities:
• Lead the design and implementation of enterprise data pipelines, data models, and cloud-based data architectures using Databricks
• Build and optimize batch and streaming data solutions that support analytics, reporting, and operational use cases
• Advise stakeholders on platform capabilities, architecture decisions, governance controls, and delivery approaches aligned to business objectives
• Drive engineering quality through automation, continuous integration/continuous deployment (CI/CD), performance tuning, and scalable delivery practices
• Contribute to technical best practices, evaluate emerging platform capabilities, and support teams delivering modern data engineering solutions
Qualifications:
Required:
• Bachelor's degree in Computer Science, Engineering, or a related field and 1+ years of experience leading cross-functional data engineering projects or technical teams
• 5+ years of experience in data engineering with a focus on Databricks deployed on Amazon Web Services (AWS), Microsoft Azure, or Google Cloud Platform (GCP)
• 5+ years of experience with Apache Spark, Delta Lake, Lakehouse architecture, and enterprise data warehousing, including third normal form (3NF) and dimensional modeling
• Experience building batch and incremental data pipelines using PySpark, Delta Live Tables, Autoloader, Structured Streaming, Databricks Workflows, or Apache Airflow
• Experience with Databricks Unity Catalog, fine-grained security controls, and continuous integration/continuous deployment (CI/CD) pipeline deployment
• Ability to travel 50%, on average, based on the work you do and the clients and industries/sectors you serve.
• Limited immigration sponsorship may be available.
Preferred:
• Master's degree in Computer Science, Engineering, or a related field
• Experience with one or more cloud ecosystems, including Amazon Web Services (AWS), Microsoft Azure, or Google Cloud Platform (GCP)
• Experience tuning Databricks or Apache Spark workloads for performance and cost efficiency
• Experience with Databricks Lakeflow
• Experience supporting artificial intelligence or machine learning use cases on cloud data platforms
Company:
Deloitte is a business consulting company that offers audit, consulting, financial advisory, and tax services. Founded in 1845, the company is headquartered in London, GBR, with a team of 10001+ employees. The company is currently Late Stage.