Job Summary:
Deloitte's Core AI & Data practice is seeking a Databricks Data Engineer to help organizations modernize their data platforms and enhance analytics and artificial intelligence capabilities. The role involves designing and optimizing cloud-based data engineering solutions, collaborating with teams to support large-scale data transformations, and delivering measurable business outcomes.
Responsibilities:
• Design, build, and maintain data pipelines and data engineering solutions using Databricks, Apache Spark, Python, and Structured Query Language (SQL)
• Support the modernization of enterprise data platforms by implementing cloud-based ingestion, transformation, and storage patterns
• Develop and maintain batch and streaming data workflows that support reporting, analytics, and artificial intelligence use cases
• Apply data architecture, integration, and data modeling practices to improve data quality, scalability, and platform performance
• Collaborate with client and Deloitte teams to troubleshoot issues, implement enhancements, and support delivery of large-scale data transformation programs
Qualifications:
Required:
• Bachelor's degree in Computer Science, Engineering, Information Systems, Data Science, Mathematics, or Statistics
• 3+ years of experience in data engineering, extract, transform, load (ETL) development, or data platform engineering
• 2+ years of experience building data pipelines in Databricks using Apache Spark, Python, and Structured Query Language (SQL)
• Experience implementing data models, data integration patterns, and cloud-based data processing workflows
• Experience working with at least one cloud platform: Amazon Web Services (AWS), Microsoft Azure, or Google Cloud Platform (GCP)
• Ability to travel 50%, on average, based on the work you do and the clients and industries/sectors you serve.
• Limited immigration sponsorship may be available.
Preferred:
• Experience with Delta Lake, Databricks Workflows, and Unity Catalog
• Experience using Git-based version control and continuous integration/continuous deployment pipelines
• Experience supporting batch and streaming data workloads
• Experience with data warehousing, lakehouse architecture, and performance optimization
• Experience supporting analytics or machine learning data pipelines
• Experience working in consulting or client service delivery environments
Company:
Deloitte is a business consulting company that offers audit, consulting, financial advisory, and tax services. Founded in 1845, the company is headquartered in London, GBR, with a team of 10001+ employees. The company is currently Late Stage.