Job Overview
We are looking for a highly senior, deeply hands on Databricks Architect to lead a largeโscale OracleโtoโDatabricks migration, covering schema migration, code conversion, and ODI job modernization. The ideal candidate has extensive experience building enterprise-grade data platforms on Databricks, has executed at least one greenfield Databricks implementation, and is exceptionally strong in PySpark, Spark SQL, framework development, and Databricks Workflows.
Key Responsibilities
- Architect, design, and implementย cloud-native data platformsย using Databricks (ingestion โ transformation โ consumption).
- Lead the full Oracle โ Databricks migration includingย schema translation, ETL/ELT logic modernization, and ODI job replacement.
- Develop reusableย PySpark frameworks, data processing patterns, and orchestration usingย Databricks Workflows.
- Build scalable, secure, and costโoptimized Databricks infrastructure and data pipelines.
- Collaborate with business and technical stakeholders to drive data modernization strategy.
- Establish development best practices, coding standards, CI/CD, and DevOps/DataOps patterns.
- Provide technical mentorship and create training plans for engineering teams.
- Contribute to building MLOps and advanced operations frameworks.
Required Qualifications
- 14+ yearsย in Data Engineering/Architecture with at leastย 4+ years hands-on Databricks experienceย delivering endโtoโend cloud data solutions.
- Strong experience migrating fromย Oracle/onโprem systems to Databricks, including SQL, PL/SQL, ETL logic, and ODI pipelines.
- Deep hands-on expertise in:
- PySpark, Spark SQL, Delta Lake, Unity Catalog
- Building reusable data frameworks
- Designing highโperformance batch and streaming pipelines
- Proven experience withย greenfield Databricks implementations.
- Strong understanding of cloud-native architectures onย AWSย and modern data platform concepts.
- Solid knowledge ofย data warehousing, columnar databases, and performance optimization.
- Good understanding ofย Agile/Scrumย development processes.
- Bonus: Experience designingย Data Products, Data Mesh architectures, Data Vault or enterprise data governance models.
- Good Understanding of Golde Gate.