Hello There,
My name is Gunjan Sharma, and I serve as the Sr. Technical Recruiter at Kanak-IT INC. I am reaching out to share an excellent career opportunity for the role of Sr. Databricks Engineer with our esteemed client. If you are interested then please share your updated resume.
Role- Sr. Databricks Engineer
Location - Cincinnati, OH Locals only (f2f interview)
Duration- 6+ months
About the job
We are seeking a Senior Databricks Engineer with deep hands-on experience designing and implementing large-scale data solutions on Azure Databricks. The ideal candidate has real-world experience building and troubleshooting production-grade data pipelines, optimizing Spark workloads, managing Delta Lake architecture, and implementing DevOps best practices using IaC and CI/CD automation.
Key Responsibilities
- Design, develop, and maintain data pipelines and ETL solutions in Azure Databricks using PySpark and Delta Lake.
- Implement data integration frameworks and API-based ingestion using tools like Apigee or Kong.
- Analyze, design, and deliver enterprise data architecture solutions focusing on scalability, performance, and governance.
- Implement automation tools and CI/CD pipelines using Jenkins, Ansible, or Terraform.
- Troubleshoot production failures and performance bottlenecks — fix partitioning, caching, shuffle, cluster sizing, and Z-ordering issues.
- Manage Unity Catalog, enforce data security (row/column-level access), and maintain data lineage.
- Administer Databricks clusters, jobs, and SQL warehouses, optimizing costs through auto-stop, job clusters, and Photon usage.
- Collaborate with cross-functional teams to drive data strategy and standards across domains.
- Create and maintain detailed architectural diagrams, interface specs, and data flow documentation.
- Mentor junior engineers on Databricks, Spark optimization, and Azure data best practices.
Required Skills & Experience
- 5+ years of experience as a Data Engineer with strong hands-on experience in Azure Databricks and PySpark.\
- Solid understanding of Delta Lake, Z-ordering, partitioning, OPTIMIZE, and ACID transactions.
Thanks & Regards
Gunjan Sharma
Sr. Technical Recruiter
Email: Gunjan@kanakits.com
LinkedIn: https://www.linkedin.com/in/gk-s-5238053a5/
Kanak IT is an equal opportunity employer. We consider all applicants for employment without regard to citizenship, immigration status, race, gender, disability, or any other protected category.