Role: BI Developer
Location: Lebanon, Indiana (Onsite-5 days a week at client location)
Experience: 5-7 Years
Visa: Any (Which doesn''t require sponsorship)
Contract: 6+ months with possible extension
Job Summary
We are looking for an experienced Senior Azure Databricks & Microsoft Fabric Data Engineer to design, develop, and implement scalable cloud-based data platforms using Microsoft Azure technologies. The ideal candidate should have strong hands-on experience with Azure Databricks, Microsoft Fabric, and modern data engineering practices, along with the ability to deliver enterprise-scale data platform solutions from design through production deployment.
Key Responsibilities
- Design, develop, and maintain scalable data pipelines using Azure Databricks.
- Develop ETL/ELT workflows using PySpark, Spark SQL, Delta Lake, and Databricks Notebooks.
- Build and optimize Lakehouse and Data Warehouse architectures.
- Develop and manage Microsoft Fabric Lakehouses, Dataflows Gen2, Data Pipelines, and OneLake solutions.
- Perform data ingestion, transformation, validation, and performance tuning.
- Collaborate with business stakeholders, solution architects, BI developers, and cross-functional teams to translate business requirements into technical solutions.
- Participate in solution design, code reviews, testing, deployment, and production support.
- Follow best practices for data security, governance, documentation, and CI/CD.
Mandatory Skills
- Strong hands-on experience with Azure Databricks.
- Expertise in PySpark, Spark SQL, Delta Lake, and Databricks Notebooks.
- Solid working knowledge of Microsoft Fabric, including Lakehouses, Dataflows Gen2, Data Pipelines, and OneLake.
- Strong understanding of Data Warehouse and Lakehouse architecture.
- Experience delivering large-scale enterprise data platform projects from design to production.
- Strong SQL skills and data modelling experience.
- Excellent communication and stakeholder management skills.
Good to Have
- Power BI (Data Modelling, DAX, Power Query, Report Development).
- Azure Data Factory, Azure Data Lake Storage Gen2, Azure DevOps, Git, CI/CD.
- Azure Synapse Analytics, Unity Catalog, Microsoft Purview.
- Experience in Agile/Scrum environments.
- Microsoft Azure or Microsoft Fabric certifications.
Required Experience
- 8–15 years of overall IT experience with at least 4+ years in Azure Data Engineering.
- Proven experience building enterprise-scale cloud data platforms.
- Experience working with structured and semi-structured data.
- Strong problem-solving and analytical skills with the ability to work independently.
Education
Bachelor''s or Master''s degree in Computer Science, Information Technology, Engineering, or a related discipline.
Preferred Domain Experience
Experience in Manufacturing, Pharmaceuticals, Healthcare, Life Sciences, or Supply Chain domains will be an advantage. Exposure to regulated environments (GxP/FDA) is desirable.
Keywords: Azure Databricks, PySpark, Delta Lake, Microsoft Fabric, Lakehouse, OneLake, Dataflows Gen2, Data Pipelines, SQL, Data Warehouse, Azure Data Engineering, Power BI, DAX, Azure DevOps, ETL, Cloud Data Platform.