Role: Lead Data Engineer
Location: San Francisco, CA (1-2 days a week onsite is must)
Job Type: W2 Contract
Contract Length: 9 months with possible extension
Experience Level: Senior/Lead
Main Skills:
SQL, Databricks, ADF, DataStage (or other ETL tool), SSAS cubes, Cognos/other, Tableau/other, Thoughtspot/other
Required Experience:
8-10 years of software development and deployment experience
At least 7 years of hands-on experience with:
SQL
Databricks
Azure Data Factory (ADF)
Datastage (or other ETL tools)
SSAS cubes
BI tools (Cognos, Tableau, ThoughtSpot, etc.)
Strong Database knowledge (SQL & No-SQL preferred)
Advanced SQL and Python skills
Experience working with APIs for data collection/ingestion
Additional Skills & Requirements:
Experience building data ingestion pipelines and data warehouse architecture
Ability to write design documentation, source-to-target mapping documentation, and manage Confluence pages
Experience converting business functionalities into technical Jira stories
Strong experience with data modeling, design patterns, and building scalable BI solutions
Knowledge of cloud platforms (Azure, AWS or equivalent)