Job Summary:
eTeam is a company seeking a Microsoft Databricks Engineer. The role involves designing and building data pipelines, working with cloud data platforms, and ensuring data governance and quality best practices.
Responsibilities:
• Hands-on experience with Databricks and core data engineering tools (SQL, Python, Spark; Hadoop familiarity acceptable)
• Experience designing and building data pipelines and ETL/ELT processes
• Experience with cloud data platforms (e.g., Azure; GCP exposure helpful)
• Working knowledge of data modeling, data architecture, and database design (relational and NoSQL)
• Knowledge of data governance, data quality, and security best practices
• Experience with workflow orchestration tools (e.g., Airflow, Luigi)
• Familiarity with organizing data using Medallion Pattern and understanding centralization vs. decentralization approaches (including Data Mesh principles)
• Strong problem-solving, communication, and documentation skills
Qualifications:
Required:
• 6 years experience
• Hands-on experience with Databricks and core data engineering tools (SQL, Python, Spark; Hadoop familiarity acceptable)
• Experience designing and building data pipelines and ETL/ELT processes
• Experience with cloud data platforms (e.g., Azure; GCP exposure helpful)
• Working knowledge of data modeling, data architecture, and database design (relational and NoSQL)
• Knowledge of data governance, data quality, and security best practices
• Experience with workflow orchestration tools (e.g., Airflow, Luigi)
• Familiarity with organizing data using Medallion Pattern and understanding centralization vs. decentralization approaches (including Data Mesh principles)
• Strong problem-solving, communication, and documentation skills
Company:
eTeam is a staffing agency that also provides payrolling services. Founded in 1999, the company is headquartered in Somerset, USA, with a team of 501-1000 employees. The company is currently Late Stage.