Job Summary:
eTeam is seeking an ADF Data Engineer to work in Houston, TX. The role involves data engineering responsibilities focusing on Azure technologies, including Azure Data Factory and Azure Databricks, along with coding and development tasks.
Responsibilities:
โข Coding AND Development
โข Migration activities
โข Unit testing
Qualifications:
Required:
โข Experience: 5โ8 years in data engineering with at least 3 years on Azure.
โข Mandatory skills: ADF, Azure Databricks, Python, SQL.
โข Azure Data Factory: Pipelines, data flows (mapping/wrangling), triggers, integration runtimes, parameterization, error handling & retries.
โข Azure Databricks: Databricks Notebooks, Jobs/Workflows, PySpark/Scala, Delta Lake, cluster configuration and optimization.
โข Programming: Advanced Python or Scala (at least one), strong coding standards, modularization, and unit testing (e.g., pytest).
โข SQL: Expert-level SQL (CTEs, window functions, query tuning), working with large datasets.
โข Data Storage & Formats: ADLS Gen2, Delta Lake, Parquet, partitioning, Z-Ordering, OPTIMIZE/VACUUM.
โข Ops & CI/CD: Git, branching strategies, CI/CD for ADF/Databricks; environment promotion; Infrastructure-as-Code exposure is a plus.
โข Minimum years of experience: > 10 years.
โข Top 3 responsibilities: Coding AND Development, Migration activities, Unit testing.
Company:
eTeam is a staffing agency that also provides payrolling services. Founded in 1999, the company is headquartered in Somerset, USA, with a team of 501-1000 employees. The company is currently Late Stage.