Job Summary:
UST is a mission-driven group of 29,000+ practical problem solvers and creative thinkers dedicated to transforming lives through technology. The Data Engineer role involves building and maintaining data pipelines, implementing data contracts and transformations, and ensuring data quality within the team's ingestion framework.
Responsibilities:
• Lands data from authoritative sources into the team's unified ingestion framework using the patterns specified in the design.
• Implements the data contracts, models, and transformations sometimes independently and sometimes as specified by the Senior Data Engineer.
• Builds pipelines in Snowflake (including Iceberg tables) and/or Databricks (Delta Lake) per the storage pattern in the design.
• Implements testing, data quality checks, and reconciliation.
• Builds the Fabric semantic layer assets and Power BI visualizations called for in the design.
• Operates and maintains the data products after delivery.
Qualifications:
Required:
• Bachelor's degree in Computer Science, Software Engineering, Information Management, or equivalent experience in field plus 4+ years of related work experience.
• Must be located in the United States.
• 4+ years of hands-on data engineering experience delivering production data pipelines in enterprise environments.
• Strong proficiency in SQL and Python, including PySpark and Spark SQL for distributed data transformation.
• Hands-on experience with Databricks including Delta Lake, Unity Catalog, and workflow orchestration.
• Hands-on experience with Snowflake at production scale.
• Working experience with Microsoft Fabric including OneLake; familiarity with Fabric IQ semantic layer concepts.
• Working experience building data visualizations and reports in Power BI.
• Experience implementing data ingestion pipelines using batch, CDC, API, or streaming patterns within a unified ingestion framework.
• Solid data modeling skills, including dimensional modeling and lakehouse modeling patterns at the physical implementation level.
• Experience implementing pipeline testing unit tests, integration tests, data quality checks, and reconciliation.
• Experience with DevOps practices for data pipelines Git, CI/CD, and automated testing.
• Good communication skills, with the ability to convey technical progress and ask clarifying questions of both technical leads and business stakeholders.
• Strong problem-solving skills and the ability to execute independently on well-defined technical work in a fast-paced, agile environment.
Preferred:
• Experience with Iceberg tables or other modern open table formats.
• Experience with HR data domains talent acquisition, workforce analytics, compensation, learning, performance, or people analytics.
• Familiarity with Workday, ServiceNow HR, or comparable HR systems of record as authoritative sources for analytics.
• Exposure to real-time streaming technologies including Kafka, Azure Event Hub, Delta Live Tables, or Spark Structured Streaming.
• Exposure to AI/ML pipelines or building data products that support ML workloads.
• Familiarity with legacy data platforms such as Teradata, Oracle, or SQL Server.
• Azure certifications or demonstrated experience with Azure-native data platform services.
• Familiarity with data privacy and regulatory compliance for HR data (GDPR, CCPA, employee data protection).
Company:
UST is a global digital transformation solutions provider. Founded in 1999, the company is headquartered in Waltham, USA, with a team of 10001+ employees. The company is currently Late Stage.