Job Summary:
eTeam is looking for a Data Engineer specializing in AI and Data. The role involves ingesting and processing data from various sources, building and maintaining data pipelines, and ensuring data quality and performance optimization.
Responsibilities:
• Ingest and process data from Client (Investments), Dynamics 365 & Coupa (Finance), Workday (HR), Concur (Operations), and external program/partner data (e.g., Health, Education).
• Build and maintain pipelines in Databricks, DBT, and Snowflake to deliver curated datasets for AI/ML.
• Design simple, reusable data models to support training and inference.
• Implement data quality tests, documentation, and lineage in DBT
• Ensure performance optimization, cost efficiency, and compliance with governance standards.
• Collaborate with Knowledge Management (AI/Data Science) team to provide feature ready datasets.
Qualifications:
Required:
• Hands-on experience with Databricks (PySpark/SQL, Unity Catalog), DBT (models, tests, docs), and Snowflake (SQL, performance tuning).
• Strong background in ETL/ELT pipeline development.
• Experience with enterprise SaaS systems (Client, D365, Coupa, Workday, Concur).
• Solid SQL and Python skills; knowledge of data quality frameworks.
Company:
eTeam is a staffing agency that also provides payrolling services. Founded in 1999, the company is headquartered in Somerset, USA, with a team of 501-1000 employees. The company is currently Late Stage.