3 Mmc Production Manager Jobs Hiring Near You

Data Engineer

Defines data flows, i.e., which parts of the organization generate data, which require data to function, how data flows are managed, and how data changes in transition. Develops, implements, and deploys custom data pipelines powering machine learning algorithms, insights generation, client benchmarking tools, business intelligence dashboards, reporting and new data products. Defines reference architecture, which is a pattern that others can follow to create and improve data systems. Innovates new ways to leverage multiple large datasets to drive revenues via the development of new products with the Data Strategy team, as well as the enhanced delivery of existing products. Consumes data from a variety of sources (relational DBs, APIs, NetApp and other cloud storage, FTPs) & formats (Excel, CSV, XML, parquet, unstructured). Constructs and maintains data pipelines between internal/external sources and the data lake utilizing modern ETL frameworks. Owns the role of data steward for a variety of high value datasets and implement innovative quality assurance practices, including automated validation with frameworks like dbt or Great Expectations. Establishes and implements metadata management standards and capabilities, including lineage mapping. Enforces strong development standards across the team through code reviews, unit/integration testing, and monitoring. Performs basic exploratory data analysis to create & validate requirements for data pipelines. Evangelizes data engineering techniques and best practices throughout the company. Keeps up to date on the latest trends and innovation in data technology and how these trends apply to GC's business and data strategy.