Job Summary:
PitchBook, a Morningstar company, is seeking a Sr. Data Engineer to join their Product and Engineering team. The role involves building unified data technologies, designing and maintaining database structures, and mentoring less experienced engineers while contributing to a culture of curiosity and collaboration.
Responsibilities:
• Expert at building unified data technologies to support advanced and automated business analytics
• Design, develop, document, and maintain database and reporting structures used to compile insights
• Define, develop, and review extract, load, and transform (ELT) processes and data modeling solutions
• Consistently evolve data processes and techniques following industry best practices
• Establish and help define reports and dashboards used to translate business data into insights, identify and prioritize operational improvement opportunities, and measure business KPIs against objectives
• Contribute to the ongoing improvement of quality assurance standards and procedures
• Mentor and guide less experienced data engineers, contributing to their professional development
• Stay updated with the latest data engineering technologies and trends and share your insights with the team
• Support the vision and values of the company through role modeling and encouraging desired behaviors
• Participate in various company initiatives and projects as requested
Qualifications:
Required:
• Bachelor's degree in a related field (Computer Science, Engineering, etc.)
• 5+ years of experience in data engineering roles, including creating and maintaining data pipelines, data modeling, and data architecture
• 5+ years of experience in data cleansing, governance, and quality/integrity
• 5+ years of experience in advanced SQL, including expert-level skills in querying large datasets from multiple sources and developing automated reporting
• 5+ years of experience in Python, with skills for diverse components of data pipelines, including scripting, data manipulation, custom extract, transform and loads, and statistical/regression analysis
• Expertise in extract, transform, and load (ETL) and extract, load, transform (ELT) processes and pipelines, platforms (e.g. Airflow), and distributed messaging (e.g. Kafka)
• Experience with tools that capture and control data modeling change management (e.g. SQLMesh)
• Experience building data alerting & notifications (e.g. on deviations, thresholds, etc.)
• Experience building and managing tools for data observability and documentation (e.g. DataLab)
• Proficient in data storage solutions, data warehousing, and cloud-based data platforms (e.g. Snowflake)
• Proficient in deploying data pipelines to a cloud-native, containerized deployment/delivery environment (e.g. Kubernetes)
• Knowledge and applicable working experience establishing and ensuring data governance, data quality, and compliance standards
• Exceptional problem-solving skills and a track record of designing and optimizing data pipelines
• Excellent communication and collaboration skills with the ability to engage with non-technical stakeholders
• Must be authorized to work in the United States without the need for visa sponsorship now or in the future
Preferred:
• Experience working with enterprise technologies (CRM, ERP, Marketing Automation Platforms, Financial Systems, etc.) is a plus
Company:
PitchBook offers financial data and tools on companies, deals, investors, and markets to support sales and business development. It is a sub-organization of Morningstar. Founded in 2007, the company is headquartered in Seattle, USA, with a team of 1001-5000 employees. The company is currently Late Stage.