Job Summary:
Sun Communities & Sun Outdoors is seeking a Senior Data Engineer to build and maintain a modern enterprise data lake and data warehouse on their Azure data platform. This role involves establishing data governance best practices and collaborating with business leadership to ensure the data platform meets organizational needs.
Responsibilities:
• Builds and maintains Azure data platform for Sun including enterprise data lake and data warehouse in alignment with Sun's strategic objectives and organizational goals (Essential)
• Incorporates Azure data platform best practices into Sun's Azure data platform (Essential)
• Develops policies and implements mechanisms for data ingestion into Azure data platform from various sources (Essential)
• Supports & mentors the data team on best practices & methodologies (Essential)
• Leads navigating challenging or technical situations to find best business outcomes (Essential)
• Works with Microsoft support to ensure an ongoing stable data system.
• Configures, validates, and implements various Azure tools such as but not limited to Databricks, Data Factory, Data Lake, Synapse Analytics and Data Catalog as appropriate
• Works with the Manager, Data Architecture to define and implement robust data governance, certification, and management policies and mechanisms
• Converts functional requirements into technical specifications; creates technical documentation as needed
• Develops and maintains relationships with vendors
• Assists in maintaining business documentation for the data and data structure in the data warehouse
• Other duties as assigned
• Configures APIs for data extraction
• Creates and organizes Data Lake and Azure Synapse serverless objects to optimize performance
• Actively collaborates with the business intelligence team, business teams, project teams, and others to understand data requirements, integration needs, constraints, and performance requirements
Qualifications:
Required:
• Bachelor's Degree in Computer or Data Science, Data Analytics, Statistics, or Information Management
• 3 years in experience designing and building enterprise data lake
• 5 years in experience designing and building an enterprise data warehouse
• 5 years of experience in modern data platforms based on Azure including but not limited to Azure Data Lake, Azure Data Factory, Azure Databricks, Synapse Analytics
• Proficient in creating data factory pipelines; copy activity, custom Azure development, custom databricks development
• Experience with ELT and ETL processes
• Advanced SQL experience and organizing database for query performance
• Experience with one or more object-oriented programming languages such as Python, C#, Java or JavaScript
• Ability to effectively manage multiple and competing priorities in a dynamic and fast-paced environment
• Exceptional organizational skills
• Strong attention to detail
• Ability to work well with others inside as well as outside the organization
• Excellent verbal and written communication skills
Preferred:
• Experience using big data file formats and compression techniques
• Experience with CI/CD processes and Azure DevOps
Company:
Sun Communities & Sun Outdoors are the nation's premier provider of manufactured home communities and RV resorts. Founded in 1975, the company is headquartered in Southfield, MI, US, , with a team of 1001-5000 employees. The company is currently Late Stage.