Lead Data Engineer
We are seeking a skilled Data Engineering Lead to oversee technical data projects and develop efficient data pipelines within the organization. This role is essential for optimizing data architecture to meet the needs of cross-functional teams, ensuring rapid data ingestion into global platforms while upholding data integrity and accessibility. The successful candidate will collaborate with stakeholders to promote data-driven decision-making and enhance data initiatives. As a subject matter expert, the Data Engineering Lead will mentor team members at all levels, fostering their development and ensuring adherence to best practices in data engineering.
Responsibilities
- Lead technical data engineering projects, ensuring rapid data ingestion into regional and global platforms.
- Guide the development, testing, and maintenance of large-scale data pipelines while adhering to best practices and quality standards.
- Support software developers, database architects, data analysts, and data scientists in enhancing data accessibility and usability.
- Maintain consistency in data delivery architecture across projects by following established reference architecture.
- Recommend and implement optimized data pipeline architectures for cross-functional teams.
- Design and deploy data flow processes that meet the needs of various systems and products.
- Assemble complex data sets to meet business requirements and support strategic initiatives.
- Identify and implement internal process improvements for data reliability, efficiency, and quality.
- Mentor team members to foster development and ensure adherence to data engineering best practices.
- Collaborate with the data analytics community to integrate new data sources and develop operational procedures with operations teams.
Required Education and Experience
- Undergraduate Degree in Computer Science, Logistics, Mathematics, Statistics, or related field
- 3+ years of experience in data engineering or equivalent role
- Strong understanding of SQL and database management systems (e.g., MySQL, PostgreSQL, SQL Server).
- Proven experience in data pipeline development and management in Azure environments.
- Proficient with Azure Data Factory, Azure Databricks, or Azure Synapse Analytics.
- Familiar with data warehousing solutions and large datasets.
- Proficient in programming languages such as Python, Java, or Scala.
- Knowledge of data modeling, ETL processes, and data warehousing concepts in Azure.
- Experience with data visualization tools (e.g., Power BI).
- Understanding of data governance and quality principles.
- Experience leading data initiatives.
- Ability to mentor and support data engineers and guide project direction.
- Knowledge of machine learning concepts and tools for advanced analytics.
- Understanding of containerization and orchestration technologies (e.g., Docker, Kubernetes).
Our Organization has a business casual environment and focuses on teamwork, associate development, training, and continuous improvement. We offer competitive wages, excellent affordable insurance benefits (including health, dental, vision and life), 401K plan, paid vacation and holidays.
Our Organization is an equal opportunity employer.
