The Data Engineer is responsible for designing, developing, and optimizing data pipelines, data modeling, and platform management to support seamless integration and operation of data systems. The incumbent will maintain the data warehouse, generate complex reports, and perform in-depth data analysis, while actively contributing to Agile team activities. This position will proactively collaborate with the Data Engineering Team, IT staff, other enterprise stakeholders and agency employees.
The Data Engineer Senior is responsible for designing, developing, architecting, and enhancing data platforms and pipelines, ensuring robust data models and system integrations for enterprise operations. The incumbent will oversee advanced data warehouse maintenance, drive strategic data initiatives, and perform comprehensive analysis while actively contributing to Agile team activities. This position will proactively collaborate with the Data Engineering Team, IT staff, other enterprise stakeholders, and agency employees.
In addition to the above, the Data Engineer will have expertise in DevOps principle and experience in CI/CD, Azure services, Kubernetes, and scripting skills (SQL, Python, PowerShell), along with testing automation. Terraform knowledge and Azure certifications are preferred.
ย
WHAT WILL YOU DO
Data Engineering
Develop and manage data platforms.
Design and implement ETL processes and perform basic data lake management.
Implement and manage CI/CD pipelines with intermediate proficiency.
Create and maintain basic data models to ensure structured data storage and accessibility.
Manage data catalogs to maintain an organized and easily accessible repository of data resources.
Develop and maintain data warehouses.
Perform administrative tasks and assist in basic system administration duties, contributing to the overall management and upkeep of data systems.
Manage data permission, ensuring proper access control and data security.
Contribute to the maintenance and optimization of the data warehouse, ensuring data integrity and availability.
Develop data-driven applications, contributing to the creation of data solutions that support business needs.
Conduct data analysis and assist in larger data analysis projects, providing insights and support to business stakeholders.
Engage in scrum activities and actively participate in Agile methodologies.
Generate reports using reporting tools, and provide support in more advanced reporting tasks as required.
Collaborate with stakeholders to gather requirements and contribute to defining project scopes and objectives.
Develop visually appealing and intuitive dashboards that provide visibility into key performance, risk, and control indicators across agency divisions and departments.
Performs related work as assigned.ย
Data Engineering Seniorย ย
Develop and manage data platforms.
Design and maintain ETL processes and perform advanced data lake management.
Oversee and manage the implementation of CI/CD pipelines utilizing advanced DevOps practices.
Create and maintain advanced data models to ensure structured data storage and accessibility.
Enhance data catalogs to maintain an organized and easily accessible repository of data resources.
Enhance the efficiency of data warehouses and oversee complex warehousing.
Optimize system performance and manage complex systems, improving ease of management and reliability of systems.
Maintain complex data permissions, ensuring proper access control and data security.
Improve the maintenance and optimization of data warehouses, ensuring data integrity and availability.
Develop data-driven applications, contributing to the creation of data solutions that support business needs.
Conduct advanced data analysis and lead larger data analysis projects, providing insights and support to business stakeholders.
Lead scrum activities, ensuring team adherence to Agile practices.
Automate reports using reporting tools and provide support for more advanced reporting tasks as required.
Partner with stakeholders to align data strategies with business goals.
Develop visually appealing and intuitive dashboards that provide visibility into key performance, risk, and control indicators across agency divisions and departments.
Performs related work as assigned.ย