Data Engineer

GENERAL JOB DESCRIPTION

The Data Engineer will plan, coordinate, and supervise all activities related to the integration of data from various sources into an organized and unified view. This individual is also responsible for the monitoring of data flow between databases, business applications, and Cloud services to identify and implement the most suitable data integration architecture for the organization’s needs. Proven communication skills, problem-solving skills, and knowledge of data integration best practices are critical to successful performance in this role.

MAJOR DUTIES AND RESPONSIBILITIES

Strategy & Planning

• Lead data integration projects involving business units, data stewards, and development teams.
• Plan, execute, and manage the strategic integration of new data and data stores into existing systems and infrastructure throughout the enterprise, including migration to Cloud services as applicable.
• Ensure that integration projects meet business requirements and goals, fulfill end-user requirements, and identify and resolve systems issues.
• Ensure that integration planning and practices are aligned with strategic business goals and the company’s overall strategic vision.
• Develop standards and processes to support and facilitate integration projects and initiatives.
• Revise data architectures when required to be compatible with changing business needs and client standards so that all legal, compliance, and operational requirements, such as data sovereignty, regulatory security and privacy policies, and service level agreements are met.
• Maintain high standards of data quality through the introduction and enforcement of information handling processes and organization of the data integration processes.
• Collaborate with BI specialists to establish overarching data analytics strategy and service-oriented architecture.

Acquisition & Deployment

• Conduct research on emerging data products, languages, and standards in support of procurement, development, security, and integration efforts in relation to the Cloud, BI, and big data management.
• Manage the selection, deployment, and maintenance of any data tools, deemed appropriate for the organization.
• Collaborate with analysts, data stewards, developers, and system owners in the testing of newly incorporated databases and integration measures.
• Lead testing phase of data integration development to identify and remedy potential problem areas.
• Liaise with developers as well as the Infrastructure Team to address issues in data patterns and architecture.
• Build relationships with the Development and Infrastructure teams to gain an understanding of different data architectures and required functionality.
• Work with cross functional business partners to negotiate terms for SLAs.

Operational Management

• Ensure the collection and coherent interpretation of the various business processes affected by data integration efforts.
• Work diligently to enhance or improve business processes via integration, or, as necessary, minimize the impact of integration on those processes.
• Evaluate results of integration projects, then report and make recommendations based on findings.
• Review data quality, addressing any issues through the creation of new processes or adjustment of the data architecture.
• Measure and manage SLAs of data solutions.
• Where necessary, mentor and help teach junior members of the team.

EXPERIENCE/CREDENTIALS

• Bachelor’s degree in computer science or computer engineering.
• 3-5 years’ experience building data integrations, using ETL tools and SQL Server, required.
• Certifications in SQL Server, Azure Data Factory, Azure DevOps are a plus.
• Proven experience in overseeing the linking of cross-functional databases between disparate business units and systems.
• Experience with business and technical requirements analysis, business process modeling/mapping and methodology development, and data mapping.
• Extensive experience with data integration architectures, including Azure Data Factory.
• Technically fluent in programming languages, including python, is a plus.
• Direct, hands-on experience with data automation tools.
• Knowledge of relational database design and management techniques.
• Strong knowledge of system and software quality assurance best practices and methodologies.
• Proficient in Microsoft Office (Word, Excel, PowerPoint)

COMPETENCIES

• Good project management skills and/or substantial exposure to project-based work structures, project lifecycle models, etc.
• Strong background in risk management methodologies as they relate to integration and Cloud computing.
• Knowledge of network protocols and standards
• Maintains absolute confidentiality of client information and safeguards client and company data; maintains high ethical standard in all practices.
• Excellent oral and interpersonal communication skills.
• Outstanding writing and documentation skills.
• Ability to communicate ideas in both technical and user-friendly language.
• Able to conduct research into application integration issues and products.
• Highly self-motivated and directed, with keen attention to detail.
• Able to prioritize and execute tasks in a high-pressure environment.
• Experience working in a team-oriented, collaborative environment.
• Strong understanding of end-user needs and requirements.

FEATURED BENEFITS:

• Medical Insurance
• Dental Insurance
• Vision Insurance
• 401(k)
• Health Savings Account
• Paid Maternity Leave
• Paid Parental Leave
• Tuition Reimbursement