We are leveraging cutting-edge technology to deliver superior data-driven solutions. We value innovation, collaboration, and excellence, and we are seeking a skilled Data Engineer to join our dynamic team to optimize and innovate our data infrastructure within the Snowflake ecosystem.
Position Summary:
As a Data Engineer, you will design, implement, and manage scalable, high-performance data solutions tailored to the needs of the financial services environment. You will be instrumental in migrating traditional relational data domains to a modern cloud data platform using Snowflake, ensuring data integrity, optimizing workflows, and integrating data governance and science tools. Your expertise will enable us to maintain a robust, cost-effective, and secure data environment.
Key Responsibilities:
- Design, develop, and manage scalable data storage and processing solutions within the Snowflake environment optimized for financial data workloads.
- Lead the migration of existing data domains and flows from relational data stores to Snowflake, ensuring seamless transitions with minimal disruption.
- Identify, analyze, and optimize new and existing data workflows to improve performance and reliability.
- Implement and enforce data integrity best practices to ensure accuracy, consistency, and security of data assets.
- Collaborate with data governance and data science teams to integrate relevant tools and frameworks within the Snowflake ecosystem following organizational standards.
- Support development and maintenance of data models and ETL/ELT processes to guarantee high-quality data ingestion into the cloud data store.
- Work closely with cross-functional teams to design and implement effective data workflows, transformations, and pipelines aligned with business goals.
- Assist in the ongoing maintenance and optimization of Snowflake environments focusing on performance tuning and cost reduction strategies.
- Contribute to the development of proof of concepts, detailed documentation, and best practice guides governing data management and Snowflake usage.
- Participate actively in code reviews, providing constructive feedback aimed at improving code quality and team collaboration.
- Design and develop data ingestion pipelines using Talend or Informatica, applying industry best practices for security and efficiency.
- Develop and maintain efficient SQL queries and Python scripts to analyze large datasets and automate end-to-end data workflows on scheduled intervals.
- Design and implement data distribution layers leveraging Snowflake REST APIs to support various downstream applications and analytics platforms.
Required Qualifications:
- Bachelor's or Master's degree in Computer Science, Information Systems, Engineering, or a related technical field.
- Proven experience (3+ years preferred) as a Data Engineer or similar role in Financial Services or a similarly regulated, data-intensive industry.
- Strong expertise with Snowflake architecture, features, and best practices in cloud data warehousing and processing.
- Hands-on experience migrating data workflows from traditional relational databases to Snowflake or other cloud-native platforms.
- Proficiency in building and optimizing ETL/ELT pipelines using tools such as Talend and/or Informatica.
- Solid SQL and Python programming skills for data ingestion, transformation, and automation workflows.
- Familiarity with data governance principles and integration of governance/data science tools within data ecosystems.
- Experience designing REST API integrations, specifically Snowflake REST API, to enable data distribution layers.
- Knowledge of data modeling, relational and dimensional data design concepts, and data warehousing methodologies.
- Ability to work onsite in Manhattan, NY, and collaborate effectively in a fast-paced, cross-functional team environment.
- Excellent communication skills and ability to document processes and best practices clearly.
Preferred Skills:
- Experience with PowerBI or similar data analytics platforms
- Experience with financial datasets, compliance standards, and security protocols.
- Familiarity with containerization (Docker/Kubernetes) and orchestration tools for data pipelines.
- Knowledge of cloud platforms beyond Snowflake, such as AWS, Azure, or GCP.