Data Engineer - AWS Glue, Spark, Python, Snowflake

COMPANY: Canoe Intelligence

WEBSITE: https://canoeintelligence.com/

TITLE:  Data Engineer - AWS Glue, Spark, Python, Snowflake

LOCATION: New York City (hybrid) or Fully Remote in the United States

SALARY: $130,000 - $165,000 (based on NYC, will be adjusted for geo)

The Role:

We are seeking a highly skilled Data Engineer to join our dynamic team. The ideal candidate will have extensive experience with AWS Glue, Spark, Python, and Snowflake, with a strong background in data engineering, ETL processes, and data warehousing.

What You’ll Do:

• Design, develop, and maintain ETL processes using AWS Glue for extracting, transforming, and loading data from various sources into our data lake and data warehouse.
  
• Collaborate with cross-functional teams to understand data requirements, identify data sources, and implement solutions for data ingestion and integration.
  
• Optimize and tune ETL workflows for performance, scalability, and reliability.
  
• Develop custom transformations and data pipelines using Spark and Python as needed.
  
• Ensure data quality and integrity throughout the ETL process, implementing appropriate error handling and monitoring mechanisms.
  
• Implement and enforce data governance policies and procedures within the data warehouse, ensuring compliance with regulatory requirements and industry best practices.
  
• Work closely with data architects and analysts to design and implement data models, schemas, and structures in Snowflake, with a focus on data governance principles such as data lineage, data quality monitoring, and metadata management.
  
• Collaborate with stakeholders to define and document data governance standards, processes, and guidelines, and facilitate training and awareness programs as needed.
  
• Continuously evaluate and implement best practices, tools, and technologies to improve data governance practices and ensure data security, privacy, and confidentiality.
  
  

What We’re Looking For:

• Bachelor's degree in Computer Science, Engineering, or related field; or equivalent work experience.
  
• Proven experience working as a Data Engineer with a focus on ETL processes, data integration, and data warehousing.
  
• Extensive hands-on experience with AWS Glue and Python. Strongly preferred experience with Spark and Snowflake.
  
• Strong understanding of cloud-based data technologies and services, particularly within the AWS ecosystem.
  
• Solid understanding of relational database concepts and experience with SQL.
  
• Excellent problem-solving skills with a strong attention to detail.
  
• Ability to communicate effectively and collaborate with cross-functional teams.
  
• Proactive attitude with a willingness to learn and adapt to new technologies and methodologies.

What You’ll Get:

• Medical, dental, vision benefits
  
• Flexible PTO
  
• 401(k)
  
• Flexible work from home policy
  
• Home office stipend + wifi reimbursement
  
• Employee Assistance Program
  
• Gym reimbursement
  
• Education assistance
  
• Parental Leave
  
• Commuter benefits
  
  

Our Values:

• Client First —> Listen, and deliver client-centric solutions
• Be An Owner —> Take initiative, improve situations, drive positive outcomes
• Excellence —> Always set the highest standard for yourself and others
• Win Together —> 1 + 1 = 3

Who We Are:

Canoe is reimagining alternative investment data processes for hundreds of leading institutional investors, capital allocators, asset servicing firms and wealth managers. By combining industry expertise with the most sophisticated data capture technologies, Canoe’s technology automates the highly-frustrating, time-consuming, and costly manual workflows related to alternative investment document and data management, extraction and delivery. With Canoe, clients can refocus capital and human resources on business performance and growth, increase efficiency, and gain deeper access to their data. Canoe’s AI-driven platform was developed in 2013 for Portage Partners LLC, a private investment firm.

Canoe is an equal opportunity employer. All aspects of employment including the decision to hire, promote, discipline, or discharge, will be based on merit, competence, performance, and business needs. We do not discriminate on the basis of race, color, religion, marital status, age, national origin, ancestry, physical or mental disability, medical condition, pregnancy, genetic information, gender, sexual orientation, gender identity or expression, veteran status, or any other status protected under federal, state, or local law.