divh2Data Engineer (Digital Wallet)/h2pLocation: Scottsdale AZ (hybrid) Duration: FTE C2C/ppJob Description:/ppMust have: Skillset: Java, Scala, S3, Glue, Python, AWS./pp6-8 years of IT experience focusing on enterprise data architecture and management./ppExperience in Conceptual/Logical/Physical Data Modeling expertise in Relational and Dimensional Data Modeling/ppExperience with Databricks on Prem, Structured Streaming, Delta Lake concepts, and Delta Live Tables required/ppExperience with Spark Scala and Java programming/ppData Lake concepts such as time travel and schema evolution and optimization/ppStructured Streaming and Delta Live Tables with Databricks as a bonus/ppExperience leading and architecting enterprise-wide initiatives specifically system integration, data migration, transformation, data warehouse build, data mart build, and data lakes implementation/support/ppAdvanced level understanding of streaming data pipelines and how they differ from batch systems/ppFormalize concepts of how to handle late data, defining windows, and data freshness/ppAdvanced understanding of ETL and ELT and ETL/ELT tools such as Data Migration Service etc/ppUnderstanding of concepts and implementation strategies for different incremental data loads such as tumbling window, sliding window, high watermarks, etc./ppFamiliarity and/or expertise with Great Expectations or other data quality/data validation frameworks a bonus/ppFamiliarity with concepts such as late data, defining windows, and how window definitions impact data freshness/ppAdvanced level SQL experience (Joins, Aggregation, Windowing functions, Common Table Expressions, RDBMS schema design performance optimization)/ppIndexing and partitioning strategy experience/ppDebug, troubleshoot, design, and implement solutions to complex technical issues/ppExperience with large-scale, high-performance enterprise big data application deployment and solution/ppArchitecture experience in AWS environment a bonus/ppFamiliarity working with Lambda specifically with how to push and pull data, how to use AWS tools to view data for processing massive data at scale a bonus/ppExperience with Gitlabs and CloudWatch and ability to write and maintain Gitlabs for supporting CI/CD pipelines/ppExperience working with AWS Lambdas for configuration and optimization and experience with S3/ppFamiliarity with Schema Registry, and message formats such as Avro, ORC, etc./p/div