Title: Azure Datalake Engineer
Desired Start Date: 2/9
Duration: 12 months or longer
Workplace: Remote
Visa: USC/GC/GC-EAD
Location: Houston, TX
Client: Fujitsu
Managing Technical Consultant Job Description:
The Azure Data Lake Engineer is responsible for designing, building, and maintaining scalable data ingestion, storage, and processing solutions on Microsoft Azure, primarily using Azure Data Lake Storage (ADLS), Azure Data Factory, and related services.
ย
Top 3 Must Skills
1.ย ย ย ย ย ย ย ย ย ย ย ย ย ย ย ย ย ย ย 12+ years hands-on experience building scalable ETL/ELT pipelines using Azure Data Factory (mapping data flows, pipelines, triggers)& Synapse pipelines.
2.ย ย ย ย ย ย ย ย ย ย ย ย ย ย ย ย ย ย ย Experience building data ingestion frameworks, data validation workflows, and orchestration logic.
3.ย ย ย ย ย ย ย ย ย ย ย ย ย ย ย ย ย ย ย Integrate SAP ECC/S4 data into Azure Data Lake using ADF/Synapse pipelines for batch & delta loads.
ย
Requirements
ยทStrong Expertise in DATA Azure data lake Azure Databricks, Azure SQL, Power BI
ยทExpertise to Implementing Data warehousing Solutions experience as Data Engineer in Azure Big Data Environment
ยทProgramming experience in Scala or Python, SQL Hands-on experience in Azure stack (Azure Data Lake, Azure Data Factory, Azure Databricks)
ยทKnowledge in PowerBI and Good understanding of other Azure services like Azure Data Lake Analytics & U-SQL, Azure SQL DW
ยทGood understanding of Azure Databricks platform and can build data analytics solutions to support the required performance Scale
ยทProficient in a source code control system such as GIT
ยทGood knowledge or hands-on of DBT tool
ยทExcellent communication skills
ยทAbility to conduct data profiling, cataloguing, and mapping for technical design and construction of technical data flows
ยทExperience with different database technologies (e.g., SQL database(s), NoSQL such as Hadoop, MongoDB, Redis, etc.
ยทExperience with exposing data to end-users via Power BI, Azure API Apps.
ยทKnowledge ofย Azure Data & Analytics PaaS Services: Azure Data Factory, Azure Data Lake, Azure Synapse Analytics, Azure Databricks, Azure IoT, Azure HDInsight Spark, Azure Cosmos DB, Azure Databricks, Azure Stream Analytics and Azure SQL DB
ยทKnowledge of Lambda and Kappa architecture patterns and Mastery of SQL
ยทExperience in turning business use cases and requirements into technical solutions
ยทExperience in business processing mapping of data and analytics solutions
ยทExperience in technology solutions, practice development, architecture, consulting, and/or cloud/infrastructure technologies
ยทExperience driving knowledge transfer and/or training programs
ยทExperience with agile delivery methodologies, proof of concepts and prototyping
ยทExperience with Azure ARM templates, PowerShell and CI/CD using Azure DevOp
ยทKnowledge ofย Master Data Management (MDM)ย and Data Quality tools
ยทExperience in managing teams, being a technical coach
ยทExperience with preparing data for Data Science and Machine Learning purposes
Experience with Azure data, Machine Learning and Artificial Intelligence solutions