Azure Data Engineer
- Contract: 1+ year
- Hybrid: 2-3 Days / Week
- Locations: Dallas area, TX
- Open on c2c or w2
Azure Data Engineer (Python & Azure)
We are looking for an Azure Data Engineer with strong Python development and containerization experience to build scalable, cloud-native data solutions. The ideal candidate will have expertise in Azure services, ETL pipeline development, automation, and data governance.
Key Responsibilities
- Develop Python-based ETL pipelines integrating data from APIs, JDBC/ODBC, and batch sources.
- Build and manage Apache Airflow DAGs using reusable, modular frameworks.
- Design and deploy containerized solutions with Docker and AKS.
- Work with Azure SQL Managed Instance to manage metadata, classifications, and access controls.
- Implement data governance using Microsoft Purview for cataloging, tagging, and lineage.
- Configure Azure services including Blob Storage, Key Vault, Azure Monitor, Functions, and AKS.
- Develop CI/CD pipelines using Azure DevOps.
- Enforce security through service accounts, least-privilege access, and data masking policies.
- Analyze audit logs and develop reporting for usage and compliance monitoring.
- Create reusable code, documentation, and automation standards.
Required Qualifications
- 5+ years of Data Engineering experience with strong Python development skills.
- Hands-on experience with:
- Python, ETL development, logging, and error handling
- SQL development and performance tuning
- Azure services (AKS, Blob Storage, Key Vault, Azure Monitor, Service Principals, Azure Functions)
- REST APIs and multi-source data ingestion
- Docker and container lifecycle management
- Service account management and data security
- Terraform, Git, and CI/CD best practices
- Data governance, PII/PCI classification, and compliance standards (SOX, GDPR, etc.)
Preferred Skills
- Microsoft Purview for data cataloging and classification.
- Power BI data lineage and report-level security experience.
- AI enthusiast.