Senior Azure Data Platform Engineer / Architect
Job Summary:
We are seeking a highly skilled Azure Data Platform Engineer / Architect to design, build, and optimize enterprise-scale data platform capabilities. The ideal candidate will have strong expertise in Azure data technologies, platform engineering, observability, CI/CD automation, reliability engineering, and enterprise data ingestion frameworks.
This role requires hands-on experience in building scalable and reusable infrastructure platforms, implementing operational excellence practices, and enabling self-service data platform capabilities for enterprise teams.
Key Responsibilities Platform Observability & Reliability Engineering
- Design and implement enterprise-grade observability frameworks covering:
- Metrics
- Monitoring
- Logging
- Alerting
- Operational dashboards
- Establish reliability engineering standards to improve platform resilience, uptime, and operational stability.
- Define platform SLAs, operational readiness standards, and incident management practices.
Platform Engineering & Infrastructure Automation
- Design and build scalable shared infrastructure platform capabilities to support enterprise data workloads.
- Develop reusable infrastructure patterns, governance guardrails, and deployment standards.
- Support scalable cloud-native platform services using Microsoft Azure technologies.
CI/CD & DevOps Enablement
- Build and maintain CI/CD frameworks for reliable and repeatable deployments.
- Implement DevOps best practices using:
- Azure DevOps
- GitHub Actions
- Infrastructure-as-Code
- Enable self-service deployment and onboarding capabilities for engineering teams.
Enterprise Data Ingestion Framework
- Design and implement enterprise-wide data ingestion frameworks supporting:
- Batch ingestion
- Near Real-Time (NRT) ingestion
- Streaming pipelines
- Ensure ingestion pipelines are:
- Scalable
- Observable
- Reusable
- Fault tolerant
AI-Driven Automation & Optimization
- Implement intelligent automation frameworks to optimize:
- Platform operations
- Monitoring
- Cost efficiency
- Performance tuning
- Identify opportunities to reduce manual operational effort using AI-driven automation capabilities.
Marketing Domain Enablement & Adoption
- Develop onboarding programs and enablement frameworks for platform consumers.
- Create documentation, templates, standards, and best practices to accelerate adoption across business domains.
- Collaborate with business and engineering teams to improve platform usability and adoption.
Required Skills & Experience Mandatory Skills
- Strong experience in:
- Platform Engineering
- Data Platform Engineering
- Infrastructure Engineering
- Hands-on expertise with:
- Azure Databricks
- Azure Synapse Analytics
- Microsoft Fabric
- Azure Data Factory
- Strong experience with:
- Azure Monitor
- Application Insights
- Log Analytics
- Experience implementing:
- CI/CD pipelines
- DevOps frameworks
- Infrastructure automation
- Expertise in enterprise data ingestion and near-real-time data pipelines.
- Strong knowledge of:
- Observability
- Reliability Engineering
- Platform Monitoring
- Operational Excellence
- Experience with:
- Cosmos DB
- PL/SQL
- MSBI technologies
- Data Modeling & Architecture
Preferred Skills
- Experience with AI-driven operational automation
- Knowledge of containerization and Kubernetes
- Experience building enterprise-scale reusable data platforms
- Strong documentation and stakeholder communication skills
- Agile/Scrum experience
Experience Required
- 5+ years of relevant experience in Azure Data Platform Engineering / Platform Engineering.