1

Azure Data Platform Engineer Jobs in Pennsylvania

Data Engineer - Databricks

Pittsburgh, PA · On-site

$111K - $133K/yr

Seeking an experienced Data Engineer to join a high-performing data engineering team responsible for building modern, cloud-native data platforms on Microsoft Azure. * This role will focus on ...

Data Engineer - Databricks

Pittsburgh, PA · On-site

$107K - $128K/yr

Seeking an experienced Data Engineer to join a high-performing data engineering team responsible for building modern, cloud-native data platforms on Microsoft Azure. * This role will focus on ...

Data & AI Platform Engineer

Philadelphia, PA

$115K - $138K/yr

Minimum 2 years in a data engineering, platform engineering, analytics engineering, or cloud ... Any relevant certs (Azure fundamentals, Snowflake, Databricks, etc) * Demonstrated experience with ...

AVP, Lead Data Engineer

Philadelphia, PA

$115K - $138K/yr

By joining Chubb as Lead Data Engineer for our North America Finance & Actuarial data platform, you ... data platforms including Azure (Synapse Analytics, Azure Data Factory, Azure Databricks) and ...

AVP, Lead Data Engineer

Philadelphia, PA

$109K - $131K/yr

By joining Chubb as Lead Data Engineer for our North America Finance & Actuarial data platform, you ... data platforms including Azure (Synapse Analytics, Azure Data Factory, Azure Databricks) and ...

Showing results 21-40

Azure Data Platform Engineer information

What is an Azure Data Platform Engineer?

An Azure Data Platform Engineer is a technology professional who specializes in designing, building, and managing data solutions on Microsoft Azure. They work with services such as Azure SQL Database, Azure Data Factory, Azure Synapse Analytics, and other cloud-based data technologies to ensure efficient data storage, processing, integration, and analytics. Their role often involves implementing data pipelines, managing data security, optimizing performance, and supporting data-driven decision-making for organizations. Azure Data Platform Engineers typically collaborate with data scientists, analysts, and software developers to deliver robust and scalable data solutions.

What are the key skills and qualifications needed to thrive as an Azure Data Platform Engineer?

To thrive as an Azure Data Platform Engineer, you need expertise in data modeling, SQL, cloud architecture, and a strong understanding of Microsoft Azure services, typically supported by a degree in computer science or related fields. Familiarity with Azure Data Factory, Azure SQL Database, Databricks, and certifications like Microsoft Certified: Azure Data Engineer Associate are valuable. Strong analytical thinking, problem-solving skills, and effective communication set top performers apart in this role. These skills ensure the efficient design, deployment, and management of robust data solutions that support business intelligence and analytics needs.

What are some common challenges Azure Data Platform Engineers face when integrating data from multiple sources?

Azure Data Platform Engineers often encounter challenges when consolidating data from diverse sources, such as differing data formats, inconsistent data quality, and varying update frequencies. Addressing these issues typically involves designing robust data pipelines using Azure Data Factory or Synapse, implementing effective data transformation and cleansing routines, and ensuring secure, compliant data movement. Collaborating closely with data architects and business analysts is essential to align technical solutions with organizational data governance and integration requirements.

What is the difference between Azure Data Platform Engineer vs Data Engineer?

AspectAzure Data Platform EngineerData Engineer
CertificationsAzure certifications (e.g., DP-203)General data engineering certifications (e.g., Google Cloud, AWS)
Work EnvironmentPrimarily cloud-based, Azure ecosystemOn-premises, cloud, or hybrid environments
Industry UsageOrganizations using Microsoft AzureVarious industries, broader data infrastructure roles
FocusDesigning, implementing, and managing Azure data solutionsBuilding and maintaining data pipelines and architectures

The Azure Data Platform Engineer specializes in Azure cloud data solutions, while the Data Engineer has a broader scope across different platforms and environments. Both roles require strong data management skills, but the Azure Data Platform Engineer focuses specifically on Azure services and certifications.

What are popular job titles related to Azure Data Platform Engineer jobs in Pennsylvania?

For Azure Data Platform Engineer jobs in Pennsylvania, the most frequently searched job titles are:

What job categories do people searching Azure Data Platform Engineer jobs in Pennsylvania look for?

The top searched job categories for Azure Data Platform Engineer jobs in Pennsylvania are:

What cities in Pennsylvania are hiring for Azure Data Platform Engineer jobs?

Cities in Pennsylvania with the most Azure Data Platform Engineer job openings:

Data Engineer - Databricks

System One Holdings, LLC

Pittsburgh, PA • On-site

$120K/yr

Full-time, Contractor

Posted 28 days ago


Job description

Data Engineer - Azure Databricks
Contract-to-Hire
Pittsburgh, PA - Onsite

Job ID J0726-0569
Visa : USC, GC, EAD (No Sponsorship)
Position Overview
  • Seeking an experienced Data Engineer to join a high-performing data engineering team responsible for building modern, cloud-native data platforms on Microsoft Azure.
  • This role will focus on designing and implementing scalable, secure, and high-performance data solutions using Azure Databricks, Apache Spark, PySpark, SQL, Delta Lake, and Unity Catalog. The position requires strong expertise in enterprise data governance, metadata management, security, and access control within the Investment Banking, Securities, or Capital Markets domain.
  • The ideal candidate is passionate about cloud data engineering, enjoys solving complex data challenges, and thrives in a collaborative Agile environment.

Required Competencies
Competency
Importance
Proficiency Level
  • Apache Spark
  • Required
  • Expert
  • Microsoft Azure
  • Required
  • Advanced
  • Investment Banking and Securities
  • Required
  • Advanced
  • Structured Query Language - SQL
  • Required
  • Expert
  • Unity Catalog
  • Required
  • Advanced
  • Databricks
  • Required
  • Expert

Key Responsibilities
  • Design, develop, and maintain scalable data pipelines using Azure Databricks.
  • Build and optimize ETL and ELT workflows using PySpark, SQL, Apache Spark, and Delta Lake.
  • Implement and manage Unity Catalog for enterprise data governance, metadata management, security, and fine-grained access control.
  • Develop cloud-native data engineering solutions on the Microsoft Azure platform.
  • Collaborate with architects, business analysts, and cross-functional teams to translate business requirements into technical solutions.
  • Optimize Spark jobs and data pipelines for performance, scalability, and cost efficiency.
  • Ensure data quality, reliability, governance, and regulatory compliance through validation, monitoring, and engineering best practices.
  • Support production deployments, troubleshooting, root-cause analysis, and performance tuning.
  • Participate in code reviews, technical documentation, and continuous improvement initiatives.
  • Apply cloud data engineering, security, CI/CD, and DevOps best practices within Azure environments.

Required Qualifications
  • 8+ years of overall data engineering or related technology experience preferred.
  • Minimum 5 years of hands-on Azure Databricks experience.
  • Mandatory hands-on experience implementing and managing Unity Catalog.
  • Expert-level experience with Apache Spark, PySpark, and SQL.
  • Strong experience developing enterprise-scale data engineering solutions on Microsoft Azure.
  • Strong experience with Delta Lake, ETL/ELT development, and data pipeline implementation.
  • Experience with Azure Data Factory and Azure Data Lake Storage Gen2.
  • Strong knowledge of the Microsoft Azure data ecosystem.
  • Strong understanding of data governance, metadata management, data security, and access control.
  • Mandatory experience within Investment Banking, Securities, or Capital Markets.
  • Experience using Git and implementing CI/CD practices.
  • Experience working in Agile/Scrum delivery environments.
  • Excellent analytical, communication, and problem-solving skills.
  • Must be willing to work onsite in Pittsburgh, PA.
  • Must be willing and eligible to convert to full-time employment after six months.

Preferred Qualifications
  • Databricks Certified Data Engineer Associate or Professional certification.
  • Microsoft Certified Azure Data Engineer Associate, DP-203.
  • Experience with Infrastructure as Code using Terraform or Bicep.
  • Experience implementing DevOps practices for Azure Databricks environments.
  • Familiarity with Microsoft Purview or Azure Purview.

#M1
#DI-CB2
#L1 - KB1
Ref: #404-IT Pittsburgh

System One logo

About System One

Sourced by ZipRecruiter

System One helps employers get work done more efficiently and economically without compromising quality. Over our 35+ year history, we've helped connect thousands of talented people with innovative companies. The excitement of a perfect fit motivates us every single day.

Industry

Business consulting services and recruiting and staffing services

Company size

5,001 - 10,000 Employees

Headquarters location

Pittsburgh, PA, US