ZipRecruiter

Log In

Senior Azure Data Engineer

Senior Azure Data Engineer

DATAMAXIS

Springfield, IL • On-site, Remote

$113.50K - $136.30K/yr

Contractor

Posted 7 days ago

Job description

Job Summary: We are seeking a Senior Azure Data Engineer to help design, build, and operate our next-generation enterprise data platform on Microsoft Azure. You will own end-to-end delivery of data pipelines and data products that power analytics, regulatory reporting, operational dashboards, and emerging AI/ML use cases. You will partner closely with data architects, analytics engineers, data scientists, business stakeholders, and platform engineering teams to deliver reliable, performance, secure, and costefficient data solutions.
This role is ideal for an engineer with strong hands-on depth in Azure Data Factory, Azure Synapse Analytics and/or Databricks, and modern Lakehouse patterns, who is comfortable leading migration programs (e.g., Informatica-to-ADF, on-prem warehouse-to-cloud), mentoring mid-level engineers, and shaping engineering standards across the team.
Key Responsibilities:
Pipeline Design & Development
  • Design and build robust, reusable, parameter-driven ingestion and transformation pipeline using Azure Data Factory, Synapse Pipelines, Data Bricks and/or Microsoft Fabric Data Factory.
  • Implement medallion architecture (Bronze / Silver / Gold) on Azure Data Lake Storage Gen2 using Delta Lake, Parquet, and structured streaming patterns.
  • Build performant ELT workflows that leverage pushdown to source systems (Synapse Dedicated SQL Pool, Azure SQL, Teradata) where appropriate.
  • Develop and optimize PySpark notebooks and jobs on Azure Databricks or Synapse Spark.

Data Modeling & Warehousing
  • Design dimensional models (Kimball star/snowflake) and data vault patterns for analytics consumption.
  • Implement Slowly Changing Dimensions (Type 1/2/3), Change Data Capture, and late-arriving data patterns.
  • Tune distributed SQL workloads in Synapse Dedicated SQL Pool / Fabric Warehouse, including distribution keys, partitioning, and clustered column store indexes.

Platform Engineering & DevOps
  • Implement CI/CD for data pipelines using Azure DevOps (YAML pipelines, ARM/Bicep/Terraform) across Dev / SIT / UAT / Prod environments.
  • Instrument pipelines with robust logging, auditing, and monitoring using Azure Monitor, Log Analytics, and KQL.
  • Define and enforce coding standards, code review practices, branching strategies, and release management.

Migration & Modernization
  • Lead or contribute to legacy-to-cloud migrations - e.g., Informatica PowerCenter to Azure Data Factory, on-premises Teradata / Oracle / SQL Server to Synapse or Fabric.
  • Perform workload assessment, capacity planning, and cost modeling for target-state architectures.
  • Production incident response for critical pipelines.

Required Qualifications:
  • Deep hands-on expertise with Azure Data Factory: pipelines, datasets, linked services, triggers, parameterization, mapping data flows, and all three Integration Runtime types (Azure, Self hosted, SSIS).
  • Strong Experience in Data Bricks and PySpark.
  • Production experience with one or more of: Azure Synapse Analytics (Dedicated and Serverless SQL Pools, Spark Pools) OR Azure Databricks (Delta Lake, Unity Catalog) OR Microsoft Fabric (Warehouse, Lakehouse, OneLake).
  • Strong working knowledge of Azure Data Lake Storage Gen2 (hierarchical namespace, RBAC + ACLs, lifecycle management, security).
  • Experience with Azure Key Vault, Azure AD / Entra ID (including managed identities and service principals), and private networking (VNet integration, private endpoints).
  • Monitoring and troubleshooting with Azure Monitor, Log Analytics, and KQL.
  • Advanced SQL - window functions, CTEs, query optimization, execution plan analysis, performance tuning.
  • Strong Python for data engineering - pandas, PySpark, REST API integration, unit testing (pytest).
  • Proficient in T-SQL; familiarity with Spark SQL, KQL, PowerShell, and Bash shell scripting.

Preferred Qualifications:
  • 5+ years of data warehouse development experience.
  • 5+ years of data modeling experience using ERWIN or similar tools.
  • 2+ years of experience with Azure Data Factory and Snowflake.
  • Medicaid Domain Knowledge is a plus.
DATAMAXIS logo

About DATAMAXIS

Sourced by ZipRecruiter

Datamaxis is passionate about making our clients win. As a trusted partner, we will bring innovative solutions, technical expertise in Data, cyber security analytics, strategic staffing and AI/ML to help create value (ROI) for our clients, stay competitive and operationally efficient.

Industry

It services

Company size

51 - 200 Employees

Headquarters location

Reston, VA, US

Year founded

2003

View All DATAMAXIS Jobs

Apply

Most Popular Jobs Similar to Data Software Engineer

Other Helpful Pages Related To Senior Azure Data Engineer

Frequently asked questions

Q: What skills or qualities help someone succeed as a Data Software Engineer?

A: To succeed as a Data Software Engineer, key technical skills include proficiency in programming languages such as Python, Java, or C++, as well as expertise in data structures, algorithms, and software development methodologies like Agile. Additionally, strong soft skills like effective communication, problem-solving, and collaboration are crucial, as Data Software Engineers often work with cross-functional teams and stakeholders to design, develop, and deploy data-driven solutions. By combining technical expertise with strong soft skills, Data Software Engineers can effectively drive business outcomes, innovate, and adapt to the rapidly evolving landscape of data technology.

Q: What is the career path for a Data Software Engineer?

A: A Data Software Engineer's typical career progression involves starting as a Junior Software Engineer, where they focus on developing and maintaining data-driven software applications, and gradually advancing to roles such as Senior Software Engineer, Technical Lead, or Data Architect, where they oversee large-scale data systems and lead cross-functional teams. Key opportunities for skill development include learning programming languages like Python, SQL, and Java, as well as data science tools like Hadoop, Spark, and machine learning frameworks like TensorFlow and PyTorch. Long-term, Data Software Engineers may pursue leadership roles, such as Director of Engineering or Chief Technology Officer, or transition into related fields like data science, product management, or entrepreneurship.

All JobsData Software Engineer Jobs
DATAMAXIS job posting for a Senior Azure Data Engineer in Springfield, IL with a salary of $113,500 to $136,300 Annually with a map of Springfield location.