Job Title: Azure Hyperscale SQL & Databricks Engineer
Location: Weehawken, NJ (onsite)
Duration: 12 months
Job Type: W2 contract
We are seeking an experienced
Azure Hyperscale SQL & Databricks Engineer to join our Cloud Data Engineering team in Weehawken, NJ.
In this role, you will design, build, and optimize large-scale data solutions on
Microsoft Azure, with a focus on
Azure SQL Hyperscale, Databricks, and PySpark.
You will collaborate with data scientists, analysts, and other engineers to deliver high-performance, secure, and scalable data platforms that drive business insights and decision-making
Required Skills & Experience
Design & Development:
Architect, deploy, and manage Azure SQL Hyperscale databases for high availability and performance.
Develop and optimize Databricks workflows (PySpark, Delta Lake) for large-scale data processing and analytics.
Implement data pipelines (ETL/ELT) using Azure Data Factory, Synapse Analytics, and Databricks.
Automate infrastructure deployment using Terraform, ARM templates, or Bicep.
Performance & Optimization:
Tune SQL queries, indexing strategies, and partitioning for Azure SQL Hyperscale.
Optimize Spark jobs (Databricks) for efficiency and cost-effectiveness.
Monitor and troubleshoot performance bottlenecks in data pipelines.
Security & Compliance:
Implement RBAC, encryption, and data masking in Azure and Databricks.
Ensure compliance with UBS data governance and regulatory policies.
Collaboration & Leadership:
Work with data scientists, analysts, and business stakeholders to translate requirements into scalable solutions.
Mentor junior engineers and promote best practices in cloud data engineering.
5+ years of hands-on experience with Azure data services (SQL Hyperscale, Databricks, Synapse, Data Factory).
Strong expertise in SQL, PySpark, and Python for data processing.
Preferred QualificationsAzure certifications (e.g., Azure Data Engineer, Azure Solutions Architect).
Experience in financial services or regulated industries.
Familiarity with machine learning workflows in Databricks
- Experience with big data architectures (Delta Lake, Parquet, distributed computing).
Proficiency in IaC tools (Terraform, ARM/Bicep) and CI/CD (Azure DevOps).
Knowledge of data security, networking, and compliance in financial services.
Bachelor’s or Master’s degree in Computer Science, Engineering, or related field.