ZipRecruiter

Log In

1

Senior Databricks Data Engineer Jobs in Delaware

Bread Financial

Data Engineer

Wilmington, DE · On-site

$111.10K - $133.40K/yr

... and Sr. Data Engineer in new analytical proof of concepts and tool exploration projects ... Create efficient data pipelines using tools like Azure Data Factory, Databricks, and AWS, focusing ...

New

Dlapiper

Data Engineer

Wilmington, DE

$111.10K - $133.40K/yr

Together. Summary The Data Engineer, Solutions & Data role designs, builds, and operates data ... Data pipeline tooling and cloud data services experience (Azure Data Factory, Azure Databricks ...

Tiger Analytics Inc.

Senior Data Engineer

Wilmington, DE

$102.90K - $139.70K/yr

We are seeking Data Engineers who are passionate about marrying data with emerging technologies. Requirements * Collaborate with and across Agile teams to design, develop, test, implement, and ...

Tiger Analytics Inc.

Senior Data Engineer

Wilmington, DE · On-site

$102.90K - $139.70K/yr

We are seeking Data Engineers who are passionate about marrying data with emerging technologies. Requirements * Collaborate with and across Agile teams to design, develop, test, implement, and ...

Bridgeforce

Data Engineer

Wilmington, DE · On-site

It is not uncommon for any colleague to organize a meeting with a senior leader or give our CEO a ... Extend the data environment to support new data sources and data types, including ingestion ...

Bridgeforce

Data Engineer

Wilmington, DE

$78K - $117K/yr

It is not uncommon for any colleague to organize a meeting with a senior leader or give our CEO a ... Extend the data environment to support new data sources and data types, including ingestion ...

next page

Showing results 1-20

People also search for

All JobsDatabricks Data Engineer JobsSenior Databricks Data Engineer JobsSenior Databricks Data Engineer Jobs in Delaware

Senior Databricks Data Engineer information

What are the key skills and qualifications needed to thrive as a Senior Databricks Data Engineer, and why are they important?

To thrive as a Senior Databricks Data Engineer, you need advanced expertise in data engineering concepts, big data technologies, and proficiency in programming languages like Python or Scala, usually backed by a bachelor's degree in computer science or a related field. Familiarity with Databricks, Apache Spark, cloud platforms (Azure, AWS, or GCP), and certifications like Databricks Certified Data Engineer are typically required. Strong problem-solving skills, effective communication, and the ability to collaborate across teams distinguish top performers in this role. These skills are essential to efficiently design scalable data solutions, optimize data workflows, and drive business insights in complex data environments.

How does a Senior Databricks Data Engineer typically collaborate with data scientists and analysts on large-scale projects?

A Senior Databricks Data Engineer works closely with data scientists and analysts to design, build, and optimize data pipelines that enable advanced analytics and machine learning initiatives. They often participate in cross-functional meetings to understand data requirements, translate them into scalable ETL processes, and ensure data quality and accessibility. Regular collaboration also involves troubleshooting data issues, optimizing Spark jobs for performance, and sharing best practices for data management. This close teamwork ensures that analytical teams have reliable, timely, and well-structured data to drive insights and decision-making.

What are Senior Databricks Data Engineers?

Senior Databricks Data Engineers are experienced professionals who design, develop, and optimize large-scale data processing pipelines using the Databricks platform. They work with big data technologies like Apache Spark, Delta Lake, and cloud platforms such as Azure or AWS. Their responsibilities include building and maintaining ETL processes, ensuring data quality, and collaborating with data scientists and analysts to deliver reliable, high-performance data solutions. As senior engineers, they also mentor junior team members and contribute to architectural decisions.

What is the difference between Senior Databricks Data Engineer vs Data Engineer?

AspectSenior Databricks Data EngineerData Engineer
CredentialsTypically requires experience with Databricks, Spark, cloud platforms, and often certifications like Databricks Certified Data Engineer AssociateRequires knowledge of data pipelines, SQL, ETL tools, and often cloud platform experience, but less specialized in Databricks
Work EnvironmentWorks primarily within Databricks environment, focusing on big data processing and analyticsWorks across various data tools and platforms, including traditional ETL and cloud services
Industry UsageCommon in organizations leveraging Databricks for big data analytics and machine learningWidely used across industries for general data pipeline development and data management

The main difference is that a Senior Databricks Data Engineer specializes in using Databricks and Spark for big data solutions, often requiring specific certifications and experience. A Data Engineer has a broader focus on data pipeline development across various tools and platforms, with less emphasis on Databricks-specific skills.

What are the most commonly searched types of Databricks Data Engineer jobs in Delaware? The most popular types of Databricks Data Engineer jobs in Delaware are:
What are popular job titles related to Senior Databricks Data Engineer jobs in Delaware? For Senior Databricks Data Engineer jobs in Delaware, the most frequently searched job titles are:
What job categories do people searching Senior Databricks Data Engineer jobs in Delaware look for? The top searched job categories for Senior Databricks Data Engineer jobs in Delaware are:
What cities in Delaware are hiring for Senior Databricks Data Engineer jobs? Cities in Delaware with the most Senior Databricks Data Engineer job openings:
Senior Databricks Data Engineer jobs near you
Sr. Databricks Engineer (PySpark and Data Lake) Exp. || 5 Days Onsite

Sr. Databricks Engineer (PySpark and Data Lake) Exp. || 5 Days Onsite

InfiCare Technologies

Wilmington, DE

$111.10K - $133.40K/yr

Other

Posted 4 days ago

Job description

Job Title: Sr. Databricks Engineer (PySpark and Data Lake) Exp.

Location: Wilmington, DE – 5 Days onsite role

Duration: Full Time / Long Term Project

Overview

We are seeking a Data Engineer to lead the modernization of legacy ETL systems by migrating Ab Initio workflows to scalable, modular PySpark pipelines on Databricks. The role involves transforming complex data ecosystems into cloud-native architectures while ensuring data integrity, performance, and reliability.

Key Responsibilities

ETL Modernization & Development

  • Analyze and migrate legacy ETL workflows from Ab Initio to PySpark-based pipelines
  • Design and develop scalable data pipelines on Databricks
  • Refactor monolithic processes into modular, reusable components
  • Leverage existing enterprise datasets to avoid redundancy

Data Integration & Processing

  • Build and maintain ETL/ELT pipelines integrating data from Snowflake and other sources
  • Process and publish enriched datasets for downstream applications
  • Support batch and near real-time data processing

Data Lineage & Optimization

  • Create end-to-end data lineage and data flow diagrams
  • Identify redundancies and drive process consolidation and optimization
  • Ensure adherence to data governance and quality standards

Testing & Validation

  • Develop unit, integration, and reconciliation frameworks
  • Perform dual-run comparisons with legacy systems
  • Validate outputs in UAT and pre-production environments

Deployment & Operations

  • Support cutover and migration strategy from legacy systems
  • Decommission legacy workflows and optimize scheduling (e.g., Control-M)
  • Develop runbooks, monitoring, and operational documentation

Collaboration

  • Work with data architects, analysts, and downstream application teams
  • Coordinate user acceptance testing (UAT/FAT) and stakeholder sign-offs

Apply