ZipRecruiter

Log In

1

Senior Databricks Data Engineer Jobs in Delaware

Td

Data Scientist III - FCRM

Wilmington, DE · On-site

$96K - $155K/yr

Position typically deals with senior/executive management * Works independently on activities ... Strong SQL, Python, Databricks, Oracle, Azure, and cloud data platform experience. * Experience ...

previous pagenext page

Showing results 21-40

All JobsDatabricks Data Engineer JobsSenior Databricks Data Engineer JobsSenior Databricks Data Engineer Jobs in Delaware

Senior Databricks Data Engineer information

What is a Senior Databricks Data engineer?

Senior Databricks Data Engineers are experienced professionals who design, develop, and optimize large-scale data processing pipelines using the Databricks platform. They work with big data technologies like Apache Spark, Delta Lake, and cloud platforms such as Azure or AWS. Their responsibilities include building and maintaining ETL processes, ensuring data quality, and collaborating with data scientists and analysts to deliver reliable, high-performance data solutions. As senior engineers, they also mentor junior team members and contribute to architectural decisions.

How does a Senior Databricks Data engineer typically collaborate with data scientists and analysts on large-scale projects?

A Senior Databricks Data Engineer works closely with data scientists and analysts to design, build, and optimize data pipelines that enable advanced analytics and machine learning initiatives. They often participate in cross-functional meetings to understand data requirements, translate them into scalable ETL processes, and ensure data quality and accessibility. Regular collaboration also involves troubleshooting data issues, optimizing Spark jobs for performance, and sharing best practices for data management. This close teamwork ensures that analytical teams have reliable, timely, and well-structured data to drive insights and decision-making.

What are the key skills and qualifications needed to thrive as a Senior Databricks Data engineer, and why are they important?

To thrive as a Senior Databricks Data Engineer, you need advanced expertise in data engineering concepts, big data technologies, and proficiency in programming languages like Python or Scala, usually backed by a bachelor's degree in computer science or a related field. Familiarity with Databricks, Apache Spark, cloud platforms (Azure, AWS, or GCP), and certifications like Databricks Certified Data Engineer are typically required. Strong problem-solving skills, effective communication, and the ability to collaborate across teams distinguish top performers in this role. These skills are essential to efficiently design scalable data solutions, optimize data workflows, and drive business insights in complex data environments.

What is the difference between Senior Databricks Data Engineer vs Data Engineer?

AspectSenior Databricks Data EngineerData Engineer
CredentialsTypically requires experience with Databricks, Spark, cloud platforms, and often certifications like Databricks Certified Data Engineer AssociateRequires knowledge of data pipelines, SQL, ETL tools, and often cloud platform experience, but less specialized in Databricks
Work EnvironmentWorks primarily within Databricks environment, focusing on big data processing and analyticsWorks across various data tools and platforms, including traditional ETL and cloud services
Industry UsageCommon in organizations leveraging Databricks for big data analytics and machine learningWidely used across industries for general data pipeline development and data management

The main difference is that a Senior Databricks Data Engineer specializes in using Databricks and Spark for big data solutions, often requiring specific certifications and experience. A Data Engineer has a broader focus on data pipeline development across various tools and platforms, with less emphasis on Databricks-specific skills.

Is a Senior Databricks Data Engineer in demand?

A Senior Databricks Data Engineer is in high demand due to the increasing adoption of cloud-based data platforms and the need for advanced data processing skills. Professionals with expertise in Spark, SQL, and cloud environments like Azure or AWS are particularly sought after in data-driven industries.

What are the most commonly searched types of Databricks Data Engineer jobs in Delaware?

The most popular types of Databricks Data Engineer jobs in Delaware are:

What are popular job titles related to Senior Databricks Data Engineer jobs in Delaware?

For Senior Databricks Data Engineer jobs in Delaware, the most frequently searched job titles are:

What job categories do people searching Senior Databricks Data Engineer jobs in Delaware look for?

The top searched job categories for Senior Databricks Data Engineer jobs in Delaware are:

What cities in Delaware are hiring for Senior Databricks Data Engineer jobs?

Cities in Delaware with the most Senior Databricks Data Engineer job openings:

Senior Databricks Data Engineer jobs near you

Senior Data Scientist

Corporation Service Company

Wilmington, DE • On-site

$110 - $150/hr

Other

Posted 8 days ago

Corporation Service Company rating

8.3

Company rating: 8.3 out of 10

Based on 18 frontline employees who took The Breakroom Quiz

79th of 495 rated business services

Job description

Business Intelligence Senior Data Scientist

Wilmington - HQ, USA

Monday-Friday 8:00 am to 5:00 pm

Hybrid

A Business Intelligence Senior Data Scientist develops advanced analytics and machine learning models, and maintains efficient data pipelines, reporting systems, DataOps practices for CI/CD of pipelines and BI infrastructure. Collaborate with analysts and business partners to deliver scalable solutions that support analytics, reporting, and data-driven decision making. 5+ years of experience in data engineering, BI development, or analytics engineering.

Some of the things you will be doing:
  • Implement data integration solutions for various data sources, ensuring data accuracy, consistency and completeness
  • Develop data quality, reconciliation and error handling frameworks to ensure data integrity
  • Optimize SQL and data transformation logic for performance and scalability
  • Document data flows, transformations and dependencies
  • Drive best practices in coding, testing and identify opportunities to improve processes and system reliability
  • Collaborate with business stakeholders to understand data requirements and translate them to scalable solutions.
  • Support analysts and business teams by delivering clean, structured datasets ready for visualization
  • Build predictive and statistical models to support forecasting, segmentation, and optimization
  • Implement Machine Learning and AI into Business Intelligence processes
  • Validate, test, and refine models to ensure accuracy and business relevance.
  • Analyze large, complex datasets to identify trends, patterns, and business opportunities
  • Support deployment and operationalization of analytics and data science outputs into Business Intelligence solutions
  • Understanding and knowledge of metadata management and data logs
What technical skills, experience and qualifications do you need?
  • Bachelor's degree
  • 5+ years of work experience
  • Experience supporting enterprise BI Platform & Predictive analytics
  • Experience in database technologies Oracle and Microsoft SQL
  • Extensive experience with R & Python and data modeling concepts
  • Understanding of data pipeline and ETL/ELT technologies
  • Understanding of next-gen technologies (Databricks, Snowflake, Microsoft fabric).
  • Proven experience in SQL performance tuning and recommend improvements for automation and maintainability.
  • Excellent understanding of data visualization concepts to support dashboards and reports
  • Ability to work both independently and in a team-oriented, collaborative environment
  • Strong problem solving and analytical thinking skills
  • Flexible and adaptable with respect to learning and understanding new technologies
  • Ability to effectively prioritize and execute tasks in a high-pressure environment
  • Excellent communication and interpersonal skills
  • Detail-oriented with a focus on quality and accuracy
  • Experience working in Agile/Scrum environments, participating in sprint planning, standups, reviews and retrospectives
  • Preferred - Experience working with cloud platforms such as Azure or AWS
  • Preferred - Experience in Alteryx is an added advantage

#LI-AM1

#SeniorDataScientistjobs

#Hybrid

#CSCCareers

#J-18808-Ljbffr

What Corporation Service Company employees say

Pay

Benefits

Hours and flexibility

Workplace

Get the full story on Breakroom

Apply