1

Senior Databricks Data Engineer Jobs in Delaware

... Databricks). * Lead the strategy for automated data ingestion from disparate internal and external ... Lead the standardization data definitions and support data architects and data engineers to ...

Principal Software Engineer

Wilmington, DE · On-site

$131K - $175.60K/yr

In this senior leadership role, you'll leverage your deep technical expertise and strategic vision ... data and NLP models. * Experience with Python * Certification in Databricks and AWS JPMorganChase ...

Principal Software Engineer

Wilmington, DE · On-site

$131K - $175.60K/yr

In this senior leadership role, you'll leverage your deep technical expertise and strategic vision ... data and NLP models. * Experience with Python * Certification in Databricks and AWS JPMorganChase ...

Java Developer

Wilmington, DE · On-site

$60 - $65/hr

Experience with Databricks and Airflow for data engineering workflows. Understanding of Agile methodologies and work within common Agile frameworks. Knowledge of CI/CD, TDD, cloud development ...

Sr Data Analyst

Wilmington, DE · Hybrid

$89.99K - $143.09K/yr

Summary The Senior Data Analyst, working in collaboration with and in support of the firm ... Highly proficiency in SQL and programming languages (Python/R/VBA) or other relevant programming ...

Senior Data Product Associate

Wilmington, DE · On-site

$122.70K - $162K/yr

As a Senior Product Associate in Talent Data Product , you contribute to the team by leveraging ... Collaborate with Information Architecture and Data Engineering to onboard new data sources and ...

We work closely with engineering, product, design, data engineering, machine learning operations ... a Senior Applied Scientist, Generative AI, you will design, build, and deploy generative and ...

next page

Showing results 1-20

Senior Databricks Data Engineer information

What are the key skills and qualifications needed to thrive as a Senior Databricks Data Engineer, and why are they important?

To thrive as a Senior Databricks Data Engineer, you need advanced expertise in data engineering concepts, big data technologies, and proficiency in programming languages like Python or Scala, usually backed by a bachelor's degree in computer science or a related field. Familiarity with Databricks, Apache Spark, cloud platforms (Azure, AWS, or GCP), and certifications like Databricks Certified Data Engineer are typically required. Strong problem-solving skills, effective communication, and the ability to collaborate across teams distinguish top performers in this role. These skills are essential to efficiently design scalable data solutions, optimize data workflows, and drive business insights in complex data environments.

How does a Senior Databricks Data Engineer typically collaborate with data scientists and analysts on large-scale projects?

A Senior Databricks Data Engineer works closely with data scientists and analysts to design, build, and optimize data pipelines that enable advanced analytics and machine learning initiatives. They often participate in cross-functional meetings to understand data requirements, translate them into scalable ETL processes, and ensure data quality and accessibility. Regular collaboration also involves troubleshooting data issues, optimizing Spark jobs for performance, and sharing best practices for data management. This close teamwork ensures that analytical teams have reliable, timely, and well-structured data to drive insights and decision-making.

What are Senior Databricks Data Engineers?

Senior Databricks Data Engineers are experienced professionals who design, develop, and optimize large-scale data processing pipelines using the Databricks platform. They work with big data technologies like Apache Spark, Delta Lake, and cloud platforms such as Azure or AWS. Their responsibilities include building and maintaining ETL processes, ensuring data quality, and collaborating with data scientists and analysts to deliver reliable, high-performance data solutions. As senior engineers, they also mentor junior team members and contribute to architectural decisions.

What is the difference between Senior Databricks Data Engineer vs Data Engineer?

AspectSenior Databricks Data EngineerData Engineer
CredentialsTypically requires experience with Databricks, Spark, cloud platforms, and often certifications like Databricks Certified Data Engineer AssociateRequires knowledge of data pipelines, SQL, ETL tools, and often cloud platform experience, but less specialized in Databricks
Work EnvironmentWorks primarily within Databricks environment, focusing on big data processing and analyticsWorks across various data tools and platforms, including traditional ETL and cloud services
Industry UsageCommon in organizations leveraging Databricks for big data analytics and machine learningWidely used across industries for general data pipeline development and data management

The main difference is that a Senior Databricks Data Engineer specializes in using Databricks and Spark for big data solutions, often requiring specific certifications and experience. A Data Engineer has a broader focus on data pipeline development across various tools and platforms, with less emphasis on Databricks-specific skills.

What are the most commonly searched types of Databricks Data Engineer jobs in Delaware? The most popular types of Databricks Data Engineer jobs in Delaware are:
What are popular job titles related to Senior Databricks Data Engineer jobs in Delaware? For Senior Databricks Data Engineer jobs in Delaware, the most frequently searched job titles are:
What job categories do people searching Senior Databricks Data Engineer jobs in Delaware look for? The top searched job categories for Senior Databricks Data Engineer jobs in Delaware are:
What cities in Delaware are hiring for Senior Databricks Data Engineer jobs? Cities in Delaware with the most Senior Databricks Data Engineer job openings:
AIA BFS - Senior Spark Developer

AIA BFS - Senior Spark Developer

Avani Technology Solutions, Inc.

Wilmington, DE • On-site

Contractor

This job post has expired today. Applications are no longer accepted.


Job description

SENIOR SPARK DEVELOPER Good experience in Bigdata concepts - Good understanding of Hadoop cluster with all included services ability to solve any ongoing issues- Good operating knowledge in with Hadoop and Spark Eco System - Good knowledge on Spark job optimization and strong programming skills in SQL. Good knowledge of Big Data querying tools with Spark Experience with integration of data from multiple data sources with Spark Experience with integration of data from multiple data sources. Experience with No500 Chars Experience: 5to8yrs Required Skills Technical Skills- Apache Spark SparkSQL Domain Skills- Nice to have skills Techincal Skills- Scala Domain Skills- Day SHIFT Roles & Responsibilities Sr. Developer Bachelors in science engineering or equivalent.Understand requirements build codes support testing and fix defects guide developers in the course of development activities in order to develop high standard stable codes within the limits of Cognizant and clients processes standards and guidelines..Project Planning and Set-up- Understand the project scope identify activities/ tasks task level estimates schedule dependencies risks and provide inputs to Module Lead for review Provide inputs to testing strategy configuration deployment hardware/software requirement etc. Review plan and provide feedback on gaps timeline and execution feasibility etc. as required in the project Participate in KT sessions conducted by customer/ other business teams and provide feedback on requirements Requirement Understanding and Analysis- Analyze functional/non functional requirements and seek clarifications for better understanding of requirements Based on understanding of system - upstream & downstream provide feedback and inputs on gaps in requirements and technical feasibility of requirements Design- Prepare the LLD/ detailed design documents based on HLD and briefing from Module Lead Seek inputs from the developers on specific modules as applicable Consolidate all modules and provide to Module Lead/ Architects/ Designers for review Suggest changes in design on technical grounds Develop components inventory for the code to be developed tying it to the non-functional requirements Perform sampling of data to understand the character/ quality of the data (project dependent- in the absence of data analyst or designer) Identify tools and technologies to be used in the project as well as reusable objects that could be customized for the project Coding- Follow coding standards and best practices to develop code and check code quality Share developed code with supervisor for review Rework on the code based on inputs if required Perform complex 9.Job Location Primary: USDEWIMC01-Wilmington - DE USA CLT
Hours : 8:00am to 5:00pm
Education :
Additional Job Details :