ZipRecruiter

Log In

1

Senior Databricks Data Engineer Jobs in Pennsylvania

Chubb

VP, Principal Data Engineer

Philadelphia, PA · On-site

... Databricks / Snowflake), ETL modernization, and replatforming efforts. * Evaluate and recommend ... Build, lead, and develop a team of approximately five direct-report senior data engineers and ...

LMI

Data Engineer - Clearance Required

Pittsburgh, PA

$111K - $133K/yr

Develop and maintain data engineering workflows in Databricks, including notebooks, Delta Lake tables, and Spark jobs, for workloads that complement or feed into the Foundry environment * Write ...

LMI

Data Engineer - Clearance Required

Pittsburgh, PA

$111K - $133K/yr

Develop and maintain data engineering workflows in Databricks, including notebooks, Delta Lake tables, and Spark jobs, for workloads that complement or feed into the Foundry environment * Write ...

LMI

Data Engineer - Clearance Required

Pittsburgh, PA · On-site +1

$111K - $133K/yr

Develop and maintain data engineering workflows in Databricks, including notebooks, Delta Lake tables, and Spark jobs, for workloads that complement or feed into the Foundry environment * Write ...

UGI

Lead Data Engineer

King Of Prussia, PA · On-site

$111K - $134K/yr

This role requires proficiency in Snowflake, SQL, and Databricks, with extensive experience integrating data from multiple source systems. The Lead Data Engineer will be deeply involved in coding and ...

PAR Technology

$130K - $144K/yr

We are seeking a Senior Data Engineer to join our team and help us build the next generation of ... Spark, Databricks, Structured Streaming * Databases: Relational (Postgres) and NoSQL (DynamoDB ...

Dlapiper

Data Engineer

Philadelphia, PA · On-site

$115K - $138K/yr

Together. Summary The Data Engineer, Solutions & Data role designs, builds, and operates data ... Data pipeline tooling and cloud data services experience (Azure Data Factory, Azure Databricks ...

previous page

Showing results 41-60

All JobsDatabricks Data Engineer JobsSenior Databricks Data Engineer JobsSenior Databricks Data Engineer Jobs in Pennsylvania

Senior Databricks Data Engineer information

What is a Senior Databricks Data engineer?

Senior Databricks Data Engineers are experienced professionals who design, develop, and optimize large-scale data processing pipelines using the Databricks platform. They work with big data technologies like Apache Spark, Delta Lake, and cloud platforms such as Azure or AWS. Their responsibilities include building and maintaining ETL processes, ensuring data quality, and collaborating with data scientists and analysts to deliver reliable, high-performance data solutions. As senior engineers, they also mentor junior team members and contribute to architectural decisions.

How does a Senior Databricks Data engineer typically collaborate with data scientists and analysts on large-scale projects?

A Senior Databricks Data Engineer works closely with data scientists and analysts to design, build, and optimize data pipelines that enable advanced analytics and machine learning initiatives. They often participate in cross-functional meetings to understand data requirements, translate them into scalable ETL processes, and ensure data quality and accessibility. Regular collaboration also involves troubleshooting data issues, optimizing Spark jobs for performance, and sharing best practices for data management. This close teamwork ensures that analytical teams have reliable, timely, and well-structured data to drive insights and decision-making.

What are the key skills and qualifications needed to thrive as a Senior Databricks Data engineer, and why are they important?

To thrive as a Senior Databricks Data Engineer, you need advanced expertise in data engineering concepts, big data technologies, and proficiency in programming languages like Python or Scala, usually backed by a bachelor's degree in computer science or a related field. Familiarity with Databricks, Apache Spark, cloud platforms (Azure, AWS, or GCP), and certifications like Databricks Certified Data Engineer are typically required. Strong problem-solving skills, effective communication, and the ability to collaborate across teams distinguish top performers in this role. These skills are essential to efficiently design scalable data solutions, optimize data workflows, and drive business insights in complex data environments.

What is the difference between Senior Databricks Data Engineer vs Data Engineer?

AspectSenior Databricks Data EngineerData Engineer
CredentialsTypically requires experience with Databricks, Spark, cloud platforms, and often certifications like Databricks Certified Data Engineer AssociateRequires knowledge of data pipelines, SQL, ETL tools, and often cloud platform experience, but less specialized in Databricks
Work EnvironmentWorks primarily within Databricks environment, focusing on big data processing and analyticsWorks across various data tools and platforms, including traditional ETL and cloud services
Industry UsageCommon in organizations leveraging Databricks for big data analytics and machine learningWidely used across industries for general data pipeline development and data management

The main difference is that a Senior Databricks Data Engineer specializes in using Databricks and Spark for big data solutions, often requiring specific certifications and experience. A Data Engineer has a broader focus on data pipeline development across various tools and platforms, with less emphasis on Databricks-specific skills.

Is a Senior Databricks Data Engineer in demand?

A Senior Databricks Data Engineer is in high demand due to the increasing adoption of cloud-based data platforms and the need for advanced data processing skills. Professionals with expertise in Spark, SQL, and cloud environments like Azure or AWS are particularly sought after in data-driven industries.

What are the most commonly searched types of Databricks Data Engineer jobs in Pennsylvania?

The most popular types of Databricks Data Engineer jobs in Pennsylvania are:

What are popular job titles related to Senior Databricks Data Engineer jobs in Pennsylvania?

For Senior Databricks Data Engineer jobs in Pennsylvania, the most frequently searched job titles are:

What job categories do people searching Senior Databricks Data Engineer jobs in Pennsylvania look for?

The top searched job categories for Senior Databricks Data Engineer jobs in Pennsylvania are:

What cities in Pennsylvania are hiring for Senior Databricks Data Engineer jobs?

Cities in Pennsylvania with the most Senior Databricks Data Engineer job openings:

Senior Databricks Data Engineer jobs near you
Infographic showing various Senior Databricks Data Engineer job openings in Pennsylvania as of August 2026, with employment types broken down into 1% As Needed, 82% Full Time, 13% Part Time, 3% Contract, and 1% Nights. Highlights an 85% Physical, 4% Hybrid, and 11% Remote job distribution.

Databricks Architect

Tata Consultancy Service Limited

Malvern, PA • On-site

$130K - $165K/yr

Full-time

Medical, Dental, Vision, Retirement, PTO

Posted 2 days ago

New

Job description

Must Have Technical/Functional Skills
• AWS Data Services S3, Redshift, Glue, Lambda, Athena.
• Data Modeling Dimensional Modeling (Star/Snowflake), Data Warehouse Design.
• Data Lake Architecture Amazon S3, Lake Formation, Data Lake best practices.
• Big Data & Processing Spark/PySpark, Amazon EMR.
• ETL/ELT Development AWS Glue, Airflow, Data Pipeline orchestration.
• SQL Expertise Advanced SQL, query optimization, performance tuning.
• Streaming & Real-Time Data Kinesis and/or Kafka
• Security & Governance IAM, KMS, Lake Formation, Encryption, Data Governance.
• Infrastructure as Code Terraform and/or CloudFormation.
• Architecture & Stakeholder Management Solution design, cloud migration, business requirement translation.
Roles & Responsibilities
Senior Databricks Architect with strong experience in designing and implementing enterprise-scale
Lakehouse architectures on cloud platforms. Expertise in Databricks, Spark, PySpark, Delta Lake, data modeling, and real-time data processing. Responsible for defining data strategy, architecture standards, governance, and scalable analytics platforms supporting AI/ML and business intelligence initiatives
Generic Managerial Skills, If any
• Strong leadership and stakeholder management skills, with experience leading cross-functional teams and driving delivery excellence.
• Proven effective communication with business and technical stakeholders.
TCS Employee Benefits Summary:
Discretionary Annual Incentive.
Comprehensive Medical Coverage: Medical & Health, Dental & Vision, Disability Planning & Insurance, Pet Insurance Plans.
Family Support: Maternal & Parental Leaves.
Insurance Options: Auto & Home Insurance, Identity Theft Protection.
Convenience & Professional Growth: Commuter Benefits & Certification & Training Reimbursement.
Time Off: Vacation, Time Off, Sick Leave & Holidays.
Legal & Financial Assistance: Legal Assistance, 401K Plan, Performance Bonus, College Fund, Student Loan Refinancing.
Salary Range: $130,000 - $165,000 a year

Apply