1

Senior Databricks Developer Jobs in Pennsylvania

Databricks Senior Data Engineer

Pittsburgh, PA · On-site

$111K - $133K/yr

Job Summary : eTeam is seeking a Databricks Senior Data Engineer to enhance their data architecture and integration strategies. The role involves collaborating with stakeholders to gather business ...

The position sits within CEI's Solutions and Engineering organization, working alongside data ... The individual will act as a senior technical leader, partnering across multiple stakeholders while ...

next page

Showing results 1-20

Senior Databricks Developer information

What are the most commonly searched types of Databricks Developer jobs in Pennsylvania?

The most popular types of Databricks Developer jobs in Pennsylvania are:

What are popular job titles related to Senior Databricks Developer jobs in Pennsylvania?

For Senior Databricks Developer jobs in Pennsylvania, the most frequently searched job titles are:

What job categories do people searching Senior Databricks Developer jobs in Pennsylvania look for?

The top searched job categories for Senior Databricks Developer jobs in Pennsylvania are:

What cities in Pennsylvania are hiring for Senior Databricks Developer jobs?

Cities in Pennsylvania with the most Senior Databricks Developer job openings:

Senior Databricks Engineer

Tata Consultancy Service Limited

Malvern, PA • On-site

$120K - $135K/yr

Full-time

Medical, Dental, Vision, Retirement, PTO

Re-posted 5 days ago


Job description

Must Have Technical/Functional Skills
Apache Spark: Mastery of Spark SQL and the DataFrame API for distributed data processing, performance tuning, and optimizing execution plans.
Delta Lake & Lakehouse: Building medallion architectures (Bronze, Silver, Gold layers) and using optimizations like Z-Ordering and ACID transactions
Pipelines & Orchestration: Developing with Delta Live Tables (DLT) and Databricks Workflows to design resilient, idempotent ELT/ETL pipelines.
Unity Catalog: Configuring data governance, row/column-level security, and data lineage
Languages: Advanced proficiency in Python (PySpark) and SQL
Storage & Data Lakes: Expert in reading/writing to Amazon S3 and integrating with AWS data warehouses (e.g., Amazon Redshift).
Security & IAM: Implementing cross-account IAM roles, S3 bucket policies, and Customer-Managed Keys (CMK) via AWS KMS
.Compute Management: Managing cluster policies, instance profiles, and utilizing Spot Instances to optimize Databricks compute costs on AWS.
Ecosystem Integration: Familiarity with integrating Databricks jobs alongside native services like AWS Glue, Amazon Kinesis, and AWS Step Functions
CI/CD & Version Control: Git-based workflows using Databricks Git Folders and managing deployments.
AI & MLOps: Using MLflow for experiment tracking and model registries.
Familiarity with LLMs, Vector Search, and GenAI integrations.
Roles & Responsibilities
Data Pipeline Development: Extract, transform, and load (ETL) data from multiple sources, building batch and streaming pipelines.Spark & Code Optimization: Write highly efficient PySpark, Scala, or SQL code. Troubleshoot distributed processing bottlenecks and optimize job performance.
Lakehouse Management: Work with the Medallion architecture to transition data through Bronze (raw), Silver (cleansed), and Gold (aggregated) layers in Delta Lake.
Orchestration & Automation: Schedule and automate workflows using Databricks Jobs, Workflows, or Delta Live Tables (DLT). Configure automated tests, retries, and error handling.
Governance & Security: Implement data privacy and access controls utilizing the Databricks Unity Catalog, ensuring compliance and secure data sharing.
Collaboration: Work alongside Data Scientists, Data Analysts, and ML Engineers to prepare data features and support BI reporting, ML training, and generative AI initiatives.
TCS Employee Benefits Summary:
Discretionary Annual Incentive.
Comprehensive Medical Coverage: Medical & Health, Dental & Vision, Disability Planning & Insurance, Pet Insurance Plans.
Family Support: Maternal & Parental Leaves.
Insurance Options: Auto & Home Insurance, Identity Theft Protection.
Convenience & Professional Growth: Commuter Benefits & Certification & Training Reimbursement.
Time Off: Vacation, Time Off, Sick Leave & Holidays.
Legal & Financial Assistance: Legal Assistance, 401K Plan, Performance Bonus, College Fund, Student Loan Refinancing.
Salary Range: $120,000 - 135,000 a year