ZipRecruiter

Log In

1

Databricks Software Jobs in Pennsylvania (NOW HIRING)

SysMind Tech

Data Engineer - Databricks

Pittsburgh, PA · On-site

$108K - $130K/yr

Contract Role Overview We are seeking an experienced Data Engineer with strong expertise in Databricks, Python, and Spark to design and build scalable data pipelines. The ideal candidate will have ...

eTeam

Databricks Senior Data Engineer

Pittsburgh, PA · On-site

$111K - $133K/yr

Job Summary : eTeam is seeking a Databricks Senior Data Engineer to enhance their data architecture and integration strategies. The role involves collaborating with stakeholders to gather business ...

previous pagenext page

Showing results 21-40

All JobsDatabricks Software JobsDatabricks Software Jobs in Pennsylvania

Databricks Software information

What is Databricks software?

Databricks Software is a unified analytics platform built on Apache Spark that provides tools for big data processing, machine learning, and collaborative data science. It enables organizations to store, manage, and analyze large datasets efficiently, supporting both batch and streaming data workloads. Databricks also offers collaborative notebooks, automated workflows, and integrations with cloud storage and data lakes, making it a popular choice for data engineering, data science, and business analytics teams.

What are the key skills and qualifications needed to thrive as a Databricks software engineer, and why are they important?

To thrive as a Databricks Software Engineer, you need strong programming skills in languages like Python, Scala, or Java, as well as a solid understanding of distributed computing and data engineering concepts. Familiarity with Databricks platform, Apache Spark, cloud services (such as AWS or Azure), and relevant certifications like Databricks Certified Data Engineer are highly valued. Excellent problem-solving abilities, collaboration, and effective communication are important soft skills for this role. These skills ensure efficient development, deployment, and optimization of big data solutions that drive business insights and innovation.

What are some common challenges faced by Databricks software engineers, and how can they be overcome?

Databricks Software Engineers often encounter challenges related to scaling big data pipelines, optimizing Spark workloads, and integrating diverse data sources. Navigating the complexity of distributed systems and managing cloud infrastructure can be demanding, especially when ensuring data reliability and security. To overcome these challenges, engineers typically collaborate closely with data scientists, DevOps, and platform teams, leverage Databricks' extensive documentation and community support, and adopt best practices such as version control and continuous integration. Regular knowledge sharing and staying updated with new features also help engineers succeed in this dynamic environment.

What is the difference between Databricks Software vs Data Engineer?

AspectDatabricks SoftwareData Engineer
Primary RolePlatform for data analytics and machine learningBuilds, maintains data pipelines and infrastructure
Required SkillsSQL, Spark, cloud platforms, data science basicsSQL, ETL, programming (Python, Scala), database management
Work EnvironmentCloud-based, collaborative data platformData teams, cloud or on-premises environments
CertificationsDatabricks certifications, cloud certificationsNone specific, often cloud or data certifications

While Databricks Software provides a platform for data analytics and machine learning, Data Engineers focus on building and maintaining data pipelines and infrastructure. Both roles often work together but have distinct responsibilities and skill sets within the data ecosystem.

What are popular job titles related to Databricks Software jobs in Pennsylvania?

For Databricks Software jobs in Pennsylvania, the most frequently searched job titles are:

What job categories do people searching Databricks Software jobs in Pennsylvania look for?

The top searched job categories for Databricks Software jobs in Pennsylvania are:

What cities in Pennsylvania are hiring for Databricks Software jobs?

Cities in Pennsylvania with the most Databricks Software job openings:

Databricks Software jobs near you

Data Engineer - Databricks

SysMind Tech

Pittsburgh, PA • On-site

$108K - $130K/yr

Contractor

Re-posted 8 days ago

Job description

Role: Data Engineer
Location: Warrendale, PA / Pittsburgh, PA (Onsite)
Job Type: Contract
Role Overview
We are seeking an experienced Data Engineer with strong expertise in Databricks, Python, and Spark to design and build scalable data pipelines. The ideal candidate will have hands-on experience with ETL/ELT development and large-scale data processing using Spark and PySpark.
Key Responsibilities
  • Design, develop, and maintain ETL/ELT data pipelines for large-scale data processing.
  • Build scalable data solutions using Databricks and Apache Spark (PySpark / Spark SQL).
  • Develop and optimize Python-based data processing frameworks.
  • Work closely with data analysts and data scientists to deliver high-quality datasets.
  • Optimize performance and scalability of data pipelines.
  • Implement data quality checks and monitoring solutions.
  • Collaborate with cross-functional teams to support analytics and reporting initiatives.

Required Skills
  • Advanced Databricks (hands-on experience)
  • Strong Python programming
  • Spark / PySpark / Spark SQL
  • ETL / ELT pipeline development
  • Data pipeline optimization and performance tuning
  • Strong SQL skills

Apply