1

Databricks Software Jobs in Pennsylvania (NOW HIRING)

Data Engineer - Databricks

Pittsburgh, PA Β· On-site

$111K - $133K/yr

Data Engineer - Databricks Duration : Contract to Hire Location : Pittsburgh, PA Work Mode : 5 Days Onsite Join a high performing data engineering team responsible for building modern, cloud native ...

Data Engineer - Databricks

Pittsburgh, PA Β· On-site

$111K - $133K/yr

Data Engineer - Azure Databricks Contract-to-Hire Pittsburgh, PA - Onsite Job ID J0726-0569 Visa : USC, GC, EAD (No Sponsorship) Position Overview * Seeking an experienced Data Engineer to join a ...

Data Engineer - Databricks

Pittsburgh, PA Β· On-site

$111K - $133K/yr

Data Engineer - Azure Databricks Contract-to-Hire Pittsburgh, PA - Onsite Job ID J0726-0569 Visa : USC, GC, EAD (No Sponsorship) Position Overview * Seeking an experienced Data Engineer to join a ...

Data Engineer - Databricks

Pittsburgh, PA Β· On-site

$111K - $133K/yr

Data Engineer - Azure Databricks Contract-to-Hire Pittsburgh, PA - Onsite Job ID J0726-0569 Visa : USC, GC, EAD (No Sponsorship) Position Overview * Seeking an experienced Data Engineer to join a ...

Senior Software Engineer

Indiana, PA Β· On-site

$112K - $147K/yr

Senior Software Engineer About the role As a Senior Software Engineer within the Application and ... Expert in C++ for Windows and highly proficient in Qt; strong expertise in Databricks, Azure ...

Databricks Senior Data Engineer

Pittsburgh, PA Β· On-site

$111K - $133K/yr

Job Summary : eTeam is seeking a Databricks Senior Data Engineer to enhance their data architecture and integration strategies. The role involves collaborating with stakeholders to gather business ...

Sr Databricks Data Engineer

Philadelphia, PA Β· On-site

$115K - $138K/yr

As a Databricks Engineer in our AI & Data practice, you will design, build, and optimize cloud-based data engineering solutions that support large-scale transformation. You will work with business ...

Sr Databricks Data Engineer

Pittsburgh, PA Β· On-site

$111K - $133K/yr

As a Databricks Engineer in our AI & Data practice, you will design, build, and optimize cloud-based data engineering solutions that support large-scale transformation. You will work with business ...

Showing results 21-40

Databricks Software information

What is Databricks software?

Databricks Software is a unified analytics platform built on Apache Spark that provides tools for big data processing, machine learning, and collaborative data science. It enables organizations to store, manage, and analyze large datasets efficiently, supporting both batch and streaming data workloads. Databricks also offers collaborative notebooks, automated workflows, and integrations with cloud storage and data lakes, making it a popular choice for data engineering, data science, and business analytics teams.

What are the key skills and qualifications needed to thrive as a Databricks software engineer, and why are they important?

To thrive as a Databricks Software Engineer, you need strong programming skills in languages like Python, Scala, or Java, as well as a solid understanding of distributed computing and data engineering concepts. Familiarity with Databricks platform, Apache Spark, cloud services (such as AWS or Azure), and relevant certifications like Databricks Certified Data Engineer are highly valued. Excellent problem-solving abilities, collaboration, and effective communication are important soft skills for this role. These skills ensure efficient development, deployment, and optimization of big data solutions that drive business insights and innovation.

What are some common challenges faced by Databricks software engineers, and how can they be overcome?

Databricks Software Engineers often encounter challenges related to scaling big data pipelines, optimizing Spark workloads, and integrating diverse data sources. Navigating the complexity of distributed systems and managing cloud infrastructure can be demanding, especially when ensuring data reliability and security. To overcome these challenges, engineers typically collaborate closely with data scientists, DevOps, and platform teams, leverage Databricks' extensive documentation and community support, and adopt best practices such as version control and continuous integration. Regular knowledge sharing and staying updated with new features also help engineers succeed in this dynamic environment.

What is the difference between Databricks Software vs Data Engineer?

AspectDatabricks SoftwareData Engineer
Primary RolePlatform for data analytics and machine learningBuilds, maintains data pipelines and infrastructure
Required SkillsSQL, Spark, cloud platforms, data science basicsSQL, ETL, programming (Python, Scala), database management
Work EnvironmentCloud-based, collaborative data platformData teams, cloud or on-premises environments
CertificationsDatabricks certifications, cloud certificationsNone specific, often cloud or data certifications

While Databricks Software provides a platform for data analytics and machine learning, Data Engineers focus on building and maintaining data pipelines and infrastructure. Both roles often work together but have distinct responsibilities and skill sets within the data ecosystem.

What are popular job titles related to Databricks Software jobs in Pennsylvania?

For Databricks Software jobs in Pennsylvania, the most frequently searched job titles are:

What job categories do people searching Databricks Software jobs in Pennsylvania look for?

The top searched job categories for Databricks Software jobs in Pennsylvania are:

What cities in Pennsylvania are hiring for Databricks Software jobs?

Cities in Pennsylvania with the most Databricks Software job openings:

Data Engineer - Databricks

Pittsburgh, PA β€’ On-site

System One
Business Consulting ServicesΒ β€’Β 5 - 10K employees

$111K - $133K/yr

Contractor

Re-posted 23 days ago


Job description

Job Title: Data Engineer – Databricks Duration : Contract to Hire Location : Pittsburgh, PA Work Mode : 5 Days Onsite Job Description: Join a high performing data engineering team responsible for building modern, cloud native data platforms on Microsoft Azure. This role offers the opportunity to design and implement scalable, secure, and high performance data solutions using Azure Databricks, with a strong focus on Unity Catalog, data governance, and enterprise analytics within the Investment/Capital Markets domain. The ideal candidate is passionate about cloud data engineering, enjoys solving complex data challenges, and thrives in a collaborative Agile environment. This position provides the opportunity to work with the latest Azure data technologies while delivering impactful business solutions. Duties and Responsibilities . Design, develop, and maintain scalable data pipelines using Azure Databricks. . Build and optimize ETL/ELT workflows leveraging PySpark, SQL, and Delta Lake. . Implement and manage Unity Catalog to support enterprise data governance, security, metadata management, and fine-grained access control. . Develop cloud native data engineering solutions on the Microsoft Azure platform. . Collaborate with architects, business analysts, and cross functional teams to gather and translate business requirements into technical solutions. . Optimize Spark jobs and data pipelines for performance, scalability, and cost efficiency. . Ensure data quality, reliability, and compliance through validation, monitoring, and best practices. . Support production deployments, troubleshooting, and performance tuning. . Participate in code reviews, technical documentation, and continuous improvement initiatives. . Apply best practices for cloud data engineering, security, and DevOps within Azure environments. Required qualifications to be successful in this role . Minimum 5 years of hands-on experience with Azure Databricks. . Hands on experience with Unity Catalog is mandatory. . Strong experience building enterprise scale data engineering solutions on Microsoft Azure. . Expert level experience with Apache Spark (PySpark) and SQL. . Strong experience with Delta Lake, ETL/ELT development, and data pipeline implementation. . Experience with Azure data services such as Azure Data Factory, Azure Data Lake Storage (ADLS Gen2), and related Azure ecosystem services. . Strong understanding of data governance, metadata management, security, and access control. . Mandatory experience in the Investment/Capital Markets domain. . Experience with Git and CI/CD practices. . Excellent analytical, communication, and problem solving skills. . Experience working in Agile/Scrum delivery environments. Preferred Qualifications . Databricks Certified Data Engineer (Associate or Professional). . Microsoft Azure Data Engineer Associate (DP 203) certification. . Experience with Infrastructure as Code (Terraform/Bicep). . Experience implementing DevOps practices for Azure Databricks environments. . Familiarity with Azure Purview/Microsoft Purview is a plus.

Ref: #404-IT Pittsburgh


System One logo

About System One

Sourced by ZipRecruiter

System One helps employers get work done more efficiently and economically without compromising quality. Over our 35+ year history, we've helped connect thousands of talented people with innovative companies. The excitement of a perfect fit motivates us every single day.

Industry

Business consulting services and recruiting and staffing services

Company size

5,001 - 10,000 Employees

Headquarters location

Pittsburgh, PA, US