ZipRecruiter

Log In

1

Big Data Developer Jobs in Pennsylvania (NOW HIRING)

Agile Enterprise Solutions

Big Data Engineer

Pittsburgh, PA · On-site

$54 - $71.50/hr

Big Data Engineer Location: Pittsburgh, PA Mode: Permanent We are looking for a Big Data Engineer that will work on the collecting, storing, processing, and analyzing of large sets of data. The ...

Kanak Elite Services Inc

Big Data Engineer

Malvern, PA · On-site

$54.75 - $72.25/hr

Big Data Engineer Location : Malvern, PA Hybrid Duration : Initial 12 months + options to extend - Long term contract role Responsibilities * Collaborate on the Smartstream cash reconciliation ...

ExlService Holdings, Inc.

Big Data Engineer

Pittsburgh, PA · On-site

$54 - $71.50/hr

Big Data Engineer Summary We are looking for an experienced Big Data Engineer with 7-10 years of hands-on experience to design, build, and maintain scalable data pipelines and processing systems in ...

RIT Solutions, Inc.

Big Data Engineer

Wayne, PA · On-site

$50.50 - $66.75/hr

RIT Solutions, Inc. is seeking a Big Data Engineer for their client Vanguard, located in Malvern, PA. The role involves providing advanced IT technical lead services, ensuring the viability of IT ...

Sonsoft Inc

Big Data Engineer

King Of Prussia, PA · On-site

$55.50 - $73.50/hr

Experience in Data Ingestion, Streaming and Big Data technologies. * Excellent communication and stakeholder management * Ability to work with distributed teams. * Exposure to Data Warehousing ...

ClifyX

Python/Big Data Admin

Pittsburgh, PA · On-site

$51.50 - $66.75/hr

ClifyX is seeking a Python/Big Data Admin to work in Pittsburgh, PA ... The role requires a good understanding of Hadoop and programming skills in Java or Python, with a ...

Sonsoft Inc

Big Data

King Of Prussia, PA · On-site

Experience in Data Ingestion, Streaming and Big Data technologies. * Excellent communication and stakeholder management * Ability to work with distributed teams. * Exposure to Data Warehousing ...

Sonsoft Inc

Big Data

King Of Prussia, PA · On-site

Experience in Data Ingestion, Streaming and Big Data technologies. * Excellent communication and stakeholder management * Ability to work with distributed teams. * Exposure to Data Warehousing ...

Sonsoft Inc

Big Data

King Of Prussia, PA · On-site

Experience in Data Ingestion, Streaming and Big Data technologies. * Excellent communication and stakeholder management * Ability to work with distributed teams. Qualifications * Bachelor's degree or ...

Saransh Inc

Data Architect (DWH)

Reading, PA · On-site

$61.25 - $78.75/hr

Expertise with Data Engineering/Big data tools such as Python, PySpark, Kafka, API's, Talend and BODS, etc. * Expertise with relational SQL and NoSQL databases * Experience in building data pipelines ...

CGI Inc.

Kafka/Spark Developer

Pittsburgh, PA · On-site

As Kafka Spark Software developers, you will be responsible for developing and maintaining scalable big data solutions using Hadoop, Spark, Kafka, and Impala to support enterprise data processing and ...

Algonomy

AWS Data Migration Engineer

Philadelphia, PA · On-site

$115K - $138K/yr

... using Big Data Platform (Databricks, Glue, EMR, Step-functions, Lambda, PySpark and other AWS ... Experience on Big Data Technologies, Hadoop Eco system and Technologies with experience programming ...

next page

Showing results 1-20

All JobsBig Data Developer JobsBig Data Developer Jobs in Pennsylvania

Big Data Developer information

See Pennsylvania salary details

$18

$59

$78

How much do big data developer jobs pay per hour?

As of Sep 3, 2026, the average hourly pay for big data developer in Pennsylvania is $59.13, according to ZipRecruiter salary data. Most workers in this role earn between $51.11 and $66.25 per hour, depending on experience, location, and employer.

What is a big data developer?

A big data developer, sometimes called a big data engineer, creates technical tools and systems that allow an organization to integrate data analytics seamlessly into business solutions. As a big data developer, your primary duties include designing, coding, testing, and monitoring software and applications that are used to achieve your organization’s goals. Big data developers work in a variety of fields, including health care, finance, biotech, media, and advertising, as well as within various government departments. The job typically involves working as part of a large team of developers, data science specialists, and programmers.

What is a big data developer?

A Big Data Developer is a technology professional who designs, builds, and maintains systems and applications for processing and analyzing large volumes of data. They work with big data tools and frameworks like Hadoop, Spark, and NoSQL databases to manage data pipelines and ensure efficient data storage and retrieval. Their role often involves collaborating with data scientists and analysts to turn massive, complex data sets into actionable insights for organizations.

What are the key skills and qualifications needed to thrive as a big data developer, and why are they important?

To thrive as a Big Data Developer, you need strong programming skills (such as Java, Scala, or Python), a deep understanding of data structures, and experience with distributed systems, often supported by a bachelor’s degree in computer science or a related field. Proficiency with big data tools and platforms like Hadoop, Spark, Hive, Kafka, and NoSQL databases, as well as familiarity with cloud services (AWS, Azure, or Google Cloud), is typically required. Analytical thinking, problem-solving abilities, and effective communication help developers collaborate with cross-functional teams and translate business needs into technical solutions. These skills are crucial for efficiently processing and analyzing large-scale data to drive informed decision-making and innovation.

What are some common challenges big data developers face when integrating new data sources into existing pipelines?

A common challenge for Big Data Developers is ensuring compatibility and data quality when integrating new data sources into established pipelines. This often involves handling different data formats, managing schema evolution, and addressing inconsistencies or missing data. Developers must also optimize for performance, as adding new sources can impact processing speed and resource utilization. Close collaboration with data engineers, analysts, and business stakeholders is essential to ensure that the integrated data supports organizational goals and maintains high reliability.

What is the difference between Big Data Developer vs Data Engineer?

AspectBig Data DeveloperData Engineer
Primary FocusDesigning and developing big data applications and solutionsBuilding and maintaining data pipelines and infrastructure
Skills & CertificationsHadoop, Spark, Java, Scala, SQLETL, cloud platforms, scripting, database management
Work EnvironmentData teams, software development projectsData infrastructure, cloud environments, data warehouses
Industry UsageTech, finance, healthcare, retailTech, finance, telecom, e-commerce

While both roles work with big data technologies, Big Data Developers focus on creating applications and solutions for processing large datasets, whereas Data Engineers build and maintain the data infrastructure that supports these applications. Understanding these distinctions helps in choosing the right career path or job search focus.

More about Big Data Developer jobs

What are popular job titles related to Big Data Developer jobs in PA?

For Big Data Developer jobs in PA, the most frequently searched job titles are:

Big Data Developer jobs near you
Infographic showing various Big Data Developer job openings in Pennsylvania as of August 2026, with employment types broken down into 75% Full Time, and 25% Contract. Highlights an 83% In-person, and 17% Hybrid job distribution, with an average salary of $123,000 per year, or $59.1 per hour.

Big Data Engineer

Agile Enterprise Solutions

Pittsburgh, PA • On-site

$54 - $71.50/hr

Full-time

Re-posted 29 days ago

Job description

Job Description

Hi,

Hope your are doing great!

My name is Shyam and I am a Professional Recruiter at Agile, Inc. I have an open opportunity that you may be a good fit for. I came across your resume and think that you might be a good fit for the position listed below.

Title: Big Data Engineer

Location: Pittsburgh, PA

Mode: Permanent

Job Description:

We are looking for a Big Data Engineer that will work on the collecting, storing, processing, and analyzing of large sets of data.

The primary focus will be on choosing optimal solutions to use for these purposes, then maintaining, implementing, and monitoring them.

You will also be responsible for integrating them with the architecture used across the company.

Skills and Qualifications

Proficient understanding of distributed computing principles

Management of Hadoop cluster (Cloudera preferred), with all included services

Ability to solve any ongoing issues with operating the cluster

Proficiency with Hadoop v2, MapReduce, HDFS, Sqoop

Experience with building stream-processing systems, using solutions such as Storm or Spark-Streaming

Good knowledge of Big Data querying tools, such as Pig, Hive, and Impala

Experience with Spark

Experience with integration of data from multiple data sources such as MsSQL Server, Oracle,

Good understanding of SQL queries, joins, stored procedures, relational schemas

Experience with NoSQL databases, such as HBase, Cassandra, MongoDB (preferred)

Knowledge of various ETL techniques and frameworks, such as Flume

Experience with various messaging systems, such as Kafka or RabbitMQ

Experience with Cloudera FS domain knowledge a big plus but not required

Thanks & Regards

Additional Information

All your information will be kept confidential according to EEO guidelines.

Agile Enterprise Solutions logo

About Agile Enterprise Solutions

Sourced by ZipRecruiter

AgileES offers a wide gamut of staffing solutions that are best aligned with requirements of the clients to bring super-colossal benefits for the clients At AgileES, every project whether it is small or big, is looked upon with equal proportion of close attention and commitment. For us, all clients are incomparably invaluable. We listen to our clients and come up with the customized hiring solutions to fulfill all recruitment needs. We are with you every step of the way… the way towards peerless success in business by helping you hire the right people with right business acumen, acuity, intelligence and ingenuity.

Industry

It services

Company size

51 - 200 Employees

Headquarters location

Frisco, TX, US

Year founded

2005

Social media

Facebook

View All Agile Enterprise Solutions Jobs

Apply