ZipRecruiter

Log In

1

Big Data Software Engineer Jobs in Philadelphia, PA

RIT Solutions, Inc.

Big Data Engineer

Wayne, PA · On-site

$50.50 - $66.75/hr

RIT Solutions, Inc. is seeking a Big Data Engineer for their client Vanguard, located in Malvern ... and direction for software, middleware, or hardware projects on a single platform. Provides ...

Kanak Elite Services Inc

Big Data Engineer

Malvern, PA · On-site

$54.75 - $72.25/hr

Big Data Engineer Location : Malvern, PA Hybrid Duration : Initial 12 months + options to extend - Long term contract role Responsibilities * Collaborate on the Smartstream cash reconciliation ...

Sonsoft Inc

Big Data Engineer

King Of Prussia, PA · On-site

$55.50 - $73.50/hr

At least 4 years of experience in software design, development and release. * Well versed with agile development methodologies. * Experience in Data Ingestion, Streaming and Big Data technologies.

AYR Global IT Solutions Inc

Big Data Developer

Wilmington, DE · On-site

$51.50 - $66.75/hr

Big Data Developer Location: Wilmington, DE Duration: 6+ Months Contract Only US Citizens and GC ... tier software applications Experience with Informatica/Ab Initio, shell scripts, Perl, Job ...

Programmers.io

Big Data Engineer

Pennington, NJ · On-site

$56.25 - $74.50/hr

Experience using statistical computer languages (Python, SQL, hive, etc.) to manipulate data and draw insights from large data sets. Experience working with and creating data architectures. Knowledge ...

Sonsoft Inc

Big Data

King Of Prussia, PA · On-site

At least 4 years of experience in software design, development and release. * Well versed with agile development methodologies. * Experience in Data Ingestion, Streaming and Big Data technologies.

Sonsoft Inc

Big Data

King Of Prussia, PA · On-site

At least 4 years of experience in software design, development and release. * Well versed with agile development methodologies. * Experience in Data Ingestion, Streaming and Big Data technologies.

next page

Showing results 1-20

All JobsBig Data Software Engineer JobsBig Data Software Engineer Jobs in Philadelphia, PA

Big Data Software Engineer information

See Philadelphia, PA salary details

$16

$63

$89

How much do big data software engineer jobs pay per hour?

As of Aug 28, 2026, the average hourly pay for big data software engineer in Philadelphia, PA is $63.55, according to ZipRecruiter salary data. Most workers in this role earn between $54.09 and $71.54 per hour, depending on experience, location, and employer.

What is a big data software engineer?

A Big Data Software Engineer is a technology professional who designs, develops, and maintains systems and applications that process large and complex data sets. They work with big data technologies like Hadoop, Spark, and NoSQL databases to enable efficient data storage, processing, and analysis. These engineers collaborate with data scientists, analysts, and other stakeholders to build scalable solutions that extract valuable insights from massive amounts of data. Their work is essential in industries such as finance, healthcare, e-commerce, and more, where data-driven decision-making is critical.

What does a big data software engineer do?

As a big data software engineer, your primary responsibilities are to collect, store, process, and analyze large amounts of data. You then build what the software architects design. Your duties are to develop software and choose solutions to maintain, implement, and continue monitoring the data. You also need to integrate your code with the current company architecture. You may handle high scale distributed systems, build and interact with algorithms, and work in cloud computing environments.

What are the key skills and qualifications needed to thrive as a big data software engineer?

To thrive as a Big Data Software Engineer, you need strong programming skills (often in Java, Scala, or Python), a solid understanding of distributed systems, and a degree in computer science or related field. Experience with big data tools like Hadoop, Spark, Kafka, as well as familiarity with cloud platforms and data pipeline frameworks, is typically required. Problem-solving, analytical thinking, and effective teamwork are essential soft skills for handling complex data challenges and collaborating across teams. These skills and qualifications are crucial for designing efficient, scalable data solutions that drive business insights and innovation.

What are the most common challenges big data software engineers face when working with large-scale data systems?

Big Data Software Engineers often encounter challenges such as ensuring data quality, optimizing the performance of data pipelines, and managing the complexity of distributed systems. Handling massive volumes of data requires careful attention to system scalability and fault tolerance. Additionally, integrating new technologies and collaborating with data scientists, analysts, and DevOps teams to deploy and maintain reliable data solutions are key aspects of the role. Staying updated on evolving big data frameworks and best practices is crucial for continued success.

What is the difference between Big Data Software Engineer vs Data Engineer?

AspectBig Data Software EngineerData Engineer
Primary FocusDeveloping and optimizing big data processing applicationsBuilding and maintaining data pipelines and infrastructure
Skills & CertificationsProgramming (Java, Scala), Hadoop, Spark, SQLETL tools, SQL, cloud platforms, scripting
Work EnvironmentData processing teams, software development projectsData infrastructure teams, cloud environments
Industry UsageTech, finance, healthcare, retailTech, finance, healthcare, retail

While both roles work with big data technologies, Big Data Software Engineers focus on creating scalable data processing applications, whereas Data Engineers build and maintain the data pipelines and infrastructure that support these applications. Both roles often collaborate but have distinct technical responsibilities.

More about Big Data Software Engineer jobs

What are the most commonly searched types of Big Data Software Engineer jobs in Philadelphia, PA?

The most popular types of Big Data Software Engineer jobs in Philadelphia, PA are:

What are popular job titles related to Big Data Software Engineer jobs in Philadelphia, PA?

For Big Data Software Engineer jobs in Philadelphia, PA, the most frequently searched job titles are:

What job categories do people searching Big Data Software Engineer jobs in Philadelphia, PA look for?

The top searched job categories for Big Data Software Engineer jobs in Philadelphia, PA are:

Big Data Software Engineer jobs near you

Big Data Engineer

RIT Solutions, Inc.

Wayne, PA • On-site

$50.50 - $66.75/hr

Full-time

Re-posted 13 days ago

Job description

Job Summary:
RIT Solutions, Inc. is seeking a Big Data Engineer for their client Vanguard, located in Malvern, PA. The role involves providing advanced IT technical lead services, ensuring the viability of IT deliverables, and communicating with stakeholders on project issues.
Responsibilities:
• Provides advanced level IT technical lead services and direction for software, middleware, or hardware projects on a single platform. Provides technical expertise and completes complex development, design, implementation, architecture design specification, and maintenance activities.
• Ensures the viability of IT deliverables.
• Communicates with key stakeholders on project issues and implications. Evaluates the impacts of change requests on technologies.
• Maintains current knowledge of IT development methodology, architecture design, and technical standards.
• Writes documentation, including technical standards and processes.
• Identifies opportunities for continuous quality improvement of technical standards, methodologies, and technologies.
• May participate in design, code, and test inspections throughout product life cycle to contribute technical expertise and to identify issues. Presents technical status and issues at milestone reviews.
Qualifications:
Required:
• Python
• AWS
• Data Analytics
• Spark
• Infrastructure as Code
• Docker
• SQL
• Big Data
• Bitbucket
• Lambda
• GIT
• EMR
• Glue
• S3
• RDS
• DynamoDB
• Cloud formation
• Kinesis
• Athena
• Must have worked in AWS environment
Company:
Jobdiva Job Portal: https://www1.jobdiva.com/candidates/myjobs/searchjobsdone.jsp?a=xbjdnwgjodtga1y1im2g881fkkeiwd0775lbvq8yqgps8vb2q36w2vj1ga6xxork&compid=-1 Recruitment (contingency search and campus selection). Founded in 2019, the company is headquartered in Arlington, USA, with a team of 201-500 employees. The company is currently Growth Stage.

Apply