ZipRecruiter

Log In

1

Big Data Software Engineer Jobs in Philadelphia, PA

Kanak Elite Services Inc

Big Data Engineer

Malvern, PA · On-site

$54.75 - $72.25/hr

Big Data Engineer Location : Malvern, PA Hybrid Duration : Initial 12 months + options to extend - Long term contract role Responsibilities * Collaborate on the Smartstream cash reconciliation ...

Sonsoft Inc

Big Data Engineer

King Of Prussia, PA · On-site

$55.50 - $73.50/hr

At least 4 years of experience in software design, development and release. * Well versed with agile development methodologies. * Experience in Data Ingestion, Streaming and Big Data technologies.

AYR Global IT Solutions Inc

Big Data Developer

Wilmington, DE · On-site

$51.50 - $66.75/hr

Big Data Developer Location: Wilmington, DE Duration: 6+ Months Contract Only US Citizens and GC ... tier software applications Experience with Informatica/Ab Initio, shell scripts, Perl, Job ...

AYR Global IT Solutions Inc

Big Data Developer

Wilmington, DE · On-site

$51.50 - $66.75/hr

Big Data Developer Location: Wilmington, DE Duration: 6+ Months Contract Only US Citizens and GC ... tier software applications Experience with Informatica/Ab Initio, shell scripts, Perl, Job ...

Compunnel

Senior AWS Big Data Engineer

Malvern, PA · On-site

$54.75 - $72.25/hr

Job Summary We are seeking a Senior AWS Big Data Engineer with 12+ years of experience in data engineering, ETL development, data analysis, and technical architecture for analytics solutions. The ...

Sonsoft Inc

Big Data

King Of Prussia, PA · On-site

At least 4 years of experience in software design, development and release. * Well versed with agile development methodologies. * Experience in Data Ingestion, Streaming and Big Data technologies.

Sonsoft Inc

Big Data

King Of Prussia, PA · On-site

At least 4 years of experience in software design, development and release. * Well versed with agile development methodologies. * Experience in Data Ingestion, Streaming and Big Data technologies.

Sonsoft Inc

Big Data

King Of Prussia, PA · On-site

At least 4 years of experience in software design, development and release. * Well versed with agile development methodologies. * Experience in Data Ingestion, Streaming and Big Data technologies.

next page

Showing results 1-20

All JobsBig Data Software Engineer JobsBig Data Software Engineer Jobs in Philadelphia, PA

Big Data Software Engineer information

See Philadelphia, PA salary details

$16

$63

$89

How much do big data software engineer jobs pay per hour?

As of Aug 21, 2026, the average hourly pay for big data software engineer in Philadelphia, PA is $63.55, according to ZipRecruiter salary data. Most workers in this role earn between $54.09 and $71.54 per hour, depending on experience, location, and employer.

What is a big data software engineer?

A Big Data Software Engineer is a technology professional who designs, develops, and maintains systems and applications that process large and complex data sets. They work with big data technologies like Hadoop, Spark, and NoSQL databases to enable efficient data storage, processing, and analysis. These engineers collaborate with data scientists, analysts, and other stakeholders to build scalable solutions that extract valuable insights from massive amounts of data. Their work is essential in industries such as finance, healthcare, e-commerce, and more, where data-driven decision-making is critical.

What does a big data software engineer do?

As a big data software engineer, your primary responsibilities are to collect, store, process, and analyze large amounts of data. You then build what the software architects design. Your duties are to develop software and choose solutions to maintain, implement, and continue monitoring the data. You also need to integrate your code with the current company architecture. You may handle high scale distributed systems, build and interact with algorithms, and work in cloud computing environments.

What are the key skills and qualifications needed to thrive as a big data software engineer?

To thrive as a Big Data Software Engineer, you need strong programming skills (often in Java, Scala, or Python), a solid understanding of distributed systems, and a degree in computer science or related field. Experience with big data tools like Hadoop, Spark, Kafka, as well as familiarity with cloud platforms and data pipeline frameworks, is typically required. Problem-solving, analytical thinking, and effective teamwork are essential soft skills for handling complex data challenges and collaborating across teams. These skills and qualifications are crucial for designing efficient, scalable data solutions that drive business insights and innovation.

What are the most common challenges big data software engineers face when working with large-scale data systems?

Big Data Software Engineers often encounter challenges such as ensuring data quality, optimizing the performance of data pipelines, and managing the complexity of distributed systems. Handling massive volumes of data requires careful attention to system scalability and fault tolerance. Additionally, integrating new technologies and collaborating with data scientists, analysts, and DevOps teams to deploy and maintain reliable data solutions are key aspects of the role. Staying updated on evolving big data frameworks and best practices is crucial for continued success.

What is the difference between Big Data Software Engineer vs Data Engineer?

AspectBig Data Software EngineerData Engineer
Primary FocusDeveloping and optimizing big data processing applicationsBuilding and maintaining data pipelines and infrastructure
Skills & CertificationsProgramming (Java, Scala), Hadoop, Spark, SQLETL tools, SQL, cloud platforms, scripting
Work EnvironmentData processing teams, software development projectsData infrastructure teams, cloud environments
Industry UsageTech, finance, healthcare, retailTech, finance, healthcare, retail

While both roles work with big data technologies, Big Data Software Engineers focus on creating scalable data processing applications, whereas Data Engineers build and maintain the data pipelines and infrastructure that support these applications. Both roles often collaborate but have distinct technical responsibilities.

More about Big Data Software Engineer jobs

What are the most commonly searched types of Big Data Software Engineer jobs in Philadelphia, PA?

The most popular types of Big Data Software Engineer jobs in Philadelphia, PA are:

What are popular job titles related to Big Data Software Engineer jobs in Philadelphia, PA?

For Big Data Software Engineer jobs in Philadelphia, PA, the most frequently searched job titles are:

What job categories do people searching Big Data Software Engineer jobs in Philadelphia, PA look for?

The top searched job categories for Big Data Software Engineer jobs in Philadelphia, PA are:

Big Data Software Engineer jobs near you

Big Data Engineer

Kanak Elite Services Inc

Malvern, PA • On-site

$54.75 - $72.25/hr

Contractor

Re-posted yesterday

Job description

Hello There,

My name is Himanshu Sharma, and I serve as the Recruitment Lead at Kanak-IT INC. I am reaching out to share an excellent career opportunity for the role of Big Data Engineer with our esteemed client. If you are interested then please share your updated resume at Himanshu01@kanakits.com .

Job Description

Position           : Big Data Engineer

Location          : Malvern, PA Hybrid

Duration         : Initial 12 months + options to extend - Long term contract role

Responsibilities

  • Collaborate on the Smartstream cash reconciliation platform, known as TLM, to support data integration and transformation workflows.
  • Design and implement ETL processes using tools like AWS Glue, Spark, or Python to transform raw data into structured formats compatible with Smartstream’s ingestion requirements.
  • Conduct data mapping exercises to align legacy data structures with modernized attributes stored in S3 buckets, ensuring consistency and accuracy across systems.
  • Ensure data quality and lineage through validation checks, anomaly detection, and documentation of data assumptions
  • Integrate data sources into cloud platforms such as AWS, leveraging services like S3, Glue, Lambda
  • Work closely with product owner and business to understand data requirements, translate them into technical specifications
  • Implement data governance principles, including version control, access management, and compliance with Vanguard and GIFS standards 

Qualification: (8+ minimum experience)

  • AWS Skills - Glue Lambda S3 KMS Stepfunctions General Skills - Data Transformation Tools like Pandas and Pyspark Cloudformation Cloudblocks Python Bitbucket/Github Coder (optional) Java (optional) Golang (optional) Cobol/JBL (optional)