1

Python Big Data Jobs (NOW HIRING)

GCP Data Engineer with Python

Dearborn, MI · On-site

$105.20K - $126.30K/yr

Role: GCP Data Engineer with Python Location: Dearborn, MI (4 days a week onsite) Job Type ... Exposure to Big Data ecosystems and distributed data processing. Nice to have Technical Skills:

Data Engineer

Richmond, VA · On-site

$60 - $64/hr

Java, Scala, Python. Big Data: Spark (Core/SQL/Streaming), Ab Initio (ETL design & integration). Cloud: AWS (S3, EMR, Lambda, Glue). Scripting/Automation: Shell Scripting (Bash), Python. Skills ...

Big DATA Developer with Python

Irving, TX

$48.25 - $66.50/hr

Big DATA Developer with Python Work Location Irving TX * Seeking a Senior Python Data Engineer with 3 to 5 years of experience skilled in Apache Spark and Python to design and implement scalable data ...

Big data

Bellevue, WA

$59.75 - $77.50/hr

Big data Location: Bellevue, WA Must Have Skills (Top 3 technical skills only) * 1. Accumulo ... Accumulo, Spark, and Python. Desired years of experience*: Above 10+ years Education ...

Big Data Engineer

Costa Mesa, CA · On-site

$59.75 - $79/hr

... Python, Hadoop, HDFS, Spark, MapReduce framework Good Scala, Pyspark, Java coding experience for ... Big Data Applications (API & Batch) on AWS Cloud using java/scala/kotlin, Cassandra, , Python ...

Big Data Developer

Atlanta, GA · On-site

$51 - $66/hr

Big Data Developer Location: Georgia (GA) Work Authorization: Only USC / GC Experience: 8+ Years ... Proficiency in Java, Python, or Scala . * Solid understanding of ETL/ELT, data modeling, and ...

Big Data Engineer

Atlanta, GA · On-site

$53.50 - $71/hr

Big Data Engineer Location: Atlanta GA - Hybrid Duration: 12 months The successful candidate must ... Experience with Databricks UI, Managing Databricks Notebooks, Delta Lake with Python, Delta Lake ...

Big Data

Plano, TX

$50.75 - $65.75/hr

Must have experience working on Big Data Processing Frameworks and Tools - MapReduce, YARN, Hive ... Strong understanding and hands-on programming/scripting experience skills - UNIX shell, Python ...

Big Data

Phoenix, AZ

$52.50 - $68.25/hr

Must have experience working on Big Data Processing Frameworks and Tools - MapReduce, YARN, Hive ... Strong understanding and hands-on programming/scripting experience skills - UNIX shell, Python ...

Big Data

Sunnyvale, CA

$62.25 - $80.75/hr

Must have experience working on Big Data Processing Frameworks and Tools - MapReduce, YARN, Hive ... Strong understanding and hands-on programming/scripting experience skills - UNIX shell, Python ...

Big Data

Moline, IL

$48 - $62/hr

Must have experience working on Big Data Processing Frameworks and Tools - MapReduce, YARN, Hive ... Strong understanding and hands-on programming/scripting experience skills - UNIX shell, Python ...

next page

Showing results 1-20

Python Big Data information

See salary details

$26.5K

$132.5K

$186K

How much do python big data jobs pay per year?

As of May 29, 2026, the average yearly pay for python big data in the United States is $132,452.00, according to ZipRecruiter salary data. Most workers in this role earn between $114,000.00 and $155,000.00 per year, depending on experience, location, and employer.

What are the key skills and qualifications needed to thrive as a Python Big Data Engineer, and why are they important?

To thrive as a Python Big Data Engineer, a strong background in Python programming, data structures, and distributed systems is essential, often supported by a degree in computer science or related fields. Familiarity with big data tools such as Hadoop, Spark, Kafka, and cloud platforms, as well as relevant certifications, is typically required. Strong analytical thinking, problem-solving abilities, and effective communication skills help professionals stand out in this field. These competencies are crucial for designing scalable data solutions, collaborating across teams, and extracting valuable insights from large datasets.

How do Python Big Data professionals typically collaborate with data engineers and data scientists in a project setting?

Python Big Data professionals often serve as a bridge between data engineers, who focus on building and maintaining data pipelines, and data scientists, who analyze and interpret data. On a typical project, you might work closely with data engineers to ensure data is efficiently ingested, cleaned, and stored using scalable solutions like Hadoop or Spark. You'll also support data scientists by developing tools, scripts, or models that help them extract insights from large datasets. Effective communication and teamwork are key, as projects often require integrating codebases and aligning on data requirements and project goals.

What is a Python Big Data engineer?

A Python Big Data engineer is a technology professional who uses the Python programming language to develop, maintain, and optimize systems that process large volumes of data, often referred to as 'big data.' They work with big data technologies like Hadoop, Spark, and data storage solutions to extract insights and support business decisions. Their responsibilities include building data pipelines, ensuring data quality, and collaborating with data scientists and analysts. Python Big Data engineers are skilled in both programming and data engineering, making them essential for handling large-scale data processing tasks.

What is the difference between Python Big Data vs Data Engineer?

AspectPython Big DataData Engineer
Required SkillsPython, Big Data tools (Hadoop, Spark), data processingPython, SQL, ETL, data pipeline development
Work EnvironmentData processing teams, analytics projectsData infrastructure, pipeline management
CertificationsBig Data certifications (Cloudera, Hortonworks)Data engineering certifications (Google Cloud, AWS)

Python Big Data specialists focus on processing large datasets using Python and Big Data tools, often working on analytics projects. Data Engineers build and maintain data pipelines and infrastructure, utilizing Python alongside SQL and cloud platforms. While both roles require Python skills, their focus areas and certifications differ, with Python Big Data emphasizing data processing and Data Engineering emphasizing data infrastructure development.

More about Python Big Data jobs
What states have the most Python Big Data jobs? States with the most job openings for Python Big Data jobs include:
Infographic showing various Python Big Data job openings in the United States as of May 2026, with employment types broken down into 3% As Needed, 67% Full Time, 25% Part Time, 2% Temporary, and 3% Contract. Highlights an 98% Physical, and 2% Remote job distribution, with an average salary of $132,452 per year, or $63.7 per hour.

Data Engineer, Hadoop, SPARK, Python, Shell, CI/CD, Hive, Snowflake, SQL 12+ Mts Con, Alpharetta, GA

ZnA Inc

Alpharetta, GA • On-site

$111.80K - $134.20K/yr

Contractor

Posted 29 days ago


Job description

 
 
JPC - 3512
 
Level 4 : ( 7+ Yrs of exp) 
 
2 rounds of interview ( final round inperson) 
 
Loc - Alpharetta, GA  (Hybrid - 3 days in office, 2 days home)
 
Duration : 12+ Months Contract
 
Description:
 
Big Data Engineer
 
MUST HAVE - Haddoop, SPARK, UNIX, Python, Shell, Github, Devops, CI/CD, Hive, SQL, Trouble Shoot SnowFlake 
 
50% Work on Haddoop - Production Support of the existing Application 
 
50% Work on Frame work of Migration of Data from Hadoop to Snowflake. 
 
 
Description:
 
Big Data Engineer 
 
Job Description
 
Role Name: Big Data Engineer, Python, Big Data (HDFS/Hive/Impala) & Apache Spark, Snowflake, ETL, Github, Devops, Shell 12+ Mths Cont, Alpharetta, GA 
 
Position Title: Consultant
 
Location: Alpharetta, GA

Position Description:
This position is for Big data engineer for Wealth Management Framework CoE team at Client’s Alpharetta or New York offices.
CoE team is responsible to define and govern the data platforms.
We are looking for colleagues with strong sense of ownership and ability to drive solutions.
The role is primarily responsible to automate the existing process and bring new ideas and innovation.
The candidate is expected to code, conduct code reviews, and test framework as needed, along with participating in application architecture and design and other phases of the automation.
The ideal candidate will be a self-motivated team player committed to delivering on time and should be able to work with or without minimal supervision.
 
Responsibilities
  • Design & Develop new automation framework for ETL processing
  • Support existing framework and become technical point of contact for all related teams
  • Enhance existing ETL automation framework as per user requirements
  • Performance tuning of spark, snowflake ETL jobs
  • New technology POC and suitability analysis for Cloud migration
  • Process optimization with the help of automation and new utility development
  • Work in collaboration for any issues and new features
  • Support any batch issue
  • Support application team teams with any queries
 
Required Skills
* 7+ years of Data engineering experience
* Must be strong in UNIX Shell, Python scripting knowledge
* Must be strong in Spark
* Must have strong knowledge of SQL
* Hands-on knowledge on how HDFS/Hive/Impala/Spark works
* Strong in logical reasoning capabilities
* Should have working knowledge of Github, DevOps, CICD/ Enterprise code management tools
* Strong collaboration and communication skills
* Must possess strong team-player skills and should have excellent written and verbal communication skills
* Ability to create and maintain a positive environment of shared success
* Ability to execute and prioritize a tasks and resolve issues without aid from direct manager or project sponsor
* Good to have working experience on snowflake & any data integration tool i.e. informatica cloud
 
 
Primary skills: Python, Big Data & Apache Spark
 
Desired skills
* Snowflake/Azure/AWS any cloud
* IDMC/any ETL tool