1

Python Big Data Jobs in New York (NOW HIRING)

Data Engineer

Newark, NJ · On-site

$119.70K - $143.80K/yr

Minimum 2 Year Experience on Big Data Platform * Proficiency with Java, Python, Scala, HBase, Hive, MapReduce, ETL, Kafka, Mongo, Postgres, Redshift. Visualization technologies etc. * Flair for data ...

Big Data Engineer Lead

New York, NY · On-site

$149.30K - $202.27K/yr

Be in tune with emerging trends in Big data and cloud technologies and participate in evaluation of ... including Python, Scala, Java, or similar * Expert knowledge of Agile approaches to software ...

Python Developer

Jersey City, NJ · On-site

$52.50 - $72.25/hr

Python Developer Location : Jersey city, NJ - 240229 Duration : 6+ months contract to hire The ... Big Data technology experience Rule engine experience such as Drools Roles and Responsibilities:

Python Developer

Jersey City, NJ · On-site

$52.50 - $72.25/hr

Python (Key), Big data, Hadoop (Preferred), Java Skills: Sound technologist, taking ownership, good problem solving and analytical skills. These skills are a must have Skills APPS NICHE SKILLS ...

Python Developer

New York, NY

$55 - $75.75/hr

Knowledge of big data environments is desired, using Pydoop library. * Experience with PL SQL. * Knowledge of version and revision control practices and procedures. Qualifications Python, JAVA, C ...

Data Engineer

Manhattan, NY · On-site

$126.20K - $151.50K/yr

NYC, NY * 3to 5 years of experience in Data Engineering using Python along with Pyspark/Spark - MUST * 3-5 years of experience in building big data solutions with pyspark , preferably in Data ...

Senior Data Engineer, Big Data

New York, NY · On-site

$105.10K - $189.60K/yr

... Python, Java, Scala, and/or Go (Required) Knowledge, Skills and Abilities : Licenses and ... A big part of how we care for one another is working to ensure our benefits evolve to meet the ...

Senior Data Engineer, Big Data

New York, NY · On-site

$105.10K - $189.60K/yr

... Python, Java, Scala, and/or Go (Required) Knowledge, Skills and Abilities : Licenses and ... A big part of how we care for one another is working to ensure our benefits evolve to meet the ...

Data Engineer

New York, NY · On-site

$125.30K - $150.40K/yr

... SQL * - Python * - Spark, Hive, Airflow Preferred Skills: * - Cloud data platforms (AWS/GCP/Azure) * - NoSQL databases Expert (12+ years) Mandatory Skills: * - Big Data architecture design ...

Be it core Java, full-stack Java, Web/UI designers, Big Data or Cloud or Mobility developers/architects, we have them all. - 4+ years of Development experience in Python/Django - Strong object ...

Python Developer

Manhattan, NY

$55.50 - $76.25/hr

Role: Sr Python Developer Location: NYC Duration : Full-time Looking for candidates with 10+ years ... We specialize in Big Data & Analytics, Digital Transformation, IT Service Management, Cognitive ...

Solution Architect - Jersey City

Jersey City, NJ · On-site

$65.75 - $86.75/hr

Extensive hands-on experience with Python, big-data frameworks, and AI/ML platforms. Proven expertise in designing and managing large-scale data ecosystems and leveraging AI for data integration and ...

Extensive hands-on experience with Python, big-data frameworks, and AI/ML platforms. Proven expertise in designing and managing large-scale data ecosystems and leveraging AI for data integration and ...

Senior Python Developer

Jersey City, NJ · On-site

$125K - $130K/yr

Key responsibilities include writing clean Python code, building and optimizing ETL processes, and ... Strong problem-solving and analytical skills Experience with big data technologies (e.g., Hadoop ...

Python Developer

Jersey City, NJ

$52.50 - $72.25/hr

Python Developer Job Location: Jersey City, NJ Job Type: Contract to Hire Description: * 7+ years ... Hands on experience with Big Data technologies strongly desired * BigData technology experience

next page

Showing results 1-20

Python Big Data information

See New York salary details

$29K

$144.8K

$203.3K

How much do python big data jobs pay per year?

As of May 29, 2026, the average yearly pay for python big data in New York is $144,806.00, according to ZipRecruiter salary data. Most workers in this role earn between $124,632.00 and $169,457.00 per year, depending on experience, location, and employer.

What are the key skills and qualifications needed to thrive as a Python Big Data Engineer, and why are they important?

To thrive as a Python Big Data Engineer, a strong background in Python programming, data structures, and distributed systems is essential, often supported by a degree in computer science or related fields. Familiarity with big data tools such as Hadoop, Spark, Kafka, and cloud platforms, as well as relevant certifications, is typically required. Strong analytical thinking, problem-solving abilities, and effective communication skills help professionals stand out in this field. These competencies are crucial for designing scalable data solutions, collaborating across teams, and extracting valuable insights from large datasets.

How do Python Big Data professionals typically collaborate with data engineers and data scientists in a project setting?

Python Big Data professionals often serve as a bridge between data engineers, who focus on building and maintaining data pipelines, and data scientists, who analyze and interpret data. On a typical project, you might work closely with data engineers to ensure data is efficiently ingested, cleaned, and stored using scalable solutions like Hadoop or Spark. You'll also support data scientists by developing tools, scripts, or models that help them extract insights from large datasets. Effective communication and teamwork are key, as projects often require integrating codebases and aligning on data requirements and project goals.

What is a Python Big Data engineer?

A Python Big Data engineer is a technology professional who uses the Python programming language to develop, maintain, and optimize systems that process large volumes of data, often referred to as 'big data.' They work with big data technologies like Hadoop, Spark, and data storage solutions to extract insights and support business decisions. Their responsibilities include building data pipelines, ensuring data quality, and collaborating with data scientists and analysts. Python Big Data engineers are skilled in both programming and data engineering, making them essential for handling large-scale data processing tasks.

What is the difference between Python Big Data vs Data Engineer?

AspectPython Big DataData Engineer
Required SkillsPython, Big Data tools (Hadoop, Spark), data processingPython, SQL, ETL, data pipeline development
Work EnvironmentData processing teams, analytics projectsData infrastructure, pipeline management
CertificationsBig Data certifications (Cloudera, Hortonworks)Data engineering certifications (Google Cloud, AWS)

Python Big Data specialists focus on processing large datasets using Python and Big Data tools, often working on analytics projects. Data Engineers build and maintain data pipelines and infrastructure, utilizing Python alongside SQL and cloud platforms. While both roles require Python skills, their focus areas and certifications differ, with Python Big Data emphasizing data processing and Data Engineering emphasizing data infrastructure development.

$119.70K - $143.80K/yr

Full-time

Posted 21 days ago


Job description

Data Engineer for enhancements to PII Data Lake environment for Grow
Flair for data, schema, data model, how to bring efficiency in big data related life cycle. Understanding of automated QA needs related to Big Data and visualization platforms.
Requirements:
  • Java is must and also should have UI experience - Profile
  • BS in Computer Science or related area
  • 5-8 years software development experience
  • Minimum 2 Year Experience on Big Data Platform
  • Proficiency with Java, Python, Scala, HBase, Hive, MapReduce, ETL, Kafka, Mongo, Postgres, Redshift. Visualization technologies etc.
  • Flair for data, schema, data model, how to bring efficiency in big data related life cycle
  • Understanding of automated QA needs related to Big data
  • Understanding of various Visualization platform (Tableau, D3JS, others)
  • Proficiency with agile or lean development practices
  • Strong object-oriented design and analysis skills
  • Excellent technical and organizational skills
  • Excellent written and verbal communication skills. Skill sets / technologies
  • Programming language -- Java (must), Python, Scala, Ruby
  • Batch processing -- Hadoop MapReduce, Cascading/Scalding, Apache Spark
  • Stream processing -- Apache Storm, AKKA, Samza, Spark streaming
  • NoSQL -- HBase, MongoDB, Cassandra, Riak,
  • ETL Tools Data Stage, Informatica
  • Code/Build/Deployment -git, hg, svn, maven, sbt, jenkins, bamboo

Job Requirements