ZipRecruiter

Log In

1

Hadoop Python Jobs in New York (NOW HIRING)

Palnar

Cloud Data Engineer

Newark, NJ

$119K - $143K/yr

... Spark, Hadoop, Python, SQL, NoSQL, Hive); Must have hands-on experience using Spark. • Solid Linux OS and Shell Scripting experience. • Experience working with big data technologies and data ...

Photon

Hadoop App Support | NJ,Texas

Somerville, NJ

... python/perl code to debug any issues or enhance the code Sound knowledge of relational databases (SQL) and experience with large SQL based systems. Strong IT consulting experience in various data ...

Sonsoft Inc

Hadoop Developer

Jersey City, NJ · On-site

Strong knowledge and hands-on programming experience in Hadoop ecosystem * Experience in Data ... Strong understanding and hands-on programming/scripting experience skills - preferably Python, Perl ...

Sonsoft Inc

Hadoop Developer

Jersey City, NJ

... Hadoop ecosystem Experience in Data ingestion (Batch and Real time) , Data Encryption ... preferably Python, Perl, Javascript, UNIX shell Should have worked on large data sets and ...

Sonsoft Inc

Hadoop Developer

Jersey City, NJ

Strong knowledge and hands-on programming experience in Hadoop ecosystem * Experience in Data ... Strong understanding and hands-on programming/scripting experience skills - preferably Python, Perl ...

Sonsoft Inc

Hadoop Developer

Jersey City, NJ · On-site

... Hadoop ecosystem Experience in Data ingestion (Batch and Real time) , Data Encryption ... preferably Python, Perl, Javascript, UNIX shell Should have worked on large data sets and ...

Sonsoft Inc

Hadoop Developer

Jersey City, NJ · On-site

... Hadoop ecosystem Experience in Data ingestion (Batch and Real time) , Data Encryption ... preferably Python, Perl, Javascript, UNIX shell Should have worked on large data sets and ...

Axelon

Software Engineer (Python)

Rutherford, NJ · Hybrid

$67 - $71/hr

Software Engineer Python Global Financial Firm located in RUTHERFORD, NJ has an immediate contract ... Familiarity with distributed data/computing tools (e.g., Hadoop, Hive, Spark, MySQL). * Background ...

Sonsoft Inc

Hadoop Developer

Jersey City, NJ · On-site

... Hadoop ecosystem Experience in Data ingestion (Batch and Real time) , Data Encryption ... preferably Python, Perl, Javascript, UNIX shell Should have worked on large data sets and ...

Precision Technologies Corp

Python GenAI

Jersey City, NJ · On-site

$52.50 - $72.25/hr

Role - Python GenAI Location - Jersey City, NJ/Charlotte, NC / Dallas, TX / NYC Type: W2-Contract ... Experience with Slurm, Hadoop/Hive, Neo4J, Apache Spark, Kafka and MongoDB is a plus * Knowledge of ...

next page

Showing results 1-20

All JobsHadoop Python JobsHadoop Python Jobs in New York

Hadoop Python information

Is Hadoop a good career?

Hadoop Python roles involve working with big data processing using Hadoop frameworks and Python programming. These jobs are in demand in data-driven industries, often requiring knowledge of distributed systems, data analysis, and related tools like Spark or Hive. Careers in this field can offer growth opportunities with relevant certifications and experience in data engineering or analytics.

Does Hadoop work with Python?

Hadoop can work with Python through tools like Hadoop Streaming, which allows developers to write MapReduce jobs in Python. Additionally, frameworks such as PySpark enable Python integration with Apache Spark, often used alongside Hadoop for big data processing. Knowledge of these tools is valuable for Hadoop Python roles.

What are the key skills and qualifications needed to thrive as a Hadoop Python Developer, and why are they important?

To thrive as a Hadoop Python Developer, you need a strong understanding of distributed computing, Hadoop ecosystem components (like HDFS, MapReduce, Hive, or Pig), and advanced Python programming skills, often supported by a degree in computer science or related field. Familiarity with tools such as Apache Spark, Sqoop, and workflow schedulers (like Oozie or Airflow), along with experience in handling big data platforms, is typically required. Problem-solving abilities, attention to detail, and effective communication help developers collaborate with teams and translate business requirements into scalable data solutions. These skills and qualifications are essential for efficiently processing and analyzing large datasets, ensuring data reliability, and driving business insights.

What is the highest paying job in Python?

The highest paying Python-related jobs include roles such as Machine Learning Engineer, Data Scientist, and Quantitative Analyst, often requiring advanced skills in algorithms, statistics, and frameworks like TensorFlow or scikit-learn. These positions typically offer salaries exceeding $120,000 annually, especially with experience and relevant certifications.

What is the difference between Hadoop Python vs Hadoop Java Developer?

AspectHadoop PythonHadoop Java Developer
Required CredentialsPython programming skills, Hadoop certificationsJava programming skills, Hadoop certifications
Work EnvironmentData analysis, scripting, data pipeline developmentCore development, system integration, big data application coding
Industry UsageData science, analytics, machine learning projectsData infrastructure, platform development, system optimization

Hadoop Python and Hadoop Java Developer roles both involve working with Hadoop ecosystems, but Python focuses more on data analysis and scripting, while Java is geared towards core development and system integration. The choice depends on your programming expertise and career goals within big data environments.

What is a Hadoop Python developer?

A Hadoop Python developer is a software professional who specializes in using Python programming language to develop, implement, and maintain applications that process and analyze large datasets within the Hadoop ecosystem. They leverage Python libraries like PySpark to write scalable data processing scripts, interact with Hadoop components such as HDFS, and optimize big data workflows. These developers play a critical role in building data pipelines, performing data transformation, and supporting analytics projects in organizations that handle vast amounts of data.

What is the salary of Hadoop engineer?

The salary of a Hadoop engineer typically ranges from $80,000 to $150,000 annually, depending on experience, location, and certifications. Skilled professionals with expertise in big data tools and programming languages like Python can command higher salaries in this field.

How do Hadoop Python developers typically collaborate with data engineers and analysts on large-scale data projects?

Hadoop Python developers frequently work alongside data engineers and analysts to design, implement, and optimize data pipelines for handling vast datasets. They are responsible for writing Python scripts that interface with Hadoop components, ensuring data is processed efficiently and meets project requirements. Regular communication with data engineers helps align on infrastructure and architectural decisions, while close collaboration with analysts ensures data outputs are accurate and actionable. Agile methodologies and daily stand-ups are common, fostering teamwork and quick problem-solving.
What are popular job titles related to Hadoop Python jobs in New York? For Hadoop Python jobs in New York, the most frequently searched job titles are:
What job categories do people searching Hadoop Python jobs in New York look for? The top searched job categories for Hadoop Python jobs in New York are:
What cities in New York are hiring for Hadoop Python jobs? Cities in New York with the most Hadoop Python job openings:
Hadoop Python jobs near you
Cloud Data Engineer

Cloud Data Engineer

Palnar

Newark, NJ

$119K - $143K/yr

Full-time

Posted 10 days ago

Job description

• Bachelors' degree is required in a relevant field.
• 8+ years of experience working in a data engineering role supporting an on-prem Data Lake; experience within institutional asset management
is a plus.
• 4+ years of strong experience with working on cloud platforms (AWS, Azure) (CloudFormation Templates, IAM, Aurora, EventBridge,
Lambda, CloudWatch);
• 2+ years of experience with Snowflake (SnowSQL, SnowPark)
• 5+ years of experience with any relational database (SQL, Store procedures, functions)
• 5+ years of experience with Python, Spark and SQL programming languages .
• Extensive hands-on experience in modern data lake architecture, database development, and data modeling.
• Knowledge of real-time data streaming and real-time analytics
• Knowledge of Microsoft suite of tools is desired (Power BI, Synapse suite of analytics tools, Azure Data Factory)
• Strong implementation skills and working knowledge of data structures, algorithms and big data tools (Spark, Hadoop, Python, SQL, NoSQL,
Hive); Must have hands-on experience using Spark.
• Solid Linux OS and Shell Scripting experience.
• Experience working with big data technologies and data formats (e.g., Parquet, Delta, Iceberg)
• Extensive experience with at least one of the following RDMS: Oracle, SQL Server, Postgres or MySQL.
• Strong communication skills: able to partner with technical and business stakeholders to drive innovative solutions.
• Prior experience using data governance technology tools.
• Prior experience in a lead role is desired but not required.
• Experience working in an agile environment embracing collaboration within and across teams.
• Excellent written and verbal communication skills.
• Detail oriented; Analytical with strong problem-solving abilities.
• Professional and energetic self-starter. Comfortable with ambiguity, able to effectively take the conceptual to the pragmatic.

Apply