1

Weekend Big Data Software Engineer Jobs in New York

BIG DATA ENGINEER

Berkeley Heights, NJ · On-site

$58.25 - $77/hr

Big Data Engineer (Java,Spark, Hadoop, Ozone CH) Location: Berkeley Heights, NJ Role Overview: We ... Software Engineering, or a related field. • Proficiency in business process modeling and ...

Senior Big Data Engineer

New York, NY · On-site +1

$170K - $180K/yr

Collaborate with Software Engineering, Data Engineering, SRE, and Database teams to support new ... Big Data: Apache Kafka, Hadoop / MapR, Aerospike, Spark Operating Systems: Rocky Linux Databases:

Sr. Big Data Engineer

Weehawken, NJ · On-site

$60.50 - $80.25/hr

Sr. Big Data Engineer Weehawken, NJ Strong Banking Domain experience is required Only Local ... Familiarity with Agile methodologies and best practices in software development. Preferred, but not ...

Big Data Engineer

Red Bank, NJ · On-site

$130K - $146K/yr

... a Big Data Developer. In this role, you will be part of the team that is responsible for ... Design and develop software components that integrate with our identity graphs, client data, and ...

Big Data Engineer

New York, NY · Remote

$57 - $75.50/hr

Does NOT want a machine learning engineer, wants a big data engineer Required Skills: * 5-10 years of experience * Python, Airflow, PySpark, Spark SQL, Spark Streaming, Scala, Relational/No SQL ...

Sr. Big Data Engineer

Jersey City, NJ

$58.25 - $77/hr

Sonsoft Inc. is growing at a steady pace specializing in the fields of Software Development ... Our Big Data capability team needs hands-on developers who can produce beautiful & functional code ...

Sr. Big Data -Engineer

Jersey City, NJ · On-site

$58.25 - $77/hr

Sonsoft Inc. is growing at a steady pace specializing in the fields of Software Development ... Services. - Our Big Data capability team needs hands-on developers who can produce beautiful ...

Big Data Developer

Jersey City, NJ · On-site

$55.25 - $71.75/hr

Big Data Developer Location: New Jersey, NJ***Hybrid 3 days in a Week*** Duration: 1 Years Spark - Must have Scala - Must Have Hive & SQL - Must Have Hadoop - Must Have Communication - Must Have ...

Big Data Engineer

New York, NY

$61 - $80.75/hr

... software engineering and systems integration. Our tightly integrated offerings are tailored to each ... Primary Skills: 1. Very strong server-side Java experience, especially in an open source, data ...

next page

Showing results 1-20

Weekend Big Data Software Engineer information

What is the difference between Weekend Big Data Software Engineer vs Weekend Data Analyst?

AspectWeekend Big Data Software EngineerWeekend Data Analyst
Required SkillsProgramming (Java, Python), Big Data tools (Hadoop, Spark), Data pipeline developmentData visualization, SQL, statistical analysis, Excel
Work EnvironmentTech companies, data-driven projects, software development teamsBusiness departments, reporting, data interpretation
CertificationsBig Data certifications (Cloudera, Hortonworks), Programming certifications

Weekend Big Data Software Engineers focus on developing and maintaining big data systems using programming and big data tools, often working in tech environments. Weekend Data Analysts interpret data, create reports, and support decision-making with statistical skills. Both roles may work on weekends but differ in technical depth and daily tasks.

What are the most commonly searched types of Big Data Software Engineer jobs in New York? The most popular types of Big Data Software Engineer jobs in New York are:

BIG DATA ENGINEER

Prophecy Technologies

Berkeley Heights, NJ • On-site

$58.25 - $77/hr

Full-time

Posted 17 days ago


Job description

Job Title: Big Data Engineer (Java,Spark, Hadoop, Ozone CH)
Location: Berkeley Heights, NJ
Role Overview:
We are seeking a highly skilled Big Data Engineer with strong experience in Apache Spark, Hadoop ecosystem, and Apache Ozone. The ideal candidate will design, develop, and optimize large-scale data processing systems, ensuring high performance, scalability, and reliability for enterprise-level applications.
Key Responsibilities:
• Design and implement distributed data processing solutions using Apache Spark, Hadoop, Flink
• Develop and maintain Spark applications for data transformation, aggregation, and ETL processes using Scala, Java, or Python
• Utilize Apache Ozone for storing large-scale datasets, ensuring efficient data access and management in a distributed environment
• Manage and optimize HDFS and Apache Ozone, Kafka for scalable and fault-tolerant storage.
• Develop ETL pipelines for batch and real-time data ingestion and transformation.
• Implement and ensure data validation, data security, integrity, and compliance across big data platforms.
• Monitor and troubleshoot performance issues in large-scale clusters.
• Collaborate with data scientists, analysts, and application teams to deliver high-quality data solutions.
• Automate workflows and improve operational efficiency using scripting and orchestration tools.
Required Skills & Qualifications:
• Strong expertise in Apache Spark (Core, SQL, Streaming).
• Hands-on experience with Hadoop ecosystem (HDFS, YARN, MapReduce).
• Proficiency in Apache Ozone for object storage and integration with Hadoop.
• Solid programming skills in Java , Scala , or Python.
• Experience with Hive, HBase , and Kafka is a plus.
• Knowledge of cluster management and resource optimization.
• Familiarity with Linux/Unix environments and shell scripting.
• Understanding of data security, governance, and compliance standards.
• Experience with cloud-based big data platforms
• Exposure to containerization (Docker, Kubernetes) for big data workloads.
• Knowledge of CI/CD pipelines for data engineering projects.
Behavioral Skills:
• Good Communication skills
• 5 days Work from Office at Berkley Heights, NJ
• Team Player
• Ability to work in a changing environment
• Strong problem solving and analytical skills
• Ability to work independently or within a team
• Manage day-to-day challenges and communicate developmental risks with the technical team
Qualifications:
• Bachelor's degree in computer science, Software Engineering, or a related field.
• Proficiency in business process modeling and documentation tools.
• Product implementation experience is preferred