ZipRecruiter

Log In

1

Big Data Testing Jobs in New York (NOW HIRING)

PamTen Inc

Data QA / ETL Test Engineer

Jersey City, NJ · On-site

$45.25 - $61.50/hr

... testing data pipelines built on modern big data platforms. • Knowledge of ETL tools such as IDMC / IICS and familiarity with Informatica-based ecosystems. • Experience with data quality ...

Lorven Technologies

ETL Tester

Manhattan, NY · On-site

... Big Data testing (Hive, Hadoop, Spark) - Basic knowledge of Python or Shell scripting for data validation - Domain experience (Banking, Healthcare, Retail, Telecom optional) Soft Skills - Strong ...

Stem Xpert

Big Data Solutions Architect

New York, NY · On-site

... testing, IT Consulting & staffing for IT Infrastructure Management through strategic consulting and ... Design/ Architected and implemented complex projects dealing with the considerable data size (GB ...

BC Forward

Data Engineer

Manhattan, NY · On-site

$78.75 - $83.83/hr

Collaborate across software engineering disciplines including analysis, development, testing, and deployment. Required Skills & Qualifications: Proficiency in Big Data development and toolsets (e.g ...

CYNET SYSTEMS

Senior Snowflake Data Engineer

New York, NY · On-site

$65 - $70/hr

... testing phases. * Architect the data warehouse and provide guidance to the team in implementation using Snowflake, SnowSQL, and other big data technologies. * Hands-on experience with Snowflake ...

Equation Staffing

VP of Data Science

Manhattan, NY · On-site

... testing, CI/CD, scalability) · Work with the leadership team in establishing a long-term vision ... big data' technologies. · Keep our data separated and secure · Work with data and analytics ...

Princeton IT Services

Lead Data Engineer

Parsippany, NJ · On-site

$115K - $138K/yr

Candidates whose experience is primarily focused on Big Data are not a fit for this role. Before ... testing, and QA. Collaborate closely with engineering teams to design and implement scalable data ...

Lorven Technologies

ETL SDET Testing - NYC, NY

Manhattan, NY · On-site +1

$55 - $71/hr

Strong SQL skills, with experience in handling big data using ETL tools (e.g. Informatica ... Experience providing testing oversight in Agile team. Should have excellent business communication ...

Publicis Groupe Holdings B.V

Data Scientist

Manhattan, NY

$72K - $109K/yr

  • Medical

  • Dental

  • Vision

  • Retirement

  • PTO

Using distributed computing systems to access and manipulate big data sources. * Conducting ... Testing scalable data pipelines or models for real-time applications. * Ensuring that analytic ...

Publicis Groupe Holdings B.V

Data Scientist

Manhattan, NY · On-site

$72K - $109K/yr

  • Medical

  • Dental

  • Vision

  • Retirement

  • PTO

Using distributed computing systems to access and manipulate big data sources. * Conducting ... Testing scalable data pipelines or models for real-time applications. * Ensuring that analytic ...

previous pagenext page

Showing results 21-40

All JobsBig Data Testing JobsBig Data Testing Jobs in New York

Big Data Testing information

See New York salary details

$17

$68

$96

How much do big data testing jobs pay per hour?

As of Aug 14, 2026, the average hourly pay for big data testing in New York is $68.90, according to ZipRecruiter salary data. Most workers in this role earn between $58.65 and $77.60 per hour, depending on experience, location, and employer.

What is big data testing?

Big Data Testing is the process of verifying and validating the quality, accuracy, and reliability of large and complex data sets and the systems that process them. It involves testing data ingestion, processing, storage, and retrieval to ensure that big data applications function as expected. This type of testing also checks for data integrity, performance, and scalability issues in big data environments such as Hadoop, Spark, or NoSQL databases. The goal is to ensure that data-driven applications deliver correct and meaningful insights.

What is the difference between Big Data Testing vs Data Analyst?

AspectBig Data TestingData Analyst
Required SkillsData validation, scripting, understanding of big data toolsData interpretation, SQL, visualization skills
Work EnvironmentTesting environments, big data platforms like Hadoop, SparkData analysis platforms, BI tools, databases
CertificationsBig Data certifications, ISTQB, testing-focused credentialsData analysis certifications, SQL, Tableau
Industry UsageQuality assurance in big data projectsBusiness insights, reporting, decision-making

Big Data Testing focuses on validating data quality, performance, and integrity within big data systems, requiring testing skills and knowledge of big data tools. Data Analysts interpret and visualize data to support business decisions, emphasizing analytical skills and data visualization. While both roles work with large datasets, Big Data Testing ensures system reliability, whereas Data Analysts focus on deriving insights from data.

What are some common challenges faced by professionals in big data testing, and how can they be addressed?

One common challenge in Big Data Testing is ensuring data quality and accuracy when dealing with vast, complex datasets that often span multiple sources and formats. Testers must also handle performance and scalability issues, as big data platforms process information at high volumes and speeds. Collaborating closely with data engineers and developers is essential to understand data flows and system architecture. To address these challenges, testers often use automation tools, develop robust test strategies, and continually update their skills to keep pace with evolving big data technologies.

What is the salary of big data tester?

The salary of a Big Data Tester typically ranges from $70,000 to $120,000 annually, depending on experience, location, and certifications. Entry-level positions may start lower, while experienced professionals with skills in tools like Hadoop or Spark can earn higher salaries.

What are the key skills and qualifications needed to thrive as a big data tester, and why are they important?

To thrive as a Big Data Tester, you need a solid understanding of data analytics, software testing methodologies, and a background in computer science or information technology. Familiarity with big data tools such as Hadoop, Spark, Hive, SQL, as well as automation frameworks and scripting languages like Python or Java, is typically required. Attention to detail, analytical thinking, and strong problem-solving abilities are crucial soft skills for identifying data issues and ensuring data quality. These skills are essential to validate large-scale data systems effectively, ensuring reliability, accuracy, and performance in data-driven projects.

What are popular job titles related to Big Data Testing jobs in New York?

For Big Data Testing jobs in New York, the most frequently searched job titles are:

What job categories do people searching Big Data Testing jobs in New York look for?

The top searched job categories for Big Data Testing jobs in New York are:

Big Data Testing jobs near you
Infographic showing various Big Data Testing job openings in New York as of August 2026, with employment types broken down into 1% As Needed, 81% Full Time, 14% Part Time, 1% Temporary, and 3% Contract. Highlights an 86% Physical, 4% Hybrid, and 10% Remote job distribution, with an average salary of $143,319 per year, or $68.9 per hour.

Big Data/Hadoop Architect

Sonoma Consulting Inc.

New York, NY

Full-time

Re-posted 11 days ago

Job description

Company Description

Halo Group is a premier provider of IT talent. We place technology experts within
the teams of the world's leading companies to help them build innovative
businesses that keep them one step closer to their customers and one step
ahead of the competition. We offer a meaningful work environment for
employees, attractive and interesting engagements for consultants, and cutting-edge
digital innovation for our customers.
We delight in helping our customers execute their digital vision. Big projects or
small, Halo Group knows that by combining the highest quality talent with our
unwavering support, we will become an invaluable extension of the team. Halo
Group's experienced consultants in Detroit, Atlanta and Dallas specialize in all
areas of product/project governance, UX/UI, multi-platform applications, quality
assurance/testing, cloud computing, and data analytics.
Since its inception, Halo Group has been recognized for numerous awards, including: 
- INC 5000
- Future 50
- 101 Best and Brightest
- Michigan 50 Companies to Watch
- Goldline Research - "Most Dependable Companies"
- Ernst & Young - "Entrepreneur of the Year" Finalist

Job Description

Mandatory:

Hands on experience in BigData space (Hadoop Stack like HDFS, Pig, Hive, HBase, Sqoop etc)

Experience with Java programming

Provide oversight and guidance to Hadoop team

Ability to debug & write / modify Pig. Hive, Sqoop codes

Ability to debug & write / modify Shell script/Python

Very good understanding of Big Data eco-system

Candidate should also have good knowledge of Big Data architecture patterns, design patterns, estimation techniques, performance tuning and trouble shooting

Willing to work on-call support over weekends

Liase with multiple application teams & co-ordinate for issue resolution

Good analytical & interaction skills

Qualifications

Bachelor's degree or foreign equivalent required from an accredited institution. Will also consider three years of progressive experience in the specialty in lieu of every year of education.
At least 10 years of experience with IT

Additional Information

All your information will be kept confidential according to EEO guidelines.

Sonoma Consult logo

About Sonoma Consult

Sourced by ZipRecruiter

Sonoma Consult is a California based C corporation helping companies bring products to the patient by working closely with the engineering teams and the clinicians. Our goal, no matter what stage of product development, is to create and execute a plan of action to move the product through the appropriate clinical and regulatory steps. Sonoma Consult works cohesively with the engineers and physicians to translate technologies to the clinic. Our goal is to help you get the very best product to the clinic and to the market. This includes planning, execution and ensuring critical data is delivered in the right format to ensure the feedback loop to the design team ultimately delivers the most advanced technology to the patient.

Industry

Business management consulting

Company size

1 - 10 Employees

Headquarters location

Sonoma, CA, US

View All Sonoma Consult Jobs

Apply