ZipRecruiter

Log In

1

Web Data Scraping Jobs in New York (NOW HIRING)

SysMind Tech

Data Engineer

Manhattan, NY · On-site

$126K - $151K/yr

Role: Data Engineer Location- New York, NY JD- Must have finance (investment/capital markets ... Experience with web-scraping. Strong problem-solving skills and the ability to work independently ...

Hedge Fund

Data Platform Engineering Lead

Manhattan, NY · On-site

$150 - $200/hr

Databricks Workflows, Airflow, managed connectors, web scraping * Data Quality & Observability: dbt tests, Elementary, Datadog * CI/CD & Version Control: Bitbucket Pipelines, contract and data ...

New

Wag Art

Staff Data Engineer

Manhattan, NY · On-site

$130 - $160/hr

  • Medical

  • Dental

  • Vision

  • PTO

Design and operate scalable data ingestion and web scraping systems, including best practices around retries, proxies, rate limiting, and anti‑bot strategies Build batch and real‑time pipelines ...

New

Royal Bank of Canada

Sr. Data Scientist

Manhattan, NY · On-site

  • Medical

  • Dental

  • Vision

  • Life

  • Retirement

  • PTO

Identify and evaluate novel data sources, to develop unique and proprietary insights for institutional research teams and clients - including web scraping, geolocation data, satellite imagery, NLP on ...

Diverse Lynx

Technical Recruiter

Newark, NJ · On-site

You will act as a subject matter expert in prospecting techniques and tools used for information retrieval, data extraction, web-scraping, continuous process improvement, process automation, and ...

Diverse Lynx LLC

Technical Recruiter

Newark, NJ

You will act as a subject matter expert in prospecting techniques and tools used for information retrieval, data extraction, web-scraping, continuous process improvement, process automation, and ...

Winaxis

Lead Python Developer

New York, NY · On-site

$153K - $188K/yr

... web scraping, data engineering, and automation using Selenium, BeautifulSoup, Scrapy, and Requests. - Schedule and optimize data workflows with Apache Airflow; integrate AI/ML models for advanced ...

LTE Care Plus Inc.

IT Manager

Melville, NY · On-site

$90K - $120K/yr

Develop and maintain web scraping and data extraction tools, including Selenium for dynamic content * Design, query, and optimize SQL and NoSQL databases, including schema design, indexing, and ...

Tavily Inc

DevOps Engineer

New York, NY · On-site

$57.75 - $79/hr

About Tavily We're building the infrastructure layer for agentic web interaction at scale. Our API ... Maintaining and optimize real-time data pipelines that process billions of events per day across ...

Nimble

Growth Customer Success Manager

Manhattan, NY · On-site

$100/hr

... web into governed, decision-grade data for AI systems and high-stakes business use. Unlike index-based "AI search" tools or brittle legacy scraping, Nimble makes the live web queryable on demand ...

FanDuel

Algorithmic Trading Senior Manager

Jersey City, NJ

  • Medical

  • Dental

  • Vision

  • Life

  • Retirement

  • PTO

Aggregate and synthesize pricing data from multiple sources including APIs, web scraping, and third-party providers to inform trading decisions * Collaborate with engineering teams to improve trading ...

previous pagenext page

Showing results 21-40

All JobsWeb Data Scraping JobsWeb Data Scraping Jobs in New York

Web Data Scraping information

What is web data scraping?

Web data scraping is the process of automatically extracting information from websites using software tools or scripts. This technique allows users to collect large amounts of structured data from web pages, which can then be analyzed or used for various purposes such as market research, price monitoring, or content aggregation. Web data scraping is commonly used in industries that rely on real-time information and competitive analysis. However, it is important to respect website terms of service and copyright laws when scraping data.

What are the key skills and qualifications needed to thrive as a web data scraping specialist?

To thrive as a Web Data Scraping Specialist, you need strong programming skills (especially in Python), knowledge of web protocols, and familiarity with HTML, CSS, and JavaScript. Experience with tools like BeautifulSoup, Scrapy, Selenium, and understanding of APIs and data storage solutions are typically required. Problem-solving, attention to detail, and persistence are crucial soft skills for overcoming challenges like anti-scraping measures and complex site structures. These competencies ensure efficient, reliable extraction of valuable data while maintaining compliance and accuracy.

What are some common challenges faced in a web data scraping role and how can they be addressed?

One common challenge in web data scraping is dealing with websites that use anti-bot measures, such as CAPTCHAs and frequent layout changes. Adapting to these obstacles often requires creative problem-solving, such as implementing rotating proxies or using headless browsers to mimic human behavior. Additionally, maintaining data accuracy and handling large volumes of unstructured data are ongoing tasks, making strong organizational and scripting skills essential. Collaborating with data analysts and developers is also key to ensuring the scraped data meets project needs and quality standards.

What is the difference between Web Data Scraping vs Data Analyst?

AspectWeb Data ScrapingData Analyst
Primary RoleExtracting data from websites automaticallyInterpreting and analyzing data to inform business decisions
Skills RequiredProgramming, web technologies, data extraction toolsStatistical analysis, data visualization, Excel, SQL
Work EnvironmentTechnical, often in IT or data teamsBusiness, finance, marketing departments
Tools & TechnologiesPython, BeautifulSoup, ScrapyExcel, Tableau, R, SQL

Web Data Scraping focuses on automatically collecting data from websites using programming tools, while Data Analysts interpret and analyze data to support business strategies. Both roles require data handling skills but differ in technical focus and end goals.

What are the most commonly searched types of Web Data Scraping jobs in New York?

The most popular types of Web Data Scraping jobs in New York are:

What are popular job titles related to Web Data Scraping jobs in New York?

For Web Data Scraping jobs in New York, the most frequently searched job titles are:

What job categories do people searching Web Data Scraping jobs in New York look for?

The top searched job categories for Web Data Scraping jobs in New York are:

What cities in New York are hiring for Web Data Scraping jobs?

Cities in New York with the most Web Data Scraping job openings:

Web Data Scraping jobs near you
Infographic showing various Web Data Scraping job openings in New York as of August 2026, with employment types broken down into 1% As Needed, 83% Full Time, 13% Part Time, and 3% Contract. Highlights an 86% Physical, 4% Hybrid, and 10% Remote job distribution.

Data Engineer

SysMind Tech

Manhattan, NY • On-site

$126K - $151K/yr

Contractor

This job post has expired today. Applications are no longer accepted.

Job description

Role: Data Engineer
Location- New York, NY
JD-
Must have finance (investment/capital markets) experience
Job Description
We are looking for an experienced Data Engineer with expertise in SQL, python, and strong data modeling skills.
In this role, you will be at the heart of our data ecosystem, designing and maintaining data pipelines and models that drive decision-making across the organization. You will play a key role in ensuring data quality, building scalable systems, and supporting cross-functional teams with clean, accurate, and actionable data.
Key Skills: Python, SQL, Snowflake, Pandas, Azure ADF ETL, Data pipelines
Behavioral Competencies: Good communication (verbal and written) Experience in managing client stakeholders
Qualifications
Bachelor's or master's degree in computer science, Engineering, or a related field.
3+ years of experience in data engineering, with a strong background in building and maintaining data pipelines and ETL processes.
Strong proficiency in SQL and experience with relational databases.
Proficiency with Python.
In-depth knowledge of data modeling, ETL processes, and data integration techniques.
Experience with data warehousing solutions.
Experience with web-scraping.
Strong problem-solving skills and the ability to work independently and as part of a team.
Excellent communication skills, with the ability to collaborate effectively with cross-functional teams.
Responsibilities
Design, develop, and maintain scalable and efficient data pipelines and ETL processes.
Experience with python, SSIS, PDI, Azure Data Factory or other ETL tools.
Improve data ETL pipeline and build tools to analyze new data efficiently.
Collaborate with data scientists/analysts, and stakeholders to understand data requirements and translate them into technical specs.
Build technologies to bolster research & trading efficiency.
Implement best practices for data quality, consistency, and governance across various data sources and systems.
Implement best practices in Data Engineering to drive innovation and enhance our platform as we scale.
Manage day-to-day operations in a fast-paced environment.

Apply