ZipRecruiter

Log In

1

Python Scraping Jobs in New York (NOW HIRING)

Hebbia

Applied Research Engineer, Agents

Manhattan, NY · On-site

$225K/yr

... Python • Experience with NLP and text processing libraries such as NLTK, SpaCy, or Apache Tika ... and data scraping techniques • Prior experience in developing NLP models and systems • ...

Royal Bank of Canada

Sr. Data Scientist

New York, NY · On-site

... teams and clients - including web scraping, geolocation data, satellite imagery, NLP on ... Expert working knowledge of Python and R , with strong overall coding abilities. * Expert-level ...

MLabs

Research Crawling Engineer

New York, NY · On-site +1

$100K/yr

This role encompasses distributed systems, scraping infrastructure, and data pipelines, focusing on ... Go, Rust, Python, Java, or C++ . * Proven experience in building web crawlers or large-scale data ...

MLabs

Research Crawling Engineer

New York, NY · Remote

$100K/yr

This role encompasses distributed systems, scraping infrastructure, and data pipelines, focusing on ... Go, Rust, Python, Java, or C++ . * Proven experience in building web crawlers or large-scale data ...

previous page

Showing results 41-60

All JobsPython Scraping JobsPython Scraping Jobs in New York

Python Scraping information

What are some common challenges faced by Python scraping professionals, and how can they be addressed?

Python Scraping professionals often encounter obstacles such as website anti-scraping measures, dynamic content loading with JavaScript, and frequent changes in website structures. Overcoming these challenges typically involves using tools like Selenium or Playwright for dynamic pages, rotating proxies and user agents to avoid detection, and writing adaptable, modular code to quickly update scrapers when site layouts change. Staying up to date with the latest libraries and best practices is vital for efficiency and compliance with legal and ethical standards.

What are the key skills and qualifications needed to thrive as a Python scraping specialist, and why are they important?

To thrive as a Python Scraping Specialist, you need strong proficiency in Python programming, understanding of web protocols (HTTP, HTML, CSS), and experience with libraries such as BeautifulSoup, Scrapy, or Selenium. Familiarity with version control systems like Git and knowledge of data storage formats (JSON, CSV, SQL) are also commonly required. Problem-solving, attention to detail, and effective communication are valuable soft skills in this role. These skills ensure efficient data extraction, compliance with website policies, and the ability to deliver actionable insights from web data.

What is the difference between Python Scraping vs Data Analyst?

AspectPython ScrapingData Analyst
Required SkillsPython programming, web scraping libraries (BeautifulSoup, Scrapy)Data analysis, SQL, Excel, statistical skills
Work EnvironmentTechnical, coding-focused, often remoteBusiness-focused, reporting, presentations
Industry UsageWeb data extraction, research projectsBusiness insights, decision-making
CertificationsPython certifications, web scraping coursesData analysis certifications (e.g., CAP, Microsoft Certified)

Python Scraping involves writing code to extract data from websites, focusing on programming skills and technical tools. Data Analysts interpret and visualize data for business insights, requiring analytical and statistical skills. While both roles work with data, Python Scraping is more technical and coding-intensive, whereas Data Analysts focus on analyzing and presenting data for decision-making.

What is Python scraping?

Python scraping refers to the process of using the Python programming language to extract data from websites or online sources. It typically involves sending HTTP requests to webpages, parsing the HTML or other content, and collecting specific information for analysis or storage. Popular Python libraries for web scraping include BeautifulSoup, Scrapy, and Requests. This technique is widely used in data analysis, research, and business intelligence, but it's important to respect website terms of service and legal guidelines when scraping data.

Is Python good for data scraping?

Python is widely used for data scraping due to its simplicity and extensive libraries like BeautifulSoup, Scrapy, and Requests that facilitate web data extraction. It is suitable for roles involving data collection, automation, and analysis, often requiring knowledge of HTML, CSS, and APIs.

Which Python scraping job is in demand?

Python scraping jobs are in high demand across industries such as data analysis, market research, and automation. Roles typically require skills in web scraping tools like BeautifulSoup or Scrapy, and knowledge of APIs and data handling. Demand is strong for professionals who can efficiently extract and process large datasets for business insights.
What are popular job titles related to Python Scraping jobs in New York? For Python Scraping jobs in New York, the most frequently searched job titles are:
What job categories do people searching Python Scraping jobs in New York look for? The top searched job categories for Python Scraping jobs in New York are:
Python Scraping jobs near you
Infographic showing various Python Scraping job openings in New York as of August 2026, with employment types broken down into 1% Internship, 87% Full Time, 4% Part Time, and 8% Contract. Highlights an 81% Physical, 5% Hybrid, and 14% Remote job distribution.

Senior Machine Learning Engineer - up to $200k + equity

ingenium.agency

Manhattan, NY • On-site

$200K/yr

Full-time

Medical, Retirement, PTO

Re-posted 27 days ago

Job description

Senior Machine Learning Engineer - up to $200k base + equity

We accelerate the deployment of climate tech solutions by providing clients with industry leading insights, data, analytics, and research on both technologies and markets. Our subscription intelligence platform gives investors, corporates, and governments the insights they need to anticipate developments and to confidently build and finance the new climate economy. We produce the industry-leading newsletter read by 60,000 climate leaders.



We are looking for a Senior Machine Learning Software Engineer to join our engineering team. As a Senior ML Software Engineer, you will design, develop and implement software solutions across our machine learning and data stack, and play a crucial role in delivering insights into the new climate economy to investors, corporates, and governments mobilizing strategies in the climate transition. Our ideal candidate has a strong technical background and a willingness to “wear many hats”, learn new skills, and take the initiative to develop new features as needs arise.


The Role

  • Collection — Implement web scraping and other collection techniques to increase the speed, efficiency, and breadth of data collection.
  • Processing — Implement AI, natural language processing, and machine learning models to extract, classify, and transform data.
  • Infrastructure — Assist in developing and maintaining our internal data server and web interface. This will include developing new features for data entry and validation of AI-generated data.
  • Analysis — Analyze the performance of the machine learning and data stack to identify opportunities to improve coverage and accuracy.


The Essentials

  • 5+ years experience as a Software Engineer, Machine Learning Engineer, Data Engineer or equivalent
  • Deep expertise in Python development
  • Experience in machine learning / natural language processing
  • Proven history developing and maintaining production-grade software
  • A passion for addressing the climate crisis through high quality research and data
  • Interest in working for a fast-moving startup with a small, international team
  • A BSc degree in Computer Science, Engineering or other relevant field


A Plus

  • Experience using Django and AWS
  • A successful history of manipulating, processing and extracting value from datasets
  • Experience working with Jira / Agile framework
  • Experience using Bitbucket Pipelines
  • Working understanding of climate tech sectors


Our Offer


  • Opportunity to work and learn at a fast-growing climate tech startup
  • Hybrid office based in New York
  • Generous base salary + stock options
  • Flexible working hours
  • 20 days PTO + federal holidays
  • Health coverage and 401(k)