ZipRecruiter

Log In

2

Freelance Remote Python Web Scraping Jobs in New York

MLabs

Research Crawling Engineer

New York, NY · On-site +1

$100K/yr

Remote - Must have a 6 hour overlap with EST Remote Full-time Compensation: $100K We are hiring on ... Go, Rust, Python, Java, or C++ . * Proven experience in building web crawlers or large-scale data ...

VML

Senior Project Manager- Freelance

New York, NY · Remote

Good understanding of emerging web standards, user-centered design (UX/UI), optimization and search ... remote offices. * High EQ and the ability to read what a team needs to help motivate them. * Self ...

NAVA Software Solutions

Data Engineer - Remote

Manhattan, NY · On-site +1

$126K - $151K/yr

Code data ingest solutions (Python, Databrick Notebooks, NodeJS) leveraging 3rd party APIs. * Daily ... A basic understanding of HTML, CSS, and web page deployment. * Excellent written and verbal skills ...

ProNexus

Senior Software Engineer

Manhattan, NY · Remote

$125K - $165K/yr

... Remote within the US or Canada Requirements * 3+ years of backend-leaning full-stack experience shipping production web applications * Strong Python and modern backend framework experience * Hands-on ...

ProNexus

Senior Software Engineer

Manhattan, NY · On-site +1

$134K - $177K/yr

... Remote within the US or Canada Requirements * 3+ years of backend-leaning full-stack experience shipping production web applications * Strong Python and modern backend framework experience * Hands-on ...

Aquent

Digital Marketing Manager - part time

Manhattan, NY · On-site +1

$50 - $60/hr

This is a fully remote role, working within your timezone * This is a part time role, approx 10-20 ... Proven track record working independently across multiple freelance, consulting, or contract ...

next page

Showing results 1-20

All JobsPython Web Scraping JobsFreelance Remote Python Web Scraping JobsFreelance Remote Python Web Scraping Jobs in New York

Freelance Remote Python Web Scraping information

What is the difference between Freelance Remote Python Web Scraping vs Freelance Remote Data Analyst?

AspectFreelance Remote Python Web ScrapingFreelance Remote Data Analyst
Skills & ToolsPython, web scraping libraries (BeautifulSoup, Scrapy), APIsExcel, SQL, data visualization tools, statistical analysis
Work EnvironmentRemote, project-based, often self-managedRemote, client-focused, report-driven
Industry UsageWeb data extraction, market research, e-commerceBusiness insights, reporting, data interpretation
CredentialsPython knowledge, basic programming skillsData analysis skills, possibly certifications (e.g., Google Data Analytics)

Freelance Remote Python Web Scraping involves extracting data from websites using Python, focusing on automation and data collection. Freelance Remote Data Analysts interpret and visualize data for clients. While both roles require analytical skills, web scraping emphasizes programming and data extraction, whereas data analysis centers on insights and reporting.

What are the most commonly searched types of Remote Python Web Scraping jobs in New York? The most popular types of Remote Python Web Scraping jobs in New York are:
What are popular job titles related to Freelance Remote Python Web Scraping jobs in New York? For Freelance Remote Python Web Scraping jobs in New York, the most frequently searched job titles are:
What job categories do people searching Freelance Remote Python Web Scraping jobs in New York look for? The top searched job categories for Freelance Remote Python Web Scraping jobs in New York are:
What cities in New York are hiring for Freelance Remote Python Web Scraping jobs? Cities in New York with the most Freelance Remote Python Web Scraping job openings:
Freelance Remote Python Web Scraping jobs near you

Research Crawling Engineer

MLabs

New York, NY • On-site, Remote

$100K/yr

Full-time

Re-posted 16 days ago

Job description

Location: Remote - Must have a 6 hour overlap with EST
Remote Full-time
Compensation: $100K
We are hiring on behalf of our client who is a technical infrastructure firm specializing in the delivery of massive-scale web data to organizations developing advanced artificial intelligence models. The organization supports high-capacity bandwidth-sharing networks and operates a distributed crawler capable of accessing high-quality public web data at a global scale. Additionally, the team has engineered sophisticated pipelines for the ingestion, segmentation, and annotation of billions of multimedia files, facilitating dataset creation for frontier research labs.
The organization operates as a lean, technical team that prioritizes speed and direct execution. As a Research Crawling Engineer, the successful candidate will design and operate large-scale web data acquisition systems. This role encompasses distributed systems, scraping infrastructure, and data pipelines, focusing on providing high-quality inputs for research and model development.
Key Responsibilities
  • Construct and maintain large-scale web crawlers across diverse domains.
  • Design high-throughput, fault-tolerant systems for data collection, managing volumes ranging from millions to billions of URLs per day.
  • Navigate anti-bot systems, rate limits, and dynamic, JavaScript-heavy websites.
  • Develop robust pipelines for data cleaning, deduplication, filtering, and normalization.
  • Build and maintain datasets specifically structured for research and machine learning model training.
  • Monitor and optimize crawl performance, coverage, and data quality through rapid iteration.
  • Collaborate with research teams to ensure data collection efforts align with modeling requirements.
  • Optimize infrastructure to ensure cost-efficiency, low latency, and reliability.

Requirements
  • Extensive programming experience in one or more of the following: Go, Rust, Python, Java, or C++.
  • Proven experience in building web crawlers or large-scale data pipelines.
  • Solid understanding of HTTP, networking protocols, and browser behavior.
  • Familiarity with distributed systems and parallel processing techniques.
  • Experience handling large datasets, ideally at the terabyte to petabyte scale.
  • Demonstrated ability to debug and maintain systems within unstable or adversarial environments.

Preferred Qualifications:
  • Experience with NLP pipelines or dataset curation for machine learning.
  • Familiarity with LLM pre-training data or retrieval systems.
  • Practical experience with headless browsers (e.g., Playwright, Puppeteer, or Chrome DevTools Protocol).
  • Knowledge of proxy systems, IP rotation, and large-scale request orchestration.
  • Background in data quality evaluation or benchmarking.
  • Experience running workloads on cloud or bare-metal infrastructure.

Benefits
  • Impactful Opportunity: Contribute to the development of a web-scale crawler and knowledge graph at the forefront of AI data accessibility.
  • High-Performance Culture: Join a lean, low-ego team that prioritizes high output and professional growth.
  • Remote Work: This position is part of a fully remote team, offering flexibility and autonomy.
  • Competitive Compensation: A package including a competitive salary, comprehensive benefits, and equity, commensurate with experience and the ability to operate at scale.

Interview Process
  1. Recruiter Coordination Call
  2. Hiring Manager Interview
  3. Founder / CEO Interview
  4. Secondary Executive Interview
  5. Final Interview

Due to the high volume of applications we anticipate, we regret that we are unable to provide individual feedback to all candidates. If you do not hear back from us within 4 weeks of your application, please assume that you have not been successful on this occasion. We genuinely appreciate your interest and wish you the best in your job search.
Commitment to Equality and Accessibility:
At MLabs, we are committed to offer equal opportunities to all candidates. We ensure no discrimination, accessible job adverts, and providing information in accessible formats. Our goal is to foster a diverse, inclusive workplace with equal opportunities for all. If you need any reasonable adjustments during any part of the hiring process or you would like to see the job-advert in an accessible format please let us know at the earliest opportunity by emailing human-resources@mlabs.city.
MLabs Ltd collects and processes the personal information you provide such as your contact details, work history, resume, and other relevant data for recruitment purposes only. This information is managed securely in accordance with MLabs Ltd's Privacy Policy and Information Security Policy, and in compliance with applicable data protection laws. Your data may be shared only with clients and trusted partners where necessary for recruitment purposes. You may request the deletion of your data or withdraw your consent at any time by contacting legal@mlabs.city.

Apply