ZipRecruiter

Log In

1

Python Scrapy Jobs (NOW HIRING)

VeridianTech

Python Automation Developer (Onsite)

Seattle, WA · On-site

$57.25 - $78.75/hr

Scrapy Must Have: 3-4 Years of Experience in developing Automations using Python language Core python skills covering: Variables and Data Types; Data Structures; Control Flow and Loops; Functions;

Superlogix, Inc

Python Developer

Fort Worth, TX · On-site

$48 - $66.25/hr

Experience with a range of common Python packages, including Requests, NumPy, Scrapy, wxPython, BeautifulSoup, Twisted, etc * Experience with full development lifecycle and tools, including Git, Jira ...

Superlogix, Inc

Python Developer

Fort Worth, TX · On-site

$48 - $66.25/hr

Experience with a range of common Python packages, including Requests, NumPy, Scrapy, wxPython, BeautifulSoup, Twisted, etc * Experience with full development lifecycle and tools, including Git, Jira ...

Winaxis

Lead Python Developer

New York, NY · On-site

$153K - $188K/yr

Lead Python Developer - Lead the design, development, and deployment of enterprise-grade ... Scrapy, and Requests. - Schedule and optimize data workflows with Apache Airflow; integrate AI/ML ...

Babel Street

Software Engineer III

Reston, VA · On-site

Mastery of Python 3.x with deep experience in extraction frameworks (Scrapy, Playwright, Selenium, or Puppeteer). * Technical Resilience: Proven ability to bypass high-level bot detection (e.g ...

10a Labs

Engineering Fellowship

Washington, DC

$125/hr

Strong Python background * Clear communicator of technical concepts for non-technical audiences ... Experience with web scraping/crawling (e.g., Beautiful Soup, Selenium, Scrapy) Machine Learning ...

Babel Street

Software Engineer III

Reston, VA · On-site +1

$59.75 - $80.25/hr

Mastery of Python 3.x with deep experience in extraction frameworks (Scrapy, Playwright, Selenium, or Puppeteer). * Technical Resilience: Proven ability to bypass high-level bot detection (e.g ...

10a Labs

Data Engineer, Web Scraping

Washington, DC · Remote

$105K - $125K/yr

Proficiency in Python, SQL * Experience with web scraping/crawling (e.g., Beautiful Soup, Selenium, Scrapy) * Experience with Google Cloud Platform (or similar), including storage and database ...

10a Labs

Data Engineer, Web Scraping

Washington, DC · On-site

$105K - $125K/yr

Proficiency in Python, SQL * Experience with web scraping/crawling (e.g., Beautiful Soup, Selenium, Scrapy) * Experience with Google Cloud Platform (or similar), including storage and database ...

10a Labs

Data Engineer, Web Scraping

San Francisco, CA · Remote

$105K - $125K/yr

Proficiency in Python, SQL * Experience with web scraping/crawling (e.g., Beautiful Soup, Selenium, Scrapy) * Experience with Google Cloud Platform (or similar), including storage and database ...

TSMC

Data Engineer (7747)

San Jose, CA · On-site

$174K - $175K/yr

Experience applying web scraping techniques and data extraction methods using Python tools such as Scrapy, BeautifulSoup, and Selenium; Experience with front-end web technologies (HTML, CSS) for data ...

next page

Showing results 1-20

All JobsPython Scrapy Jobs

Python Scrapy information

See salary details

$13

$58

$86

How much do python scrapy jobs pay per hour?

As of Jul 11, 2026, the average hourly pay for python scrapy in the United States is $58.62, according to ZipRecruiter salary data. Most workers in this role earn between $48.32 and $66.59 per hour, depending on experience, location, and employer.

What are some typical challenges faced by professionals working in Python Scrapy roles?

Professionals using Python Scrapy often encounter challenges such as handling dynamic websites that use JavaScript, navigating anti-scraping protections, and ensuring data accuracy from diverse sources. It's common to troubleshoot failed crawls, manage large volumes of data, and adapt quickly to changing website structures. Successful Scrapy specialists are resourceful in finding solutions, collaborating with data engineers or product teams, and keeping up-to-date with best practices for ethical data gathering. Overcoming these challenges is an excellent way to build expertise in automation, data engineering, and scalable data solutions.

What is a Python Scrapy job?

A Python Scrapy job involves using the Scrapy framework to build web crawlers and extract data from websites. Responsibilities typically include writing spiders, handling requests and responses, managing data pipelines, and dealing with challenges like CAPTCHA and AJAX-loaded content. These jobs are common in web scraping, data mining, and competitive intelligence fields.

What are the key skills and qualifications needed to thrive in the Python Scrapy position, and why are they important?

To thrive as a Python Scrapy professional, you need strong expertise in Python programming, web scraping concepts, and data processing, often supported by experience with the Scrapy framework. Familiarity with related tools like XPath, CSS selectors, databases (SQL/NoSQL), and version control (e.g., Git) is important, and certifications in Python or data science can be advantageous. Attention to detail, problem-solving, and effective communication are valuable soft skills that set candidates apart. These technical and interpersonal abilities are crucial for efficiently extracting, processing, and delivering high-quality data in collaborative environments.

More about Python Scrapy jobs
What are the most commonly searched types of Python Scrapy jobs? The most popular types of Python Scrapy jobs are:
What states have the most Python Scrapy jobs? States with the most job openings for Python Scrapy jobs include:
What job categories do people searching Python Scrapy jobs look for? The top searched job categories for Python Scrapy jobs are:
Python Scrapy jobs near you
Infographic showing various Python Scrapy job openings in the United States as of July 2026, with employment types broken down into 86% Full Time, and 14% Part Time. Highlights an 71% In-person, and 29% Remote job distribution, with an average salary of $121,932 per year, or $58.6 per hour.

Web Scraper remote

ESRhealthcare and EXEC STAFF RECRUITERS

New York, NY • Remote

$20 - $50/hr

Part-time

Posted 16 days ago

Job description

Web Scraper remote

50 openings

$20 - $50/hr

Required Skills

Python

Scrapy

Selenium

Html

Css

Javascript

Rest-api

Json

Xml

Data-cleaning

Data-manipulation

Nosql

Relational-databases

Web-security

Job Description

Job Title: Web Scraper

Job Type: Contractor (Part-time)

Location: Remote

Job Summary: In this role, you'll apply your expertise to help train next-generation AI systems. Your work will shape how models learn, reason, and perform through high-quality, real-world input. No prior experience in AI is required — your domain knowledge is what matters.

Key Responsibilities:

- Design, develop, and maintain robust web scraping scripts and applications

- Perform data extraction from multiple websites, handling both static and dynamic content

- Clean, validate, and structure large volumes of scraped data for further analysis

- Monitor scraping pipelines for data quality and troubleshoot scraping failures

- Implement solutions to bypass anti-scraping mechanisms and maintain scraping effectiveness

- Collaborate with customer's team members to define data requirements and deliverables

- Document scraping processes and maintain code for scalability and reusability

Required Skills and Qualifications:

- Proven experience in building and maintaining web scrapers using tools such as Python, Scrapy, Selenium, or similar technologies

- Strong understanding of HTML, CSS, JavaScript, and web protocols

- Expertise in handling APIs, RESTful interfaces, and parsing JSON/XML data

- Excellent written and verbal communication skills, with the ability to convey technical information clearly

- Proficiency with data cleaning, manipulation, and storage using relational or NoSQL databases

- Knowledge of web security concepts and best practices for ethical scraping

- Demonstrated ability to troubleshoot and resolve issues autonomously

Preferred Qualifications:

- Experience with cloud-based scraping and deployment (AWS, Azure, or GCP)

- Familiarity with version control systems like Git

- Background in large-scale data extraction projects