1

Python Scrapy Jobs (NOW HIRING)

Python Developer

Fort Worth, TX

$48 - $66.25/hr

Experience with a range of common Python packages, including Requests, NumPy, Scrapy, wxPython, BeautifulSoup, Twisted, etc * Experience with full development lifecycle and tools, including Git, Jira ...

Python Developer

Fort Worth, TX · On-site

$48 - $66.25/hr

Experience with a range of common Python packages, including Requests, NumPy, Scrapy, wxPython, BeautifulSoup, Twisted, etc * Experience with full development lifecycle and tools, including Git, Jira ...

Lead Python Developer

New York, NY · On-site

$153.20K - $188.20K/yr

Lead Python Developer - Lead the design, development, and deployment of enterprise-grade ... Scrapy, and Requests. - Schedule and optimize data workflows with Apache Airflow; integrate AI/ML ...

Mastery of Python 3.x with deep experience in extraction frameworks (Scrapy, Playwright, Selenium, or Puppeteer). * Technical Resilience: Proven ability to bypass high-level bot detection (e.g ...

Strong Python background * Clear communicator of technical concepts for non-technical audiences ... Experience with web scraping/crawling (e.g., Beautiful Soup, Selenium, Scrapy) Machine Learning ...

Software Engineer III

Reston, VA · On-site +1

$59.75 - $80.25/hr

Mastery of Python 3.x with deep experience in extraction frameworks (Scrapy, Playwright, Selenium, or Puppeteer). * Technical Resilience: Proven ability to bypass high-level bot detection (e.g ...

Proficiency in Python, SQL * Experience with web scraping/crawling (e.g., Beautiful Soup, Selenium, Scrapy) * Experience with Google Cloud Platform (or similar), including storage and database ...

Data Engineer, Web Scraping

$117.20K - $140.70K/yr

... Python, SQL • Experience with web scraping/crawling (e.g., Beautiful Soup, Selenium, Scrapy) • Experience with Google Cloud Platform (or similar), including storage and database services (e.g ...

Proficiency in Python, SQL * Experience with web scraping/crawling (e.g., Beautiful Soup, Selenium, Scrapy) * Experience with Google Cloud Platform (or similar), including storage and database ...

Design, build, and maintain scalable data pipelines using Python, Spark, and Airflow to support our ... Preferred * Experience with Django, Scala, or Scrapy. * Hands-on experience with workflow ...

Strong Python background * Clear communicator of technical concepts for non-technical audiences ... Experience with web scraping/crawling (e.g., Beautiful Soup, Selenium, Scrapy) Machine Learning ...

next page

Showing results 1-20

Python Scrapy information

See salary details

$13

$58

$86

How much do python scrapy jobs pay per hour?

As of May 31, 2026, the average hourly pay for python scrapy in the United States is $58.62, according to ZipRecruiter salary data. Most workers in this role earn between $48.32 and $66.59 per hour, depending on experience, location, and employer.

What is a Python Scrapy job?

A Python Scrapy job involves using the Scrapy framework to build web crawlers and extract data from websites. Responsibilities typically include writing spiders, handling requests and responses, managing data pipelines, and dealing with challenges like CAPTCHA and AJAX-loaded content. These jobs are common in web scraping, data mining, and competitive intelligence fields.

What are the key skills and qualifications needed to thrive in the Python Scrapy position, and why are they important?

To thrive as a Python Scrapy professional, you need strong expertise in Python programming, web scraping concepts, and data processing, often supported by experience with the Scrapy framework. Familiarity with related tools like XPath, CSS selectors, databases (SQL/NoSQL), and version control (e.g., Git) is important, and certifications in Python or data science can be advantageous. Attention to detail, problem-solving, and effective communication are valuable soft skills that set candidates apart. These technical and interpersonal abilities are crucial for efficiently extracting, processing, and delivering high-quality data in collaborative environments.

What are some typical challenges faced by professionals working in Python Scrapy roles?

Professionals using Python Scrapy often encounter challenges such as handling dynamic websites that use JavaScript, navigating anti-scraping protections, and ensuring data accuracy from diverse sources. It's common to troubleshoot failed crawls, manage large volumes of data, and adapt quickly to changing website structures. Successful Scrapy specialists are resourceful in finding solutions, collaborating with data engineers or product teams, and keeping up-to-date with best practices for ethical data gathering. Overcoming these challenges is an excellent way to build expertise in automation, data engineering, and scalable data solutions.
What are the most commonly searched types of Python Scrapy jobs? The most popular types of Python Scrapy jobs are:
What states have the most Python Scrapy jobs? States with the most job openings for Python Scrapy jobs include:

Python Automation Developer (Onsite)

VeridianTech

Seattle, WA

$57.25 - $78.75/hr

Other

Posted 2 days ago


Job description

Hi,
Job Title: - Python Automation Developer
Location: - Renton, WA / Everett, WA
Full-time/permanent
Job Description
Must Have Technical/Functional Skills
Technical Skills:
1. Core python skills covering: Variables and Data Types; Data Structures; Control Flow and Loops; Functions;
2. Input/Output (I/O) and File Handling; Exception Handling; Modules and Packages etc.
3. Libraries: Python Libraries such as NumPy; Pandas; Scikit-learn; TensorFlow and PyTorch;
4. Framework: Django ; Flask; FastAPI
5. Web Scraping and HTTP: Beautiful Soup; Scrapy
Must Have:
3-4 Years of Experience in developing Automations using Python language
Core python skills covering: Variables and Data Types; Data Structures; Control Flow and Loops; Functions;
Input/Output (I/O) and File Handling; Exception Handling; Modules and Packages etc.
Libraries: Python Libraries such as NumPy; Pandas; Scikit-learn; TensorFlow and PyTorch;
Framework: Django ; Flask; FastAPI
Web Scraping and HTTP: Beautiful Soup; Scrapy
Good to have:
- Background in operations research/optimization (e.g., scheduling, VM allocation).
- Experience with AWS cloud platforms.
- Security best practices: vulnerability scanning.
- knowledge on automation tools like RPA Blue Prism or RPA Power Automate.
Thanks