ZipRecruiter

Log In

1

Python Scrapy Jobs (NOW HIRING)

VeridianTech

Python Automation Developer (Onsite)

Seattle, WA · On-site

$57.25 - $78.75/hr

Scrapy Must Have: 3-4 Years of Experience in developing Automations using Python language Core python skills covering: Variables and Data Types; Data Structures; Control Flow and Loops; Functions;

Superlogix, Inc

Python Developer

Fort Worth, TX

$48 - $66.25/hr

Experience with a range of common Python packages, including Requests, NumPy, Scrapy, wxPython, BeautifulSoup, Twisted, etc * Experience with full development lifecycle and tools, including Git, Jira ...

Superlogix, Inc

Python Developer

Fort Worth, TX · On-site

$48 - $66.25/hr

Experience with a range of common Python packages, including Requests, NumPy, Scrapy, wxPython, BeautifulSoup, Twisted, etc * Experience with full development lifecycle and tools, including Git, Jira ...

Winaxis

Lead Python Developer

New York, NY · On-site

$153K - $188K/yr

Lead Python Developer - Lead the design, development, and deployment of enterprise-grade ... Scrapy, and Requests. - Schedule and optimize data workflows with Apache Airflow; integrate AI/ML ...

Babel Street

Software Engineer III

Reston, VA · On-site

Mastery of Python 3.x with deep experience in extraction frameworks (Scrapy, Playwright, Selenium, or Puppeteer). * Technical Resilience: Proven ability to bypass high-level bot detection (e.g ...

Two Six Technologies

Data Collection Engineer

$117K - $140K/yr

Design and deploy high-performance, distributed web scrapers using Python and Scrapy to extract massive datasets efficiently. * Dynamic Content Extraction: Utilize Browser Scripting tools to navigate ...

10a Labs

Engineering Fellowship

Washington, DC

$125/hr

Strong Python background * Clear communicator of technical concepts for non-technical audiences ... Experience with web scraping/crawling (e.g., Beautiful Soup, Selenium, Scrapy) Machine Learning ...

Babel Street

Software Engineer III

Reston, VA · On-site +1

$59.75 - $80.25/hr

Mastery of Python 3.x with deep experience in extraction frameworks (Scrapy, Playwright, Selenium, or Puppeteer). * Technical Resilience: Proven ability to bypass high-level bot detection (e.g ...

10a Labs

Data Engineer, Web Scraping

Washington, DC · Remote

$105K - $125K/yr

Proficiency in Python, SQL * Experience with web scraping/crawling (e.g., Beautiful Soup, Selenium, Scrapy) * Experience with Google Cloud Platform (or similar), including storage and database ...

10a Labs

Data Engineer, Web Scraping

Washington, DC · On-site

$105K - $125K/yr

Proficiency in Python, SQL * Experience with web scraping/crawling (e.g., Beautiful Soup, Selenium, Scrapy) * Experience with Google Cloud Platform (or similar), including storage and database ...

10a Labs

Data Engineer, Web Scraping

San Francisco, CA · Remote

$105K - $125K/yr

Proficiency in Python, SQL * Experience with web scraping/crawling (e.g., Beautiful Soup, Selenium, Scrapy) * Experience with Google Cloud Platform (or similar), including storage and database ...

ABC Legal Services

Operations Specialist

Loveland, CO

$26 - $28/hr

... Scrapy, Puppeteer, or similar) * Automation experience -- scripting, workflow orchestration, or process automation tools (e.g., Python, Zapier, n8n, Airflow) * Exceptional attention to detail and ...

ABC Legal Services

Operations Specialist

Longmont, CO · On-site

$26 - $28/hr

... Scrapy, Puppeteer, or similar) * Automation experience - scripting, workflow orchestration, or process automation tools (e.g., Python, Zapier, n8n, Airflow) * Exceptional attention to detail and ...

next page

Showing results 1-20

All JobsPython Scrapy Jobs

Python Scrapy information

See salary details

$13

$58

$86

How much do python scrapy jobs pay per hour?

As of Aug 2, 2026, the average hourly pay for python scrapy in the United States is $58.62, according to ZipRecruiter salary data. Most workers in this role earn between $48.32 and $66.59 per hour, depending on experience, location, and employer.

What are some typical challenges faced by professionals working in Python Scrapy roles?

Professionals using Python Scrapy often encounter challenges such as handling dynamic websites that use JavaScript, navigating anti-scraping protections, and ensuring data accuracy from diverse sources. It's common to troubleshoot failed crawls, manage large volumes of data, and adapt quickly to changing website structures. Successful Scrapy specialists are resourceful in finding solutions, collaborating with data engineers or product teams, and keeping up-to-date with best practices for ethical data gathering. Overcoming these challenges is an excellent way to build expertise in automation, data engineering, and scalable data solutions.

What is a Python Scrapy job?

A Python Scrapy job involves using the Scrapy framework to build web crawlers and extract data from websites. Responsibilities typically include writing spiders, handling requests and responses, managing data pipelines, and dealing with challenges like CAPTCHA and AJAX-loaded content. These jobs are common in web scraping, data mining, and competitive intelligence fields.

What are the key skills and qualifications needed to thrive in the Python Scrapy position, and why are they important?

To thrive as a Python Scrapy professional, you need strong expertise in Python programming, web scraping concepts, and data processing, often supported by experience with the Scrapy framework. Familiarity with related tools like XPath, CSS selectors, databases (SQL/NoSQL), and version control (e.g., Git) is important, and certifications in Python or data science can be advantageous. Attention to detail, problem-solving, and effective communication are valuable soft skills that set candidates apart. These technical and interpersonal abilities are crucial for efficiently extracting, processing, and delivering high-quality data in collaborative environments.

More about Python Scrapy jobs
What are the most commonly searched types of Python Scrapy jobs? The most popular types of Python Scrapy jobs are:
What states have the most Python Scrapy jobs? States with the most job openings for Python Scrapy jobs include:
What job categories do people searching Python Scrapy jobs look for? The top searched job categories for Python Scrapy jobs are:
Python Scrapy jobs near you
Infographic showing various Python Scrapy job openings in the United States as of July 2026, with employment types broken down into 92% Full Time, 4% Part Time, and 4% Contract. Highlights an 81% Physical, 6% Hybrid, and 13% Remote job distribution, with an average salary of $121,932 per year, or $58.6 per hour.

Python Automation Developer

Tata Consultancy Service Limited

Plano, TX • On-site

$90K - $120K/yr

Full-time

Medical, Dental, Vision, Retirement, PTO

Re-posted 16 days ago

Job description

Must Have Technical/Functional Skills
Technical Skills:
1. Core python skills covering: Variables and Data Types; Data Structures; Control Flow and Loops; Functions;
2. Input/Output (I/O) and File Handling; Exception Handling; Modules and Packages etc.
3. Libraries: Python Libraries such as NumPy; Pandas; Scikit-learn; TensorFlow and PyTorch;
4. Framework: Django ; Flask; FastAPI
5. Web Scraping and HTTP: Beautiful Soup; Scrapy
Must Have:
• 3-4 Years of Experience in developing Automations using Python language
• Core python skills covering: Variables and Data Types; Data Structures; Control Flow and Loops; Functions;
• Input/Output (I/O) and File Handling; Exception Handling; Modules and Packages etc.
• Libraries: Python Libraries such as NumPy; Pandas; Scikit-learn; TensorFlow and PyTorch;
• Framework: Django ; Flask; FastAPI
• Web Scraping and HTTP: Beautiful Soup; Scrapy
Good to have:
- Background in operations research/optimization (e.g., scheduling, VM allocation).
- Experience with AWS cloud platforms.
- Security best practices: vulnerability scanning.
- knowledge on automation tools like RPA Blue Prism or RPA Power Automate.
Roles & Responsibilities
- End-to-end software development across design, implementation, testing, deployment, and maintenance.
- Understand existing complex Python-based codebases, implement new feature, automations and maintain existing code base ensuring quality, performance, scalability, and security.
- Write, maintain, and optimize Python scripts for data processing, system monitoring, and workflow automation
- Maintaining/Enhancing existing CI/CD pipelines (GitLab CI, GitHub Actions, Jenkins), define branching strategies, enforce code review standards, optimize build/test/deploy workflows, and manage releases.
- Work on Linux environment, monitoring.
- Understand complex interfacing system and integrate with different interfaces (APIs, event-driven, batch processes, etc.).
- Model relational databases, optimize SQL queries, and conduct performance tuning and schema evolution.
- Communicate with User and Understand operations research/optimization methods to solve complex airline operations and crew planning problems.
- Collaborate with product managers and clients; present technical solutions, manage expectations, and translate requirements into delivery plans.
- Scope work, estimate effort, break down tasks, and manage sprint commitments.
- Design and implement automated testing to ensure software quality, often using tools like PyTest or Selenium
Base Salary Range : $90,000 to $120,000 Per Annum
TCS Employee Benefits Summary:
Discretionary Annual Incentive.
Comprehensive Medical Coverage: Medical & Health, Dental & Vision, Disability Planning & Insurance, Pet Insurance Plans.
Family Support: Maternal & Parental Leaves.
Insurance Options: Auto & Home Insurance, Identity Theft Protection.
Convenience & Professional Growth: Commuter Benefits & Certification & Training Reimbursement.
Time Off: Vacation, Time Off, Sick Leave & Holidays.
Legal & Fi nancial Assistance: Legal Assistance, 401K Plan, Performance Bonus, College Fund, Student Loan Refinancing.
#LI-SV2
#LI-KUMARAN

Apply