ZipRecruiter

Log In

1

Python Scrapy Jobs (NOW HIRING)

Sayari

Data Engineer (Remote, US)

$90K - $120K/yr

Design, build, and maintain scalable data pipelines using Python, Spark, and Airflow to support our ... Preferred * Experience with Django, Scala, or Scrapy. * Hands-on experience with workflow ...

TSMC

Data Engineer (7747)

San Jose, CA

$174K - $175K/yr

Experience applying web scraping techniques and data extraction methods using Python tools such as Scrapy, BeautifulSoup, and Selenium; Experience with front-end web technologies (HTML, CSS) for data ...

TSMC

Data Engineer (7747)

San Jose, CA · On-site

$174K - $175K/yr

Experience applying web scraping techniques and data extraction methods using Python tools such as Scrapy, BeautifulSoup, and Selenium; Experience with front-end web technologies (HTML, CSS) for data ...

10a Labs

Engineering Fellowship

Washington, DC · On-site

Strong Python background * Clear communicator of technical concepts for non-technical audiences ... Experience with web scraping/crawling (e.g., Beautiful Soup, Selenium, Scrapy) Machine Learning ...

CTC

Web Scraping Engineer- 3566726

Arlington, VA · On-site +1

$105K - $110K/yr

Proficiency in Python and Java and experience with web scraping libraries such as BeautifulSoup, Scrapy, or Selenium. * Knowledge of AI/machine learning techniques for data extraction and ...

Wynd Labs

Web Scraping Specialist

New York, NY

$102K - $103K/yr

Proficiency in languages such as Python or JavaScript, with strong skills in libraries and frameworks like BeautifulSoup, Scrapy, or Selenium. * Knowledge of asynchronous programming, multithreading ...

Articul8

Machine Learning Engineer - Data Pipeline

Dublin, CA · On-site

$128K - $154K/yr

Proficiency in at least one programming language commonly used in machine learning, such as Python ... Scrapy), data collection (e.g., VPNs, Selenium), data processing (e.g., Hadoop, Datasketch)

MLabs

Web Scraping Specialist

New York, NY · On-site +1

$75K - $100K/yr

Advanced skills in Python or JavaScript, specifically with libraries and frameworks such as BeautifulSoup, Scrapy, or Selenium. * Advanced Programming: Strong knowledge of asynchronous programming ...

MLabs

Web Scraping Specialist

New York, NY · Remote

$75K - $100K/yr

Advanced skills in Python or JavaScript, specifically with libraries and frameworks such as BeautifulSoup, Scrapy, or Selenium. * Advanced Programming: Strong knowledge of asynchronous programming ...

next page

Showing results 1-20

All JobsPython Scrapy Jobs

Python Scrapy information

See salary details

$13

$58

$86

How much do python scrapy jobs pay per hour?

As of Jul 12, 2026, the average hourly pay for python scrapy in the United States is $58.62, according to ZipRecruiter salary data. Most workers in this role earn between $48.32 and $66.59 per hour, depending on experience, location, and employer.

What are some typical challenges faced by professionals working in Python Scrapy roles?

Professionals using Python Scrapy often encounter challenges such as handling dynamic websites that use JavaScript, navigating anti-scraping protections, and ensuring data accuracy from diverse sources. It's common to troubleshoot failed crawls, manage large volumes of data, and adapt quickly to changing website structures. Successful Scrapy specialists are resourceful in finding solutions, collaborating with data engineers or product teams, and keeping up-to-date with best practices for ethical data gathering. Overcoming these challenges is an excellent way to build expertise in automation, data engineering, and scalable data solutions.

What is a Python Scrapy job?

A Python Scrapy job involves using the Scrapy framework to build web crawlers and extract data from websites. Responsibilities typically include writing spiders, handling requests and responses, managing data pipelines, and dealing with challenges like CAPTCHA and AJAX-loaded content. These jobs are common in web scraping, data mining, and competitive intelligence fields.

What are the key skills and qualifications needed to thrive in the Python Scrapy position, and why are they important?

To thrive as a Python Scrapy professional, you need strong expertise in Python programming, web scraping concepts, and data processing, often supported by experience with the Scrapy framework. Familiarity with related tools like XPath, CSS selectors, databases (SQL/NoSQL), and version control (e.g., Git) is important, and certifications in Python or data science can be advantageous. Attention to detail, problem-solving, and effective communication are valuable soft skills that set candidates apart. These technical and interpersonal abilities are crucial for efficiently extracting, processing, and delivering high-quality data in collaborative environments.

More about Python Scrapy jobs
What are the most commonly searched types of Python Scrapy jobs? The most popular types of Python Scrapy jobs are:
What states have the most Python Scrapy jobs? States with the most job openings for Python Scrapy jobs include:
What job categories do people searching Python Scrapy jobs look for? The top searched job categories for Python Scrapy jobs are:
Python Scrapy jobs near you
Infographic showing various Python Scrapy job openings in the United States as of July 2026, with employment types broken down into 86% Full Time, and 14% Part Time. Highlights an 71% In-person, and 29% Remote job distribution, with an average salary of $121,932 per year, or $58.6 per hour.

Data Engineer (Remote, US)

Sayari

Remote

$90K - $120K/yr

Full-time

Medical, Dental, Vision, Life, Retirement, PTO

Re-posted 16 days ago

Job description

About Sayari:
Sayari is the judgment infrastructure for trustworthy AI in economic security and commercial risk. The Sayari Commercial World Model resolves 11.7B+ primary-source records from 250+ jurisdictions forming the ground truth of global commerce. A Judgment Ontology, encoding over a decade of investigative tradecraft, and Superconductor, an agentic orchestration platform, deliver AI that reasons like an expert analyst, shows its work, and traces every finding to its source. Trusted by U.S. Customs and Border Protection, HM Revenue & Customs, and Fortune 500 enterprises, Sayari is used by thousands of professionals across 35+ countries to secure supply chains and dismantle illicit networks. Headquartered in Washington, D.C., with offices in London, Singapore, Tokyo, and Tel Aviv.
POSITION DESCRIPTION
As a Data Engineer at Sayari, you will be the engine behind the world's most comprehensive commercial world model. You will join a high-autonomy team responsible for building and scaling the complex orchestration systems that transform billions of primary-source records into actionable intelligence. This is a role for a "builder" who respects the complexity of large-scale ETL and graph databases and is "PhD-curious" about the future of AI-native data products and modern orchestration.
JOB RESPONSIBILITIES
  • Design, build, and maintain scalable data pipelines using Python, Spark, and Airflow to support our core data acquisition and entity resolution engines.
  • Collaborate cross-functionally with AI/ML and Product teams to implement new features and AI-native products.
  • Proactively identify and resolve bottlenecks in our complex ETL processes, bringing a fresh perspective to refine and optimize our existing codebase.
  • Contribute to a robust engineering culture through rigorous code reviews, unit testing, and clear communication of design decisions.
  • Own the end-to-end delivery of roadmap tasks within two-week sprints, ensuring work meets high standards for quality, documentation, and performance.
  • Participate in roadmap planning and story refinement, eventually taking ownership of major epics that drive our long-term product defensibility.
SKILLS & EXPERIENCE
Required
  • Professional proficiency in Python and experience contributing to shared codebases using Git (branching, PRs, code reviews).
  • 3+ years of experience working in Data Engineering
  • Demonstrated experience working with relational databases (PostgreSQL/BigQuery) and an interest in or familiarity with graph databases.
  • Familiarity with distributed computing (Spark) or a strong desire to master it.
  • Strong collaborative skills and the ability to work effectively in an Agile, sprint-based environment.
  • A "self-directed" orientation: ability to move tasks from "assigned" to "complete" with high autonomy and clear communication.

Preferred
  • Experience with Django, Scala, or Scrapy.
  • Hands-on experience with workflow orchestration tools like Airflow.
  • Experience or strong interest in LLM tuning, deployment, and AI engineering best practices.
  • Experience working with international or non-English datasets.
  • Prior experience working with high-scale, complex data pipelines.

The target base salary for this position is $90,000-$120,000 plus company bonus and equity. Final offer amounts are determined by multiple factors including location, local market variances, candidate experience and expertise, internal peer equity, and may vary from the amounts listed above.
Benefits:
  • 100% fully paid medical, vision, and dental for employees and their dependents
  • Generous time off; we observe all US federal holidays, close our office for a winter break (12/24-12/31), in addition to granting 18 PTO days and 10 sick days
  • Outstanding compensation package; competitive commissions for revenue roles and bonuses for non-revenue positions
  • A strong commitment to diversity, equity, and inclusion
  • Eligibility to participate in additional benefits such as 401k match up to 5%, 100% paid life insurance (up to $100,000 coverage),, and parental leave
  • A collaborative and positive culture - your team will be as smart and driven as you
  • Limitless growth and learning opportunities

Sayari is an equal opportunity employer and strongly encourages diverse candidates to apply. We believe diversity and inclusion mean our team members should reflect the diversity of the United States. No employee or applicant will face discrimination or harassment based on race, color, ethnicity, religion, age, gender, gender identity or expression, sexual orientation, disability status, veteran status, genetics, or political affiliation. We strongly encourage applicants of all backgrounds to apply.
Pay Range
$90,000-$120,000 USD

Apply