1

Python Scrapy Jobs (NOW HIRING)

Machine Learning Engineer

Dublin, CA · On-site

$90 - $130/hr

Proficiency in at least one programming language commonly used in machine learning, such as Python ... Scrapy), data collection (e.g., VPNs, Selenium), data processing (e.g., Hadoop, Datasketch)

Proficiency in at least one programming language commonly used in machine learning, such as Python ... Scrapy), data collection (e.g., VPNs, Selenium), data processing (e.g., Hadoop, Datasketch)

Web Scraping Engineer- 3566726

Arlington, VA · On-site +1

$105K - $110K/yr

Proficiency in Python and Java and experience with web scraping libraries such as BeautifulSoup, Scrapy, or Selenium. * Knowledge of AI/machine learning techniques for data extraction and ...

Showing results 21-26

Python Scrapy information

See salary details

$13

$58

$86

How much do python scrapy jobs pay per hour?

As of Aug 22, 2026, the average hourly pay for python scrapy in the United States is $58.62, according to ZipRecruiter salary data. Most workers in this role earn between $48.32 and $66.59 per hour, depending on experience, location, and employer.

What is a Python Scrapy?

A Python Scrapy job involves using the Scrapy framework to build web crawlers and extract data from websites. Responsibilities typically include writing spiders, handling requests and responses, managing data pipelines, and dealing with challenges like CAPTCHA and AJAX-loaded content. These jobs are common in web scraping, data mining, and competitive intelligence fields.

What are the key skills and qualifications needed to thrive in the Python Scrapy position?

To thrive as a Python Scrapy professional, you need strong expertise in Python programming, web scraping concepts, and data processing, often supported by experience with the Scrapy framework. Familiarity with related tools like XPath, CSS selectors, databases (SQL/NoSQL), and version control (e.g., Git) is important, and certifications in Python or data science can be advantageous. Attention to detail, problem-solving, and effective communication are valuable soft skills that set candidates apart. These technical and interpersonal abilities are crucial for efficiently extracting, processing, and delivering high-quality data in collaborative environments.

What are some typical challenges faced by professionals working in Python Scrapy roles?

Professionals using Python Scrapy often encounter challenges such as handling dynamic websites that use JavaScript, navigating anti-scraping protections, and ensuring data accuracy from diverse sources. It's common to troubleshoot failed crawls, manage large volumes of data, and adapt quickly to changing website structures. Successful Scrapy specialists are resourceful in finding solutions, collaborating with data engineers or product teams, and keeping up-to-date with best practices for ethical data gathering. Overcoming these challenges is an excellent way to build expertise in automation, data engineering, and scalable data solutions.

What are the most commonly searched types of Python Scrapy jobs?

The most popular types of Python Scrapy jobs are:

What states have the most Python Scrapy jobs?

States with the most job openings for Python Scrapy jobs include:

Infographic showing various Python Scrapy job openings in the United States as of August 2026, with employment types broken down into 1% Internship, 87% Full Time, 6% Part Time, and 6% Contract. Highlights an 76% Physical, 7% Hybrid, and 17% Remote job distribution, with an average salary of $121,932 per year, or $58.6 per hour.

Software Development Engineering - Advisor II

Fiserv, Inc.

Milwaukee, WI • On-site

Full-time

Re-posted 10 days ago


Fiserv rating

7.7

Company rating: 7.7 out of 10

Based on 95 frontline employees who took The Breakroom Quiz

108th of 151 rated financial services


Job description

Calling all innovators - find your future at Fiserv.
We're Fiserv, a global leader in Fintech and payments, and we move money and information in a way that moves the world. We connect financial institutions, corporations, merchants and consumers to one another millions of times a day - quickly, reliably, and securely. Any time you swipe your credit card, pay through a mobile app, or withdraw money from the bank, we're involved. If you want to make an impact on a global scale, come make a difference at Fiserv.
Job Title
Software Development Engineering - Advisor II
TITLE: Software Development Engineering - Advisor II
EMPLOYER: Fiserv Solutions, LLC
LOCATION: Milwaukee, WI (and various unanticipated locations throughout the U.S. subject to authorization from management)
DUTIES: Spearhead and fine tune the creation of emerging deep learning models that transform text, raw images, and time series data into interpretable information and actionable recommendations to power AI applications. Design and implement user-friendly interactive web applications that connect with machine learning systems. Deploy deep learning models. Design and implement dashboards to summarize key analytics for stakeholders. Collaborate with product, engineering, and operational teams to proactively gather feedback, gather requirements, and develop metrics. Communicate findings, recommendations, and analysis results to stakeholders in verbal, visual and written media. Stay up-to-date with industry trends and advancements in machine learning platforms as well as machine learning techniques, and lead the team in learning and improvement.
REQUIREMENTS: Bachelor's degree in Computer Engineering, Telecommunications Engineering, Electrical Engineering, Mechanical Engineering, Computer Science, Data Science, Statistics, Mathematics, Applied Mathematics, Physics, or a related field and 4 years in any job title involving algorithm, machine learning framework, and platform development experience in data science. Alternatively, the employer will accept Master's degree in Computer Engineering, Telecommunications Engineering, Electrical Engineering, Mechanical Engineering, Computer Science, Data Science, Statistics, Mathematics, Applied Mathematics, Physics, or a related field and 2 years in any job title involving algorithm, machine learning framework, and platform development experience in data science. Prior experience must include: 2 years developing and deploying data science models using Python; 2 years working with version control systems including GIT; 2 years documenting the development processes, including code, design decisions, and user guides; 2 years working in Machine Learning (ML), natural language processing (NLP), and deep learning (DL) models for business specific use cases; 1 year designing and building topic modeling algorithms using Latent Dirichlet Allocation (LDA); Designing and creating Sigma dashboard to showcase topic modeling results for stakeholders; Performing analysis on topic modeling outputs to derive actionable insights and present findings to stakeholders; Presenting highly technical findings to non-technical audience including senior leadership; Performing Exploratory Data Analysis (EDA) on numerical and categorical features to identify relevant features; Designing and developing ensemble model to predict merchant attrition risk; Designing, developing and deploying merchant retention models to predict customer retention using Adobe Analytics; Designing and developing clustering algorithm on a set of customers identified by merchant retention model based on heuristics and business requirements; Designing KPIs based on customer behavior data to measure performance and customer stickiness; Designing and building database structure and automated reporting dashboard using tableau and sigma; Designing and developing Random Forest and Regression model to predict customer/merchant retention; Designing and developing time series model using ARIMA and fbProphet for multi-region demand forecasting at multiple temporal resolution; Working with TensorFlow, scikit-learn, and Keras for machine learning tasks; Implementing web scraping and data mining solutions to gather open-source data using scrapy in Python; Leading and performing architectural design with collaborators based on stakeholder requirements; and Performing text preprocessing, vectorization using Tf-Idf, clustering using DBScan, and summarization methods.
TRAVEL: None
TO APPLY: Apply by selecting "Apply" on this page and following prompts to attach resume and submit.
JOB CODE: CR594
#P3M
It is unlawful to discriminate against a prospective employee due to the individual's status as a veteran.
Our commitment to Equal Opportunity:
Fiserv is proud to be an Equal Opportunity Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, national origin, gender, gender identity, sexual orientation, age, disability, protected veteran status, or any other category protected by law.
If you have a disability and require a reasonable accommodation in completing a job application or otherwise participating in the overall hiring process, please contact AskHR.US@fiserv.com. Please note our AskHR representatives do not have visibility to your application status. Current associates who require a workplace accommodation should refer to Fiserv's Disability Accommodation Policy for additional information.
Note to agencies:
Fiserv does not accept resume submissions from agencies outside of existing agreements. Please do not send resumes to Fiserv associates. Fiserv is not responsible for any fees associated with unsolicited resume submissions.
Warning about fake job posts:
Please be aware of fraudulent job postings that are not affiliated with Fiserv. Fraudulent job postings may be used by cyber criminals to target your personally identifiable information and/or to steal money or financial information. Any communications from a Fiserv representative will come from a legitimate Fiserv email address.

What Fiserv employees say

Pay

Benefits

Hours and flexibility

Workplace

Get the full story on Breakroom


Fiserv logo

About Fiserv

Sourced by ZipRecruiter

Fiserv is a global leader in fintech and payments for over 35 years serving thousands of financial institutions and millions of businesses in more than 100 countries. Our Purpose is to deliver superior value for our clients through leading technology, targeted innovation, and excellence in everything we do as we process over 40% of the world's debit and credit transactions.

Industry

It services and software development

Company size

10,000+ Employees

Headquarters location

Brookfield, WI, US

Social media