ZipRecruiter

Log In

1

Python Data Scraping Jobs (NOW HIRING)

CTC

Web Scraping Engineer- 3566726

Arlington, VA · On-site +1

$105K - $110K/yr

Proficiency in Python and Java and experience with web scraping libraries such as BeautifulSoup, Scrapy, or Selenium. * Knowledge of AI/machine learning techniques for data extraction and ...

MLabs

Web Scraping Specialist

New York, NY · Remote

$75K - $100K/yr

Data Retrieval: Manage complex data retrieval tasks, including handling pagination and dynamic ... Advanced skills in Python or JavaScript, specifically with libraries and frameworks such as ...

Galls

Data Scientist

Lexington, KY

  • Medical

  • Dental

  • Vision

  • Retirement

  • PTO

Develop scripts and processes for data scraping, collection, cleansing, normalization, and ... Strong programming skills in Python and SQL, with experience developing scalable production-ready ...

SS&C Technologies

Sr. Data Engineer

San Francisco, CA · On-site

$134K - $162K/yr

  • Medical

  • Dental

  • Vision

  • Retirement

  • PTO

Python Proficiency : Expertise in building data ingestion tools using Python, including web scraping and external APIs, and proficient in Python data science packages (numpy, pandas, scikit-learn ...

SS&C

Sr. Data Engineer

San Francisco, CA

$134K - $162K/yr

  • Medical

  • Dental

  • Vision

  • Retirement

  • PTO

Python Proficiency : Expertise in building data ingestion tools using Python, including web scraping and external APIs, and proficient in Python data science packages (numpy, pandas, scikit-learn ...

SS&C Technologies Inc

Sr. Data Engineer

San Francisco, CA · On-site

$134K - $162K/yr

  • Medical

  • Dental

  • Vision

  • Retirement

  • PTO

Python Proficiency : Expertise in building data ingestion tools using Python, including web scraping and external APIs, and proficient in Python data science packages (numpy, pandas, scikit-learn ...

Winaxis

Lead Python Developer

New York, NY · On-site

$153K - $188K/yr

Lead Python Developer - Lead the design, development, and deployment of enterprise-grade ... scraping, data engineering, and automation using Selenium, BeautifulSoup, Scrapy, and Requests ...

NAVA Software Solutions

Python Developer

Houston, TX · On-site

$45.50 - $62.75/hr

Writing modular, reusable components to liaise between external sources of data, internal tools and ... Experience scraping websites with Beautiful Soup, Selenium, etc. * Oracle / PL SQL development ...

THE TILTED CIRCLE LLC

Python AI Developer

Charlotte, NC · On-site

$49 - $67.75/hr

... scraping / template‑based extraction for structured forms 3. Develop AI/LLM‑based extraction ... Extracted data vs source document b. Post‑load verification between Contact Master and source ...

previous page

Showing results 41-60

All JobsTechnology JobsPython Data Scraping Jobs

Python Data Scraping information

What is the difference between Python Data Scraping vs Python Data Analysis?

AspectPython Data ScrapingPython Data Analysis
Primary FocusExtracting data from websites and online sourcesProcessing, interpreting, and visualizing data
Skills RequiredWeb scraping libraries (BeautifulSoup, Scrapy), Python programmingData manipulation (Pandas), statistical analysis, visualization (Matplotlib, Seaborn)
Work EnvironmentData collection, often in research or data-driven companiesData interpretation, reporting, and decision-making
Common UsageGathering data for research, market analysis, or machine learningBusiness insights, data reporting, predictive modeling

Python Data Scraping and Python Data Analysis are related but distinct roles. Data scraping focuses on extracting data from websites, while data analysis involves processing and interpreting that data. Both require Python skills but serve different stages of the data pipeline.

Is Python good for data scraping?

Python is widely used for data scraping due to its simplicity, extensive libraries like BeautifulSoup and Scrapy, and strong community support. It allows data analysts and developers to efficiently extract, process, and automate data collection tasks. Knowledge of programming and web technologies enhances effectiveness in this role.
More about Python Data Scraping jobs

What cities are hiring for Python Data Scraping jobs?

Cities with the most Python Data Scraping job openings:

What states have the most Python Data Scraping jobs?

States with the most job openings for Python Data Scraping jobs include:

What job categories do people searching Python Data Scraping jobs look for?

The top searched job categories for Python Data Scraping jobs are:

Python Data Scraping jobs near you
Infographic showing various Python Data Scraping job openings in the United States as of August 2026, with employment types broken down into 2% Internship, 69% Full Time, 11% Part Time, and 18% Contract. Highlights an 75% In-person, 2% Hybrid, and 23% Remote job distribution.

Lead Python Engineer / Developer - Vice President

iCapital

Stamford, CT • On-site

$150K - $180K/yr

Other

Medical, Dental, Vision, Retirement, PTO

Posted 5 days ago

Job description

About the Role
iCapital is looking to hire an experienced Python Developer with expertise in web scraping, automated portal interactions, and cloud-native deployment using AWS. The ideal candidate will have hands-on experience working with Playwright for browser automation, managing multi-factor authentication (MFA) flows, and deploying scalable scraping tasks via AWS Lambda and related services. This role will assist in architecting and building robust, secure, and scalable scraping solutions that interact with complex web applications and secured portals.
Responsibilities
  • Assist with the design and implementation of advanced scraping solutions using Python, Playwright, and AWS services.
  • Automate interactions with JavaScript-heavy and authentication-secured websites, including handling MFA, CAPTCHAs, and session or token-based login flows.
  • Architect scraping pipelines using serverless AWS components such as Lambda, Step Functions, S3, CloudWatch, and Secrets Manager.
  • Build systems that scale to support high volumes of data extraction with fault tolerance, retries, and intelligent logging.
  • Integrate and manage complex workflows across multiple portals, APIs, and data sources.
  • Contribute to architectural decisions, tooling, and best practices.

Qualifications
  • Bachelor's or master's degree in computer science, software engineering, or related field, or equivalent professional experience
  • 10+ years of experience in Python development, with a strong focus on automation and data extraction
  • Proven expertise in web scraping using tools like Playwright, Selenium, Scrapy, BeautifulSoup, and requests
  • In-depth experience handling multi-step authentication flows, including multi-factor authentication (MFA), CAPTCHA solving, and session or cookie management
  • Proficient in deploying and managing scraping workloads in AWS, particularly Lambda, S3, IAM, CloudWatch, and Secrets Manager
  • Experience with asynchronous programming, headless browsers, and JavaScript-rendered content
  • Solid understanding of web protocols (i.e. HTTP, HTTPS, cookies, headers), and the ability to reverse-engineer network calls and authentication mechanisms
  • Comfortable working with APIs, JSON/XML, and data transformation
  • Experience with CI or CD pipelines, Docker, and infrastructure as code (i.e. CloudFormation, Terraform)
  • Familiar with data pipeline orchestration tools such as Apache Airflow or AWS Step Functions
  • Prior experience scraping from secure or enterprise-level portals (i.e. financial, healthcare, legal)
  • Background in data engineering or ETL workflows is a plus
  • Exposure to Python testing frameworks and writing unit or integration tests

Benefits
The base salary range for this role is $150,000 to $180,000. iCapital offers a compensation package which includes salary, equity for all full-time employees, and an annual performance bonus. Employees also receive a comprehensive benefits package that includes an employer matched retirement plan, generously subsidized healthcare with 100% employer paid dental, vision, telemedicine, and virtual mental health counseling, parental leave, and unlimited paid time off (PTO).
We believe the best ideas and innovation happen when we are together. Employees in this role will work in the office Monday-Thursday, with the flexibility to work remotely on Friday.
For additional information on iCapital, please visit Twitter: @icapitalnetwork | LinkedIn: | Awards Disclaimer: ;br>
iCapital is proud to be an Equal Employment Opportunity and Affirmative Action employer. We do not discriminate based upon race, religion, color, national origin, gender, sexual orientation, gender identity, age, status as a protected veteran, status as an individual with a disability, or other applicable legally protected characteristics.

Apply