Proficiency in Python and Java and experience with web scraping libraries such as BeautifulSoup, Scrapy, or Selenium. * Knowledge of AI/machine learning techniques for data extraction and ...
Proficiency in Python and Java and experience with web scraping libraries such as BeautifulSoup, Scrapy, or Selenium. * Knowledge of AI/machine learning techniques for data extraction and ...
Data Engineer, Web Scraping
Washington, DC · Remote
$105K - $125K/yr
Proficiency in Python, SQL * Experience with web scraping/crawling (e.g., Beautiful Soup, Selenium, Scrapy) * Experience with Google Cloud Platform (or similar), including storage and database ...
Data Engineer, Web Scraping
Washington, DC · Remote
$105K - $125K/yr
Proficiency in Python, SQL * Experience with web scraping/crawling (e.g., Beautiful Soup, Selenium, Scrapy) * Experience with Google Cloud Platform (or similar), including storage and database ...
Data Engineer, Web Scraping
Washington, DC · On-site
$105K - $125K/yr
Proficiency in Python, SQL * Experience with web scraping/crawling (e.g., Beautiful Soup, Selenium, Scrapy) * Experience with Google Cloud Platform (or similar), including storage and database ...
Data Engineer, Web Scraping
Washington, DC · On-site
$105K - $125K/yr
Proficiency in Python, SQL * Experience with web scraping/crawling (e.g., Beautiful Soup, Selenium, Scrapy) * Experience with Google Cloud Platform (or similar), including storage and database ...
Data Engineer, Web Scraping
San Francisco, CA · Remote
$105K - $125K/yr
Proficiency in Python, SQL * Experience with web scraping/crawling (e.g., Beautiful Soup, Selenium, Scrapy) * Experience with Google Cloud Platform (or similar), including storage and database ...
Data Engineer, Web Scraping
San Francisco, CA · Remote
$105K - $125K/yr
Proficiency in Python, SQL * Experience with web scraping/crawling (e.g., Beautiful Soup, Selenium, Scrapy) * Experience with Google Cloud Platform (or similar), including storage and database ...
Python Automation Developer (Onsite)
Seattle, WA · On-site
$57.25 - $78.75/hr
Flask; FastAPI 5. Web Scraping and HTTP: Beautiful Soup; Scrapy Must Have: 3-4 Years of Experience in developing Automations using Python language Core python skills covering: Variables and Data ...
Python Automation Developer (Onsite)
Seattle, WA · On-site
$57.25 - $78.75/hr
Flask; FastAPI 5. Web Scraping and HTTP: Beautiful Soup; Scrapy Must Have: 3-4 Years of Experience in developing Automations using Python language Core python skills covering: Variables and Data ...
Web Scraper remote
New York, NY · Remote
$20 - $50/hr
... scraping processes and maintain code for scalability and reusability Required Skills and Qualifications: - Proven experience in building and maintaining web scrapers using tools such as Python ...
Quick apply
Web Scraper remote
New York, NY · Remote
$20 - $50/hr
... scraping processes and maintain code for scalability and reusability Required Skills and Qualifications: - Proven experience in building and maintaining web scrapers using tools such as Python ...
Python Automation Engineer - Vice President
Salt Lake City, UT · On-site
$130K - $160K/yr
About the Role iCapital is looking to hire an experienced Python Developer with expertise in web scraping, automated portal interactions, and cloud-native deployment using AWS. The ideal candidate ...
Python Automation Engineer - Vice President
Salt Lake City, UT · On-site
$130K - $160K/yr
About the Role iCapital is looking to hire an experienced Python Developer with expertise in web scraping, automated portal interactions, and cloud-native deployment using AWS. The ideal candidate ...
Python Automation Engineer - Vice President
Salt Lake City, UT · On-site +1
$130K - $160K/yr
About the Role iCapital is looking to hire an experienced Python Developer with expertise in web scraping, automated portal interactions, and cloud-native deployment using AWS. The ideal candidate ...
Python Automation Engineer - Vice President
Salt Lake City, UT · On-site +1
$130K - $160K/yr
About the Role iCapital is looking to hire an experienced Python Developer with expertise in web scraping, automated portal interactions, and cloud-native deployment using AWS. The ideal candidate ...
Write and maintain Python web-scraping scripts to safely harvest relevant web data. * Data Modeling and Analytics: Create and maintain data models to support analytics and reporting needs, ensuring ...
Write and maintain Python web-scraping scripts to safely harvest relevant web data. * Data Modeling and Analytics: Create and maintain data models to support analytics and reporting needs, ensuring ...
Python Automation Engineer - Vice President
Salt Lake City, UT · On-site
$130K - $160K/yr
About the Role iCapital is looking to hire an experienced Python Developer with expertise in web scraping, automated portal interactions, and cloud-native deployment using AWS. The ideal candidate ...
Python Automation Engineer - Vice President
Salt Lake City, UT · On-site
$130K - $160K/yr
About the Role iCapital is looking to hire an experienced Python Developer with expertise in web scraping, automated portal interactions, and cloud-native deployment using AWS. The ideal candidate ...
Python Automation Developer
Renton, WA · On-site
$56.75 - $78.25/hr
Web Scraping and HTTP: Beautiful Soup; Scrapy Must Have: • 3-4 Years of Experience in developing Automations using Python language • Core python skills covering: Variables and Data Types; Data ...
Python Automation Developer
Renton, WA · On-site
$56.75 - $78.25/hr
Web Scraping and HTTP: Beautiful Soup; Scrapy Must Have: • 3-4 Years of Experience in developing Automations using Python language • Core python skills covering: Variables and Data Types; Data ...
Python Automation Developer
Everett, WA · On-site
$55.50 - $76.50/hr
Web Scraping and HTTP: Beautiful Soup; Scrapy Must Have: • 3-4 Years of Experience in developing Automations using Python language • Core python skills covering: Variables and Data Types; Data ...
Python Automation Developer
Everett, WA · On-site
$55.50 - $76.50/hr
Web Scraping and HTTP: Beautiful Soup; Scrapy Must Have: • 3-4 Years of Experience in developing Automations using Python language • Core python skills covering: Variables and Data Types; Data ...
$68 - $87.25/hr
Write and maintain Python web-scraping scripts to safely harvest relevant web data. * Data Modeling and Analytics: Create and maintain data models to support analytics and reporting needs, ensuring ...
$68 - $87.25/hr
Write and maintain Python web-scraping scripts to safely harvest relevant web data. * Data Modeling and Analytics: Create and maintain data models to support analytics and reporting needs, ensuring ...
Python Automation Developer
Plano, TX · On-site
$90K - $120K/yr
FastAPI 5. Web Scraping and HTTP: Beautiful Soup; Scrapy Must Have: • 3-4 Years of Experience in developing Automations using Python language • Core python skills covering: Variables and Data ...
Python Automation Developer
Plano, TX · On-site
$90K - $120K/yr
FastAPI 5. Web Scraping and HTTP: Beautiful Soup; Scrapy Must Have: • 3-4 Years of Experience in developing Automations using Python language • Core python skills covering: Variables and Data ...
Python / AWS Developer
Chantilly, VA · On-site
$51.50 - $71/hr
Develop components of a modular program using Python and AWS Services. * The solution runs in a ... Experience with AWS CDK, DevOps, and/or Web Scraping Security Clearance : * Must have an active TS ...
Python / AWS Developer
Chantilly, VA · On-site
$51.50 - $71/hr
Develop components of a modular program using Python and AWS Services. * The solution runs in a ... Experience with AWS CDK, DevOps, and/or Web Scraping Security Clearance : * Must have an active TS ...
The chatbot will integrate with Snowflake for data retrieval, leverage APIs or web scraping to ... Strong proficiency in Python and relevant libraries (e.g., LangChain, FastAPI, BeautifulSoup ...
The chatbot will integrate with Snowflake for data retrieval, leverage APIs or web scraping to ... Strong proficiency in Python and relevant libraries (e.g., LangChain, FastAPI, BeautifulSoup ...
Locals and INPERSON Urgent Need Python Developer
$48.75 - $67.25/hr
Position: Python Developer Location: Raleigh NC (Locals Only) Duration: 6-12 Months Contract Top ... Web scraping is also known as web harvesting or web data extraction. It's used for extracting data ...
Locals and INPERSON Urgent Need Python Developer
$48.75 - $67.25/hr
Position: Python Developer Location: Raleigh NC (Locals Only) Duration: 6-12 Months Contract Top ... Web scraping is also known as web harvesting or web data extraction. It's used for extracting data ...
Locals and INPERSON Urgent Need Python Developer
$48.75 - $67.25/hr
Position: Python Developer Location: Raleigh NC (Locals Only) Duration: 6-12 Months Contract Top ... Web scraping is also known as web harvesting or web data extraction. It's used for extracting data ...
Locals and INPERSON Urgent Need Python Developer
$48.75 - $67.25/hr
Position: Python Developer Location: Raleigh NC (Locals Only) Duration: 6-12 Months Contract Top ... Web scraping is also known as web harvesting or web data extraction. It's used for extracting data ...
Gen AI Lead
Dallas, TX · On-site
$138K - $170K/yr
AI/ML Development, Generative AI, LLMs, Python, Web Frameworks, MLOps, Data Engineering Role ... Scraping * Data & Engineering - SQL, MySQL, Postgres, Spark, S3, Trino, Data Factory, ETL, Data ...
Quick apply
Gen AI Lead
Dallas, TX · On-site
$138K - $170K/yr
AI/ML Development, Generative AI, LLMs, Python, Web Frameworks, MLOps, Data Engineering Role ... Scraping * Data & Engineering - SQL, MySQL, Postgres, Spark, S3, Trino, Data Factory, ETL, Data ...
Python / AWS Developer
Chantilly, VA · On-site
$52 - $71.50/hr
The Python / AWS Developer will design, build, and configure applications to meet business ... Web Scraping Company : Accenture Federal Services is a leading US federal services company and ...
Python / AWS Developer
Chantilly, VA · On-site
$52 - $71.50/hr
The Python / AWS Developer will design, build, and configure applications to meet business ... Web Scraping Company : Accenture Federal Services is a leading US federal services company and ...
Python Web Scraping information
See salary details
$44.47 - $46.28
12% of jobs
$46.28 - $48.10
12% of jobs
$48.55 is the 25th percentile. Wages below this are outliers.
$48.10 - $49.91
2% of jobs
$49.91 - $51.73
0% of jobs
$51.73 - $53.54
0% of jobs
$53.54 - $55.35
0% of jobs
$55.35 - $57.17
0% of jobs
$57.17 - $58.98
7% of jobs
The median wage is $60.36 / hr.
$58.98 - $60.80
21% of jobs
$62.11 is the 75th percentile. Wages above this are outliers.
$60.80 - $62.61
28% of jobs
$62.61 - $64.42
17% of jobs
$44
$57
$64
How much do python web scraping jobs pay per hour?
What Are Python Web Scraping Jobs?
Web scraping is a process used for web data extraction. Python web scraping uses Python software to gather information and organize it for later analysis. You can find work as a Python web scraping engineer or web scraping developer where you write and run spiders to perform web crawling to obtain and extract data, as well as troubleshoot system issues. There are other opportunities as a Python web scraping analyst where your duties are to analyze the gathered information. You can work a Python web scraping job at a specific company or provide freelance services.
What are some common challenges faced by professionals in Python web scraping roles, and how can they be addressed?
What is Python web scraping?
What are the key skills and qualifications needed to thrive as a Python Web Scraping Specialist, and why are they important?
What is the difference between Python Web Scraping vs Data Analyst?
| Aspect | Python Web Scraping | Data Analyst |
|---|---|---|
| Required Skills | Python, libraries like BeautifulSoup, Scrapy | Excel, SQL, data visualization tools |
| Work Environment | Programming, scripting, automation | Data interpretation, reporting |
| Industry Usage | Web data extraction, automation projects | Business insights, decision-making |
Python Web Scraping focuses on extracting data from websites using programming skills, while Data Analysts interpret and visualize data for business insights. Both roles require analytical thinking but differ in technical tools and daily tasks.

Web Scraping Engineer- 3566726 with Security Clearance
Arlington, VA • On-site
Contractor
Posted 12 days ago
Job description
Defense, Intelligence, and Federal Civilian agencies as well as Fortune 1000 companies. Got the Government Contractor Blues? Looking for a company that cares and goes beyond just filling another contract billet?
Well look no further! Experience this family-oriented company who takes pride in you and will help you grow where your passions lie. Holding many Defense & Federal government contracts around the globe, with our client you have the opportunity to take on new and evolving challenges, aim beyond what you think you are capable of and work in collaborative, dynamic, and high-tempo environments.
Our clients' employees are their most valued asset and they invest in their people because they are in it for the long term. They are committed to your success and well-being and offer competitive benefits packages, salaries, bonus/award programs, and a high potential for professional growth and job opportunities world-wide. Why Should You Be Interested ?
* Direct hire position * Competitive compensation and comprehensive benefits * Mid-size company with room for growth Position Title : Web Scraping Engineer Position Location : This position is currently remote, with occasional meetings in Arlington, VA. Daily Responsibilities: * Position supports the development and maintenance of the agency's web scraping infrastructure. The position is responsible for extracting data from various websites and APIs, ensuring data quality and accuracy, and optimizing the scraping process for efficiency.
Duties include: * Develop and maintain web scraping scripts and tools to extract data from websites and APIs. * Collaborate with cross-functional teams to understand data requirements and implement scraping solutions accordingly. * Monitor and troubleshoot scraping processes to ensure data quality and accuracy.
* Optimize scraping scripts for performance and efficiency, considering factors such as speed, scalability, and resource utilization. * Stay up-to-date with the latest web scraping techniques, tools, and best practices. * Conduct data analysis and validation to ensure the integrity of scraped data.
* Collaborate with data engineering and data science teams to integrate scraped data into our data pipelines and systems. * Document and communicate technical solutions, processes, and best practices to team members. Required Years of Experience (min) : * 3+ years of professional experience in web scraping or a similar role.
Required Degree : * BS/BA degree in Computer Science, Information Sciences, or related IT discipline OR Allowable Substitution: Additional ten (10) years of related professional experience can be substituted for a BS/BA degree. Required Experience : * Proficiency in Python and Java and experience with web scraping libraries such as BeautifulSoup, Scrapy, or Selenium. * Knowledge of AI/machine learning techniques for data extraction and classification.
* Experience incorporating AI into Quality Control solutions and AI/ML techniques on an open-source application to web scrape for data extraction and classification. * Understanding of HTML, CSS, and JavaScript to navigate and interact with websites. * Experience working with APIs and handling different data formats (JSON, XML, etc.).
* Familiarity with database systems and SQL for data storage and retrieval. * Familiarity of data cleaning and preprocessing techniques to ensure data quality. * Strong problem-solving skills and ability to troubleshoot and debug scraping issues.
* Excellent communication and collaboration skills to work effectively in a team environment. * Attention to detail and ability to handle large volumes of data efficiently. Preferred Experience : * Experience with cloud platforms for scalable web scraping infrastructure.
* Familiarity with data visualization tools and techniques. * Understanding of legal and ethical considerations related to web scraping. Required Clearance : * Secret clearance Pay Information TBD Please note: This range is based on our market pay structures.
However, individual salaries are determined by a variety of factors including, but not limited to: business considerations, local market conditions, and internal equity, as well as candidate qualifications, such as skills, education, and experience. Computer Technologies Consultants, Inc. is an Equal Opportunity Employer that provides employment opportunities for all qualified applicants without regard to race, color, religion, gender identity and/or expression, sexual orientation, age, mental or sensory differing abilities, protected veteran status, sex, national origin, or any other characteristic protected by applicable law.
Computer Technologies Consultants, Inc. is devoted to diversity, equity, and inclusion.
About Computer Technologies Consultants
Sourced by ZipRecruiter
Industry
It services
Company size
51 - 200 Employees
Headquarters location
Lanham, MD, US
Year founded
1992