Strong knowledge of data engineering platforms such as Airflow. Experience with the Google ... Web Scraping using Requests, BeautifulSoup, Selenium and Scrapy * Frameworks such as Flask/Django ...
Strong knowledge of data engineering platforms such as Airflow. Experience with the Google ... Web Scraping using Requests, BeautifulSoup, Selenium and Scrapy * Frameworks such as Flask/Django ...
Product Engineer - Interact
San Francisco, CA · On-site +1
$180K - $290K/yr
... web scraping, or agent tooling About Firecrawl Firecrawl is the easiest way to extract data from the web. Developers use us to reliably convert URLs into LLM-ready markdown or structured data with a ...
Product Engineer - Interact
San Francisco, CA · On-site +1
$180K - $290K/yr
... web scraping, or agent tooling About Firecrawl Firecrawl is the easiest way to extract data from the web. Developers use us to reliably convert URLs into LLM-ready markdown or structured data with a ...
Founding TypeScript Engineer
San Francisco, CA · On-site
$150K - $220K/yr
Design, build, and operate core infrastructure including APIs, LLM-powered workflows, web scraping ... Familiarity with distributed systems, microservices, data pipelines, or cloud infrastructure (AWS ...
Founding TypeScript Engineer
San Francisco, CA · On-site
$150K - $220K/yr
Design, build, and operate core infrastructure including APIs, LLM-powered workflows, web scraping ... Familiarity with distributed systems, microservices, data pipelines, or cloud infrastructure (AWS ...
Founding Engineer
San Francisco, CA · On-site
$150K - $220K/yr
What You'll Do * Design, build, and operate core infrastructure for a people-data and agent ... Experience with large-scale knowledge graph architecture or web scraping systems at scale. Visa ...
Founding Engineer
San Francisco, CA · On-site
$150K - $220K/yr
What You'll Do * Design, build, and operate core infrastructure for a people-data and agent ... Experience with large-scale knowledge graph architecture or web scraping systems at scale. Visa ...
Founding Engineer
San Francisco, CA · On-site
$150K - $220K/yr
What You'll Do * Design, build, and operate core infrastructure for a people-data and agent ... Experience with large-scale knowledge graph architecture or web scraping systems at scale. Visa ...
Quick apply
Founding Engineer
San Francisco, CA · On-site
$150K - $220K/yr
What You'll Do * Design, build, and operate core infrastructure for a people-data and agent ... Experience with large-scale knowledge graph architecture or web scraping systems at scale. Visa ...
Software Development Engineer - Data Acquisition & Normalization
Mountain View, CA · On-site
$135K - $162K/yr
... web applications using OOP languages such as Java, Ruby, JavaScript, TypeScript, Go, Python, Rust, or C++. * Exposure to data acquisition or integration work, including APIs, screen scraping, ETL, or ...
Software Development Engineer - Data Acquisition & Normalization
Mountain View, CA · On-site
$135K - $162K/yr
... web applications using OOP languages such as Java, Ruby, JavaScript, TypeScript, Go, Python, Rust, or C++. * Exposure to data acquisition or integration work, including APIs, screen scraping, ETL, or ...
... web applications using OOP languages such as Java, Ruby, JavaScript, TypeScript, Go, Python, Rust, or C++. * Exposure to data acquisition or integration work, including APIs, screen scraping, ETL, or ...
Quick apply
... web applications using OOP languages such as Java, Ruby, JavaScript, TypeScript, Go, Python, Rust, or C++. * Exposure to data acquisition or integration work, including APIs, screen scraping, ETL, or ...
Product Engineer - Scrape
San Francisco, CA · On-site +1
$180K - $290K/yr
... scraping, crawling, browser automation, or data infrastructure Visa: US Citizenship/Visa required for SF; N/A for Remote About Firecrawl Firecrawl is the easiest way to extract data from the web.
Product Engineer - Scrape
San Francisco, CA · On-site +1
$180K - $290K/yr
... scraping, crawling, browser automation, or data infrastructure Visa: US Citizenship/Visa required for SF; N/A for Remote About Firecrawl Firecrawl is the easiest way to extract data from the web.
The systems you build must extract signal from chaos, integrating low-trust external data into ... Understanding of web scraping techniques and countermeasures.- Masters Degree or higher in Computer ...
The systems you build must extract signal from chaos, integrating low-trust external data into ... Understanding of web scraping techniques and countermeasures.- Masters Degree or higher in Computer ...
The systems you build must extract signal from chaos, integrating low-trust external data into ... Understanding of web scraping techniques and countermeasures. - Masters Degree or higher in ...
The systems you build must extract signal from chaos, integrating low-trust external data into ... Understanding of web scraping techniques and countermeasures. - Masters Degree or higher in ...
Understanding of web scraping techniques and countermeasures. - Awareness of network security, HTTP ... data privacy and machine learning. For San Francisco, CA-based roles: The base salary range for ...
Understanding of web scraping techniques and countermeasures. - Awareness of network security, HTTP ... data privacy and machine learning. For San Francisco, CA-based roles: The base salary range for ...
(PHD) Applied Machine Learning Engineer
San Francisco, CA · On-site
$170K - $200K/yr
Mine data from the web through large-scale crawling and scraping to power our models and insights. * Transform unstructured text data into structured knowledge with NLP, entity recognition, and ...
(PHD) Applied Machine Learning Engineer
San Francisco, CA · On-site
$170K - $200K/yr
Mine data from the web through large-scale crawling and scraping to power our models and insights. * Transform unstructured text data into structured knowledge with NLP, entity recognition, and ...
Senior AI Engineer
$121K - $167K/yr
... web scraping, with a clear mandate: deliver a production-grade system that detects compliance ... data changes. * Handle modern web rendering challenges at scale: JavaScript-heavy SPAs ...
Senior AI Engineer
$121K - $167K/yr
... web scraping, with a clear mandate: deliver a production-grade system that detects compliance ... data changes. * Handle modern web rendering challenges at scale: JavaScript-heavy SPAs ...
AI Engineer
San Francisco, CA · On-site
$180K - $300K/yr
Embedding and indexing infrastructure that handles millions of requests, plus the crawling and scraping systems that feed it visual data from across the web * Ship the product surface. Internal tools ...
New
AI Engineer
San Francisco, CA · On-site
$180K - $300K/yr
Embedding and indexing infrastructure that handles millions of requests, plus the crawling and scraping systems that feed it visual data from across the web * Ship the product surface. Internal tools ...
New
Strong knowledge of various data sources, integration patterns (APIs, web scraping, messaging queues), and ETL/ELT tools. * Expertise in programming languages such as Java, Python, Scala, or Go.
Strong knowledge of various data sources, integration patterns (APIs, web scraping, messaging queues), and ETL/ELT tools. * Expertise in programming languages such as Java, Python, Scala, or Go.
Strong knowledge of various data sources, integration patterns (APIs, web scraping, messaging queues), and ETL/ELT tools. * Expertise in programming languages such as Java, Python, Scala, or Go.
Strong knowledge of various data sources, integration patterns (APIs, web scraping, messaging queues), and ETL/ELT tools. * Expertise in programming languages such as Java, Python, Scala, or Go.
Senior Data Engineer
Calabasas, CA · On-site
$145K - $160K/yr
Role Summary AmaWaterways is hiring our first Senior Data Engineer to scale the modern data ... Web scraping and source integration * Use Playwright with persistent browser profiles for SSO ...
Quick apply
Senior Data Engineer
Calabasas, CA · On-site
$145K - $160K/yr
Role Summary AmaWaterways is hiring our first Senior Data Engineer to scale the modern data ... Web scraping and source integration * Use Playwright with persistent browser profiles for SSO ...
Build and maintain scalable ETL/ELT pipelines in Python, SQL, and dbt-ingesting data via APIs, web scraping, and streaming sources. * Develop and operate data pipelines using orchestration frameworks ...
Build and maintain scalable ETL/ELT pipelines in Python, SQL, and dbt-ingesting data via APIs, web scraping, and streaming sources. * Develop and operate data pipelines using orchestration frameworks ...
Stand up data models, dashboards, and processes that turn ambiguity into repeatable, auditable ... web scraping. • AI in practice: You know how to evaluate and deploy AI/LLM tools to real ...
Stand up data models, dashboards, and processes that turn ambiguity into repeatable, auditable ... web scraping. • AI in practice: You know how to evaluate and deploy AI/LLM tools to real ...
Stand up data models, dashboards, and processes that turn ambiguity into repeatable, auditable ... web scraping. • AI in practice: You know how to evaluate and deploy AI/LLM tools to real ...
Stand up data models, dashboards, and processes that turn ambiguity into repeatable, auditable ... web scraping. • AI in practice: You know how to evaluate and deploy AI/LLM tools to real ...
Web Data Scraping information
See California salary details
$10.12 - $15.30
16% of jobs
$17.27 is the 25th percentile. Wages below this are outliers.
$15.30 - $20.48
24% of jobs
$20.48 - $25.66
8% of jobs
The median wage is $26.52 / hr.
$25.66 - $30.84
9% of jobs
$30.84 - $36.01
13% of jobs
$38.46 is the 75th percentile. Wages above this are outliers.
$36.01 - $41.19
9% of jobs
$41.19 - $46.37
6% of jobs
$46.37 - $51.55
5% of jobs
$51.55 - $56.73
3% of jobs
$56.73 - $61.91
3% of jobs
$61.91 - $67.09
2% of jobs
$10
$31
$67
How much do web data scraping jobs pay per hour?
What are the key skills and qualifications needed to thrive as a Web Data Scraping Specialist, and why are they important?
What is web data scraping?
What is the difference between Web Data Scraping vs Data Analyst?
| Aspect | Web Data Scraping | Data Analyst |
|---|---|---|
| Primary Role | Extracting data from websites automatically | Interpreting and analyzing data to inform business decisions |
| Skills Required | Programming, web technologies, data extraction tools | Statistical analysis, data visualization, Excel, SQL |
| Work Environment | Technical, often in IT or data teams | Business, finance, marketing departments |
| Tools & Technologies | Python, BeautifulSoup, Scrapy | Excel, Tableau, R, SQL |
Web Data Scraping focuses on automatically collecting data from websites using programming tools, while Data Analysts interpret and analyze data to support business strategies. Both roles require data handling skills but differ in technical focus and end goals.
What are some common challenges faced in a web data scraping role and how can they be addressed?

Full-time
Posted 14 days ago
Job description
Invisible Technologies offers unusual services (a combination of outsourcing and automation) to fast-scaling, innovative companies. Each company understands and uses our services in a variety of ways. It's critical we can communicate to segments of users with visually appealing, and highly communicative assets. You're helping us explain the benefits of our product in a way that words alone never could.
Job Description
Job Responsibilities:
Create crawlers for each source URL by using Python modules [scrapy, selenium, requests, BeautifulSoup and splash]
Create and maintain scrapy pipelines and middlewares to manage the output from the crawlers.
Create crawlers for all types of websites irrespective of the technical roadblocks.
Manage the crawlers to overcome technical challenges like IP ban, geolocation ban, captcha and bot blocking services.
Write SQL queries to manage database operations using Python modules like sqlalchemyDeploy the python scripts / crawlers to Linux based AWS servers
SkillsMust Haves:
Strong hands-on experience in Python programming
Good experience with scraping libraries such as Requests, BeautifulSoup, Selenium and Scrapy.
Proven 3+ experience working on web development frameworks such as Flask/Django/FastAPI/Tornado/PandasKnowledge of building APIs and services using REST.
Experience with any RDBMS and strong SQL knowledge.
Clear with Object-oriented concepts.
Excellent troubleshooting skills.
Proficient understanding of code versioning tools like git.
Basic understanding of front-end technologies, such as JavaScript, HTML5 and CSS3Understanding of fundamental design principles behind a scalable application.
Nice to have:
Familiar with UI frameworks like Angular/ReactJS
Strong unit test and debugging skills.
Strong knowledge of data engineering platforms such as Airflow.
Experience with the Google CloudDockerAgile and Scrum. Even better if have worked in Jira and confluence.
Experience with ETLCeleryExcellent interpersonal skills and ability to to work with a diverse team
Qualifications
Required: Technical Skills
- Python
- JavaScript
- PostgresSQL
- Web Scraping using Requests, BeautifulSoup, Selenium and Scrapy
- Frameworks such as Flask/Django/FastAPI/Tornado/Pandas
- Building APIs and services using REST
Additional Information
https://jobs.lever.co/invisible/e3f21175-7605-4b30-8790-5ddbd97ab3b5