1

Data Scraping Jobs in California (NOW HIRING)

Data Engineer

San Francisco, CA · On-site +1

$160K/yr

Experience with web scraping and cleaning unstructured data * Knowledge of data science and machine learning concepts * A strong interest in sports and sports betting, with an emphasis on Tennis. An ...

Experience with web scraping and cleaning unstructured data * Knowledge of data science and machine learning concepts * A strong interest in sports and sports betting, with an emphasis on Tennis. An ...

Data Engineer with Java & Scala

San Jose, CA

$134K - $161K/yr

... scraping, calling APIs, write SQL queries, etc.). Work closely with our engineering team to integrate and build algorithms Process unstructured data into a form suitable for analysis - and then do ...

Sr. Data Engineer

San Francisco, CA · On-site

$134K - $162K/yr

Expertise in building data ingestion tools using Python, including web scraping and external APIs, and proficient in Python data science packages (numpy, pandas, scikit-learn, nltk, TensorFlow ...

Sr. Data Engineer

San Francisco, CA · On-site

$134K - $162K/yr

Expertise in building data ingestion tools using Python, including web scraping and external APIs, and proficient in Python data science packages (numpy, pandas, scikit-learn, nltk, TensorFlow ...

Sr. Data Engineer

San Francisco, CA · On-site

$134K - $162K/yr

Expertise in building data ingestion tools using Python, including web scraping and external APIs, and proficient in Python data science packages (numpy, pandas, scikit-learn, nltk, TensorFlow ...

Manage onboarding timelines and prioritize work relative to other data induction initiatives (e.g., PromoTracker historical data, image scraping, RV scraping). * Drive harmonization discussions to ...

Integration Engineer

Oakland, CA · On-site

$119K - $160K/yr

... of data collection. You will use a custom Python-based macro system and write HTML, text, and OCR parsers to interface with it. OCR and web-scraping experience required . This role can be remote.

Integration Engineer

Oakland, CA · On-site +1

$119K - $160K/yr

... of data collection. You will use a custom Python-based macro system and write HTML, text, and OCR parsers to interface with it. OCR and web-scraping experience required . This role can be remote.

Staff Engineer

San Francisco, CA · On-site

$250K - $300K/yr

Design, build, and operate core infrastructure powering a people-data and AI agent platform -- including APIs, LLM-powered workflows, web scraping systems, and large-scale knowledge graph ...

New

Staff Engineer

San Francisco, CA · On-site

$250K - $300K/yr

Design, build, and operate core infrastructure powering a people-data and AI agent platform - including APIs, LLM-powered workflows, web scraping systems, and large-scale knowledge graph architecture.

New

Founding Engineer

San Francisco, CA · On-site

$150K - $220K/yr

About the Role A seed-funded B2B SaaS startup in the people-data and AI agents space is looking for ... Design, build, and operate core infrastructure including APIs, LLM-powered workflows, web scraping ...

Founding Engineer

San Francisco, CA · On-site

$150K - $220K/yr

About the Role A seed-funded B2B SaaS startup in the people-data and AI agents space is looking for ... Design, build, and operate core infrastructure including APIs, LLM-powered workflows, web scraping ...

Showing results 21-40

Data Scraping information

What is a data scraping?

A Data Scraping job involves extracting structured data from websites or online sources using automated tools or scripts. This data is then used for various purposes, such as market research, competitive analysis, or business intelligence. Professionals in this field typically use programming languages like Python or tools like Scrapy and BeautifulSoup to collect and organize data efficiently. However, ethical considerations and legal guidelines must be followed to ensure compliance with website policies and data protection laws.

What are the key skills and qualifications needed to thrive in data scraping, and why are they important?

To excel in Data Scraping, proficiency in programming languages such as Python or JavaScript, familiarity with web protocols, and understanding of data extraction methodologies are essential, often supported by a degree in computer science or a related field. Experience with web scraping tools like BeautifulSoup, Scrapy, or Selenium, and knowledge of APIs are commonly required; relevant certifications in data analysis or automation can be advantageous. Strong problem-solving skills, attention to detail, and effective communication help professionals successfully tackle complex data challenges and collaborate with teams. These competencies are vital to reliably gather, process, and deliver valuable data while adhering to legal and ethical standards.

What are the typical challenges faced in data scraping, and how are they addressed?

Data Scraping professionals often encounter challenges such as dealing with anti-scraping measures, frequent changes to website structures, and managing large volumes of unstructured data. These obstacles require adaptability and creative problem-solving, as well as continuous learning to update scripts and leverage the latest tools. Team collaboration is common—data scrapers may work closely with data analysts, engineers, or business stakeholders to ensure the data collected meets the project's needs. Proactively communicating and staying current with industry best practices helps data scraping specialists efficiently navigate these challenges and deliver high-quality results.

What are the most commonly searched types of Data Scraping jobs in California?

The most popular types of Data Scraping jobs in California are:

Infographic showing various Data Scraping job openings in California as of August 2026, with employment types broken down into 75% Full Time, 14% Part Time, and 11% Contract. Highlights an 100% In-person job distribution.

Data Engineer

Swish Analytics

San Francisco, CA • On-site, Remote

$160K/yr

Full-time

Posted 26 days ago


Job description

Company Overview
Swish Analytics is a sports analytics, betting and fantasy startup building the next generation of predictive sports analytics data products. We believe that oddsmaking is a challenge rooted in engineering, mathematics, and sports betting expertise; not intuition. We're looking for team-oriented individuals with an authentic passion for accurate and predictive real-time data who can execute in a fast-paced, creative, and continually-evolving environment without sacrificing technical excellence. Our challenges are unique, so we hope you are comfortable in uncharted territory and passionate about building systems to support products across a variety of industries and consumer/enterprise clients.
Job Description
The Swish Analytics team is seeking Data Engineers to have a direct impact on the infrastructure and delivery of our core consumer and enterprise data offerings as well as helping support our coverage of non-US sports. We're a team passionate about accurate predictions and real-time data, and hope you find satisfaction in building new products with the latest and greatest technologies. This is a remote position.
Duties
  • Support production systems and help triage issues during live sporting events
  • Architect low-latency, real-time analytics systems including raw data collection, feature development and endpoint production
  • Build new sports betting data products and predictions offerings
  • Integrate large and complex real-time datasets into new consumer and enterprise products
  • Develop production-level predictive analytics into enterprise-grade APIs
  • Contribute to the design and implementation of new, fully-automated sports data delivery frameworks

Requirements
  • BS/BA degree in Mathematics, Computer Science, or related STEM field
  • Minimum of 2+ years of demonstrated experience writing production level code (Python)
  • Proficiency in Python and SQL (preferably MySQL) Demonstrated experience with Airflow
  • Demonstrated experience with Kubernetes
  • Experience building end-to-end ETL pipelines
  • Experience utilizing REST APIs
  • Experience with version control (git), continuous integration and deployment, shell scripting, and cloud-computing infrastructures (AWS)
  • Experience with web scraping and cleaning unstructured data
  • Knowledge of data science and machine learning concepts
  • A strong interest in sports and sports betting, with an emphasis on Tennis. An understanding of US-based sports including the NFL, NBA, MLB, NHL, College Football, College Basketball, and the ability use your knowledge of the sport to inform your work with complex datasets

Base Salary: Starting at $160,000 - DOE
Swish Analytics is an Equal Opportunity Employer. All candidates who meet the qualifications will be considered without regard to race, color, religion, sex, national origin, age, disability, sexual orientation, pregnancy status, genetic, military, veteran status, marital status, or any other characteristic protected by law. The position responsibilities are not limited to the responsibilities outlined above and are subject to change. At the employer's discretion, this position may require successful completion of background and reference checks.
Department Data Engineering Locations San Francisco, CA - Remote Remote status Fully Remote