1

Telecommute Python Web Scraping Jobs in California

Data Engineer

San Francisco, CA ยท On-site +1

$160K/yr

Proficiency in Python and SQL (preferably MySQL) Demonstrated experience with Airflow ... Experience with web scraping and cleaning unstructured data * Knowledge of data science and machine ...

Data Engineer with Java & Scala

San Jose, CA

$134K - $161K/yr

... in Java, Python and Scala With Spark and Machine Learning (3+) Data mining, Data analysis Data ... web scraping, calling APIs, write SQL queries, etc.). Work closely with our engineering team to ...

Data Engineer

San Francisco, CA ยท Remote

$160K/yr

Proficiency in Python and SQL (preferably MySQL) Demonstrated experience with Airflow ... Experience with web scraping and cleaning unstructured data * Knowledge of data science and machine ...

Sr. Data Engineer

San Francisco, CA ยท On-site

$134K - $162K/yr

Expertise in building data ingestion tools using Python, including web scraping and external APIs, and proficient in Python data science packages (numpy, pandas, scikit-learn, nltk, TensorFlow ...

Sr. Data Engineer

San Francisco, CA ยท On-site

$134K - $162K/yr

Expertise in building data ingestion tools using Python, including web scraping and external APIs, and proficient in Python data science packages (numpy, pandas, scikit-learn, nltk, TensorFlow ...

Sr. Data Engineer

San Francisco, CA ยท On-site

$134K - $162K/yr

Expertise in building data ingestion tools using Python, including web scraping and external APIs, and proficient in Python data science packages (numpy, pandas, scikit-learn, nltk, TensorFlow ...

Sr. Software Engineer

Monterey Park, CA ยท Hybrid

$180K - $210K/yr

Python, React, Javascript, SQL * Bachelor's degree in Computer Science or related, or related ... web scraping and other automation scripting, ETL and data pipelines, data science, machine learning

Sr. Software Engineer

Monterey Park, CA ยท On-site

$180K - $210K/yr

Python, React, Javascript, SQL Qualifications * Bachelor's degree in Computer Science or related ... web scraping and other automation scripting, ETL and data pipelines, data science, machine learning

Showing results 21-40

Telecommute Python Web Scraping information

What is a telecommute Python web scraping job?

Telecommute Python Web Scraping jobs involve working remotely to develop and maintain scripts or applications that extract data from websites using the Python programming language. Professionals in these roles use libraries such as BeautifulSoup, Scrapy, or Selenium to automate the collection of web data for analysis, business intelligence, or research purposes. The remote aspect allows workers to perform their tasks from any location with internet access, collaborating with teams or clients online. These jobs typically require knowledge of web protocols, HTML, and ethical scraping practices.

What skills and qualifications are needed to thrive as a telecommute Python web scraping specialist?

To thrive as a Telecommute Python Web Scraping Specialist, you need strong Python programming skills, experience with web scraping libraries like BeautifulSoup and Scrapy, and a solid understanding of HTML, CSS, and data formats such as JSON and CSV. Familiarity with version control systems like Git, cloud platforms, and knowledge of handling CAPTCHAs or anti-bot systems are typically required. Attention to detail, problem-solving abilities, and effective remote communication are crucial soft skills for this role. These competencies ensure efficient data extraction, compliance with legal and ethical standards, and smooth collaboration in a remote work environment.

What are common challenges faced when working remotely as a Python web scraping specialist, and how can they be addressed?

Remote Python web scraping specialists often encounter challenges like managing asynchronous communication with team members, handling inconsistent website structures, and ensuring compliance with website terms of service. To address these, it's important to establish clear communication channels (such as Slack or regular video calls), maintain detailed documentation, and use robust scraping frameworks that handle website changes gracefully. Additionally, staying updated on legal and ethical guidelines for web scraping is crucial to avoid potential pitfalls.

What is the difference between Telecommute Python Web Scraping vs Telecommute Data Analyst?

AspectTelecommute Python Web ScrapingTelecommute Data Analyst
Required SkillsPython, web scraping libraries, data extractionData analysis, SQL, Excel, visualization tools
Work EnvironmentRemote, independent, technicalRemote, collaborative, analytical
Industry UsageWeb data collection, research, market analysisBusiness insights, reporting, decision-making

While both roles often work remotely and require analytical skills, Telecommute Python Web Scraping focuses on extracting data from websites using Python, whereas Telecommute Data Analysts interpret and visualize data to support business decisions. The roles complement each other but serve different primary functions in data workflows.

What are the most commonly searched types of Python Web Scraping jobs in California?

The most popular types of Python Web Scraping jobs in California are:

What cities in California are hiring for Telecommute Python Web Scraping jobs?

Cities in California with the most Telecommute Python Web Scraping job openings:

Senior AI Engineer, Agentic Data Enrichment

Baselayer

San Francisco, CA โ€ข On-site

$124K - $169K/yr

Other

Medical, Dental, Vision, Retirement, PTO

Re-posted 11 hours ago


Job description

ABOUT BASELAYER
Every business in America needs a bank account to exist. The system that decides whether they're real, who's behind them, and whether they're a risk, runs on infrastructure from the 1980s. We're rebuilding that layer from scratch.
Baselayer is the identity layer for institutions across the United States - the most complete business graph in America and every human tied to it. We fuse public records, IRS data, sanctions lists, web signals, and fraud telemetry from 2,200+ financial institutions into a single graph that resolves any business and the humans behind it in milliseconds. The legacy credit bureaus took 50 years to build something that gets 60% match rates. We've built something that gets 98% in under two years.
Today we're trusted by over 20% of financial institutions in America - including FIS, Rho, Socure and leading loan infrastructure providers. But the graph is becoming infrastructure for anyone who needs to know if a business is real and worth trusting: gig platforms, marketplaces, AI companies, and commerce infrastructure at scale.
Trust is the substrate of every financial transaction. We're rebuilding it.
ABOUT THE TEAM
We're solving real-time entity resolution at a scale no one else has cracked - fusing dozens of data sources into a single business identity graph and resolving any entity in milliseconds. It's a graph AI problem, a retrieval problem, and a fraud-modeling problem stacked on top of each other. The technical depth is real.
You'd be joining a small team where the data moat is defensible, the research problems are open, and the infrastructure you build becomes load-bearing for businesses. Ownership is real. Velocity is real. There's no layer of process between an idea and shipping it.
We're at an inflection point - the graph is built, the match rates speak for themselves, and the hardest problems are still ahead: graph embeddings, fraud propagation models across the business network, real-time traversal at sub-100ms latency, and expanding the identity layer beyond finance into every platform that needs to trust a business.
If you want to work on something foundational - the kind of infrastructure that gets built once and everything else runs on top of - this is it.
ABOUT THE ROLE
Baselayer answers questions the loan application didn't ask. For every business that crosses our queues, we need to know things that aren't on the form: what the business actually does, where it actually lives on the web, whether the people it names match the public record, and whether anything across the open web contradicts the story we were told. We answer those questions with LLM-driven agents that crawl, click, search, and extract structured evidence from across the web - and we treat this as a production data pipeline, not a research demo. We're hiring a Senior AI Engineer to own a slice of this enrichment surface end-to-end.
WHAT YOU'LL DO
  • Own industry/category classification of businesses from heterogeneous signals (name, website, directory presence, reviews).
  • Build and maintain discovery and verification systems for a business's real web presence - filtering aggregators, parked domains, brand collisions, and impersonators.
  • Link individuals to businesses via public web evidence (e.g. confirming a named officer or employee genuinely works there).
  • Develop risk/legitimacy scoring derived from web-presence signals, fed back into downstream underwriting.
  • Build and evolve the shared agent infrastructure: provider-agnostic base agents, shared toolset registry (browser navigation, search, scraping, structured database lookups, scoring), eval harness, and instrumentation surface for token-and-tool tracing.
  • Own model selection, agent design, prompt and tool engineering, eval methodology, and cost control across your enrichment surface.

MINIMUM REQUIREMENTS
  • Shipped LLM-driven agents to production - not notebooks, not demos. Real users, real cost, real failure modes, real on-call.
  • Strong async Python including structured-data libraries, modern web frameworks, and relational databases.
  • Experience across multiple frontier LLM providers and at least one agent framework, with deep knowledge of failure modes.
  • Built or maintained eval methodology: curated golden datasets, scoring functions, labelling guidelines, regression diagnostics.
  • Browser automation experience: headless browsers, anti-bot evasion, authenticated flows.
  • Holds informed opinions on structured-output reliability - when to use JSON-schema mode vs. function calling vs. extractor-on-top-of-text.

WHAT SETS YOU APART
  • Web scraping at scale: anti-bot evasion, residential proxies, request fingerprinting, authenticated flows, CDN defeats.
  • Eval-framework experience (e.g., LangSmith, Braintrust, Evals, or custom).
  • Entity resolution / record linkage / fuzzy matching at scale.
  • Browser-automation experience at the devtools-protocol level.
  • Built a tool registry or toolset abstraction over multiple LLM providers.
  • Cost/latency optimization: response caching, semantic caching, model routing (cheap-first then escalate), thinking-budget tuning, prompt-cache hit-rate work.

WORK LOCATION
  • Based in SF; hybrid - 4 days per week in office.

COMPENSATION
  • Salary Range: $230,000 - $340,000 + Equity

BENEFITS
  • Time off when you need it: Flexible PTO so you can recharge without red tape.
  • In-person energy: We're based in SF and meet in the office 4 days a week.
  • Competitive compensation: We pay well and back it with equity. We want you to think and act like an owner.
  • Career rocket fuel: You'll help build the foundation of a high-growth startup, working side by side with experienced founders and team members who've done it before.
  • Benefits on us: We cover 100% of your health, dental, and vision premiums. No surprise deductions from your paycheck.
  • 401(k) with company match: We match your contributions so your future self benefits too
  • HSA contributions included: We contribute to your HSA on applicable plans, so your coverage works as hard as you do
  • Stay healthy, stay sharp: A $250 monthly gym stipend to help you bring your best self to work, and everywhere else
  • A seat at the table: We believe in transparency, radical candor, and giving every team member a voice