1

Python Scraping Jobs in California (NOW HIRING)

Applied AI Engineer

San Francisco, CA · On-site

$180K - $220K/yr

... scraping for Facebook Jobs and Meta Reality Labs. * Vishruth (Founding Applied AI Engineer ... Work primarily across LLM-driven systems, data pipelines, and AI-enabled services, using Python ...

... SQL, Python, and experience in API pulls/integrations. * Working familiarity with ArcGIS ... scraping, data parsing, and meta data extraction. * Experience with near-real time event-based ...

New

Sr. Intelligence Analyst

Hawthorne, CA · On-site

$120K - $160K/yr

... SQL, Python, and experience in API pulls/integrations. * Working familiarity with ArcGIS ... scraping, data parsing, and meta data extraction. * Experience with near-real time event-based ...

New

Python, Excel VBA, Oracle SQL, MS SQL, SOQL (Salesforce Object Query Language), HTML, and libraries for web scraping, TensorFlow, PyTorch, and LangChain; Advanced AI/ML Experience: building Retrieval ...

Intelligence Analyst

Hawthorne, CA · On-site

$95K - $120K/yr

... SQL, Python, and experience in API pulls/integrations. * Working familiarity with ArcGIS ... scraping, data parsing, and meta data extraction. * Experience with near-real time event-based ...

Senior Data Engineer

San Diego, CA · On-site

$117.30K - $158.70K/yr

Extensive knowledge of coding in Python or Scala with a focus on data processing. * Experience ... Comfortable working with unstructured and semi-structured data (Web scraping). * Experience working ...

... SQL, Python, and experience in API pulls/integrations. * Working familiarity with ArcGIS ... scraping, data parsing, and meta data extraction. * Experience with near-real time event-based ...

Core Skills (Required) * Python (Pandas, NumPy, scikit-learn, SciPy) * Strong grounding ... Web scraping/development (Selenium, Javascript, HTTP, CSS) * Forecasting or time-series analysis

Advanced in SQL and Python, experience with Retool, API & Web Scraping a bonus * Experience driving results as an IC and working with technical teams to drive scalable architecture * Ability to drive ...

... scraping pipelines, unit test generators, repo sandboxing). * Design dashboards and APIs for ... Fluency in Python and proficiency in one or more major languages (C++, Java, Go, Rust, or JS)

... scraping for negative sentiment and/or market shifts that can be leveraged to out-position the ... Full-stack development skills (e.g., JavaScript, Python, React) to build growth experiments and ...

AI Engineer

San Francisco, CA · On-site

$180K - $220K/yr

... scraping for Facebook Jobs and Meta Reality Labs. * Vishruth (Founding Applied AI Engineer ... Work primarily across LLM-driven systems, data pipelines, and AI-enabled services, using Python ...

Threat Collections Engineer

San Francisco, CA · On-site +1

$300K - $320K/yr

Have strong coding proficiency in Python and SQL for building detection logic, data pipelines, and ... Familiarity with web scraping and data extraction at scale * Experience with behavioral analytics ...

next page

Showing results 1-20

Python Scraping information

See California salary details

$13

$57

$85

How much do python scraping jobs pay per hour?

As of May 31, 2026, the average hourly pay for python scraping in California is $57.85, according to ZipRecruiter salary data. Most workers in this role earn between $47.69 and $65.72 per hour, depending on experience, location, and employer.

What are the key skills and qualifications needed to thrive as a Python Scraping Specialist, and why are they important?

To thrive as a Python Scraping Specialist, you need strong proficiency in Python programming, understanding of web protocols (HTTP, HTML, CSS), and experience with libraries such as BeautifulSoup, Scrapy, or Selenium. Familiarity with version control systems like Git and knowledge of data storage formats (JSON, CSV, SQL) are also commonly required. Problem-solving, attention to detail, and effective communication are valuable soft skills in this role. These skills ensure efficient data extraction, compliance with website policies, and the ability to deliver actionable insights from web data.

What are some common challenges faced by Python Scraping professionals, and how can they be addressed?

Python Scraping professionals often encounter obstacles such as website anti-scraping measures, dynamic content loading with JavaScript, and frequent changes in website structures. Overcoming these challenges typically involves using tools like Selenium or Playwright for dynamic pages, rotating proxies and user agents to avoid detection, and writing adaptable, modular code to quickly update scrapers when site layouts change. Staying up to date with the latest libraries and best practices is vital for efficiency and compliance with legal and ethical standards.

What is Python scraping?

Python scraping refers to the process of using the Python programming language to extract data from websites or online sources. It typically involves sending HTTP requests to webpages, parsing the HTML or other content, and collecting specific information for analysis or storage. Popular Python libraries for web scraping include BeautifulSoup, Scrapy, and Requests. This technique is widely used in data analysis, research, and business intelligence, but it's important to respect website terms of service and legal guidelines when scraping data.

What is the difference between Python Scraping vs Data Analyst?

AspectPython ScrapingData Analyst
Required SkillsPython programming, web scraping libraries (BeautifulSoup, Scrapy)Data analysis, SQL, Excel, statistical skills
Work EnvironmentTechnical, coding-focused, often remoteBusiness-focused, reporting, presentations
Industry UsageWeb data extraction, research projectsBusiness insights, decision-making
CertificationsPython certifications, web scraping coursesData analysis certifications (e.g., CAP, Microsoft Certified)

Python Scraping involves writing code to extract data from websites, focusing on programming skills and technical tools. Data Analysts interpret and visualize data for business insights, requiring analytical and statistical skills. While both roles work with data, Python Scraping is more technical and coding-intensive, whereas Data Analysts focus on analyzing and presenting data for decision-making.

What job categories do people searching Python Scraping jobs in California look for? The top searched job categories for Python Scraping jobs in California are:
What cities in California are hiring for Python Scraping jobs? Cities in California with the most Python Scraping job openings:
Infographic showing various Python Scraping job openings in California as of May 2026, with employment types broken down into 68% Full Time, and 32% Part Time. Highlights an 73% Physical, 5% Hybrid, and 22% Remote job distribution, with an average salary of $120,336 per year, or $57.9 per hour.
Software Development Engineer - Data Acquisition & Normalization

Software Development Engineer - Data Acquisition & Normalization

ID.me

Mountain View, CA • On-site

$135.10K - $162.20K/yr

Full-time

Medical, Dental, Vision, Life, Retirement, PTO

Posted 17 days ago


ID.me rating

6.3

Company rating: 6.3 out of 10

Based on 6 frontline employees who took The Breakroom Quiz

163rd of 184 rated software companies


Job description

Company Overview
ID.me is the next-generation digital identity wallet that simplifies how individuals securely prove their identity online. Consumers can verify their identity with ID.me once and seamlessly login across websites without having to create a new login and verify their identity again. Over 152 million users experience streamlined login and identity verification with ID.me at 20 federal agencies, 45 state government agencies, and 70+ healthcare organizations. More than 600+ consumer brands use ID.me to verify communities and user segments to honor service and build more authentic relationships. ID.me's technology meets the federal standards for consumer authentication set by the Commerce Department and is approved as a NIST 800-63-3 IAL2 / AAL2 credential service provider by the Kantara Initiative. ID.me is committed to "No Identity Left Behind" to enable all people to have a secure digital identity. To learn more, visit https://network.id.me/.
Role Overview
ID.me is seeking a Software Development Engineer III to join the Data Acquisition & Normalization team. This team is responsible for building and operating the integrations that power the Identity Trust Graph - acquiring, normalizing, and refreshing identity attributes from authoritative and commercial sources.
In this role, you will contribute to building and maintaining connectors, data pipelines, and normalization services that ensure ID.me delivers reliable, real-time validation of identity attributes at internet scale. You will work alongside experienced engineers and partner with Product Managers from the Persons and Organizations teams to help translate validation contracts into working integrations.
This position is based in our Mountain View, CA office, 5 days per week.
Key Responsibilities
  • Build and maintain connectors to government registries, telcos, licensing authorities, and commercial data providers.
  • Standardize and reconcile heterogeneous data formats into clean schemas usable by the Identity Trust Graph.
  • Monitor and help resolve upstream source changes; contribute to retries, fallbacks, and error handling to improve pipeline reliability.
  • Contribute to the Attribute Validation Service (AVS) by adding trusted data that validates identity attributes against sources of record.
  • Help deliver clean and validated attribute data to downstream consumers including Wallet, Fraud, and Domains.
  • Assist in reporting coverage and freshness metrics to Product, Ops, and Analytics stakeholders.
  • Handle sensitive data in accordance with NIST, ISO 27001, and FedRAMP standards.
  • Write high-quality, maintainable, and well-tested code, including automated tests and observability instrumentation.
  • Participate in system design discussions, code reviews, and technical documentation to support team alignment.
Key Success Metrics
  • Attribute coverage and freshness SLA attainment.
  • Connector uptime and reliability.
  • Validation latency and success rates.
  • MTTR (mean time to resolution) for broken integrations.
  • Cost efficiency per validation event.
Required Qualifications
  • Bachelor's or Master's degree in Computer Science, Engineering, or a related field (or equivalent experience).
  • 4+ years of experience developing web applications using OOP languages such as Java, Ruby, JavaScript, TypeScript, Go, Python, Rust, or C++.
  • Exposure to data acquisition or integration work, including APIs, screen scraping, ETL, or normalization pipelines.
  • Experience building systems in Docker, Kubernetes or Nomad and services in a containerized, cloud-based, infrastructure-as-code driven ecosystem such as GCP.
  • Ability to deliver features end to end, including automated test coverage, observability, monitoring, and documentation.
  • Ability to communicate technical tradeoffs clearly and work collaboratively within a team.
  • Proficiency and strong interest in AI-assisted development tools (e.g., Claude Code or Codex) to accelerate delivery and code quality.
Preferred Qualifications
  • Familiarity with operating data pipelines with reliability and SLA requirements.
  • Understanding of distributed systems concepts, caching, asynchronous processing, and cloud-native patterns.
  • Exposure to authentication and authorization standards (OAuth2, OIDC, JWT, or custom schemes).
  • Familiarity with identity and credential verification systems, including data validation, proofing, or trust scoring.
  • Exposure to event-driven architectures (Kafka, SNS/SQS) and patterns for decoupled service communication.
  • Experience with cloud infrastructure (AWS, GCP, or Azure), including containerization and deployment pipelines.
  • Familiarity with observability, monitoring, and incident response best practices.
  • Awareness of compliance and security requirements for sensitive data (NIST, FedRAMP, ISO 27001).
  • Bonus: Exposure to FinTech, identity, or data aggregation companies (e.g., Plaid, Yodlee, Envestnet).

The annual base salary listed does not include a company bonus, incentive for sales roles, equity and benefits which will be determined based on experience, skills, education, relevant training, geographic location and role.
ID.me offers comprehensive medical, dental, vision, health savings account, flexible spending accounts (medical, limited purpose, dependent care, commuter benefit accounts), basic and voluntary life and AD&D insurance, 401(k) with company match, parental leave, ability to participate in unlimited paid time off subject to the terms and conditions of the PTO policy, including 8 company wide holidays, short and long-term disability insurance, accident and critical illness insurance, referral bonus policy, employee assistance program, pet insurance, travel assistant program, wellbeing and childcare discounts, benefit advocates, and a learning and development benefit.
The above represents the anticipated total rewards package for this job requisition. Final offers may vary from the amount listed based on qualifications, professional experiences, skills, education, relevant training, geographic location, and other job related factors.
Mountain View, CA Pay Range
$168,926-$192,500 USD
ID.me is a full-time, in-office culture. Unless a specific job description explicitly states otherwise, all roles are on-site five days per week at one of our offices in McLean, VA; Mountain View, CA; New York City, NY; or Tampa, FL. Certain roles - such as field-based sales or other remote-by-design positions - may have different work arrangements as noted in their individual postings.
ID.me maintains a work environment free from discrimination, where employees are treated with dignity and respect. All ID.me employees share in the responsibility for fulfilling our commitment to equal employment opportunity. ID.me does not discriminate against any employee or applicant on the basis of age, ancestry, color, family or medical care leave, gender identity or expression, genetic information, marital status, medical condition, national origin, physical or mental disability, political affiliation, protected veteran status, race, religion, sex (including pregnancy), sexual orientation, or any other characteristic protected by applicable laws, regulations and ordinances. ID.me adheres to these principles in all aspects of employment, including recruitment, hiring, training, compensation, promotion, benefits, social and recreational programs, and discipline. In addition, ID.me's policy is to provide reasonable accommodation to qualified employees who have protected disabilities to the extent required by applicable laws, regulations and ordinances where a particular employee works. Upon request we will provide you with more information about such accommodations.
Please review our Privacy Policy, including our CCPA policy, at id.me/privacy. If you provide ID.me with any personally identifiable information you confirm that you have read and agree to be bound by the terms and conditions set out in our Privacy Policy.
ID.me participates in E-Verify.