ZipRecruiter

Log In

2

Full Time Python Web Scraping Jobs (NOW HIRING)

Two Six Technologies

Data Collection Engineer

$117K - $140K/yr

... web barriers. * Reliability Focus: A strong commitment to data integrity, system monitoring, and building self-healing scraping systems. * Core Language: Expert-level proficiency in Python

New

Babel Street

Software Engineer III

Reston, VA · On-site

We are looking for a Senior Python Engineer with a "hacker" mindset to join our team as a Software Engineer III. This role is dedicated to large-scale web scraping and data harvesting. If you have ...

LTE Care Plus Inc.

IT Manager

Melville, NY · On-site

$90K - $120K/yr

Develop and maintain web scraping and data extraction tools, including Selenium for dynamic content ... Strong proficiency in Python and Java * Working knowledge of Node.js, React.js, and Java Spring ...

Geo Owl

Data Scientist (EO and SAR)

Springfield, VA · On-site

... web scraping for curation per Maven data priorities • Build geospatial visualization and ... in Python and other languages for data cleaning and manipulation Preferred : • Experience ...

DevSelect

Data Engineer

Chicago, IL · On-site +1

$118K - $141K/yr

Responsibilities include data mining, web scraping, cleaning and organizing the data into both SQL ... Required Job Qualifications: • At least 4 years experience with python development and database ...

Marathon TS

Senior Software Engineer

Washington, DC · On-site

$138K - $182K/yr

... web scraping solutions to enhance the capabilities of our government partner's tools. Responsibilities : • Develop and maintain web applications using Python, React, and Flask • Create and ...

LTE Care Plus Inc.

IT Manager

Melville, NY · On-site

Develop and maintain web scraping and data extraction tools, including Selenium for dynamic content ... Strong proficiency in Python and Java * Working knowledge of Node.js, React.js, and Java Spring ...

Incedo

Hadoop Developer

Wilson, NC · On-site

Contract/Full Time • Bachelors (IT/Computer Science Preferred); Master's Degree preferred ... web scraping, calling APIs, write SQL queries, etc.) • Excellent technical skills - able to ...

Incedo

Hadoop Developer

Wilson, NC · On-site

Contract/Full Time Bachelors (IT/Computer Science Preferred); Master's Degree preferred (IT/Compute ... web scraping, calling APIs, write SQL queries, etc.) Excellent technical skills - able to ...

next page

Showing results 1-20

All JobsPython Web Scraping JobsFull Time Python Web Scraping Jobs

Full Time Python Web Scraping information

See salary details

$44

$57

$64

How much do full time python web scraping jobs pay per hour?

As of Jul 15, 2026, the average hourly pay for full time python web scraping in the United States is $57.88, according to ZipRecruiter salary data. Most workers in this role earn between $52.88 and $62.50 per hour, depending on experience, location, and employer.

What are the key skills and qualifications needed to thrive as a Full Time Python Web Scraping professional, and why are they important?

To thrive as a Full Time Python Web Scraping professional, you need expertise in Python programming, web scraping frameworks (like Scrapy or BeautifulSoup), and a strong understanding of HTML, CSS, and web protocols. Familiarity with tools such as Selenium for dynamic content extraction, RESTful APIs, version control systems like Git, and knowledge of anti-bot measures is often required. Attention to detail, problem-solving ability, and effective communication skills help you handle complex data extraction challenges and collaborate with teams. These skills ensure accurate, efficient data collection and compliance with ethical and legal standards, which are vital for successful web scraping projects.

What are some common challenges faced in a full-time Python web scraping role, and how can they be addressed?

In a full-time Python web scraping role, professionals often encounter challenges such as handling websites with anti-scraping measures, frequent site structure changes, and managing large volumes of data efficiently. Overcoming these issues typically involves using robust libraries like Requests and BeautifulSoup or frameworks such as Scrapy, implementing rotating proxies and user-agent headers to avoid detection, and setting up error handling to adapt to site changes. Maintaining clear communication with team members, especially when integrating scraped data with databases or other systems, is also crucial for success in this collaborative environment.

What are Full Time Python Web Scraping jobs?

Full Time Python Web Scraping jobs involve using the Python programming language to collect, extract, and process data from websites on a regular, full-time schedule. Professionals in these roles build and maintain automated scripts or tools to gather structured and unstructured data for purposes like market research, data analysis, or business intelligence. They often work with libraries such as BeautifulSoup, Scrapy, and Selenium, and are responsible for handling challenges like dynamic content, CAPTCHA, and legal considerations around data usage.

What is the difference between Full Time Python Web Scraping vs Data Analyst?

AspectFull Time Python Web ScrapingData Analyst
Required SkillsPython, web scraping libraries, data extractionExcel, SQL, data visualization, basic programming
Work EnvironmentTech companies, data-driven projects, remote or officeBusiness environments, reporting, dashboards
Industry UsageWeb data collection, market research, e-commerceBusiness insights, decision-making, reporting

Full Time Python Web Scraping roles focus on extracting data from websites using Python, often requiring programming and technical skills. Data Analysts interpret and visualize data for business insights, typically using tools like Excel and SQL. While both roles involve data, Web Scraping is more technical and specialized in data collection, whereas Data Analysts focus on analyzing and presenting data for strategic decisions.

What cities are hiring for Full Time Python Web Scraping jobs? Cities with the most Full Time Python Web Scraping job openings:
What are the most commonly searched types of Python Web Scraping jobs? The most popular types of Python Web Scraping jobs are:
Full Time Python Web Scraping jobs near you
Data Collection Engineer

Data Collection Engineer

Two Six Technologies

Remote

$117K - $140K/yr

Full-time

Medical, Dental, Vision, Life, Retirement, PTO

Posted 4 days ago

New

Job description

At Two Six Technologies, we build, deploy, and implement innovative products that solve the world's most complex challenges today. Through unrivaled collaboration and unwavering trust, we push the boundaries of what's possible to empower our team and support our customers in building a safer global future.
Two Six Technologies is seeking a highly skilled Data Collection Engineer to design, scale, and maintain our distributed web scraping and data extraction infrastructure. In this role, you will be responsible for building resilient data pipelines that harvest data from complex web ecosystems, ensuring strict data quality through automated validation, and managing containerized workloads at scale. If you thrive on reverse-engineering web applications, overcoming anti-bot barriers, and orchestrating distributed systems, we want you on our team.
Location: 100% Remote
What you will Do:
  • Distributed Crawler Development: Design and deploy high-performance, distributed web scrapers using Python and Scrapy to extract massive datasets efficiently.
  • Dynamic Content Extraction: Utilize Browser Scripting tools to navigate, interact with, and extract data from modern, dynamic, and JavaScript-heavy websites.
  • Infrastructure & Container Orchestration: Deploy, scale, and manage scraping workloads on Kubernetes, ensuring optimal resource allocation and fault tolerance.
  • Data Validation & Quality Assurance: Define strict JSON Schemas and leverage Pydantic to enforce data types, validate incoming payloads, and catch data drift early.
  • Data Ingestion & Storage: Build and optimize search and storage pipelines using Elasticsearch, transforming raw web dumps into highly structured, searchable data.
  • Pipeline Workflow Management: Architect robust pipeline workflows to manage the end-to-end data lifecycle-from discovery and extraction to validation and storage.
  • Anti-Bot & Proxy Engineering: Manage complex proxy rotation, session handling, and browser fingerprinting to maintain high success rates against advanced anti-scraping systems.

What you will need (basic qualifications):
  • Experience: 7+ years of professional software engineering experience, with a heavy focus on web scraping, data engineering, or distributed systems.
  • Analytical Mindset: Excellent reverse-engineering skills, with the ability to dissect network traffic, unearth hidden APIs, and bypass complex web barriers.
  • Reliability Focus: A strong commitment to data integrity, system monitoring, and building self-healing scraping systems.
  • Core Language: Expert-level proficiency in Python.
  • Scraping Frameworks: Deep experience with Scrapy and distributed scraping architectures (e.g., handling distributed queues, broad vs. deep crawling).
  • Automation & Browser Scripting: Proven experience with browser automation tools (Playwright, Selenium, or Puppeteer).
  • Data Serialization & Validation: Mastery of JSON, JSON Schema, and data validation using Pydantic.
  • Search & Analytics Engines: Hands-on experience indexing, querying, and optimizing Elasticsearch clusters.
  • Orchestration: Strong proficiency in managing and scaling applications within Kubernetes environments.
  • Workflow Management: Experience building structured pipeline workflows to handle complex, multi-stage data extraction tasks.
  • Education: Bachelor's degree in Computer Science, Engineering

Nice if you Have:
  • AI & Intelligent Extraction: Experience leveraging LLMs or Computer Vision for adaptive scraping, parsing unstructured HTML, or bypassing CAPTCHAs (AI in data collection).
  • Cloud Infrastructure: Strong hands-on experience with AWS ecosystems (e.g., EKS, EC2, S3, RDS).
  • Relational Databases: Proficiency in SQL for querying, schema design, and storing structured relational data.
  • In-Memory Data Structures: Experience with Redis (specifically for caching, deduplication, or as a Scrapy distributed queue back-end).
  • Event Streaming: Familiarity with Apache Kafka for real-time data streaming and decoupled pipeline architectures.
  • Containerization: Strong foundation in Docker for local development and containerizing scraping microservices.
  • DevOps: Experience with CI/CD pipelines (GitHub Actions, GitLab CI, Jenkins) for automated testing and deployment of crawlers.

Clearance Requirement:
  • Eligible to obtain a clearance

Two Six Technologies is committed to providing competitive and comprehensive compensation packages that reflect the value we place on our employees and their contributions. We believe in rewarding skills, experience, and performance. Our offerings include but are not limited to, medical, dental, and vision insurance, life and disability insurance, retirement benefits, paid leave, tuition assistance and professional development.
The projected salary range listed for this position is annualized. This is a general guideline and not a guarantee of salary. Salary is one component of our total compensation package and the specific salary offered is determined by various factors, including, but not limited to education, experience, knowledge, skills, geographic location, as well as contract specific affordability and organizational requirements.
Salary Range
$160,000-$200,000 USD
Looking for other great opportunities? Check out Two Six Technologies Opportunities for all our Company's current openings!
Ready to make the first move towards growing your career? If so, check out the Two Six Technologies Candidate Journey! This will give you step-by-step directions on applying, what to expect during the application process, information about our rich benefits and perks along with our most frequently asked questions. If you are undecided and would like to learn more about us and how we are contributing to essential missions, check out our Two Six Technologies News page! We share information about the tech world around us and how we are making an impact! Still have questions, no worries! You can reach us at Contact Two Six Technologies. We are happy to connect and cover the information needed to assist you in reaching your next career milestone.
Two Six Technologies is an Equal Opportunity Employer and does not discriminate in employment opportunities or practices based on race (including traits historically associated with race, such as hair texture, hair type and protective hair styles (e.g., braids, twists, locs and twists)), color, religion, national origin, sex (including pregnancy, childbirth or related medical conditions and lactation), sexual orientation, gender identity or expression, age (40 and over), marital status, disability, genetic information, and protected veteran status or any other characteristic protected by applicable federal, state, or local law. For more information review the Two Six Technologies Equal Employment Opportunity and Affirmative Action Policy and the EEO Poster.
If you are an individual with a disability and would like to request reasonable workplace accommodation for any part of our employment process, please send an email to accommodations@twosixtech.com. Information provided will be kept confidential and used only to the extent required to provide needed reasonable accommodations.
Additionally, please be advised that this business uses E-Verify in its hiring practices.
By submitting the following application, I hereby certify that to the best of my knowledge, the information provided is true and accurate.

Apply