Data Engineer
Chantilly, VA · On-site
$118K - $142K/yr
... using Python and SQL. • Integrate data from multiple sources, including databases, APIs ... web scraping and data ingestion workflows to collect open-source data, integrating content and ...
Data Engineer
Chantilly, VA · On-site
$118K - $142K/yr
... using Python and SQL. • Integrate data from multiple sources, including databases, APIs ... web scraping and data ingestion workflows to collect open-source data, integrating content and ...
Data Engineer
Chantilly, VA · On-site
$118K - $142K/yr
... using Python and SQL. * Integrate data from a variety of structured and unstructured sources ... Develop and maintain web scraping and data ingestion workflows to collect and process open-source ...
Quick apply
Data Engineer
Chantilly, VA · On-site
$118K - $142K/yr
... using Python and SQL. * Integrate data from a variety of structured and unstructured sources ... Develop and maintain web scraping and data ingestion workflows to collect and process open-source ...
Data Engineer with Security Clearance
Chantilly, VA · On-site
$118K - $142K/yr
... using Python and SQL. * Integrate data from a variety of structured and unstructured sources ... Develop and maintain web scraping and data ingestion workflows to collect and process open-source ...
Data Engineer with Security Clearance
Chantilly, VA · On-site
$118K - $142K/yr
... using Python and SQL. * Integrate data from a variety of structured and unstructured sources ... Develop and maintain web scraping and data ingestion workflows to collect and process open-source ...
Build web scraping algorithms for imagery curation in accordance with customer data priorities ... Development experience in Python and other languages for data cleaning and manipulation What Would ...
Build web scraping algorithms for imagery curation in accordance with customer data priorities ... Development experience in Python and other languages for data cleaning and manipulation What Would ...
Engineering Fellowship
Washington, DC · On-site
Strong Python background * Clear communicator of technical concepts for non-technical audiences ... Experience with web scraping/crawling (e.g., Beautiful Soup, Selenium, Scrapy) Machine Learning ...
Engineering Fellowship
Washington, DC · On-site
Strong Python background * Clear communicator of technical concepts for non-technical audiences ... Experience with web scraping/crawling (e.g., Beautiful Soup, Selenium, Scrapy) Machine Learning ...
Data Scientist
Mclean, VA · On-site
$107K - $195K/yr
Perform web scraping and apply various techniques for processing unstructured data. * leverage ... Experience with Python is required. * Strong SQL skills and experience with relational databases ...
Data Scientist
Mclean, VA · On-site
$107K - $195K/yr
Perform web scraping and apply various techniques for processing unstructured data. * leverage ... Experience with Python is required. * Strong SQL skills and experience with relational databases ...
Data Scientist
Mclean, VA · On-site
$107K - $195K/yr
Perform web scraping and apply various techniques for processing unstructured data. * leverage ... Experience with Python is required. * Strong SQL skills and experience with relational databases ...
Data Scientist
Mclean, VA · On-site
$107K - $195K/yr
Perform web scraping and apply various techniques for processing unstructured data. * leverage ... Experience with Python is required. * Strong SQL skills and experience with relational databases ...
Data Scientist
Mclean, VA · On-site
$131K - $237K/yr
Perform web scraping and apply various techniques for processing unstructured data. * Leverage ... Experience with Python is required. * Strong SQL skills and experience with relational databases ...
Data Scientist
Mclean, VA · On-site
$131K - $237K/yr
Perform web scraping and apply various techniques for processing unstructured data. * Leverage ... Experience with Python is required. * Strong SQL skills and experience with relational databases ...
Support the use of data collection and analytical tools, specifically Python, but also Tableau, SQL ... Experience with API integrations, web scraping, and database management * Demonstrated experience ...
Support the use of data collection and analytical tools, specifically Python, but also Tableau, SQL ... Experience with API integrations, web scraping, and database management * Demonstrated experience ...
Data Scientist - Senior
Falls Church, VA · On-site
Build web scraping algorithms for imagery curation in accordance with customer data priorities ... Development experience in Python and other languages for data cleaning and manipulation What Would ...
Data Scientist - Senior
Falls Church, VA · On-site
Build web scraping algorithms for imagery curation in accordance with customer data priorities ... Development experience in Python and other languages for data cleaning and manipulation What Would ...
Build web scraping algorithms for imagery curation in accordance with customer data priorities ... Development experience in Python and other languages for data cleaning and manipulation What Would ...
Build web scraping algorithms for imagery curation in accordance with customer data priorities ... Development experience in Python and other languages for data cleaning and manipulation What Would ...
Support the use of data collection and analytical tools, specifically Python, but also Tableau, SQL ... Experience with API integrations, web scraping, and database management * Demonstrated experience ...
Support the use of data collection and analytical tools, specifically Python, but also Tableau, SQL ... Experience with API integrations, web scraping, and database management * Demonstrated experience ...
Data Scientist
Mclean, VA · On-site
$107K - $195K/yr
Perform web scraping and apply various techniques for processing unstructured data. * leverage ... Experience with Python is required. * Strong SQL skills and experience with relational databases ...
Data Scientist
Mclean, VA · On-site
$107K - $195K/yr
Perform web scraping and apply various techniques for processing unstructured data. * leverage ... Experience with Python is required. * Strong SQL skills and experience with relational databases ...
Data Engineer
Chantilly, VA · On-site
$117K - $140K/yr
Develop and implement web scraping and data ingestion workflows to collect open-source data ... Python, SQL, and PySpark (highly desired) for data processing and pipeline development. * Elastic ...
Data Engineer
Chantilly, VA · On-site
$117K - $140K/yr
Develop and implement web scraping and data ingestion workflows to collect open-source data ... Python, SQL, and PySpark (highly desired) for data processing and pipeline development. * Elastic ...
Data Engineer with Security Clearance
Chantilly, VA · On-site
$118K - $142K/yr
Develop and implement web scraping and data ingestion workflows to collect open-source data ... Python, SQL, and PySpark (highly desired) for data processing and pipeline development. * Elastic ...
Data Engineer with Security Clearance
Chantilly, VA · On-site
$118K - $142K/yr
Develop and implement web scraping and data ingestion workflows to collect open-source data ... Python, SQL, and PySpark (highly desired) for data processing and pipeline development. * Elastic ...
Data Engineer
Centreville, VA · On-site +1
$113K - $136K/yr
Develop and implement web scraping and data ingestion workflows to collect open-source data ... Python, SQL, and PySpark (highly desired) for data processing and pipeline development. * Elastic ...
Data Engineer
Centreville, VA · On-site +1
$113K - $136K/yr
Develop and implement web scraping and data ingestion workflows to collect open-source data ... Python, SQL, and PySpark (highly desired) for data processing and pipeline development. * Elastic ...
Data Engineer
Chantilly, VA · On-site
$200K - $220K/yr
Develop and implement web scraping and data ingestion workflows to collect open-source data ... Python, SQL, and PySpark (highly desired) for data processing and pipeline development. * Elastic ...
Data Engineer
Chantilly, VA · On-site
$200K - $220K/yr
Develop and implement web scraping and data ingestion workflows to collect open-source data ... Python, SQL, and PySpark (highly desired) for data processing and pipeline development. * Elastic ...
Data Engineer
Columbia, MD · On-site
$93K - $136K/yr
... web scraping, Direct Connect) and internal agency sources into the data lake landing zone and downstream curated zones. * Develop production-grade ETL workflows using AWS Glue, PySpark, Python ...
Quick apply
Data Engineer
Columbia, MD · On-site
$93K - $136K/yr
... web scraping, Direct Connect) and internal agency sources into the data lake landing zone and downstream curated zones. * Develop production-grade ETL workflows using AWS Glue, PySpark, Python ...
Data Engineer
Columbia, MD · On-site
$93K - $136K/yr
... web scraping, Direct Connect) and internal agency sources into the data lake landing zone and downstream curated zones. * Develop production-grade ETL workflows using AWS Glue, PySpark, Python ...
Data Engineer
Columbia, MD · On-site
$93K - $136K/yr
... web scraping, Direct Connect) and internal agency sources into the data lake landing zone and downstream curated zones. * Develop production-grade ETL workflows using AWS Glue, PySpark, Python ...
Data Engineer
Columbia, MD · On-site
$93K - $136K/yr
... web scraping, Direct Connect) and internal agency sources into the data lake landing zone and downstream curated zones. * Develop production-grade ETL workflows using AWS Glue, PySpark, Python ...
Data Engineer
Columbia, MD · On-site
$93K - $136K/yr
... web scraping, Direct Connect) and internal agency sources into the data lake landing zone and downstream curated zones. * Develop production-grade ETL workflows using AWS Glue, PySpark, Python ...
Freelance Python Web Scraping information
What is the difference between Freelance Python Web Scraping vs Freelance Data Analyst?
| Aspect | Freelance Python Web Scraping | Freelance Data Analyst |
|---|---|---|
| Skills & Credentials | Python, web scraping libraries, basic data handling | Excel, SQL, data visualization, statistical analysis |
| Work Environment | Remote, project-based, client-specific | Remote or on-site, consulting or project-based |
| Industry Usage | Web data extraction for research, marketing, or business insights | Data interpretation, reporting, and strategic recommendations |
Freelance Python Web Scraping focuses on extracting data from websites using Python, while Freelance Data Analysts interpret and analyze data to provide insights. Both roles often work remotely and require technical skills, but their core functions differ: one is data collection, the other is data analysis.
What are some common challenges faced by freelance Python web scraping professionals, and how can they be addressed?
Freelance Python web scraping professionals often encounter challenges such as dealing with websites that have anti-scraping measures, handling frequent changes in website structures, and managing large volumes of data efficiently. To address these issues, it's important to stay updated with the latest scraping libraries and techniques, utilize rotating proxies and user-agent strings, and write modular code that can be easily adapted when websites update their layouts. Additionally, maintaining clear communication with clients about legal considerations and project scope helps set realistic expectations and ensures a smooth workflow.
What is freelance Python web scraping?
Freelance Python web scraping involves using the Python programming language to extract data from websites on a project or contract basis, rather than as a full-time employee. Freelancers in this field use libraries like BeautifulSoup, Scrapy, or Selenium to gather, parse, and organize data from various web sources according to client needs. Projects can range from collecting product prices, aggregating news articles, monitoring social media trends, or compiling research datasets. Freelance web scrapers must ensure they comply with relevant legal and ethical guidelines, as well as website terms of service. The work requires technical proficiency, problem-solving skills, and clear communication with clients.
What are the key skills and qualifications needed to thrive as a Freelance Python Web Scraping specialist, and why are they important?
To thrive as a Freelance Python Web Scraping specialist, you need strong programming skills in Python, a deep understanding of web protocols, and knowledge of data extraction techniques. Familiarity with libraries like BeautifulSoup, Scrapy, Selenium, and experience using APIs, along with basic knowledge of version control systems like Git, is typically required. Problem-solving, attention to detail, and effective communication are crucial soft skills for managing client requirements and navigating technical challenges. These skills ensure efficient, ethical, and accurate data extraction, which is vital for delivering reliable results to clients.
What are the most commonly searched types of Python Web Scraping jobs in Washington? The most popular types of Python Web Scraping jobs in Washington are:
What are popular job titles related to Freelance Python Web Scraping jobs in Washington? For Freelance Python Web Scraping jobs in Washington, the most frequently searched job titles are:
What job categories do people searching Freelance Python Web Scraping jobs in Washington look for? The top searched job categories for Freelance Python Web Scraping jobs in Washington are:
What cities in Washington are hiring for Freelance Python Web Scraping jobs? Cities in Washington with the most Freelance Python Web Scraping job openings:
$118K - $142K/yr
Full-time
Re-posted 17 days ago
Job description
Job Summary:
Edgesource Corporation is an innovative technology service provider for various federal and state clients. They are seeking a data engineer to support data structuring and development for a large enterprise system, focusing on ETL/ELT pipelines, data architecture, and collaboration with data scientists and stakeholders.
Responsibilities:
• Design, develop, and maintain ETL/ELT pipelines for batch and real-time processing using Python and SQL.
• Integrate data from multiple sources, including databases, APIs, streaming platforms, PDFs, and MS Office files.
• Build scalable data architectures to support analytics and machine learning workloads.
• Optimize data processing and queries for performance and cost efficiency in AWS S3.
• Exposure to PySpark or other big data frameworks is a plus for future pipeline scalability.
• Develop and implement web scraping and data ingestion workflows to collect open-source data, integrating content and producing structured datasets and visualizations for analytics and stakeholder consumption.
• Collect, clean, and validate large volumes of structured and unstructured data.
• Track data versions, implement data quality checks, and ensure data reliability.
• Design and optimize data storage in AWS S3, including raw, intermediate, and final datasets.
• Implement data governance practices, including documentation, cataloging, lineage, and security.
• Ensure compliance security standards.
• Work closely with Data Scientists, Analysts, and stakeholders to understand data requirements.
• Prepare clean, structured, and feature-ready datasets for analytics and machine learning.
• Support feature engineering, aggregations, and transformations at scale.
• Assist in deploying ML models to production, ensuring monitoring, versioning, and performance optimization.
• Integrate with REST APIs.
• Utilize Docker, Kubernetes, Git, and CI/CD pipelines to deploy and manage workflows.
• Document pipelines, data schemas, and transformations clearly.
• Communicate technical concepts effectively with cross-functional teams.
• Participate in code reviews and promote best practices across the team.
Qualifications:
Required:
• Active TS/SCI FSP
• 3–5 years + of professional experience in data engineering or related roles.
• Strong collaboration skills to work effectively with Data Scientists, Analysts, and Engineering teams.
• Ability to communicate complex technical concepts to non-technical stakeholders.
• Detail-oriented, curious, and committed to data quality.
• Capable of managing multiple priorities in a fast-paced environment.
• Python, SQL, and PySpark (highly desired) for data processing and pipeline development.
• Elastic/OpenSearch for search and analytics solutions.
• Experience with AWS cloud services and Linux environments.
• Git for version control and collaborative development.
• Understanding of machine learning workflows and MLOps concepts.
Preferred:
• Hands-on experience modeling, querying, and optimizing graph databases, especially Neo4j highly desired
Company:
NATIONAL SECURITY EXPERTISE THAT POWERS MISSION SUCCESS Edgesource doesn't observe the mission from afar—we advance it from within. Founded in 1997, the company is headquartered in Alexandria, USA, with a team of 51-200 employees. The company is currently Growth Stage.
Edgesource Corporation is an innovative technology service provider for various federal and state clients. They are seeking a data engineer to support data structuring and development for a large enterprise system, focusing on ETL/ELT pipelines, data architecture, and collaboration with data scientists and stakeholders.
Responsibilities:
• Design, develop, and maintain ETL/ELT pipelines for batch and real-time processing using Python and SQL.
• Integrate data from multiple sources, including databases, APIs, streaming platforms, PDFs, and MS Office files.
• Build scalable data architectures to support analytics and machine learning workloads.
• Optimize data processing and queries for performance and cost efficiency in AWS S3.
• Exposure to PySpark or other big data frameworks is a plus for future pipeline scalability.
• Develop and implement web scraping and data ingestion workflows to collect open-source data, integrating content and producing structured datasets and visualizations for analytics and stakeholder consumption.
• Collect, clean, and validate large volumes of structured and unstructured data.
• Track data versions, implement data quality checks, and ensure data reliability.
• Design and optimize data storage in AWS S3, including raw, intermediate, and final datasets.
• Implement data governance practices, including documentation, cataloging, lineage, and security.
• Ensure compliance security standards.
• Work closely with Data Scientists, Analysts, and stakeholders to understand data requirements.
• Prepare clean, structured, and feature-ready datasets for analytics and machine learning.
• Support feature engineering, aggregations, and transformations at scale.
• Assist in deploying ML models to production, ensuring monitoring, versioning, and performance optimization.
• Integrate with REST APIs.
• Utilize Docker, Kubernetes, Git, and CI/CD pipelines to deploy and manage workflows.
• Document pipelines, data schemas, and transformations clearly.
• Communicate technical concepts effectively with cross-functional teams.
• Participate in code reviews and promote best practices across the team.
Qualifications:
Required:
• Active TS/SCI FSP
• 3–5 years + of professional experience in data engineering or related roles.
• Strong collaboration skills to work effectively with Data Scientists, Analysts, and Engineering teams.
• Ability to communicate complex technical concepts to non-technical stakeholders.
• Detail-oriented, curious, and committed to data quality.
• Capable of managing multiple priorities in a fast-paced environment.
• Python, SQL, and PySpark (highly desired) for data processing and pipeline development.
• Elastic/OpenSearch for search and analytics solutions.
• Experience with AWS cloud services and Linux environments.
• Git for version control and collaborative development.
• Understanding of machine learning workflows and MLOps concepts.
Preferred:
• Hands-on experience modeling, querying, and optimizing graph databases, especially Neo4j highly desired
Company:
NATIONAL SECURITY EXPERTISE THAT POWERS MISSION SUCCESS Edgesource doesn't observe the mission from afar—we advance it from within. Founded in 1997, the company is headquartered in Alexandria, USA, with a team of 51-200 employees. The company is currently Growth Stage.
About Edgesource
Sourced by ZipRecruiter
Company size
51 - 200 Employees
Headquarters location
Alexandria, VA, US
Year founded
1997