Computer Technologies Consultants (CTC) is seeking a Web Scraping Engineer to support the United States Department of State in Arlington, VA. This would be a 3+ month contract with the possibility of ...
Computer Technologies Consultants (CTC) is seeking a Web Scraping Engineer to support the United States Department of State in Arlington, VA. This would be a 3+ month contract with the possibility of ...
Web Scraping Engineer- 3566726
Arlington, VA · On-site +1
$105K - $110K/yr
Computer Technologies Consultants (CTC) is seeking a Web Scraping Engineer to support the United States Department of State in Arlington, VA. This would be a 3+ month contract with the possibility of ...
Quick apply
Web Scraping Engineer- 3566726
Arlington, VA · On-site +1
$105K - $110K/yr
Computer Technologies Consultants (CTC) is seeking a Web Scraping Engineer to support the United States Department of State in Arlington, VA. This would be a 3+ month contract with the possibility of ...
Data Engineer, Web Scraping
$117K - $140K/yr
The Data Engineer will design, implement, and optimize end-to-end data pipelines for web scraping and processing data, collaborating with ML engineers and software developers to deliver insights and ...
Data Engineer, Web Scraping
$117K - $140K/yr
The Data Engineer will design, implement, and optimize end-to-end data pipelines for web scraping and processing data, collaborating with ML engineers and software developers to deliver insights and ...
Freelance Data Scraping Engineer (Python)
Houston, TX · Remote
$37/hr
Mindrift is looking for highly skilled Python Data Scraping Engineers to join the Tendem project and drive specialized data scraping workflows within our hybrid AI + human system. In this role, as an ...
Freelance Data Scraping Engineer (Python)
Houston, TX · Remote
$37/hr
Mindrift is looking for highly skilled Python Data Scraping Engineers to join the Tendem project and drive specialized data scraping workflows within our hybrid AI + human system. In this role, as an ...
Freelance Data Scraping Engineer (Python)
New York, NY · On-site +1
$37/hr
Mindrift is looking for highly skilled Python Data Scraping Engineers to join the Tendem project and drive specialized data scraping workflows within our hybrid AI + human system. In this role, as an ...
Freelance Data Scraping Engineer (Python)
New York, NY · On-site +1
$37/hr
Mindrift is looking for highly skilled Python Data Scraping Engineers to join the Tendem project and drive specialized data scraping workflows within our hybrid AI + human system. In this role, as an ...
Freelance Data Scraping Engineer (Python)
Houston, TX · Remote
$37/hr
Mindrift is looking for highly skilled Python Data Scraping Engineers to join the Tendem project and drive specialized data scraping workflows within our hybrid AI + human system. In this role, as an ...
Freelance Data Scraping Engineer (Python)
Houston, TX · Remote
$37/hr
Mindrift is looking for highly skilled Python Data Scraping Engineers to join the Tendem project and drive specialized data scraping workflows within our hybrid AI + human system. In this role, as an ...
Mindrift is looking for highly skilled Python Data Scraping Engineers to join the Tendem project and drive specialized data scraping workflows within our hybrid AI + human system. In this role, as an ...
Mindrift is looking for highly skilled Python Data Scraping Engineers to join the Tendem project and drive specialized data scraping workflows within our hybrid AI + human system. In this role, as an ...
Freelance Data Scraping Engineer (Python)
Austin, TX · Remote
$37/hr
Mindrift is looking for highly skilled Python Data Scraping Engineers to join the Tendem project and drive specialized data scraping workflows within our hybrid AI + human system. In this role, as an ...
Freelance Data Scraping Engineer (Python)
Austin, TX · Remote
$37/hr
Mindrift is looking for highly skilled Python Data Scraping Engineers to join the Tendem project and drive specialized data scraping workflows within our hybrid AI + human system. In this role, as an ...
Data Engineer, Web Scraping
Washington, DC · Remote
$105K - $125K/yr
Conduct ad hoc web scraping and data collection to support research and intelligence initiatives; * Prepare data for further analysis, including data cleaning, transformation, anonymization, and ...
Data Engineer, Web Scraping
Washington, DC · Remote
$105K - $125K/yr
Conduct ad hoc web scraping and data collection to support research and intelligence initiatives; * Prepare data for further analysis, including data cleaning, transformation, anonymization, and ...
Freelance Data Scraping Engineer (Python)
Dallas, TX · Remote
$37/hr
Mindrift is looking for highly skilled Python Data Scraping Engineers to join the Tendem project and drive specialized data scraping workflows within our hybrid AI + human system. In this role, as an ...
Freelance Data Scraping Engineer (Python)
Dallas, TX · Remote
$37/hr
Mindrift is looking for highly skilled Python Data Scraping Engineers to join the Tendem project and drive specialized data scraping workflows within our hybrid AI + human system. In this role, as an ...
Freelance Data Scraping Engineer (Python)
New York, NY · Remote
$37/hr
Mindrift is looking for highly skilled Python Data Scraping Engineers to join the Tendem project and drive specialized data scraping workflows within our hybrid AI + human system. In this role, as an ...
Freelance Data Scraping Engineer (Python)
New York, NY · Remote
$37/hr
Mindrift is looking for highly skilled Python Data Scraping Engineers to join the Tendem project and drive specialized data scraping workflows within our hybrid AI + human system. In this role, as an ...
Mindrift is looking for highly skilled Senior Python Data Scraping Engineers to join the Tendem project and drive specialized data scraping workflows within our hybrid AI + human system. In this role ...
Mindrift is looking for highly skilled Senior Python Data Scraping Engineers to join the Tendem project and drive specialized data scraping workflows within our hybrid AI + human system. In this role ...
Freelance Data Scraping Engineer (Python)
San Antonio, TX · Remote
$37/hr
Mindrift is looking for highly skilled Python Data Scraping Engineers to join the Tendem project and drive specialized data scraping workflows within our hybrid AI + human system. In this role, as an ...
Freelance Data Scraping Engineer (Python)
San Antonio, TX · Remote
$37/hr
Mindrift is looking for highly skilled Python Data Scraping Engineers to join the Tendem project and drive specialized data scraping workflows within our hybrid AI + human system. In this role, as an ...
Senior Python Data Scraping Engineer (Freelance)
Brooklyn, NY · Remote
$45/hr
Mindrift is looking for highly skilled Senior Python Data Scraping Engineers to join the Tendem project and drive specialized data scraping workflows within our hybrid AI + human system. In this role ...
Senior Python Data Scraping Engineer (Freelance)
Brooklyn, NY · Remote
$45/hr
Mindrift is looking for highly skilled Senior Python Data Scraping Engineers to join the Tendem project and drive specialized data scraping workflows within our hybrid AI + human system. In this role ...
Senior Python Data Scraping Engineer (Freelance)
Austin, TX · Remote
$45/hr
Mindrift is looking for highly skilled Senior Python Data Scraping Engineers to join the Tendem project and drive specialized data scraping workflows within our hybrid AI + human system. In this role ...
Senior Python Data Scraping Engineer (Freelance)
Austin, TX · Remote
$45/hr
Mindrift is looking for highly skilled Senior Python Data Scraping Engineers to join the Tendem project and drive specialized data scraping workflows within our hybrid AI + human system. In this role ...
Data Engineer - Web Scraping & Data Extraction
San Francisco, CA · Remote
$105K - $125K/yr
10a Labs is seeking a Data Engineer to design and implement data pipelines for scraping and processing data. The role includes web scraping, data cleaning, and API development, collaborating with ML ...
Data Engineer - Web Scraping & Data Extraction
San Francisco, CA · Remote
$105K - $125K/yr
10a Labs is seeking a Data Engineer to design and implement data pipelines for scraping and processing data. The role includes web scraping, data cleaning, and API development, collaborating with ML ...
Remote AI Data & Web Scraping Specialist
Dallas, TX · Remote
$32/hr
The role involves advanced web scraping, technical problem-solving, and writing Python scripts for data processing. Ideal candidates will possess at least one year of relevant experience, proficiency ...
Remote AI Data & Web Scraping Specialist
Dallas, TX · Remote
$32/hr
The role involves advanced web scraping, technical problem-solving, and writing Python scripts for data processing. Ideal candidates will possess at least one year of relevant experience, proficiency ...
Senior Python Data Scraping Engineer (Freelance)
New York, NY · On-site +1
$45/hr
Mindrift is looking for highly skilled Senior Python Data Scraping Engineers to join the Tendem project and drive specialized data scraping workflows within our hybrid AI + human system. In this role ...
Senior Python Data Scraping Engineer (Freelance)
New York, NY · On-site +1
$45/hr
Mindrift is looking for highly skilled Senior Python Data Scraping Engineers to join the Tendem project and drive specialized data scraping workflows within our hybrid AI + human system. In this role ...
Mindrift is looking for highly skilled Senior Python Data Scraping Engineers to join the Tendem project and drive specialized data scraping workflows within our hybrid AI + human system. In this role ...
Mindrift is looking for highly skilled Senior Python Data Scraping Engineers to join the Tendem project and drive specialized data scraping workflows within our hybrid AI + human system. In this role ...
Senior Python Data Scraping Engineer (Freelance)
Queens, NY · Remote
$45/hr
Mindrift is looking for highly skilled Senior Python Data Scraping Engineers to join the Tendem project and drive specialized data scraping workflows within our hybrid AI + human system. In this role ...
Senior Python Data Scraping Engineer (Freelance)
Queens, NY · Remote
$45/hr
Mindrift is looking for highly skilled Senior Python Data Scraping Engineers to join the Tendem project and drive specialized data scraping workflows within our hybrid AI + human system. In this role ...
Scraping information
What is the difference between Scraping vs Data Analyst?
| Aspect | Scraping | Data Analyst |
|---|---|---|
| Required Credentials | Basic programming skills, knowledge of web technologies | Degree in statistics, mathematics, or related field; analytical skills |
| Work Environment | Primarily technical, focused on coding and data extraction | Business or corporate setting, analyzing data for insights |
| Employer & Industry Usage | Used across tech, marketing, research industries for data collection | Used in finance, marketing, healthcare for data interpretation |
| Search & Comparison Intent | Understanding data extraction methods, tools, and techniques | Interpreting data, generating reports, making data-driven decisions |
While both roles involve working with data, Scraping focuses on extracting data from websites using programming skills, whereas Data Analysts interpret and analyze data to support business decisions. Scraping is more technical and coding-oriented, while Data Analysts require analytical and statistical expertise.

Full-time
Posted 10 days ago
Job description
With offices in Washington DC and San Diego, CA, CTC is a leading technology company providing lifecycle IT, data analytics, cloud managed hosting services, agile software development, DevOps, Test Automation, Cyber Security, and infrastructure solutions. Additionally, we provide Professional Talent Acquisition Services as we proudly support the unique needs of U.S. Defense, Intelligence, and Federal Civilian agencies as well as Fortune 1000 companies.
Got the Government Contractor Blues? Looking for a company that cares and goes beyond just filling another contract billet? Well look no further! Experience this family-oriented company who takes pride in you and will help you grow where your passions lie. Holding many Defense & Federal government contracts around the globe, with our client you have the opportunity to take on new and evolving challenges, aim beyond what you think you are capable of and work in collaborative, dynamic, and high-tempo environments. Our clients' employees are their most valued asset and they invest in their people because they are in it for the long term. They are committed to your success and well-being and offer competitive benefits packages, salaries, bonus/award programs, and a high potential for professional growth and job opportunities world-wide.
Why Should You Be Interested?
- Direct hire position
- Competitive compensation and comprehensive benefits
- Mid-size company with room for growth
Position Title: Web Scraping Engineer
Position Location: This position is currently remote, with occasional meetings in Arlington, VA.
Daily Responsibilities:
- Position supports the development and maintenance of the agency's web scraping infrastructure. The position is responsible for extracting data from various websites and APIs, ensuring data quality and accuracy, and optimizing the scraping process for efficiency. Duties include:
- Develop and maintain web scraping scripts and tools to extract data from websites and APIs.
- Collaborate with cross-functional teams to understand data requirements and implement scraping solutions accordingly.
- Monitor and troubleshoot scraping processes to ensure data quality and accuracy.
- Optimize scraping scripts for performance and efficiency, considering factors such as speed, scalability, and resource utilization.
- Stay up-to-date with the latest web scraping techniques, tools, and best practices.
- Conduct data analysis and validation to ensure the integrity of scraped data.
- Collaborate with data engineering and data science teams to integrate scraped data into our data pipelines and systems.
- Document and communicate technical solutions, processes, and best practices to team members.
Required Years of Experience (min):
- 3+ years of professional experience in web scraping or a similar role.
Required Degree:
- BS/BA degree in Computer Science, Information Sciences, or related IT discipline OR Allowable Substitution: Additional ten (10) years of related professional experience can be substituted for a BS/BA degree.
Required Experience:
- Proficiency in Python and Java and experience with web scraping libraries such as BeautifulSoup, Scrapy, or Selenium.
- Knowledge of AI/machine learning techniques for data extraction and classification.
- Experience incorporating AI into Quality Control solutions and AI/ML techniques on an open-source application to web scrape for data extraction and classification.
- Understanding of HTML, CSS, and JavaScript to navigate and interact with websites.
- Experience working with APIs and handling different data formats (JSON, XML, etc.).
- Familiarity with database systems and SQL for data storage and retrieval.
- Familiarity of data cleaning and preprocessing techniques to ensure data quality.
- Strong problem-solving skills and ability to troubleshoot and debug scraping issues.
- Excellent communication and collaboration skills to work effectively in a team environment.
- Attention to detail and ability to handle large volumes of data efficiently.
Preferred Experience:
- Experience with cloud platforms for scalable web scraping infrastructure.
- Familiarity with data visualization tools and techniques.
- Understanding of legal and ethical considerations related to web scraping.
Required Clearance:
- Secret clearance
Pay Information
TBD
Please note: This range is based on our market pay structures. However, individual salaries are determined by a variety of factors including, but not limited to: business considerations, local market conditions, and internal equity, as well as candidate qualifications, such as skills, education, and experience.
Computer Technologies Consultants, Inc. is an Equal Opportunity Employer that provides employment opportunities for all qualified applicants without regard to race, color, religion, gender identity and/or expression, sexual orientation, age, mental or sensory differing abilities, protected veteran status, sex, national origin, or any other characteristic protected by applicable law. Computer Technologies Consultants, Inc. is devoted to diversity, equity, and inclusion.
About Computer Technologies Consultants
Sourced by ZipRecruiter
Industry
It services
Company size
51 - 200 Employees
Headquarters location
Lanham, MD, US
Year founded
1992