... web scraping, calling APIs, write SQL queries, etc.). 3.Experience 7to9yrs 4.Required Skills Technical Skills- ,Scala,Big Data Domain Skills- 5.Nice to have skills Technical Skills- ,Azure Synapse ...
... web scraping, calling APIs, write SQL queries, etc.). 3.Experience 7to9yrs 4.Required Skills Technical Skills- ,Scala,Big Data Domain Skills- 5.Nice to have skills Technical Skills- ,Azure Synapse ...
Technical Recruiter
Newark, NJ · On-site
... leading to senior-level talent. You will act as a subject matter expert in prospecting techniques and tools used for information retrieval, data extraction, web-scraping, continuous process ...
Technical Recruiter
Newark, NJ · On-site
... leading to senior-level talent. You will act as a subject matter expert in prospecting techniques and tools used for information retrieval, data extraction, web-scraping, continuous process ...
Software Engineer III
Reston, VA · On-site
We are looking for a Senior Python Engineer with a "hacker" mindset to join our team as a Software Engineer III. This role is dedicated to large-scale web scraping and data harvesting. If you have ...
Software Engineer III
Reston, VA · On-site
We are looking for a Senior Python Engineer with a "hacker" mindset to join our team as a Software Engineer III. This role is dedicated to large-scale web scraping and data harvesting. If you have ...
Technical Recruiter
Newark, NJ · On-site
... leading to senior-level talent. You will act as a subject matter expert in prospecting techniques and tools used for information retrieval, data extraction, web-scraping, continuous process ...
Technical Recruiter
Newark, NJ · On-site
... leading to senior-level talent. You will act as a subject matter expert in prospecting techniques and tools used for information retrieval, data extraction, web-scraping, continuous process ...
Software Engineer III
Reston, VA · On-site +1
$59.75 - $80.25/hr
We are looking for a Senior Python Engineer with a "hacker" mindset to join our team as a Software Engineer III. This role is dedicated to large-scale web scraping and data harvesting. If you have ...
Software Engineer III
Reston, VA · On-site +1
$59.75 - $80.25/hr
We are looking for a Senior Python Engineer with a "hacker" mindset to join our team as a Software Engineer III. This role is dedicated to large-scale web scraping and data harvesting. If you have ...
Senior Software Engineer
$123K - $162K/yr
The Role We are looking for a Senior Software Engineer to drive the evolution of our shared data ... Deep understanding of large-scale data collection, including web scraping, parsing, proxy ...
Quick apply
Senior Software Engineer
$123K - $162K/yr
The Role We are looking for a Senior Software Engineer to drive the evolution of our shared data ... Deep understanding of large-scale data collection, including web scraping, parsing, proxy ...
Reporting to the Market Making Senior Director of Quants & Algorithmic Trading, this leader will be ... Aggregate and synthesize pricing data from multiple sources including APIs, web scraping, and third ...
Reporting to the Market Making Senior Director of Quants & Algorithmic Trading, this leader will be ... Aggregate and synthesize pricing data from multiple sources including APIs, web scraping, and third ...
Senior AI Engineer
$121K - $167K/yr
... web scraping, with a clear mandate: deliver a production-grade system that detects compliance ... Senior Director, surfacing risks and trade-offs early. Requirements * Production backend Python ...
Senior AI Engineer
$121K - $167K/yr
... web scraping, with a clear mandate: deliver a production-grade system that detects compliance ... Senior Director, surfacing risks and trade-offs early. Requirements * Production backend Python ...
Senior Machine Learning Engineer - up to $200k base + equity We accelerate the deployment of ... Collection -- Implement web scraping and other collection techniques to increase the speed ...
Quick apply
Senior Machine Learning Engineer - up to $200k base + equity We accelerate the deployment of ... Collection -- Implement web scraping and other collection techniques to increase the speed ...
Uber is looking for a Senior Staff Engineer to lead the technical vision and execution for our ... Understanding of web scraping techniques and countermeasures.- Awareness of network security, HTTP ...
Uber is looking for a Senior Staff Engineer to lead the technical vision and execution for our ... Understanding of web scraping techniques and countermeasures.- Awareness of network security, HTTP ...
Senior AI Engineer, Agentic Data Enrichment
San Francisco, CA · On-site
$124K - $169K/yr
Web scraping at scale: anti-bot evasion, residential proxies, request fingerprinting, authenticated flows, CDN defeats. * Eval-framework experience (e.g., LangSmith, Braintrust, Evals, or custom)
Senior AI Engineer, Agentic Data Enrichment
San Francisco, CA · On-site
$124K - $169K/yr
Web scraping at scale: anti-bot evasion, residential proxies, request fingerprinting, authenticated flows, CDN defeats. * Eval-framework experience (e.g., LangSmith, Braintrust, Evals, or custom)
Uber is looking for a Senior Staff Engineer to lead the technical vision and execution for our ... Understanding of web scraping techniques and countermeasures.- Awareness of network security, HTTP ...
Uber is looking for a Senior Staff Engineer to lead the technical vision and execution for our ... Understanding of web scraping techniques and countermeasures.- Awareness of network security, HTTP ...
Sr. Data Scientist
Memphis, TN · On-site
Role: Sr. Data Scientist Duration: Full Time / Permanent Location: Memphis, TN Required Skills ... with web scraping Experience with Text Matching applications Nice to have: Understanding of ...
Sr. Data Scientist
Memphis, TN · On-site
Role: Sr. Data Scientist Duration: Full Time / Permanent Location: Memphis, TN Required Skills ... with web scraping Experience with Text Matching applications Nice to have: Understanding of ...
Senior AI Engineer, Agentic Data Enrichment
San Francisco, CA · On-site
$124K - $169K/yr
Web scraping at scale: anti-bot evasion, residential proxies, request fingerprinting, authenticated flows, CDN defeats. * Eval-framework experience (e.g., LangSmith, Braintrust, Evals, or custom)
Senior AI Engineer, Agentic Data Enrichment
San Francisco, CA · On-site
$124K - $169K/yr
Web scraping at scale: anti-bot evasion, residential proxies, request fingerprinting, authenticated flows, CDN defeats. * Eval-framework experience (e.g., LangSmith, Braintrust, Evals, or custom)
Senior Research Manager - Product & AI
New York, NY · Hybrid
$125K - $140K/yr
Experience with web scraping tools or basic Python for data collection. * Experience with working with AI agent building platforms (e.g. Cursor or N8N). * Familiarity with the Learning and Thinking ...
Senior Research Manager - Product & AI
New York, NY · Hybrid
$125K - $140K/yr
Experience with web scraping tools or basic Python for data collection. * Experience with working with AI agent building platforms (e.g. Cursor or N8N). * Familiarity with the Learning and Thinking ...
Senior AI Engineer, Agentic Data Enrichment
San Francisco, CA · On-site
$124K - $169K/yr
Web scraping at scale: anti-bot evasion, residential proxies, request fingerprinting, authenticated flows, CDN defeats. * Eval-framework experience (e.g., LangSmith, Braintrust, Evals, or custom)
Senior AI Engineer, Agentic Data Enrichment
San Francisco, CA · On-site
$124K - $169K/yr
Web scraping at scale: anti-bot evasion, residential proxies, request fingerprinting, authenticated flows, CDN defeats. * Eval-framework experience (e.g., LangSmith, Braintrust, Evals, or custom)
Senior Research Manager - Product & AI
New York, NY · On-site
$125K - $140K/yr
Experience with web scraping tools or basic Python for data collection. * Experience with working with AI agent building platforms (e.g. Cursor or N8N). * Familiarity with the Learning and Thinking ...
Senior Research Manager - Product & AI
New York, NY · On-site
$125K - $140K/yr
Experience with web scraping tools or basic Python for data collection. * Experience with working with AI agent building platforms (e.g. Cursor or N8N). * Familiarity with the Learning and Thinking ...
Financial Data Scientist, Wealth
New York, NY · On-site
$180K - $200K/yr
... third-party web scraping vendors, ensuring quality, relevance, and compliance. * Facilitate tactical execution by delivering timely insights, data products, and analytical support to senior ...
Financial Data Scientist, Wealth
New York, NY · On-site
$180K - $200K/yr
... third-party web scraping vendors, ensuring quality, relevance, and compliance. * Facilitate tactical execution by delivering timely insights, data products, and analytical support to senior ...
... web scraping, and scalable data pipelines • Understanding of statistical methods and skills such as Bayesian Networks Inference, linear and non-linear regression, hierarchical, mixed models/multi ...
... web scraping, and scalable data pipelines • Understanding of statistical methods and skills such as Bayesian Networks Inference, linear and non-linear regression, hierarchical, mixed models/multi ...
... extraction, web-scraping, continuous process improvement, process automation, and candidate ... senior level leaders and stakeholders, reporting on progress, creating and advising on talent ...
... extraction, web-scraping, continuous process improvement, process automation, and candidate ... senior level leaders and stakeholders, reporting on progress, creating and advising on talent ...
Senior Web Scraping information
See salary details
$11K - $28.1K
0% of jobs
$28.1K - $45.2K
0% of jobs
$45.2K - $62.3K
0% of jobs
$62.3K - $79.4K
0% of jobs
$79.4K - $96.5K
0% of jobs
$104.4K is the 25th percentile. Wages below this are outliers.
$96.5K - $113.5K
54% of jobs
$113.5K - $130.6K
12% of jobs
$147.3K is the 75th percentile. Wages above this are outliers.
$130.6K - $147.7K
9% of jobs
$147.7K - $164.8K
4% of jobs
$164.8K - $181.9K
0% of jobs
$181.9K - $199K
21% of jobs
$11K
$133.3K
$199K
How much do senior web scraping jobs pay per year?
What is the difference between Senior Web Scraping vs Data Engineer?
| Aspect | Senior Web Scraping | Data Engineer |
|---|---|---|
| Credentials | Proficiency in programming, web technologies, and data extraction tools | Degree in Computer Science, Data Science, or related fields; experience with databases and ETL processes |
| Work Environment | Project-based, focused on developing and maintaining web scraping scripts | Data pipelines, infrastructure, and large-scale data processing systems |
| Industry Usage | Used across tech, e-commerce, research, and marketing sectors for data collection | Used in data-driven companies for data storage, transformation, and analysis |
| Search & Comparison Intent | Understanding roles, skills, and responsibilities in web data extraction | Exploring data infrastructure, pipelines, and data management roles |
While Senior Web Scraping specialists focus on extracting data from websites using programming skills, Data Engineers build and maintain the infrastructure for storing and processing large datasets. Both roles require technical expertise but serve different stages of data handling in organizations.
Contractor
Posted 6 days ago
Job description
2.Job summary
• 7 years' development experience in one of the Big Data Technologies.
• Hadoop eco system (Pig, Hive, HBASE)
• Spark, Scala, Kafka
• Cross trained in Talend is added advantage • DW basic concepts
• Unix scripting is added advantage
• To be proficient in designing efficient and robust ETL workflows
• To be able to work with cloud computing environments
• Gather and process raw data at scale (including writing scripts, web scraping, calling APIs, write SQL queries, etc.).
3.Experience 7to9yrs
4.Required Skills Technical Skills- ,Scala,Big Data Domain Skills-
5.Nice to have skills Technical Skills- ,Azure Synapse Analytics Domain Skills- 6.Technology Data Management
7.Shift Day 9AM TO 6PM GMT
8.Roles & Responsibilities
• 7 years' development experience in one of the Big Data Technologies.
• Hadoop eco system (Pig, Hive, HBASE)
• Spark, Scala, Kafka
• Cross trained in Talend is added advantage • DW basic concepts
• Unix scripting is added advantage
• To be proficient in designing efficient and robust ETL workflows
• To be able to work with cloud computing environments
• Gather and process raw data at scale (including writing scripts, web scraping, calling APIs, write SQL queries, etc.).
• Secondary skillset: Knowledge on JIRA / Github/ Jenkins / Zena / Healthcare Claims Knowledge
• Experience in Agile Development methodologies
• Excellent communication skills and team dynamics
9.Job Location Primary: USILCIAC02-Chicago - IL USA, CLT Alternate: ,
10.Job Type 60CW00 Business Associate 11.Demand Requires Travel? N 12.Certification(s) Required NA
Additional Sills: Skills:
Category
Name
Required
Importance
Experience
No items to display.
About First Soft Solutions
Sourced by ZipRecruiter
First Soft Solutions custom application Development and Maintenance Services are designed to enable you to lower the total cost of ownership and the required quality for your application. While all application Development Outsourcing is Technically custom, The difference is that packaged applications were designed with a general set of features to be used by a broad range of users. Custom application development is capable of producing practically any feature you may desire for your site. Time and money are virtually the only limiting factors. Our goal is to provide Clients with the Solution that fits their specific and unique needs while giving them the knowledge they need to operate and maintain the New Systems and Software. Our allegiance is to the best solution for our Clients. Our experience and knowledgeable consultants are ready to go above and beyond expectations to assist you in obtaining your goals. We can also provides expert project management throughout the entire project life cycle.
Industry
It services
Company size
11 - 50 Employees
Headquarters location
East Brunswick, NJ, US
Year founded
2006