... Crawler Development ... Design and implement efficient and scalable web crawlers in Java to collect data from various ...
... Crawler Development ... Design and implement efficient and scalable web crawlers in Java to collect data from various ...
Software Engineer, Web Crawling
San Francisco, CA · On-site
$180K - $350K/yr
As a Web Crawler engineer, you'd be responsible for crawling the entire web. Basically build Google-scale crawling! Who You Are * You have extensive experience building and scaling web crawlers, or ...
Software Engineer, Web Crawling
San Francisco, CA · On-site
$180K - $350K/yr
As a Web Crawler engineer, you'd be responsible for crawling the entire web. Basically build Google-scale crawling! Who You Are * You have extensive experience building and scaling web crawlers, or ...
... leading bot\/web crawler detection product. \n \n \n \n \n \n \n We need engineers who are ... Experience working on data driven applications would be great\n \n * Strong communicator, happy to ...
... leading bot\/web crawler detection product. \n \n \n \n \n \n \n We need engineers who are ... Experience working on data driven applications would be great\n \n * Strong communicator, happy to ...
... leading bot\/web crawler detection product. \n \n \n \n \n \n \n We need engineers who are ... Experience working on data driven applications would be great\n \n * Strong communicator, happy to ...
... leading bot\/web crawler detection product. \n \n \n \n \n \n \n We need engineers who are ... Experience working on data driven applications would be great\n \n * Strong communicator, happy to ...
Software Engineer, Data Infra
San Francisco, CA · On-site
$250/hr
About the Role We're looking for an engineer to join us and contribute to data infrastructure. You ... Have experience building a web crawler. * Have extensive experience understanding and scaling ...
Software Engineer, Data Infra
San Francisco, CA · On-site
$250/hr
About the Role We're looking for an engineer to join us and contribute to data infrastructure. You ... Have experience building a web crawler. * Have extensive experience understanding and scaling ...
Research Engineer, Generalist
San Francisco, CA · On-site
$125 - $150/hr
Generalist Research Engineers work across our search and retrieval stack: crawling, parsing, ML ... Make our web crawler 3x faster This is an in‑person opportunity in San Francisco. We're happy ...
Research Engineer, Generalist
San Francisco, CA · On-site
$125 - $150/hr
Generalist Research Engineers work across our search and retrieval stack: crawling, parsing, ML ... Make our web crawler 3x faster This is an in‑person opportunity in San Francisco. We're happy ...
Java Developer (Remote Permanent Opportunity)
$52.25 - $67.50/hr
Ingestion Pipeline: process data that comes from our web crawler which discovers and fetches ... Solid experience with Java programming (we also use Spring, Spring Webflux, Reactor, Netty) * Multi ...
Java Developer (Remote Permanent Opportunity)
$52.25 - $67.50/hr
Ingestion Pipeline: process data that comes from our web crawler which discovers and fetches ... Solid experience with Java programming (we also use Spring, Spring Webflux, Reactor, Netty) * Multi ...
$250/hr
About the Role We're looking for an engineer to join us and contribute to data infrastructure. You ... Have experience building a web crawler. * Have extensive experience understanding and scaling ...
$250/hr
About the Role We're looking for an engineer to join us and contribute to data infrastructure. You ... Have experience building a web crawler. * Have extensive experience understanding and scaling ...
Java Developer (Remote Permanent Opportunity)
$52.25 - $67.50/hr
Ingestion Pipeline: process data that comes from our web crawler which discovers and fetches ... Solid experience with Java programming (we also use Spring, Spring Webflux, Reactor, Netty) * Multi ...
Java Developer (Remote Permanent Opportunity)
$52.25 - $67.50/hr
Ingestion Pipeline: process data that comes from our web crawler which discovers and fetches ... Solid experience with Java programming (we also use Spring, Spring Webflux, Reactor, Netty) * Multi ...
Software Engineer, Data Infrastructure
San Francisco, CA · On-site
$250/hr
About the Role We're looking for an engineer to join us and contribute to data infrastructure. You ... Have experience building a web crawler. * Have extensive experience understanding and scaling ...
Software Engineer, Data Infrastructure
San Francisco, CA · On-site
$250/hr
About the Role We're looking for an engineer to join us and contribute to data infrastructure. You ... Have experience building a web crawler. * Have extensive experience understanding and scaling ...
AI Search Engineer
San Francisco, CA · On-site
$200 - $250/hr
Engineered from the ground up for an agentic world. Why this role matters This is a high ... Design and scale a distributed web crawler optimized for freshness, coverage, and extracting agent ...
AI Search Engineer
San Francisco, CA · On-site
$200 - $250/hr
Engineered from the ground up for an agentic world. Why this role matters This is a high ... Design and scale a distributed web crawler optimized for freshness, coverage, and extracting agent ...
$200 - $250/hr
Engineered from the ground up for an agentic world. Why this role matters This is a high ... Design and scale a distributed web crawler optimized for freshness, coverage, and extracting agent ...
$200 - $250/hr
Engineered from the ground up for an agentic world. Why this role matters This is a high ... Design and scale a distributed web crawler optimized for freshness, coverage, and extracting agent ...
Senior Java Engineer
$58.50 - $74.75/hr
Senior Java Engineer Position: Full time Location: Toronto, Ontario (Initially Remote) About Us: We ... Ingestion Pipeline: process data that comes from our web crawler which discovers and fetches ...
Senior Java Engineer
$58.50 - $74.75/hr
Senior Java Engineer Position: Full time Location: Toronto, Ontario (Initially Remote) About Us: We ... Ingestion Pipeline: process data that comes from our web crawler which discovers and fetches ...
Senior Java Engineer
$58.50 - $74.75/hr
Senior Java Engineer Position: Full time Location: Toronto, Ontario (Initially Remote) About Us: We ... Ingestion Pipeline: process data that comes from our web crawler which discovers and fetches ...
Senior Java Engineer
$58.50 - $74.75/hr
Senior Java Engineer Position: Full time Location: Toronto, Ontario (Initially Remote) About Us: We ... Ingestion Pipeline: process data that comes from our web crawler which discovers and fetches ...
Data Engineer
Herndon, VA · On-site
$150 - $200/hr
This position applies data engineering best practices to support enterprise ontologies, knowledge graphs, Semantic Web technologies, and AI/ML applications while ensuring data quality, governance ...
Data Engineer
Herndon, VA · On-site
$150 - $200/hr
This position applies data engineering best practices to support enterprise ontologies, knowledge graphs, Semantic Web technologies, and AI/ML applications while ensuring data quality, governance ...
Data Engineer
Phoenix, AZ · On-site
$113K - $136K/yr
The role involves developing and deploying cloud-based web applications primarily using AWS ... data engineering experience, Master's Degree is a plus • 3+ years of experience with AWS cloud ...
Data Engineer
Phoenix, AZ · On-site
$113K - $136K/yr
The role involves developing and deploying cloud-based web applications primarily using AWS ... data engineering experience, Master's Degree is a plus • 3+ years of experience with AWS cloud ...
Data Engineer
Herndon, VA · On-site
$117K - $141K/yr
This position applies data engineering best practices to support enterprise ontologies, knowledge graphs, Semantic Web technologies, and AI/ML applications while ensuring data quality, governance ...
Data Engineer
Herndon, VA · On-site
$117K - $141K/yr
This position applies data engineering best practices to support enterprise ontologies, knowledge graphs, Semantic Web technologies, and AI/ML applications while ensuring data quality, governance ...
Data Engineer
Herndon, VA · On-site
$117K - $141K/yr
This position applies data engineering best practices to support enterprise ontologies, knowledge graphs, Semantic Web technologies, and AI/ML applications while ensuring data quality, governance ...
Data Engineer
Herndon, VA · On-site
$117K - $141K/yr
This position applies data engineering best practices to support enterprise ontologies, knowledge graphs, Semantic Web technologies, and AI/ML applications while ensuring data quality, governance ...
Data Engineer
Herndon, VA · On-site
$117K - $141K/yr
This position applies data engineering best practices to support enterprise ontologies, knowledge graphs, Semantic Web technologies, and AI/ML applications while ensuring data quality, governance ...
Quick apply
Data Engineer
Herndon, VA · On-site
$117K - $141K/yr
This position applies data engineering best practices to support enterprise ontologies, knowledge graphs, Semantic Web technologies, and AI/ML applications while ensuring data quality, governance ...
Data Engineer
Miami, FL · On-site
$109K - $131K/yr
Data Engineer Client: Filthy Food, Location: Miami, Florida, Onsite Role Our client has an ... Web: www.conchtech.com
Quick apply
Data Engineer
Miami, FL · On-site
$109K - $131K/yr
Data Engineer Client: Filthy Food, Location: Miami, Florida, Onsite Role Our client has an ... Web: www.conchtech.com
Web Crawler Data Engineer information
See salary details
$11.54 - $18.36
4% of jobs
$18.36 - $25.17
0% of jobs
$25.17 - $31.99
0% of jobs
$31.99 - $38.81
6% of jobs
$38.81 - $45.63
5% of jobs
$50.89 is the 25th percentile. Wages below this are outliers.
$45.63 - $52.45
12% of jobs
The median wage is $59.11 / hr.
$52.45 - $59.27
23% of jobs
$65.74 is the 75th percentile. Wages above this are outliers.
$59.27 - $66.08
26% of jobs
$66.08 - $72.90
13% of jobs
$72.90 - $79.72
3% of jobs
$79.72 - $86.54
7% of jobs
$11
$59
$86
How much do web crawler data engineer jobs pay per hour?
As of Sep 9, 2026, the average hourly pay for web crawler data engineer in the United States is $59.01, according to ZipRecruiter salary data. Most workers in this role earn between $51.20 and $66.83 per hour, depending on experience, location, and employer.
What are popular job titles related to Web Crawler Data Engineer jobs?
For Web Crawler Data Engineer jobs, the most frequently searched job titles are:
Java Developer with Web Crawling, Web Scrapping experience
Sunnyvale, CA • On-site
Syntricate Technologies •
IT Services • 51 - 200 employees51 - 200 employees
Full-time
Re-posted 5 days ago
Job description
Job Summary:
Syntricate Technologies is seeking a Java Developer with expertise in web crawling and web scraping. The role involves designing and implementing efficient web crawlers in Java and building proofs of concept for new business requirements.
Responsibilities:
• Proficient in Java development (Core Java, Multithreading, Collections, Memory Management)
• Web Crawler Development: Design and implement efficient and scalable web crawlers in Java to collect data from various online sources
• Experience with designing and building POCs as required for new business requirements – e.g.: on concepts of Web Crawling, Web Scraping etc.
• Experience of web crawling frameworks and tools, such as Scrapy, Puppeteer
• Experience with designing and building POCs as required for new business requirements – e.g.: on concepts of Web Crawling, Web Scraping etc.
• Proficient with Java Design Patterns
• Proficient with Spring Framework (Springboot etc.)
• Proficient with REST APIs, Webservices, Microservices
• Experience with Kubernetes (CI/CD Deployments)
Qualifications:
Required:
• Proficient in Java development (Core Java, Multithreading, Collections, Memory Management)
• Web Crawler Development: Design and implement efficient and scalable web crawlers in Java to collect data from various online sources
• Experience with designing and building POCs as required for new business requirements – e.g.: on concepts of Web Crawling, Web Scraping etc.
• Experience of web crawling frameworks and tools, such as Scrapy, Puppeteer
• Proficient with Java Design Patterns
• Proficient with Spring Framework (Springboot etc.)
• Proficient with REST APIs, Webservices, Microservices
• Experience with Kubernetes (CI/CD Deployments)
Company:
Syntricate Technologies offers quality assurance, validation, regulatory, business analysis, and project management services. Founded in 2004, the company is headquartered in Boston, USA, with a team of 51-200 employees. The company is currently Growth Stage.
Syntricate Technologies is seeking a Java Developer with expertise in web crawling and web scraping. The role involves designing and implementing efficient web crawlers in Java and building proofs of concept for new business requirements.
Responsibilities:
• Proficient in Java development (Core Java, Multithreading, Collections, Memory Management)
• Web Crawler Development: Design and implement efficient and scalable web crawlers in Java to collect data from various online sources
• Experience with designing and building POCs as required for new business requirements – e.g.: on concepts of Web Crawling, Web Scraping etc.
• Experience of web crawling frameworks and tools, such as Scrapy, Puppeteer
• Experience with designing and building POCs as required for new business requirements – e.g.: on concepts of Web Crawling, Web Scraping etc.
• Proficient with Java Design Patterns
• Proficient with Spring Framework (Springboot etc.)
• Proficient with REST APIs, Webservices, Microservices
• Experience with Kubernetes (CI/CD Deployments)
Qualifications:
Required:
• Proficient in Java development (Core Java, Multithreading, Collections, Memory Management)
• Web Crawler Development: Design and implement efficient and scalable web crawlers in Java to collect data from various online sources
• Experience with designing and building POCs as required for new business requirements – e.g.: on concepts of Web Crawling, Web Scraping etc.
• Experience of web crawling frameworks and tools, such as Scrapy, Puppeteer
• Proficient with Java Design Patterns
• Proficient with Spring Framework (Springboot etc.)
• Proficient with REST APIs, Webservices, Microservices
• Experience with Kubernetes (CI/CD Deployments)
Company:
Syntricate Technologies offers quality assurance, validation, regulatory, business analysis, and project management services. Founded in 2004, the company is headquartered in Boston, USA, with a team of 51-200 employees. The company is currently Growth Stage.
About Syntricate Technologies
Sourced by ZipRecruiter
Industry
It services
Company size
51 - 200 Employees
Headquarters location
Boston, MA, US