Web Developer
Dunwoody, GA · On-site
Familiarity with web QA tools, browser developer tools, crawling tools, accessibility testing tools or performance testing tools. * Experience working in regulated, highly governed or large ...
Dunwoody, GA · On-site
Familiarity with web QA tools, browser developer tools, crawling tools, accessibility testing tools or performance testing tools. * Experience working in regulated, highly governed or large ...
Dunwoody, GA · On-site
Familiarity with web QA tools, browser developer tools, crawling tools, accessibility testing tools or performance testing tools. * Experience working in regulated, highly governed or large ...
Richardson, TX · On-site
Familiarity with web QA tools, browser developer tools, crawling tools, accessibility testing tools or performance testing tools. * Experience working in regulated, highly governed or large ...
Richardson, TX · On-site
Familiarity with web QA tools, browser developer tools, crawling tools, accessibility testing tools or performance testing tools. * Experience working in regulated, highly governed or large ...
$150K - $215K/yr
Fortinet is calling for an experienced Staff Software Development Engineer who can think outside ... Experience with popular security detecting, penetration testing, web crawling tools is a plus, like ...
$150K - $215K/yr
Fortinet is calling for an experienced Staff Software Development Engineer who can think outside ... Experience with popular security detecting, penetration testing, web crawling tools is a plus, like ...
$150K - $215K/yr
Fortinet is calling for an experienced Staff Software Development Engineer who can think outside ... Experience with popular security detecting, penetration testing, web crawling tools is a plus, like ...
$150K - $215K/yr
Fortinet is calling for an experienced Staff Software Development Engineer who can think outside ... Experience with popular security detecting, penetration testing, web crawling tools is a plus, like ...
... Web Crawling, Data Collection, Feature Engineering, MLOps, ML Systems, Scalable Systems, Parallel Computing, Model Architecture Design, Experimentation, Research Scientists, Research Engineers ...
... Web Crawling, Data Collection, Feature Engineering, MLOps, ML Systems, Scalable Systems, Parallel Computing, Model Architecture Design, Experimentation, Research Scientists, Research Engineers ...
... Web Crawling, Data Collection, Feature Engineering, MLOps, ML Systems, Scalable Systems, Parallel Computing, Model Architecture Design, Experimentation, Research Scientists, Research Engineers ...
... Web Crawling, Data Collection, Feature Engineering, MLOps, ML Systems, Scalable Systems, Parallel Computing, Model Architecture Design, Experimentation, Research Scientists, Research Engineers ...
Tempe, AZ · On-site
Familiarity with web QA tools, browser developer tools, crawling tools, accessibility testing tools or performance testing tools. * Experience working in regulated, highly governed or large ...
Tempe, AZ · On-site
Familiarity with web QA tools, browser developer tools, crawling tools, accessibility testing tools or performance testing tools. * Experience working in regulated, highly governed or large ...
Bloomington, IL · On-site
Familiarity with web QA tools, browser developer tools, crawling tools, accessibility testing tools or performance testing tools. * Experience working in regulated, highly governed or large ...
Bloomington, IL · On-site
Familiarity with web QA tools, browser developer tools, crawling tools, accessibility testing tools or performance testing tools. * Experience working in regulated, highly governed or large ...
Continental, OH · On-site +1
$150K - $225K/yr
Thrive in high-autonomy, fast-moving environments. * (Bonus) Have experience with healthcare data, product engineering, ML systems, or web crawling. * (Extra bonus) Have 10+ years of GPT-5 experience ...
Continental, OH · On-site +1
$150K - $225K/yr
Thrive in high-autonomy, fast-moving environments. * (Bonus) Have experience with healthcare data, product engineering, ML systems, or web crawling. * (Extra bonus) Have 10+ years of GPT-5 experience ...
Washington, DC · Remote
$105K - $125K/yr
Collaborate with ML engineers, other data engineers, and software developers to deliver actionable ... Experience with web scraping/crawling (e.g., Beautiful Soup, Selenium, Scrapy) * Experience with ...
Washington, DC · Remote
$105K - $125K/yr
Collaborate with ML engineers, other data engineers, and software developers to deliver actionable ... Experience with web scraping/crawling (e.g., Beautiful Soup, Selenium, Scrapy) * Experience with ...
Washington, DC · On-site
$105K - $125K/yr
Our adversarial red teaming, model evaluations, and intelligence collection enable engineering ... Experience with web scraping/crawling (e.g., Beautiful Soup, Selenium, Scrapy) * Experience with ...
Washington, DC · On-site
$105K - $125K/yr
Our adversarial red teaming, model evaluations, and intelligence collection enable engineering ... Experience with web scraping/crawling (e.g., Beautiful Soup, Selenium, Scrapy) * Experience with ...
$117K - $140K/yr
Experience with OCR, web crawling, or evals * Prior experience pre-training LLMs PROCESS * Intro call with one of our Founding Engineers * Technical Interview(s) with one of our Founding Engineers
$117K - $140K/yr
Experience with OCR, web crawling, or evals * Prior experience pre-training LLMs PROCESS * Intro call with one of our Founding Engineers * Technical Interview(s) with one of our Founding Engineers
OR · On-site
You build for the humans visiting today and the AI agents already crawling the web. LLM-ready ... programming, and more. Because we take our jobs seriously, we add in time for rest with Unlimited ...
Denver, CO · On-site
... engineered for maintainability and ownership transfer • Experience designing web application ... crawling and scraping approaches, including structured content extraction, normalization, and ...
Denver, CO · On-site
... engineered for maintainability and ownership transfer • Experience designing web application ... crawling and scraping approaches, including structured content extraction, normalization, and ...
... programming, especially in SQL, Python, C#, and JavaScript • Experience with advanced data ... web crawling, web scraping, or automated data collection tools for identifying and preserving ...
New
... programming, especially in SQL, Python, C#, and JavaScript • Experience with advanced data ... web crawling, web scraping, or automated data collection tools for identifying and preserving ...
New
Englewood Cliffs, NJ · On-site
$67K - $80K/hr
Maintain and enhance web crawling and external data collection engines. * Ensure data quality ... Design and optimize Prompt Engineering, RAG (Retrieval-Augmented Generation) pipelines.
Quick apply
Englewood Cliffs, NJ · On-site
$67K - $80K/hr
Maintain and enhance web crawling and external data collection engines. * Ensure data quality ... Design and optimize Prompt Engineering, RAG (Retrieval-Augmented Generation) pipelines.
You build for the humans visiting today and the AI agents already crawling the web. LLM-ready ... programming, and more. Because we take our jobs seriously, we add in time for rest with Unlimited ...
You build for the humans visiting today and the AI agents already crawling the web. LLM-ready ... programming, and more. Because we take our jobs seriously, we add in time for rest with Unlimited ...
San Francisco, CA · On-site
$155K - $210K/yr
In this role, you will own the end-to-end data lifecycle-from raw web-scale crawling to the fine ... This position is ideal for a scientist who views data as a high-scale engineering challenge and an ...
San Francisco, CA · On-site
$155K - $210K/yr
In this role, you will own the end-to-end data lifecycle-from raw web-scale crawling to the fine ... This position is ideal for a scientist who views data as a high-scale engineering challenge and an ...
Reston, VA · On-site
This includes designing scalable crawling architectures, reverse-engineering web applications to identify data points, and implementing evasion techniques to bypass IP rate-limiting and bot detection.
Reston, VA · On-site
This includes designing scalable crawling architectures, reverse-engineering web applications to identify data points, and implementing evasion techniques to bypass IP rate-limiting and bot detection.
Reston, VA · On-site +1
$59.75 - $80.25/hr
This includes designing scalable crawling architectures, reverse-engineering web applications to identify data points, and implementing evasion techniques to bypass IP rate-limiting and bot detection.
Reston, VA · On-site +1
$59.75 - $80.25/hr
This includes designing scalable crawling architectures, reverse-engineering web applications to identify data points, and implementing evasion techniques to bypass IP rate-limiting and bot detection.
$11.54 - $18.36
4% of jobs
$18.36 - $25.17
0% of jobs
$25.17 - $31.99
0% of jobs
$31.99 - $38.81
6% of jobs
$38.81 - $45.63
5% of jobs
$50.89 is the 25th percentile. Wages below this are outliers.
$45.63 - $52.45
12% of jobs
The median wage is $59.11 / hr.
$52.45 - $59.27
23% of jobs
$65.74 is the 75th percentile. Wages above this are outliers.
$59.27 - $66.08
26% of jobs
$66.08 - $72.90
13% of jobs
$72.90 - $79.72
3% of jobs
$79.72 - $86.54
7% of jobs
$11
$59
$86
| Aspect | Web Crawling Engineer | Data Engineer |
|---|---|---|
| Required Credentials | Bachelor's in Computer Science, relevant experience in web scraping and crawling | Bachelor's or higher in Computer Science, Data Science, or related fields |
| Work Environment | Focus on developing and maintaining web crawlers, data extraction tools | Designing data pipelines, managing large datasets, optimizing data flow |
| Employer & Industry Usage | Tech companies, search engines, data providers | Tech firms, finance, healthcare, any data-driven industry |
| Common Search & Comparison Intent | Understanding roles in web data collection | Understanding data infrastructure roles |
While both roles involve working with data, a Web Crawling Engineer specializes in developing tools to extract data from websites, focusing on crawling and scraping techniques. A Data Engineer builds and maintains data pipelines and infrastructure to process and store large datasets. The roles often overlap in data collection and processing but differ in scope and focus.
Full-time
Medical, Dental, Vision, Life, Retirement, PTO
Posted 4 days ago
7.5
Based on 1,362 frontline employees who took The Breakroom Quiz
195th of 261 rated insurance
Being good neighbors – helping people, investing in our communities, and making the world a better place – is who we are at State Farm. It is at the core of how we operate and the reason for our success. Come join a #1 team and do some good!
Sponsorship: Applicants are required to be eligible to lawfully work in the U.S. immediately; employer will not sponsor applicants for U.S. work authorization (e.g. H-1B visa) for this opportunity.
State Farm is hiring a Web Developer to build, maintain and improve digital experiences that support content, site performance, accessibility, measurement and organic search visibility. This role is a good fit for an experienced Web Developer who can work independently on assigned page builds, enhancements and fixes while partnering with design teams to translate approved design files into high-quality web experiences and collaborating with senior technical partners on more complex platform or architecture decisions.
In this role, you will:
Required Qualifications
Preferred Qualifications
Items of Note
Because work-life balance is a priority at State Farm, compensation is based on our standard 38:45-hour work week!
At State Farm, we offer more than just a paycheck. Check out our suite of benefits designed to give you the flexibility you need to take care of you and your family!
Visit our State Farm Careers page for more information on our benefits, locations, and the hiring process of joining the State Farm team!
Remote: Qualified candidates (outside of hub locations listed below) may be considered for 100% remote work arrangements based on where a candidate currently resides or is currently located.
Hybrid: Qualified candidates (in or near hub locations listed below) should plan to spend time working from home and some time working in the office as part of our hybrid work environment.
Hub locations: Dunwoody, GA; Richardson, TX; Tempe, AZ; or Bloomington, IL
Sponsorship: Applicants are required to be eligible to lawfully work in the U.S. immediately; employer will not sponsor applicants for U.S. work authorization (e.g. H-1B visa) for this opportunity.
For Los Angeles candidates: Pursuant to the Los Angeles Fair Chance Initiative for Hiring, we will consider for employment qualified applicants with criminal histories.
For San Francisco candidates: Pursuant to the San Francisco Fair Chance Ordinance, we will consider for employment qualified applicants with arrest and conviction records.
For Colorado, Hawaii and Washington State candidates:
Salary range: $110,000 - $137,500
Application deadline is expected to close on 6/26/2026. Applicant volume and hiring needs may result in early closure or extension beyond the listed deadline. To submit an application, click "Apply" on the job listing page on the State Farm career site.
For California, New York, and CT candidates:
Potential salary range: $125,000 - $156,250
Potential yearly incentive pay: up to 15% of base salary
Competitive Benefits, including:
For more details, visit our benefits summary page.
Qualifications:Required Qualifications
Preferred Qualifications
Items of Note
Get the full story on Breakroom
Sourced by ZipRecruiter
Insurance services and finance and insurance
10,000+ Employees
Bloomington, IL, US