1

Web Crawler Engineer Jobs (NOW HIRING)

Working cross-functionally with product, engineering, design, and analytics teams, you will help ... Define how we measure AI, using log data, crawler activity, and emerging tooling to turn a murky ...

AI Search & SEO Manager

Pleasanton, CA · On-site

$150 - $200/hr

... and crawler access policies for LLM bots * Define and track emerging AI search metrics -- LLM ... web vitals, schema/structured data, site architecture -- in close collaboration with engineering

SEO & AI Search Lead

Pleasanton, CA · On-site

$140K - $174K/yr

... crawler access policies for LLM bots * Define and track emerging AI search metrics LLM citation ... web vitals, schema/structured data, site architecture in close collaboration with engineering

SEO & AI Search Lead

Pleasanton, CA · On-site

$150 - $200/hr

... and crawler access policies for LLM bots * Define and track emerging AI search metrics -- LLM ... web vitals, schema/structured data, site architecture -- in close collaboration with engineering

SEO & AI Search Lead

Pleasanton, CA · On-site

$140K - $174K/yr

... and crawler access policies for LLM bots * Define and track emerging AI search metrics - LLM ... web vitals, schema/structured data, site architecture - in close collaboration with engineering

NY · On-site

$125 - $150/hr

... Web Vitals, JS rendering, hreflang, and multilingual SEO. * Experience leading pre- and post ... Confident working with engineering teams -- you can scope a ticket, validate the fix, and explain ...

... URL structure, and Core Web Vitals. * Launch and migration SEO. URL mapping, redirect ... Enough HTML, CSS, and JavaScript to diagnose a problem and write a specification a developer can ...

... URL structure, and Core Web Vitals. * Launch and migration SEO. URL mapping, redirect ... Enough HTML, CSS, and JavaScript to diagnose a problem and write a specification a developer can ...

$80 - $100/hr

... URL structure, and Core Web Vitals. * Launch and migration SEO. URL mapping, redirect ... Enough HTML, CSS, and JavaScript to diagnose a problem and write a specification a developer can ...

Showing results 41-51

Web Crawler Engineer information

See salary details

$11

$59

$86

How much do web crawler engineer jobs pay per hour?

As of Sep 9, 2026, the average hourly pay for web crawler engineer in the United States is $59.01, according to ZipRecruiter salary data. Most workers in this role earn between $51.20 and $66.83 per hour, depending on experience, location, and employer.

What is the job of a Web Crawler Engineer?

A Web Crawler Engineer designs and develops automated programs that systematically browse and index web content for search engines or data analysis. They typically work with programming languages like Python or Java, utilize web scraping tools, and ensure efficient, respectful crawling while managing large-scale data collection processes.

What is the salary of a Web Crawler Engineer?

The salary of a Web Crawler Engineer typically ranges from $70,000 to $130,000 annually, depending on experience, location, and company size. Skilled professionals with expertise in web scraping, data mining, and programming languages like Python or Java are often in higher demand and may earn higher salaries.

What are popular job titles related to Web Crawler Engineer jobs?

For Web Crawler Engineer jobs, the most frequently searched job titles are:

Infographic showing various Web Crawler Engineer job openings in the United States as of September 2026, with employment types broken down into 1% Internship, 92% Full Time, 3% Part Time, and 4% Contract. Highlights an 85% Physical, 4% Hybrid, and 11% Remote job distribution, with an average salary of $122,736 per year, or $59 per hour.

Product Leader, Growth & Acquisition

Corte Madera, CA • On-site

RH
Specialized Design Services • 5 - 10K employees

Full-time

Re-posted 7 days ago


Restoration Hardware rating

7.6

Company rating: 7.6 out of 10

Based on 51 frontline employees who took The Breakroom Quiz

15th of 63 rated furniture retailers


Job description

RH is seeking a Product Leader of Growth and Acquisition to own how customers discover and choose our brand across organic search, AI-powered discovery, and the broader digital acquisition journey. As consumer behavior continues to evolve, you will lead the strategy and execution of RH's organic growth engine across a large, global ecommerce platform spanning multiple markets and languages. This role is an ideal fit for a strategic SEO leader ready to step into broader product ownership, or a growth PM with genuine, hands-on SEO depth. Combining deep SEO expertise with a product management mindset, you will drive experimentation, leverage analytics to uncover growth opportunities, and optimize the customer discovery experience to increase qualified traffic and business impact. Working cross-functionally with product, engineering, design, and analytics teams, you will help shape the future of how customers find RH while raising the analytical rigor and growth capabilities of the broader product organization.

YOUR RESPONSIBILITIES

  • Lead RH's organic growth strategy, defining the roadmap, prioritizing opportunities, and aligning initiatives to measurable business outcomes.
  • Drive enterprise SEO across a large, global ecommerce platform, optimizing site architecture, crawlability, structured data, page performance, and technical implementations that strengthen long-term organic visibility. 
  • Develop RH's AI discovery strategy, ensuring our content and products are optimized for emerging search experiences including AI Overviews, ChatGPT, Perplexity, and future conversational platforms
  • Define how we measure AI, using log data, crawler activity, and emerging tooling to turn a murky signal into decisions
  • Build a disciplined experimentation program by developing hypotheses, running A/B tests, analyzing results, and translating insights into scalable improvements across acquisition and conversion.
  • Collaborate with product, engineering, design, merchandising, content, and analytics teams to deliver growth initiatives while influencing priorities through data-driven recommendations.
  • Measure performance using analytics and experimentation, connecting organic growth initiatives to customer acquisition, revenue, and long-term business impact.
  • Champion a culture of data-informed decision making, helping elevate analytical rigor and growth thinking across the digital product organization.

OUR REQUIREMENTS

  • 4+ years of experience in Growth Product Management, SEO, or digital growth, with a demonstrated ability to drive measurable organic acquisition and business results at scale.
  • Deep expertise in enterprise SEO, including technical SEO, site architecture, structured data, Core Web Vitals, large product catalogs, faceted navigation, and complex ecommerce environments.
  • Strong analytical capabilities with experience using GA4 (or equivalent), experimentation frameworks, dashboards, and SQL or comparable data analysis tools.
  • Exceptional communication and cross-functional leadership skills, with the ability to influence teams and executives through thoughtful analysis and clear recommendations.
  • A product thinker first. You treat organic as a revenue driver, not just a traffic channel, and you don't just execute a channel checklist. You use data to find the signal, form a hypothesis, and move, without mistaking endless analysis for progress.
RH is an equal opportunity employer and does not discriminate against any applicant on the basis of race, color, religion, national origin, gender, marital status, age, disability, sexual orientation, military/veteran status, or any other status protected by federal or state law or local ordinance.

At RH, we are committed to promoting pay equity. Rate of pay is determined based on each individual's experience, qualifications, and the geographic location of the role.

What Restoration Hardware employees say

Pay

Benefits

Hours and flexibility

Workplace

Get the full story on Breakroom