ZipRecruiter

Log In

1

Python Web Scraping Jobs in New York, NY (NOW HIRING)

Nimbleway

Senior Solution Consultant

Manhattan, NY · On-site

$210 - $250/hr

Unlike index-based "AI search" tools or brittle legacy scraping, Nimble makes the live web ... You'll combine technical expertise in APIs, Python, and web data with exceptional business acumen ...

previous page

Showing results 41-50

All JobsPython Web Scraping JobsPython Web Scraping Jobs in New York, NY

Python Web Scraping information

See New York, NY salary details

$48

$63

$70

How much do python web scraping jobs pay per hour?

As of Aug 17, 2026, the average hourly pay for python web scraping in New York, NY is $63.33, according to ZipRecruiter salary data. Most workers in this role earn between $57.84 and $68.37 per hour, depending on experience, location, and employer.

What is Python web scraping?

Python web scraping is the process of automatically extracting information from websites using Python programming. It typically involves sending HTTP requests to web pages, parsing the HTML content, and retrieving specific data, such as text, images, or links. Common libraries used for web scraping in Python include BeautifulSoup, Scrapy, and Requests. Web scraping is widely used for tasks like data analysis, market research, and price monitoring, but it's important to follow website terms of service and legal guidelines.

What are Python web scraping jobs?

Web scraping is a process used for web data extraction. Python web scraping uses Python software to gather information and organize it for later analysis. You can find work as a Python web scraping engineer or web scraping developer where you write and run spiders to perform web crawling to obtain and extract data, as well as troubleshoot system issues. There are other opportunities as a Python web scraping analyst where your duties are to analyze the gathered information. You can work a Python web scraping job at a specific company or provide freelance services.

What are the key skills and qualifications needed to thrive as a Python web scraping specialist, and why are they important?

To excel in Python web scraping, you need strong programming skills in Python, a solid understanding of HTML/CSS, and experience with data extraction techniques. Familiarity with libraries such as Beautiful Soup, Scrapy, Selenium, and tools for data storage like SQL or Pandas is typically required. Attention to detail, problem-solving abilities, and ethical judgment are important soft skills for overcoming technical challenges and ensuring compliance with site policies. These skills are crucial to efficiently gather accurate, legal data from websites and transform it into actionable insights.

What are some common challenges faced by professionals in Python web scraping roles, and how can they be addressed?

Python web scraping professionals frequently encounter challenges such as handling websites with dynamic content, managing IP bans, and ensuring compliance with legal and ethical guidelines. To address these, it's important to use libraries like Selenium for dynamic pages, implement rotating proxies and user agents to avoid blocking, and thoroughly review website terms of service. Staying up to date with best practices and automating error handling will also help navigate these common obstacles effectively.

What is the difference between Python Web Scraping vs Data Analyst?

AspectPython Web ScrapingData Analyst
Required SkillsPython, libraries like BeautifulSoup, ScrapyExcel, SQL, data visualization tools
Work EnvironmentProgramming, scripting, automationData interpretation, reporting
Industry UsageWeb data extraction, automation projectsBusiness insights, decision-making

Python Web Scraping focuses on extracting data from websites using programming skills, while Data Analysts interpret and visualize data for business insights. Both roles require analytical thinking but differ in technical tools and daily tasks.

More about Python Web Scraping jobs

What are the most commonly searched types of Python Web Scraping jobs in New York, NY?

The most popular types of Python Web Scraping jobs in New York, NY are:

What are popular job titles related to Python Web Scraping jobs in New York, NY?

For Python Web Scraping jobs in New York, NY, the most frequently searched job titles are:

What job categories do people searching Python Web Scraping jobs in New York, NY look for?

The top searched job categories for Python Web Scraping jobs in New York, NY are:

Python Web Scraping jobs near you
Infographic showing various Python Web Scraping job openings in New York, NY as of August 2026, with employment types broken down into 67% Part Time, and 33% Contract. Highlights an 33% In-person, and 67% Remote job distribution, with an average salary of $131,718 per year, or $63.3 per hour.

Director, AI Engineering & Automation

Nasdaq

New York, NY • On-site

$134K - $248K/yr

Full-time

Medical, Dental, Vision, Life, Retirement, PTO

Re-posted 8 days ago

Job description

As a Director, AI Engineering & Automation, you will be accountable for leading the execution of the AI strategy within our Corporate Finance Division. This role requires a proven ability to set direction, drive end-to-end delivery, and deliver measurable business impact in complex, regulated environments.
You'll thrive in this position if you bring executive presence, strategic clarity, and the ability to mobilize diverse teams towards a common vision-combining deep expertise in AI and financial systems with a passion for transformative innovation.
Key Responsibilities
  • Design and implement solutions EAD the execution of the AI strategy for Corporate Finance, , ensuring alignment with Nasdaq's global objectives and delivering significant business value.
  • Inspire, develop, and empower a team of AI professionals to deliver excellence at scale, providing leadership, mentorship, and accountability for outcomes and measurable impact.
  • Drive operational discipline and end-to-end delivery execution by overseeing the development of Generative AI solutions and AI-powered automations that enhance decision-making and efficiency, ensuring code quality, performance, and reliability.
  • Be a thought leader in the team's adoption of best practices in software development.
  • Collaborate with senior stakeholders across finance and technology to identify opportunities for AI-driven transformation and ensure alignment on strategic priorities.
  • Collaborate effectively within geographically dispersed teams
  • Champion innovation and best practices in AI/ML, staying at the forefront of industry developments and guiding technical direction for model development, data curation, and scalable solution delivery.
  • Lead large, cross-functional delivery teams with persuasive communication, resource allocation expertise, and the ability to manage complex risks that impact long-term departmental success.

Required Qualifications
  • Extensive leadership experience in AI solution delivery, technology execution, or a comparable role within finance or fintech organizations.
  • Strong proficiency in Python, with a good understanding of its ecosystem and best practices.
  • Proficiency with AWS and cloud technologies.
  • Experience of infrastructure-as-code tools like Terraform
  • Knowledge with Visual Studio Code and other modern development environments
  • Deep understanding of Generative AI concepts, including Large Language Models (LLMs), Retrieval-Augmented Generation (RAG), and their practical applications to deliver solutions to real-world business challenges.
  • Proficiency with version control systems, particularly Git.
  • Strong executive presence with exceptional communication skills and the ability to influence senior stakeholders, translating complex technical concepts for diverse audiences.
  • Track record of building, and leading high-performing delivery teams across functions delivering impactful AI solutions on time and at scale.
  • In-depth knowledge of finance-related processes, financial data, accounting systems, and regulatory landscapes.
  • Proficiency in Python and agile software development methodologies, with superior delivery management and strategic thinking abilities.

Preferred Qualifications
  • Bachelor's degree in Data Science, Computer Science, or related field; advanced degree (e.g., MBA) or equivalent senior leadership training a plus.
  • 10+ years of experience in development, AI/ML solution delivery, or software development, with experience utilizing LLMs, RAG, RPA, or web-scraping valued.
  • Prior experience working within or supporting Corporate Finance organizations in capital markets or regulated industries.
  • Familiarity with Spec-Driven Development Methodologies
  • Experience with RPA (e.g., Automation Anywhere, Blue Prism) a plus.

This position will be located in New York and offers the opportunity for a hybrid work environment at least 3 days a week in-office, subject to change, providing flexibility and accessibility for qualified candidates.
Come as You Are
Nasdaq is an equal opportunity employer. We welcome applications from candidates of all backgrounds and identities.
We are committed to fostering an inclusive workplace where diverse perspectives, experiences, and identities are valued and celebrated.
We ensure that individuals with disabilities are provided with reasonable accommodation throughout the hiring process.
What We Offer
We're proud to offer a competitive rewards package that is meaningful, recognizes the unique needs of our employees and their families and incentivizes employees for their contribution to Nasdaq's overall success.
The base pay range for this role is $134,000 - $248,000. In addition to base salary, Nasdaq provides a generous annual bonus/commission (short-term incentive), and equity (long-term incentive), comprehensive benefits, and opportunity for growth. Exact compensation may vary based on several job-related factors that are unique to each candidate, including but not limited to: skill set, experience, education/training, business needs and market demands.
Nasdaq's programs and rewards are intended to allow our employees to:
  • Secure Wealth: 401(k) program with 6% employer match, Employee Stock Purchase Program with 15% discount, Student loan repayment program up to $10k, Company paid life and disability plans, Generous paid time off
  • Prioritize Health: Comprehensive medical, dental and vision coverage, Health spending account with employer contribution, Paid flex days to support mental wellbeing, Gym membership discounts
  • Care for Family: Hybrid home/office schedule (for most positions), Paid parental leave, Fertility benefits, Paid bereavement leave
  • Connect with Community: Company gift matching program, Employee resource groups, Paid volunteer days
  • Grow Career: Education Assistance Program, Robust job skills training and Professional development opportunities

For more information, visit Nasdaq Benefits & Rewards Career page

Apply