1

Weekend Python Web Scraping Jobs in New York (NOW HIRING)

Requirements * 2-3+ years of software development experience with strong proficiency in Python ... experience with web scraping. * Familiarity, or willingness to meaningfully adopt, GenAI code ...

Research Crawling Engineer

New York, NY · Remote

$100K - $130K/yr

This role encompasses distributed systems, scraping infrastructure, and data pipelines, focusing on ... Go, Rust, Python, Java, or C++ . * Proven experience in building web crawlers or large-scale data ...

Research Crawling Engineer

New York, NY · On-site +1

$100K - $130K/yr

This role encompasses distributed systems, scraping infrastructure, and data pipelines, focusing on ... Go, Rust, Python, Java, or C++ . * Proven experience in building web crawlers or large-scale data ...

Java Developer

Jericho, NY · On-site

$2.1K - $3.2K/yr

Several years of professional experience as a backend developer, preferably working on web ... Weekend availability

next page

Showing results 1-20

Weekend Python Web Scraping information

What are some common challenges faced in a weekend Python web scraping role, and how can they be addressed?

One frequent challenge in weekend Python web scraping roles is dealing with websites that implement anti-scraping measures, such as CAPTCHAs or frequent layout changes. Effective solutions include using libraries like Selenium or Playwright to mimic human browsing, rotating user agents and IP addresses, and staying updated with website structure changes. Additionally, time management is key, as weekend roles often require efficiently balancing multiple scraping tasks within limited hours. Collaborating with other developers or data engineers, even asynchronously, can help share solutions and maintain scraping scripts effectively.

What are the key skills and qualifications needed to thrive as a Weekend Python Web Scraping Specialist, and why are they important?

To thrive as a Weekend Python Web Scraping Specialist, you need strong proficiency in Python programming, experience with web scraping libraries like BeautifulSoup and Scrapy, and a solid understanding of HTML, CSS, and HTTP protocols. Familiarity with version control systems such as Git, browser automation tools like Selenium, and sometimes cloud platforms is also typically expected. Attention to detail, problem-solving skills, and effective communication are essential soft skills to manage project requirements and address data extraction challenges. These competencies ensure accurate, efficient data gathering and reliable delivery within tight weekend timelines.

What are Weekend Python Web Scraping jobs?

Weekend Python Web Scraping jobs involve using the Python programming language to collect and extract data from websites, typically during weekend hours or as a part-time remote role. These jobs often require knowledge of web scraping libraries like BeautifulSoup, Scrapy, or Selenium, as well as an understanding of HTML and web protocols. The work can include tasks such as gathering data for market research, competitive analysis, or data aggregation projects. Since the work is scheduled for weekends, it offers flexibility for those who have commitments during the week. Attention to ethical web scraping practices and compliance with website terms of service is usually important.

What is the difference between Weekend Python Web Scraping vs Weekend Data Analyst?

AspectWeekend Python Web ScrapingWeekend Data Analyst
Required SkillsPython, web scraping libraries, data extractionExcel, SQL, data visualization, basic programming
Work EnvironmentRemote, project-based, technicalRemote or on-site, analytical, business-focused
Industry UsageTech, e-commerce, researchFinance, marketing, consulting

Weekend Python Web Scraping involves writing scripts to extract data from websites, focusing on technical skills like Python programming. Weekend Data Analysts interpret and visualize data to support business decisions, requiring analytical and communication skills. While both roles may work remotely and require some technical knowledge, Python Web Scraping is more technical and coding-intensive, whereas Data Analysis emphasizes data interpretation and reporting.

What are the most commonly searched types of Python Web Scraping jobs in New York? The most popular types of Python Web Scraping jobs in New York are:
What cities in New York are hiring for Weekend Python Web Scraping jobs? Cities in New York with the most Weekend Python Web Scraping job openings:
Director, AI Engineering & Automation

Director, AI Engineering & Automation

Nasdaq

New York, NY • On-site

$134K - $248K/yr

Full-time

Medical, Dental, Vision, Life, Retirement, PTO

Posted 9 days ago


Job description

As a Director, AI Engineering & Automation, you will be accountable for leading the execution of the AI strategy within our Corporate Finance Division. This role requires a proven ability to set direction, drive end-to-end delivery, and deliver measurable business impact in complex, regulated environments.
You'll thrive in this position if you bring executive presence, strategic clarity, and the ability to mobilize diverse teams towards a common vision-combining deep expertise in AI and financial systems with a passion for transformative innovation.
Key Responsibilities
  • Design and implement solutions EAD the execution of the AI strategy for Corporate Finance, , ensuring alignment with Nasdaq's global objectives and delivering significant business value.
  • Inspire, develop, and empower a team of AI professionals to deliver excellence at scale, providing leadership, mentorship, and accountability for outcomes and measurable impact.
  • Drive operational discipline and end-to-end delivery execution by overseeing the development of Generative AI solutions and AI-powered automations that enhance decision-making and efficiency, ensuring code quality, performance, and reliability.
  • Be a thought leader in the team's adoption of best practices in software development.
  • Collaborate with senior stakeholders across finance and technology to identify opportunities for AI-driven transformation and ensure alignment on strategic priorities.
  • Collaborate effectively within geographically dispersed teams
  • Champion innovation and best practices in AI/ML, staying at the forefront of industry developments and guiding technical direction for model development, data curation, and scalable solution delivery.
  • Lead large, cross-functional delivery teams with persuasive communication, resource allocation expertise, and the ability to manage complex risks that impact long-term departmental success.

Required Qualifications
  • Extensive leadership experience in AI solution delivery, technology execution, or a comparable role within finance or fintech organizations.
  • Strong proficiency in Python, with a good understanding of its ecosystem and best practices.
  • Proficiency with AWS and cloud technologies.
  • Experience of infrastructure-as-code tools like Terraform
  • Knowledge with Visual Studio Code and other modern development environments
  • Deep understanding of Generative AI concepts, including Large Language Models (LLMs), Retrieval-Augmented Generation (RAG), and their practical applications to deliver solutions to real-world business challenges.
  • Proficiency with version control systems, particularly Git.
  • Strong executive presence with exceptional communication skills and the ability to influence senior stakeholders, translating complex technical concepts for diverse audiences.
  • Track record of building, and leading high-performing delivery teams across functions delivering impactful AI solutions on time and at scale.
  • In-depth knowledge of finance-related processes, financial data, accounting systems, and regulatory landscapes.
  • Proficiency in Python and agile software development methodologies, with superior delivery management and strategic thinking abilities.

Preferred Qualifications
  • Bachelor's degree in Data Science, Computer Science, or related field; advanced degree (e.g., MBA) or equivalent senior leadership training a plus.
  • 10+ years of experience in development, AI/ML solution delivery, or software development, with experience utilizing LLMs, RAG, RPA, or web-scraping valued.
  • Prior experience working within or supporting Corporate Finance organizations in capital markets or regulated industries.
  • Familiarity with Spec-Driven Development Methodologies
  • Experience with RPA (e.g., Automation Anywhere, Blue Prism) a plus.

This position will be located in New York and offers the opportunity for a hybrid work environment at least 3 days a week in-office, subject to change, providing flexibility and accessibility for qualified candidates.
Come as You Are
Nasdaq is an equal opportunity employer. We welcome applications from candidates of all backgrounds and identities.
We are committed to fostering an inclusive workplace where diverse perspectives, experiences, and identities are valued and celebrated.
We ensure that individuals with disabilities are provided with reasonable accommodation throughout the hiring process.
What We Offer
We're proud to offer a competitive rewards package that is meaningful, recognizes the unique needs of our employees and their families and incentivizes employees for their contribution to Nasdaq's overall success.
The base pay range for this role is $134,000 - $248,000. In addition to base salary, Nasdaq provides a generous annual bonus/commission (short-term incentive), and equity (long-term incentive), comprehensive benefits, and opportunity for growth. Exact compensation may vary based on several job-related factors that are unique to each candidate, including but not limited to: skill set, experience, education/training, business needs and market demands.
Nasdaq's programs and rewards are intended to allow our employees to:
  • Secure Wealth: 401(k) program with 6% employer match, Employee Stock Purchase Program with 15% discount, Student loan repayment program up to $10k, Company paid life and disability plans, Generous paid time off
  • Prioritize Health: Comprehensive medical, dental and vision coverage, Health spending account with employer contribution, Paid flex days to support mental wellbeing, Gym membership discounts
  • Care for Family: Hybrid home/office schedule (for most positions), Paid parental leave, Fertility benefits, Paid bereavement leave
  • Connect with Community: Company gift matching program, Employee resource groups, Paid volunteer days
  • Grow Career: Education Assistance Program, Robust job skills training and Professional development opportunities

For more information, visit Nasdaq Benefits & Rewards Career page