ZipRecruiter

Log In

1

Freelance Python Web Scraping Jobs in New York (NOW HIRING)

B Capital

Integration Engineer

Manhattan, NY · On-site

$90 - $120/hr

Python, SQL, Data Analytics About the role Redbird is an analytics operating system for the ... Experience collecting data using REST API endpoints, SDKs, web scraping, and Robotic Process ...

LTE Care Plus Inc.

IT Manager

Melville, NY · On-site

Develop and maintain web scraping and data extraction tools, including Selenium for dynamic content ... Strong proficiency in Python and Java * Working knowledge of Node.js, React.js, and Java Spring ...

GPTZero

Investigations Engineer - NYC

New York, NY · On-site

$140K - $220K/yr

Ability to tell creative and compelling stories using data * 2+ YOE in Python for developing ... Experience with web scraping and search at scale, including search, LLM, OCR, and data crawling ...

Royal Bank of Canada

Sr. Data Scientist

Manhattan, NY · On-site

... teams and clients - including web scraping, geolocation data, satellite imagery, NLP on ... Expert working knowledge of Python and R , with strong overall coding abilities. * Expert-level ...

Royal Bank of Canada

Sr. Data Scientist

New York, NY · On-site

... teams and clients - including web scraping, geolocation data, satellite imagery, NLP on ... Expert working knowledge of Python and R , with strong overall coding abilities. * Expert-level ...

Omnicom

Data Analyst

New York, NY · On-site

$66K - $75K/yr

... of Python & data and plotting libraries, with a keen interest in developing their programming ... web scraping, APIs). - Experience writing VBA macros a plus. - Experienced and comfortable ...

Nimbleway

Senior Solution Consultant

Manhattan, NY · On-site

$210 - $250/hr

Unlike index-based "AI search" tools or brittle legacy scraping, Nimble makes the live web ... You'll combine technical expertise in APIs, Python, and web data with exceptional business acumen ...

MLabs

Research Crawling Engineer

New York, NY · Remote

$100K/yr

This role encompasses distributed systems, scraping infrastructure, and data pipelines, focusing on ... Go, Rust, Python, Java, or C++ . * Proven experience in building web crawlers or large-scale data ...

previous page

Showing results 41-60

All JobsPython Web Scraping JobsFreelance Python Web Scraping JobsFreelance Python Web Scraping Jobs in New York

Freelance Python Web Scraping information

What is the difference between Freelance Python Web Scraping vs Freelance Data Analyst?

AspectFreelance Python Web ScrapingFreelance Data Analyst
Skills & CredentialsPython, web scraping libraries, basic data handlingExcel, SQL, data visualization, statistical analysis
Work EnvironmentRemote, project-based, client-specificRemote or on-site, consulting or project-based
Industry UsageWeb data extraction for research, marketing, or business insightsData interpretation, reporting, and strategic recommendations

Freelance Python Web Scraping focuses on extracting data from websites using Python, while Freelance Data Analysts interpret and analyze data to provide insights. Both roles often work remotely and require technical skills, but their core functions differ: one is data collection, the other is data analysis.

What are some common challenges faced by freelance Python web scraping professionals, and how can they be addressed?

Freelance Python web scraping professionals often encounter challenges such as dealing with websites that have anti-scraping measures, handling frequent changes in website structures, and managing large volumes of data efficiently. To address these issues, it's important to stay updated with the latest scraping libraries and techniques, utilize rotating proxies and user-agent strings, and write modular code that can be easily adapted when websites update their layouts. Additionally, maintaining clear communication with clients about legal considerations and project scope helps set realistic expectations and ensures a smooth workflow.

What is freelance Python web scraping?

Freelance Python web scraping involves using the Python programming language to extract data from websites on a project or contract basis, rather than as a full-time employee. Freelancers in this field use libraries like BeautifulSoup, Scrapy, or Selenium to gather, parse, and organize data from various web sources according to client needs. Projects can range from collecting product prices, aggregating news articles, monitoring social media trends, or compiling research datasets. Freelance web scrapers must ensure they comply with relevant legal and ethical guidelines, as well as website terms of service. The work requires technical proficiency, problem-solving skills, and clear communication with clients.

What are the key skills and qualifications needed to thrive as a freelance Python web scraping specialist, and why are they important?

To thrive as a Freelance Python Web Scraping specialist, you need strong programming skills in Python, a deep understanding of web protocols, and knowledge of data extraction techniques. Familiarity with libraries like BeautifulSoup, Scrapy, Selenium, and experience using APIs, along with basic knowledge of version control systems like Git, is typically required. Problem-solving, attention to detail, and effective communication are crucial soft skills for managing client requirements and navigating technical challenges. These skills ensure efficient, ethical, and accurate data extraction, which is vital for delivering reliable results to clients.
What are the most commonly searched types of Python Web Scraping jobs in New York? The most popular types of Python Web Scraping jobs in New York are:
What are popular job titles related to Freelance Python Web Scraping jobs in New York? For Freelance Python Web Scraping jobs in New York, the most frequently searched job titles are:
What job categories do people searching Freelance Python Web Scraping jobs in New York look for? The top searched job categories for Freelance Python Web Scraping jobs in New York are:
What cities in New York are hiring for Freelance Python Web Scraping jobs? Cities in New York with the most Freelance Python Web Scraping job openings:
Freelance Python Web Scraping jobs near you

Data Engineering Internship (Summer 2027)

Castleton Commodities International LLC

Stamford, CT

$122K - $146K/yr

Full-time

Posted 21 days ago

Job description

Application Deadline: September 1, 11:59 pm EST

Program Summary - Data Science & Technology Internship

Company Overview:

Castleton Commodities International is a leading global energy commodities merchant and infrastructure asset investor. As a trader, CCI deploys capital on a proprietary basis in the physical and financial commodity markets, providing the Company with market insights and access. As a strategic investor and developer, CCI leverages its market expertise, operations capabilities, and industry knowledge to invest in, and develop, select commodity infrastructure assets. Our strategically integrated platform has generated strong risk-adjusted returns for our investors since our formation.

Position Overview:

CCI is developing a leading-edge Data Science platform, as staying at the forefront of data management and analytics is essential to our investment strategy. We are looking for motivated and detail-oriented Data Engineering Interns to join our Global Data Science & Technology team in Houston, TX, Stamford, CT, & New York City offices. The Data Engineering Intern will work closely with our Data Science, Data Engineering and Commercial teams to build and optimize data pipelines that power our analytics, forecasting, and investment decision-making processes. This is a hands-on technical internship ideal for someone who enjoys solving real-world data challenges, especially around ingesting, scraping, and managing large datasets across the commodity markets.

Responsibilities:

  • Develop and maintain robust data ingestion pipelines from various internal and external sources, including APIs, FTP endpoints, and cloud data providers.
  • Develop data ingestion and transformation pipelines using Python and SQL, publishing Snowflake for downstream use in analytics and forecasting tools.
  • Work on data architecture and data management projects for both new and existing data sources.
  • Design and implement ETL processes to clean, normalize, and store structured and semi-structured data in Snowflake, our core relational data warehouse.
  • Analyze data pipeline performance and implement optimizations to improve efficiency and reliability.
  • Conduct data quality checks and build validation logic to identify anomalies and ensure data integrity for use by commercial trading and analytics teams.
  • Automate data workflows using Python, SQL, and orchestration tools (e.g., Airflow or similar).
  • Assist in transitioning legacy datasets and codebases into scalable, cloud-native workflows aligned with our modern data architecture.
  • Document data sources, pipeline logic, and data models to ensure maintainability and knowledge transfer.

Qualifications:

  • Currently pursuing a Bachelor's or higher degree in Computer Science, Engineering, Management Information Systems, or related technical field.
  • Expected graduation date of Winter 2027 or Spring/Summer 2028.
  • Strong programming experience in Python (preferred libraries: pandas, NumPy, SQL alchemy, etc.).
  • Strong understanding of SQL and experience querying relational databases (Snowflake a plus).
  • Exposure to or interest in cloud platforms (e.g., AWS, Azure), particularly with cloud data storage and compute.
  • Familiarity with web scraping frameworks and handling large-scale structured and unstructured data sources.

Apply