Build and maintain scalable ETL/ELT pipelines in Python, SQL, and dbt-ingesting data via APIs, web scraping, and streaming sources. * Develop and operate data pipelines using orchestration frameworks ...
Build and maintain scalable ETL/ELT pipelines in Python, SQL, and dbt-ingesting data via APIs, web scraping, and streaming sources. * Develop and operate data pipelines using orchestration frameworks ...
Senior Data Engineer (San Francisco)
San Francisco, CA ยท On-site
$150K - $250K/yr
Be a data hunter - Whether it's web scraping, third-party integrations, or unconventional sources ... Technical expertise - You've got Python, SQL, and large-scale data processing tools locked down.
Senior Data Engineer (San Francisco)
San Francisco, CA ยท On-site
$150K - $250K/yr
Be a data hunter - Whether it's web scraping, third-party integrations, or unconventional sources ... Technical expertise - You've got Python, SQL, and large-scale data processing tools locked down.
Senior Operations Manager, Rules & Automation
Mountain View, CA ยท On-site
$120K - $160K/yr
Advanced in SQL and Python, experience with Retool, API & Web Scraping a bonus * Experience driving results as an IC and working with technical teams to drive scalable architecture * Ability to drive ...
Senior Operations Manager, Rules & Automation
Mountain View, CA ยท On-site
$120K - $160K/yr
Advanced in SQL and Python, experience with Retool, API & Web Scraping a bonus * Experience driving results as an IC and working with technical teams to drive scalable architecture * Ability to drive ...
Senior Operations Manager, Rules & Automation
Mountain View, CA ยท On-site
$120K - $160K/yr
Advanced in SQL and Python, experience with Retool, API & Web Scraping a bonus * Experience driving results as an IC and working with technical teams to drive scalable architecture * Ability to drive ...
Quick apply
Senior Operations Manager, Rules & Automation
Mountain View, CA ยท On-site
$120K - $160K/yr
Advanced in SQL and Python, experience with Retool, API & Web Scraping a bonus * Experience driving results as an IC and working with technical teams to drive scalable architecture * Ability to drive ...
Python Systems Engineer (Remote)
Redwood City, CA ยท On-site +1
Participate in on-call rotations (limited to your working hours + the occasional weekend) and ... Building large-scale or complex multi-tenant web applications * Parallelization, code optimization ...
Python Systems Engineer (Remote)
Redwood City, CA ยท On-site +1
Participate in on-call rotations (limited to your working hours + the occasional weekend) and ... Building large-scale or complex multi-tenant web applications * Parallelization, code optimization ...
Participate in on-call rotations (limited to your working hours + the occasional weekend) and ... Building large-scale or complex multi-tenant web applications * Parallelization, code optimization ...
Participate in on-call rotations (limited to your working hours + the occasional weekend) and ... Building large-scale or complex multi-tenant web applications * Parallelization, code optimization ...
Threat Collections Engineer
San Francisco, CA ยท On-site +1
$300K - $320K/yr
Have strong coding proficiency in Python and SQL for building detection logic, data pipelines, and ... Familiarity with web scraping and data extraction at scale * Experience with behavioral analytics ...
Threat Collections Engineer
San Francisco, CA ยท On-site +1
$300K - $320K/yr
Have strong coding proficiency in Python and SQL for building detection logic, data pipelines, and ... Familiarity with web scraping and data extraction at scale * Experience with behavioral analytics ...
Senior Fullstack/Backend Engineer
San Francisco, CA ยท On-site
$180K - $280K/yr
Work primarily across backend systems, data pipelines, and AI-enabled services, using Python ... scale web scraping for Facebook Jobs and Meta Reality Labs. * Nico (Product) , previously led ...
Senior Fullstack/Backend Engineer
San Francisco, CA ยท On-site
$180K - $280K/yr
Work primarily across backend systems, data pipelines, and AI-enabled services, using Python ... scale web scraping for Facebook Jobs and Meta Reality Labs. * Nico (Product) , previously led ...
Senior Software Engineer, Swarm Systems
San Diego, CA ยท On-site
$129K - $171K/yr
... Python web services. Unlike almost any other robotics company, ASR's advanced SITL suite allows ... Occasional off-hours or weekend work required for emergency facility responses or projects as ...
Senior Software Engineer, Swarm Systems
San Diego, CA ยท On-site
$129K - $171K/yr
... Python web services. Unlike almost any other robotics company, ASR's advanced SITL suite allows ... Occasional off-hours or weekend work required for emergency facility responses or projects as ...
Founder Business Operations - AI Healthcare Startup (San Francisco)
San Francisco, CA ยท On-site
$150K - $200K/yr
Comfort with light scripting or automation tasks (e.g., Python, Excel macros, web scraping). * Familiarity with tools like Figma, Canva, Photoshop, or slide design software. The role would suit. * Ex ...
Founder Business Operations - AI Healthcare Startup (San Francisco)
San Francisco, CA ยท On-site
$150K - $200K/yr
Comfort with light scripting or automation tasks (e.g., Python, Excel macros, web scraping). * Familiarity with tools like Figma, Canva, Photoshop, or slide design software. The role would suit. * Ex ...
... Python web services. Unlike almost any other robotics company, ASR's advanced SITL suite allows ... Occasional off-hours or weekend work required for emergency facility responses or projects as ...
... Python web services. Unlike almost any other robotics company, ASR's advanced SITL suite allows ... Occasional off-hours or weekend work required for emergency facility responses or projects as ...
Software Development Engineer - Data Acquisition & Normalization
Mountain View, CA ยท On-site
$135K - $162K/yr
... web applications using OOP languages such as Java, Ruby, JavaScript, TypeScript, Go, Python, Rust, or C++. * Exposure to data acquisition or integration work, including APIs, screen scraping, ETL, or ...
Software Development Engineer - Data Acquisition & Normalization
Mountain View, CA ยท On-site
$135K - $162K/yr
... web applications using OOP languages such as Java, Ruby, JavaScript, TypeScript, Go, Python, Rust, or C++. * Exposure to data acquisition or integration work, including APIs, screen scraping, ETL, or ...
Founding GTM Engineer
San Francisco, CA ยท On-site
$120K - $200K/yr
Proficiency writing code (Python, JavaScript, or SQL) and familiarity working with APIs * Track ... scraping/indexing the web, etc.) * High bias toward action and "shipping v1 today"-you thrive in ...
Founding GTM Engineer
San Francisco, CA ยท On-site
$120K - $200K/yr
Proficiency writing code (Python, JavaScript, or SQL) and familiarity working with APIs * Track ... scraping/indexing the web, etc.) * High bias toward action and "shipping v1 today"-you thrive in ...
Site Reliability Engineer, GNC
Hawthorne, CA ยท On-site
$145K - $175K/yr
Monitoring and incident response for web applications and services * Manage the underlying ... Willing to work extended hours and weekends when needed to meet critical deadlines COMPENSATION AND ...
Site Reliability Engineer, GNC
Hawthorne, CA ยท On-site
$145K - $175K/yr
Monitoring and incident response for web applications and services * Manage the underlying ... Willing to work extended hours and weekends when needed to meet critical deadlines COMPENSATION AND ...
Site Reliability Engineer, GNC
Hawthorne, CA ยท On-site
$145K - $175K/yr
Monitoring and incident response for web applications and services * Manage the underlying ... Willing to work extended hours and weekends when needed to meet critical deadlines COMPENSATION AND ...
Site Reliability Engineer, GNC
Hawthorne, CA ยท On-site
$145K - $175K/yr
Monitoring and incident response for web applications and services * Manage the underlying ... Willing to work extended hours and weekends when needed to meet critical deadlines COMPENSATION AND ...
Site Reliability Engineer, GNC
Hawthorne, CA ยท On-site
$145K - $175K/yr
Monitoring and incident response for web applications and services * Manage the underlying ... Willing to work extended hours and weekends when needed to meet critical deadlines COMPENSATION AND ...
Site Reliability Engineer, GNC
Hawthorne, CA ยท On-site
$145K - $175K/yr
Monitoring and incident response for web applications and services * Manage the underlying ... Willing to work extended hours and weekends when needed to meet critical deadlines COMPENSATION AND ...
Software Development Engineer - Data Acquisition & Normalization
Mountain View, CA ยท On-site
$135K - $162K/yr
... web applications using OOP languages such as Java, Ruby, JavaScript, TypeScript, Go, Python, Rust, or C++. * Exposure to data acquisition or integration work, including APIs, screen scraping, ETL, or ...
Software Development Engineer - Data Acquisition & Normalization
Mountain View, CA ยท On-site
$135K - $162K/yr
... web applications using OOP languages such as Java, Ruby, JavaScript, TypeScript, Go, Python, Rust, or C++. * Exposure to data acquisition or integration work, including APIs, screen scraping, ETL, or ...
Software Development Engineer - Data Acquisition & Normalization
Mountain View, CA ยท On-site +1
$135K - $162K/yr
... web applications using OOP languages such as Java, Ruby, JavaScript, TypeScript, Go, Python, Rust, or C++. * Exposure to data acquisition or integration work, including APIs, screen scraping, ETL, or ...
Quick apply
Software Development Engineer - Data Acquisition & Normalization
Mountain View, CA ยท On-site +1
$135K - $162K/yr
... web applications using OOP languages such as Java, Ruby, JavaScript, TypeScript, Go, Python, Rust, or C++. * Exposure to data acquisition or integration work, including APIs, screen scraping, ETL, or ...
We're looking for individuals who want to dig into the details of how "big data" and "web-scale ... Experience coding in one or more of Python, Java, Go, Ruby, C, C++ * Experience with personal test ...
We're looking for individuals who want to dig into the details of how "big data" and "web-scale ... Experience coding in one or more of Python, Java, Go, Ruby, C, C++ * Experience with personal test ...
We're looking for individuals who want to dig into the details of how "big data" and "web-scale ... Experience coding in one or more of Python, Java, Go, Ruby, C, C++ * Experience with personal test ...
We're looking for individuals who want to dig into the details of how "big data" and "web-scale ... Experience coding in one or more of Python, Java, Go, Ruby, C, C++ * Experience with personal test ...
Weekend Python Web Scraping information
What are some common challenges faced in a weekend Python web scraping role, and how can they be addressed?
What are the key skills and qualifications needed to thrive as a Weekend Python Web Scraping Specialist, and why are they important?
What are Weekend Python Web Scraping jobs?
What is the difference between Weekend Python Web Scraping vs Weekend Data Analyst?
| Aspect | Weekend Python Web Scraping | Weekend Data Analyst |
|---|---|---|
| Required Skills | Python, web scraping libraries, data extraction | Excel, SQL, data visualization, basic programming |
| Work Environment | Remote, project-based, technical | Remote or on-site, analytical, business-focused |
| Industry Usage | Tech, e-commerce, research | Finance, marketing, consulting |
Weekend Python Web Scraping involves writing scripts to extract data from websites, focusing on technical skills like Python programming. Weekend Data Analysts interpret and visualize data to support business decisions, requiring analytical and communication skills. While both roles may work remotely and require some technical knowledge, Python Web Scraping is more technical and coding-intensive, whereas Data Analysis emphasizes data interpretation and reporting.
- Scala Software Engineer
- Contract Netapp Storage Engineer
- Java Python Developer Seasonal
- Temp Senior Django Developer
- Senior Resilience Insurance Analytics
- Day Shift 250K Salary Software Engineer
- Online Google Apps Script Developer
- Live In Data Platform Engineer
- Contract Data Platform Engineer
- Senior Specialist Software Engineer Military
Software Engineer- Data Engineering (Staff/ Sr Staff)
San Francisco, CA โข On-site, Remote
Full-time
Medical, Dental, Vision, Retirement, PTO
Posted yesterday
Job description
Equilibrium Energy is a team of technologists, power market experts, and AI pioneers reimagining how the world's most critical industry operates. We're building a first-of-its-kind AI operating system for the power sector, uniting cutting-edge science with real-world purpose to enable a cleaner, more resilient energy future. At EQ, you'll join a tight-knit group of brilliant, curious, and adventurous people who bring the same energy to collaboration as they do to innovation.
Equilibrium Energy is a well-funded, Series B clean energy startup backed by some of the most prominent institutional investors in climate. New colleagues will share our vision that a next-generation energy company must be built from the ground up on deep industry expertise combined with an unwavering commitment to modern digital approaches. We're looking for collaborative, talented, passionate and resourceful folks to join our team and help us lay the foundation for our important mission and ambitious plan.
What we are looking for
Equilibrium Energy is building the platform that will power the clean energy transition. As a Staff/ Sr Staff Software Engineer- Data Engineering, you will play a critical role in shaping our long-term data architecture. You'll lead the design and implementation of high-impact data initiatives that support energy trading, forecasting, and AI development.
This is a hands-on role that blends platform engineering, advanced data processing, and cross-functional collaboration. You'll help scale our systems to enable near real-time decision-making and empower traders, data scientists, and operators to move faster with confidence.
What you will do
- Design and implement the long-term data architecture using modern technologies and frameworks.
- Build and maintain scalable ETL/ELT pipelines in Python, SQL, and dbt-ingesting data via APIs, web scraping, and streaming sources.
- Develop and operate data pipelines using orchestration frameworks such as Temporal and Dagster.
- Design data models and schemas for our cloud warehouse (Databricks) and relational databases; contribute to the development of our ML feature store.
- Optimize workflows for performance and cost efficiency.
- Drive large, cross-functional data initiatives from planning to execution.
- Partner with AI and engineering teams to ensure high-quality datasets for machine learning and analytics.
- Collaborate with product managers, scientists, and engineers to gather requirements and deliver robust data products.
- Mentor other engineers in best practices for data ingestion, architecture, and scalable pipeline design.
- Support the software testing cycle, debug code, and resolve issues found during QA or user acceptance testing.
- Bachelor's degree in Computer Science, Data Science, Engineering, or a related technical field.
- 7+ years of progressive experience in data or software engineering.
- Advanced programming skills in Python and SQL.
- Experience building globally distributed data systems and real-time pipelines.
- Hands-on with orchestration/stream processing tools like Temporal, Dagster, Airflow, Spark, or Kafka.
- Strong knowledge of relational and NoSQL databases (e.g., Postgres, MySQL, MongoDB, ElasticSearch, Cassandra).
- Familiarity with data warehousing and cloud computing (Databricks and AWS preferred).
- Experience mentoring engineers and providing architectural direction.
- Strong analytical skills, with the ability to work with unstructured or ambiguous datasets.
- Commitment to data quality, testing, and observability.
- Experience with both OLTP and OLAP data processing systems
- Experience with energy market data or weather data sources (e.g., NWS, NOAA, Yes Energy).
- Experience using dbt for transformations and data quality checks.
- Collaborating with data science teams to build and productionize ML pipelines.
- Familiarity with DataOps practices and CI/CD for data workflows.
- Knowledge of real-time data technologies, graph databases, or unstructured data processing.
- Understanding of power systems, grid operations, or financial aspects of energy trading.
Not sure this is the right role for you?
We are a high growth company with accelerating hiring needs so there's a great chance we'll be able to create a custom role for you, now or in the future. All roles, titles and compensation packages are tailored to the applicant, so apply anyways and tell us in your cover letter about your dream role.
What we offer
Equilibrium is composed of deeply knowledgeable industry experts across all our functions, with decades of experience in energy-specific commercial structuring, power systems engineering, machine learning, computational research, operations research, distributed and compute-intensive infrastructure, and modern software & ML engineering. Our experience in the space means we've previously built versions of nearly every technical component of our platform. We are now designing them better, and combining them in a holistic and novel way, to achieve global scale and climate impact. We pride ourselves on our deeply empathetic & collaborative culture, honest and direct but respectful communication, and our balanced, flexible, and remote-first work environment.
Employee benefits include:
- Competitive base salary and a comprehensive medical, dental, vision, and 401k package
- Opportunity to own a significant piece of the company via a meaningful equity grant
- Unlimited vacation and flexible work schedule
- Accelerated professional growth and development opportunities through direct collaboration and mentorship from leading industry expert colleagues across energy and tech
Equilibrium Energy is a diverse and inclusive, equal opportunity employer that does not discriminate on the basis of race, gender, nationality, sexual orientation, veteran status, disability, age, or other legally protected status.