1

Overnight Databricks Data Engineer Jobs in Portland, OR

Sr Data Engineer (Databricks)

Camas, WA · On-site

$126K - $151K/yr

Wealth Management Position: Sr Data Engineer (Databricks) Compensation: $130K - $150K + Bonus Location: First 90 days on site and then 1 day a week WFH either in Camas, WA or Plano, TX Work ...

Sr Data Engineer (Databricks)

Camas, WA · On-site

$126K - $151K/yr

Wealth Management Position: Sr Data Engineer (Databricks) Compensation: $130K - $150K + Bonus Location: First 90 days on site and then 1 day a week WFH either in Camas, WA or Plano, TX Work ...

... Databricks Data Engineer Associate] is a plus - Designing and implementing thorough data architecture strategies - Developing and documenting data models, data flow diagrams, and data architecture ...

... Architect, Databricks Data Engineer Associate] is a plus - Designing and implementing thorough data architecture strategies - Developing and documenting data models and data flow diagrams ...

... Databricks Data Engineer Associate] is a plus - Designing and implementing thorough data architecture strategies that meet the current and future business needs - Developing and documenting data ...

Databricks Lead/Architect

Portland, OR · On-site

$58.50 - $80.25/hr

Bachelor's or Master's degree in Computer Science, Data Engineering, or a related quantitative ... Databricks Certified Data Engineer (Associate or Professional) and/or Azure Data Engineer Associate ...

Data Engineer

Beaverton, OR · On-site

$119K - $143K/yr

Databricks AWS Apache Spark Python PySpark Previous Clients experience a plus. Any ETWs let go at the end of 05/31 can be considered since a 90 day break would be fulfilled. Skills Data engineer ...

DataOS Data Engineer Description - DataOS Data Engineer collaborating on cutting edge advances in ... Strong Notebooks environment experience (Jupyter, DataBricks) * Experience collecting requirements ...

Data Engineer - Manager

Portland, OR · On-site

$99K - $232K/yr

... Data Engineer - Manager, you will play a pivotal role in transforming raw data into actionable ... Databricks and Snowflake - Guiding team members in data architecture development and database ...

Azure Solutions Architect Expert, Azure Data Engineer Associate, Snowflake Core, Snowflake Databricks Data Engineer Associate] is a plus - Proficient in Python and SQL - Experience with Docker and ...

Financial Data Engineer

Beaverton, OR · On-site

$119K - $143K/yr

... Databricks notebooks, Apache Spark (SQL, Python, Scala), and other Microsoft Azure or open-source ... Engineers. * Maintain high-quality documentation about data structures in the shared data ...

Financial Data Engineer

Beaverton, OR · On-site

$119K - $143K/yr

... Databricks notebooks, Apache Spark (SQL, Python, Scala), and other Microsoft Azure or open-source ... Engineers. * Maintain high-quality documentation about data structures in the shared data ...

... Engineer - Senior Associate, you will focus on designing and building data infrastructure and ... Databricks Unified Data Analytics Platform for advanced data analytics and visualization ...

Data Engineer, Staff

Newberg, OR

$120K - $144K/yr

Overview The Staff Data Engineer independently plans, schedules, and leads data, analytics, and ... Snowflake or Databricks) * Experience with lambda and kappa architectures * Experience with iPaaS ...

Data Engineer, Staff

Newberg, OR · On-site

$120K - $144K/yr

Overview The Staff Data Engineer independently plans, schedules, and leads data, analytics, and ... Snowflake or Databricks) * Experience with lambda and kappa architectures * Experience with iPaaS ...

next page

Showing results 1-20

Overnight Databricks Data Engineer information

What is the difference between Overnight Databricks Data Engineer vs Data Engineer?

AspectOvernight Databricks Data Engineer
Work EnvironmentPrimarily remote or on-site, working overnight shifts to support global data operations
CertificationsDatabricks certifications, cloud platform credentials (AWS, Azure), data engineering certifications
Tools & TechnologiesDatabricks platform, Spark, cloud services, SQL, Python, ETL tools
Industry UsageTech, finance, healthcare, retail with 24/7 data needs

While both roles focus on data engineering, the Overnight Databricks Data Engineer specializes in managing data pipelines on the Databricks platform during overnight shifts, often supporting global operations. A Data Engineer may work across various platforms and shifts, with broader responsibilities in data architecture and pipeline development. The overnight role emphasizes specific platform expertise and shift timing, catering to organizations with continuous data processing needs.

What are some unique challenges faced by Overnight Databricks Data Engineers, and how can they be addressed?

Overnight Databricks Data Engineers often work with limited real-time support, which can present challenges when troubleshooting urgent data pipeline issues or system outages. To address this, it’s essential to develop strong problem-solving skills, document processes thoroughly, and leverage automated monitoring and alerting tools. Additionally, close collaboration with daytime teams during handoff periods ensures continuity and minimizes disruptions. Building a habit of proactive communication and maintaining detailed logs helps the entire team resolve issues efficiently and maintain data quality.

What are the key skills and qualifications needed to thrive as an Overnight Databricks Data Engineer, and why are they important?

To thrive as an Overnight Databricks Data Engineer, you need strong proficiency in data engineering, Python or Scala programming, and experience with big data technologies, typically supported by a relevant degree in computer science or a related field. Familiarity with Databricks, Apache Spark, cloud platforms (such as AWS or Azure), and certifications like Databricks Certified Data Engineer are highly valued. Attention to detail, problem-solving, and effective communication are essential soft skills, especially for troubleshooting and collaborating across shifts. These competencies ensure reliable data pipeline management and efficient resolution of issues during off-hours, maintaining seamless business operations.

What is an Overnight Databricks Data Engineer?

An Overnight Databricks Data Engineer is a professional who works primarily during night shifts to manage, design, and maintain big data pipelines and workflows using Databricks, a cloud-based data analytics platform. Their responsibilities often include developing and optimizing data processing jobs, ensuring data quality, and troubleshooting issues that arise during overnight data operations. This role is critical for organizations that require 24/7 data processing, continuous ETL jobs, or real-time analytics. Working overnight may also involve monitoring automated systems, performing scheduled data loads, and collaborating with global teams to ensure data availability and reliability.
What are the most commonly searched types of Databricks Data Engineer jobs in Portland, OR? The most popular types of Databricks Data Engineer jobs in Portland, OR are:

Sr Data Engineer (Databricks)

Qode

Camas, WA • On-site

$126K - $151K/yr

Full-time

Posted 22 days ago


Job description

Client: Wealth Management
Position: Sr Data Engineer (Databricks)
Compensation: $130K - $150K + Bonus
Location: First 90 days on site and then 1 day a week WFH either in Camas, WA or Plano, TX
Work Authorization: USC or GC ONLY
Education: BS or equivalent in Computer Science or related field or a combination of technical skills, cloud, operating system, networking, security, data application, data modeling and BI background
Experience:
  • Minimum of 8 years of experience developing software and data solution for enterprise environment focusing on data and cloud applications with direct experience with application development, data warehouse and BI design, implementation, and operation
  • Experience with cloud data warehouse and analytics technologies, specifically Azure Databricks, Azure Synapse, Azure Data Factory, Azure Data Lake Storage, Power BI, and other Azure data solutions
  • Knowledge or experience with infrastructure (operating system and networking) and cloud administration and automation such as Terraform for Infrastructure as Code.
  • Knowledge of DevOps in application development such as GitHub Actions, or Powershell
  • Experience with application development using Microsoft or cloud technologies (such as SQL, Azure, C#, Python)
  • Experience with Machine Learning, MLOps
  • Experience with investment management systems and processes
  • Experience with Agile methodologies in a cloud, application, database, data warehousing and BI space

Responsibilities:
  • Work with business and technology partners to analyze how the data warehouse, analytics and application will meet our goals
  • Evaluate all proposed requests to determine fit with data warehouse, analytics and application solution architecture.
  • Own data warehouse and analytics technical platform on Azure, from implementation to enhancements and ongoing operations
  • Design, develop and coordinate cloud data and application solutions/projects across diverse groups and areas including enterprise architecture, application development, identity and access management, network and data management
  • Provide technical direction and guidance to database and application developers
  • Develop cloud security and access control solution/policy, data and BI standards, guidelines and best practice for business groups and technical teams
  • Perform maintenance and troubleshooting activities for data warehouse, BI platform and other data projects and resolve issues
  • Monitor system application logs and identify potential issues and improvements to ensure smooth operations
  • Perform capacity planning, cloud cost analysis and optimization and provide recommendations to management
  • Provide after-hour system and application support
  • Develop multiple work plans for projects and prepare appropriate status reports and submit them to management