1

Overnight Databricks Data Engineer Jobs in Wilton, CT

Data Engineer

Jericho, NY

$115K - $140K/yr

The Data Engineer will play a critical role in designing, building, and scaling Kimco's enterprise ... Databricks is also valued. The role partners closely with business, analytics, and engineering ...

Data Engineer

Jericho, NY · On-site

$115K - $140K/yr

The Data Engineer will play a critical role in designing, building, and scaling Kimco's enterprise ... Databricks is also valued. The role partners closely with business, analytics, and engineering ...

Sr Data Engineer

Shelton, CT · On-site

$114K - $137K/yr

The Sr Data Engineer is a senior-level, hands-on technical leader responsible for designing ... Implement Lambda or Kappa architectures using Databricks Structured Streaming / DLT or Snowflake ...

Data Engineer - Senior Manager

Melville, NY · On-site

$124K - $280K/yr

... Architect, Databricks Data Engineer Associate] is a plus - Designing and implementing thorough data architecture strategies - Developing and documenting data models and data flow diagrams ...

Data Engineer - Senior Manager

Stamford, CT · On-site

$124K - $280K/yr

... Architect, Databricks Data Engineer Associate] is a plus - Designing and implementing thorough data architecture strategies - Developing and documenting data models and data flow diagrams ...

... Databricks Data Engineer Associate] is a plus - Designing and implementing thorough data architecture strategies - Developing and documenting data models, data flow diagrams, and data architecture ...

... Databricks Data Engineer Associate] is a plus - Designing and implementing thorough data architecture strategies - Developing and documenting data models, data flow diagrams, and data architecture ...

Data Engineer

Jericho, NY · On-site

$118K - $142K/yr

Fabric Analytics Engineer Associate) or equivalent AWS certifications, or Snowflake/Databricks ... cloud data platform migrations and modernization initiatives. • Knowledge of CI/CD ...

... Databricks Data Engineer Associate] is a plus - Designing and implementing thorough data architecture strategies that meet the current and future business needs - Developing and documenting data ...

... Databricks Data Engineer Associate] is a plus - Designing and implementing thorough data architecture strategies that meet the current and future business needs - Developing and documenting data ...

Sr Data Engineer

Shelton, CT · On-site

$106K - $144K/yr

Sr Data Engineer - Shelton, CT Ready to build what's next with one of the world's most iconic ... Implement Lambda or Kappa architectures using Databricks Structured Streaming / DLT or Snowflake ...

Sr Data Engineer

Shelton, CT · On-site

$106K - $144K/yr

Sr Data Engineer - Shelton, CT Ready to build what's next with one of the world's most iconic ... Implement Lambda or Kappa architectures using Databricks Structured Streaming / DLT or Snowflake ...

Sr Data Engineer

Shelton, CT

$106K - $144K/yr

Sr Data Engineer - Shelton, CT Ready to build what's next with one of the world's most iconic ... Implement Lambda or Kappa architectures using Databricks Structured Streaming / DLT or Snowflake ...

Sr Data Engineer

Shelton, CT

$106K - $144K/yr

Sr Data Engineer - Shelton, CT Ready to build what's next with one of the world's most iconic ... Implement Lambda or Kappa architectures using Databricks Structured Streaming / DLT or Snowflake ...

Sr Data Engineer

Shelton, CT · On-site

$106K - $144K/yr

Sr Data Engineer - Shelton, CT Ready to build what's next with one of the world's most iconic ... Implement Lambda or Kappa architectures using Databricks Structured Streaming / DLT or Snowflake ...

Sr Data Engineer

Shelton, CT · On-site

$106K - $144K/yr

Sr Data Engineer - Shelton, CT Ready to build what's next with one of the world's most iconic ... Implement Lambda or Kappa architectures using Databricks Structured Streaming / DLT or Snowflake ...

Sr Data Engineer

Shelton, CT · On-site

$106K - $144K/yr

Sr Data Engineer - Shelton, CT Ready to build what's next with one of the world's most iconic ... Implement Lambda or Kappa architectures using Databricks Structured Streaming / DLT or Snowflake ...

Sr Data Engineer

Shelton, CT · On-site

$106K - $144K/yr

Sr Data Engineer - Shelton, CT Ready to build what's next with one of the world's most iconic ... Implement Lambda or Kappa architectures using Databricks Structured Streaming / DLT or Snowflake ...

Sr Data Engineer

Shelton, CT · On-site

$106K - $144K/yr

Sr Data Engineer - Shelton, CT Ready to build what's next with one of the world's most iconic ... Implement Lambda or Kappa architectures using Databricks Structured Streaming / DLT or Snowflake ...

Sr Data Engineer

Shelton, CT · On-site

$106K - $144K/yr

Sr Data Engineer - Shelton, CT Ready to build what's next with one of the world's most iconic ... Implement Lambda or Kappa architectures using Databricks Structured Streaming / DLT or Snowflake ...

next page

Showing results 1-20

Overnight Databricks Data Engineer information

What is the difference between Overnight Databricks Data Engineer vs Data Engineer?

AspectOvernight Databricks Data Engineer
Work EnvironmentPrimarily remote or on-site, working overnight shifts to support global data operations
CertificationsDatabricks certifications, cloud platform credentials (AWS, Azure), data engineering certifications
Tools & TechnologiesDatabricks platform, Spark, cloud services, SQL, Python, ETL tools
Industry UsageTech, finance, healthcare, retail with 24/7 data needs

While both roles focus on data engineering, the Overnight Databricks Data Engineer specializes in managing data pipelines on the Databricks platform during overnight shifts, often supporting global operations. A Data Engineer may work across various platforms and shifts, with broader responsibilities in data architecture and pipeline development. The overnight role emphasizes specific platform expertise and shift timing, catering to organizations with continuous data processing needs.

What unique challenges do overnight Databricks data engineers face, and how can they be addressed?

Overnight Databricks Data Engineers often work with limited real-time support, which can present challenges when troubleshooting urgent data pipeline issues or system outages. To address this, it’s essential to develop strong problem-solving skills, document processes thoroughly, and leverage automated monitoring and alerting tools. Additionally, close collaboration with daytime teams during handoff periods ensures continuity and minimizes disruptions. Building a habit of proactive communication and maintaining detailed logs helps the entire team resolve issues efficiently and maintain data quality.

What skills and qualifications are needed to thrive as an overnight Databricks data engineer?

To thrive as an Overnight Databricks Data Engineer, you need strong proficiency in data engineering, Python or Scala programming, and experience with big data technologies, typically supported by a relevant degree in computer science or a related field. Familiarity with Databricks, Apache Spark, cloud platforms (such as AWS or Azure), and certifications like Databricks Certified Data Engineer are highly valued. Attention to detail, problem-solving, and effective communication are essential soft skills, especially for troubleshooting and collaborating across shifts. These competencies ensure reliable data pipeline management and efficient resolution of issues during off-hours, maintaining seamless business operations.

What is an overnight Databricks data engineer?

An Overnight Databricks Data Engineer is a professional who works primarily during night shifts to manage, design, and maintain big data pipelines and workflows using Databricks, a cloud-based data analytics platform. Their responsibilities often include developing and optimizing data processing jobs, ensuring data quality, and troubleshooting issues that arise during overnight data operations. This role is critical for organizations that require 24/7 data processing, continuous ETL jobs, or real-time analytics. Working overnight may also involve monitoring automated systems, performing scheduled data loads, and collaborating with global teams to ensure data availability and reliability.
What cities near Wilton, CT are hiring for Overnight Databricks Data Engineer jobs? Cities near Wilton, CT with the most Overnight Databricks Data Engineer job openings:

$115K - $140K/yr

Full-time

Re-posted 25 days ago


Job description

******Unless specifically contracted, resumes from recruiting agencies are not being accepted for this position.*****

The Data Engineer will play a critical role in designing, building, and scaling Kimco's enterprise data platform in the cloud. This role is responsible for developing modern data pipelines, enabling trusted analytics, and ensuring the reliability, security, and performance of cloud-based data solutions. While Kimco is a Microsoft-first organization (Azure/Microsoft Fabric), experience delivering comparable solutions on AWS and/or with Snowflake and/or Databricks is also valued. The role partners closely with business, analytics, and engineering teams to translate complex data requirements into scalable, future-proof architectures. This role will drive modernization initiatives, establish data engineering best practices, and mentor team members while continuously improving data quality, accessibility, and operational efficiency.

Key Responsibilities

  • Design, build, and maintain scalable, secure, and cost-efficient data solutions on a cloud data platform (Microsoft Azure/Microsoft Fabric preferred; AWS and comparable platforms considered).

  • Develop and optimize modern ETL/ELT pipelines supporting enterprise systems such as Salesforce, MRI, and other internal and external data sources.

  • Lead cloud data platform modernization and migration initiatives, reducing manual processes and improving data reliability.

  • Define and enforce data architecture, governance, security, and quality standards across the data ecosystem.

  • Partner closely with BI and analytics teams to enable trusted reporting and insights (e.g., Power BI and semantic models) across the organization.

  • Ensure high performance, availability, and cost efficiency through monitoring, performance tuning, and continuous optimization.

  • Translate complex business requirements into scalable, future-proof data architectures in collaboration with business and engineering stakeholders.

  • Support the development of training materials and conduct workshops for team members

  • Evaluate and adopt new data technologies and capabilities (e.g., Microsoft Fabric, Azure services, Snowflake, Databricks) to drive innovation and long-term platform scalability.

  • Contribute to the company's purpose by improving the data platform and analytics capabilities that enable better decision-making and positive impact.

  • Travel up to 15%.

Qualifications

Required

  • Bachelor's degree in computer science, Engineering, Information Systems, or equivalent practical experience.

  • 5+ years of experience in data engineering, with at least 3+ years designing and delivering cloud-based data solutions (Azure preferred; AWS and other major cloud platforms considered).

  • Hands-on experience with modern cloud data engineering tools and services, such as Microsoft Fabric (Data Factory, Synapse), Azure Data Factory/Azure Synapse, Databricks, and/or Snowflake.

  • Proven expertise in building and optimizing large-scale ETL/ELT pipelines for high-volume, enterprise data environments.

  • Advanced SQL skills and experience with data modeling for analytics and reporting workloads.

  • Experience integrating data from enterprise systems such as Salesforce, ERP/property management platforms (e.g., MRI), or similar SaaS applications.

  • Solid understanding of data governance, security, data quality, and access control within cloud data platforms (Azure preferred).

  • Demonstrated ability to translate complex business requirements into scalable, production-grade data architectures.

  • Strong communication skills with the ability to collaborate effectively across business, analytics, and engineering teams.

Preferred

  • Cloud and data platform certifications (Azure preferred), such as DP-203 (Data Engineering on Microsoft Azure) or DP-600 (Microsoft certified: Fabric Analytics Engineer Associate) or equivalent AWS certifications, or Snowflake/Databricks credentials.

  • Hands-on experience with Power BI and enabling self-service analytics through a governed semantic layer (Microsoft Fabric experience a plus).

  • Familiarity with cloud cost optimization, performance tuning, and monitoring of data platforms at scale.

  • Experience with cloud data platform migrations and modernization initiatives.

  • Knowledge of CI/CD, infrastructure-as-code, and automated deployment patterns for data solutions.

  • Experience working in large-scale, enterprise or real estate / financial services data environments.

The expected salary range for this position is between $115,000 and $140,000. The actual compensation will be based on factors such as scope and responsibilities of the position, candidate's work experience, education/training, job-related skills, internal peer equity, market and business considerations and other factors permitted by law.

** Kimco Realty is an Equal Opportunity Employer - Veteran/Disability **