ZipRecruiter

Log In

1

Overnight Databricks Data Engineer Jobs in Connecticut

The Subway

Sr. Data Engineer

Shelton, CT · On-site

$106K - $144K/yr

Senior Data Engineer Ready to build what's next with one of the world's most iconic brands? Why ... Hands-on experience building lakehouse solutions on Databricks (Delta Lake, Unity Catalog) or ...

subway

Sr. Data Engineer

Shelton, CT

$106K - $144K/yr

Senior Data Engineer Ready to build what's next with one of the world's most iconic brands? Why ... Hands-on experience building lakehouse solutions on Databricks (Delta Lake, Unity Catalog) or ...

subway

Sr. Data Engineer

Shelton, CT

$106K - $144K/yr

Senior Data Engineer Ready to build what's next with one of the world's most iconic brands? Why ... Hands-on experience building lakehouse solutions on Databricks (Delta Lake, Unity Catalog) or ...

subway

Sr. Data Engineer

Shelton, CT

$106K - $144K/yr

Senior Data Engineer Ready to build what's next with one of the world's most iconic brands? Why ... Hands-on experience building lakehouse solutions on Databricks (Delta Lake, Unity Catalog) or ...

Travelers

Data Engineer I (AWS, Databricks)

Hartford, CT · On-site

$109K - $180K/yr

As a Data Engineer, you will play a key role in growing and transforming our analytics landscape ... Databricks: Notebooks, Jobs, Unity Catalog, Genie, and concepts such as Autoloader, streaming, and ...

Berkley

Data Engineer

Greenwich, CT

$128K - $154K/yr

Familiarity with cloud data platforms and distributed processing frameworks (e.g., Databricks, Snowflake, Spark, or similar), and modern data engineering tooling. * Strong programming skills ...

Berkley

Data Engineer

Greenwich, CT · On-site

$128K - $154K/yr

Familiarity with cloud data platforms and distributed processing frameworks (e.g., Databricks, Snowflake, Spark, or similar), and modern data engineering tooling. * Strong programming skills ...

Berkley

Data Engineer

Greenwich, CT

$128K - $154K/yr

Familiarity with cloud data platforms and distributed processing frameworks (e.g., Databricks, Snowflake, Spark, or similar), and modern data engineering tooling. * Strong programming skills ...

Deloitte

Lead Data Engineer

Stamford, CT · On-site

$109K - $143K/yr

Deloitte is seeking a Lead Data Engineer- Databricks to support the design, build, and delivery of modern data and analytics solutions for clients across industries. In this role, you will help teams ...

previous page

Showing results 41-60

All JobsDatabricks Data Engineer JobsOvernight Databricks Data Engineer JobsOvernight Databricks Data Engineer Jobs in Connecticut

Overnight Databricks Data Engineer information

What is the difference between Overnight Databricks Data Engineer vs Data Engineer?

AspectOvernight Databricks Data Engineer
Work EnvironmentPrimarily remote or on-site, working overnight shifts to support global data operations
CertificationsDatabricks certifications, cloud platform credentials (AWS, Azure), data engineering certifications
Tools & TechnologiesDatabricks platform, Spark, cloud services, SQL, Python, ETL tools
Industry UsageTech, finance, healthcare, retail with 24/7 data needs

While both roles focus on data engineering, the Overnight Databricks Data Engineer specializes in managing data pipelines on the Databricks platform during overnight shifts, often supporting global operations. A Data Engineer may work across various platforms and shifts, with broader responsibilities in data architecture and pipeline development. The overnight role emphasizes specific platform expertise and shift timing, catering to organizations with continuous data processing needs.

What are some unique challenges faced by Overnight Databricks Data Engineers, and how can they be addressed?

Overnight Databricks Data Engineers often work with limited real-time support, which can present challenges when troubleshooting urgent data pipeline issues or system outages. To address this, it’s essential to develop strong problem-solving skills, document processes thoroughly, and leverage automated monitoring and alerting tools. Additionally, close collaboration with daytime teams during handoff periods ensures continuity and minimizes disruptions. Building a habit of proactive communication and maintaining detailed logs helps the entire team resolve issues efficiently and maintain data quality.

What are the key skills and qualifications needed to thrive as an Overnight Databricks Data Engineer, and why are they important?

To thrive as an Overnight Databricks Data Engineer, you need strong proficiency in data engineering, Python or Scala programming, and experience with big data technologies, typically supported by a relevant degree in computer science or a related field. Familiarity with Databricks, Apache Spark, cloud platforms (such as AWS or Azure), and certifications like Databricks Certified Data Engineer are highly valued. Attention to detail, problem-solving, and effective communication are essential soft skills, especially for troubleshooting and collaborating across shifts. These competencies ensure reliable data pipeline management and efficient resolution of issues during off-hours, maintaining seamless business operations.

What is an Overnight Databricks Data Engineer?

An Overnight Databricks Data Engineer is a professional who works primarily during night shifts to manage, design, and maintain big data pipelines and workflows using Databricks, a cloud-based data analytics platform. Their responsibilities often include developing and optimizing data processing jobs, ensuring data quality, and troubleshooting issues that arise during overnight data operations. This role is critical for organizations that require 24/7 data processing, continuous ETL jobs, or real-time analytics. Working overnight may also involve monitoring automated systems, performing scheduled data loads, and collaborating with global teams to ensure data availability and reliability.
What are the most commonly searched types of Databricks Data Engineer jobs in Connecticut? The most popular types of Databricks Data Engineer jobs in Connecticut are:
What cities in Connecticut are hiring for Overnight Databricks Data Engineer jobs? Cities in Connecticut with the most Overnight Databricks Data Engineer job openings:
Overnight Databricks Data Engineer jobs near you

Sr. Data Engineer

The Subway

Shelton, CT • On-site

$106K - $144K/yr

Full-time

Medical, Life, Retirement

Re-posted 2 days ago

Subway rating

4.4

Company rating: 4.4 out of 10

Based on 2,044 frontline employees who took The Breakroom Quiz

98th of 106 rated fast food restaurants

Job description

We are Subway Headquarters! A dedicated team of professionals supporting thousands of franchisees around the globe.
Senior Data Engineer
Ready to build what's next with one of the world's most iconic brands?
Why Join Subway?
At Subway, we are not standing still. We are building.
This is a business focused on what matters most: growing franchisee profitability, strengthening our brand and creating long-term value. The people who thrive here are the ones who want to make a real impact.
You will not just do the work. You will shape it.
We move fast. We think like owners. We make decisions that matter. We hold ourselves to a high standard because what we do directly impacts thousands of franchisees around the world.
If you bring energy, accountability and a bias for action, you will fit right in.
We take the work seriously, but we also know the best results come from teams that support each other, celebrate wins and show up ready to build something better every day.
This is your chance to be part of what's next.
About the Role:
The Sr. Data Engineer will be responsible for the design and development of data pipelines to support System Integrations as well as data pipelines that power our Analytical Platforms. In collaboration with Product Owners and other technical teams, the Sr. Data Engineer will lead significant enterprise-wide work as part of larger cross-functional teams supporting multiple major project initiatives. A candidate will deliver scalable, flexible, and high-quality solutions that conform to Subway's data design and governance strategies, leveraging our cloud data platform built on Snowflake or Databricks along with other modern cloud-based technologies.
Responsibilities include but not limited to:
  • Design and develop data pipelines and integrations that are performant, scalable and flexible.
  • Work with project teams to deliver system integration pipelines, ensuring a high degree of reliability and resiliency.
  • Work with business users and project teams to provide SME guidance, finalize pipeline requirements and develop level of effort estimates.
  • Develop automated testing and deployment scripts to support integrations and pipelines.
  • Provide database support by coding utilities, responding to user questions, and resolving problems.
  • Create and maintain documentation of data pipelines including data flow and data lineage documentation.
  • Responsible for tier 3 support and assisting our Operations Team as required to provide a great customer experience for our users.
  • Responsible for overall data quality as it relates to our Enterprise Data Warehouse and associated Data Marts. Provide data analysis as required to troubleshoot data issues.
  • Assist with integration related code reviews and mentorship of junior developers.
  • Implement data governance and master data management principles as part of data pipeline development and delivery.

Qualifications (some examples listed below):
  • Lakehouse Architecture: Hands-on experience building lakehouse solutions on Databricks (Delta Lake, Unity Catalog) or Snowflake (Iceberg Tables, Horizon Catalog).
  • Medallion Architecture: Proven ability to design Bronze/Silver/Gold layers for curated, analytics-ready data.
  • Streaming or Batch Processing: Experience implementing Lambda or Kappa architectures using Databricks Structured Streaming / DLT or Snowflake Dynamic Tables / Snowpipe Streaming.
  • Semantic Layer: Experience building and managing semantic models using Databricks AI/BI Genie or Unity Catalog Metrics or Snowflake Semantic Views / Cortex Analyst to enable consistent, governed metrics for BI and AI consumption.
  • ETL/ELT Orchestration: Building pipelines with Airflow, Databricks Lakeflow, or Snowflake Openflow; familiarity with dbt is a plus.
  • Programming: Strong PySpark or advanced SQL skills; Python for data engineering or automation.
  • Data Modeling: Dimensional modeling, Data Vault, or schema design for analytical workloads.
  • Performance Tuning: Cluster/warehouse sizing, partitioning, clustering keys, Z-ordering, or query optimization.
  • Governance & Security: Working knowledge of Unity Catalog (Databricks) or Horizon Catalog (Snowflake) for lineage, access control, or data quality.
  • CI/CD & DevOps: Git, Databricks Asset Bundles or Snowflake CLI/Schemachange, automated testing, or deployment pipelines.
  • Cloud Ecosystem: AWS (S3, Glue, Kinesis), Azure, or GCP services supporting modern data platforms.
  • AI/ML Enablement: Familiarity with Databricks Mosaic AI or Snowflake Cortex for GenAI or ML use cases.
  • Collaboration: Strong communication skills to partner with Product Owners, Analysts, or cross-functional engineering teams.
  • Education: Bachelor's degree in Computer or Information Science or related field, or equivalent combination of education and experience.
  • Experience: 5-8 years creating quality data pipelines and system integrations with at least 3 years of experience in a cloud environment.

What do we offer?
  • Insurance Plans (Medical, Life)
  • Pension/401K/RSP (country specific)
  • Competitive Bonus
  • Mobility Allowance
  • Tuition Reimbursement
  • Company Holidays
  • Volunteering time
  • And More.....

Compensation: The base pay range for this role is $119,200 - 149,000 annually
Pay within this range will be determined in good faith based on job-related factors, which may include skills, experience, education/training, location, and internal equity.
The Company is only considering applicants who are currently authorized to work in the country the position is based. AA/EOE/D/V

What Subway employees say

Pay

Benefits

Hours and flexibility

Workplace

Get the full story on Breakroom

Apply