1

Overnight Databricks Data Engineer Jobs in Pompano Beach, FL

Data Engineer

West Palm Beach, FL · On-site

$110K - $133K/yr

Azure or Databricks certifications (e.g., Azure Data Engineer Associate, Azure Solutions Architect Expert, Databricks Data Engineer Professional) are a plus. We are GEI. Some of the world's most ...

Data Engineer I

Plantation, FL · On-site

$113K - $136K/yr

DATA ENGINEER I The Technology & Data team is seeking a Data Engineer I to support the development ... Work with Databricks and Apache Spark to process and transform data. Troubleshoot data quality ...

Data Engineer I

Plantation, FL · On-site

$113K - $136K/yr

DATA ENGINEER I The Technology & Data team is seeking a Data Engineer I to support the development ... The ideal candidate has foundational experience with Databricks, SQL, SQL Server, SSIS, PL/SQL, and ...

Data Engineer I

Plantation, FL

$113K - $136K/yr

DATA ENGINEER I The Technology & Data team is seeking a Data Engineer I to support the development ... Work with Databricks and Apache Spark to process and transform data. Troubleshoot data quality ...

Sr Data Engineer

Plantation, FL · On-site

$109K - $131K/yr

... preferably Databricks/Snowflake/Azure Synapse required. • Experience in DevOps activities ... data models and creating effective dashboards. • Demonstrated ability to translate complex ...

Sr Data Engineer

Plantation, FL · Remote

$109K - $131K/yr

... preferably Databricks/Snowflake/Azure Synapse required. • Experience in DevOps activities ... data models and creating effective dashboards. • Demonstrated ability to translate complex ...

The Technology & Data team is seeking an experienced Data Engineer II to support the design ... Utilize Databricks, Apache Spark, and Delta Lake technologies to process and transform large ...

The Technology & Data team is seeking an experienced Data Engineer II to support the design ... Utilize Databricks, Apache Spark, and Delta Lake technologies to process and transform large ...

Senior Data Engineer

Hollywood, FL · On-site

$65 - $70/hr

... Databricks Unity Catalog) and pipeline orchestration tools (e.g. dbt) Demonstrated experience with data modeling, feature engineering, and building transforms for ML feature stores Strong ...

Azure Cloud Data Engineer

Weston, FL · Remote

$108K - $130K/yr

AZURE DATA ENGINEER (REMOTE) ARC Group has an immediate opportunity for an aspiring Azure / Cloud ... CosmosDB, Data Factory, Databricks. * Robust knowledge of cloud storage aspects (ADLS gen2)

Senior Data Engineer

Boca Raton, FL · On-site

$100K - $136K/yr

Databricks for additional transformations and machine learning. * Looker for BI and reporting. You ... engineering, and product to understand how the data works, where it comes from, and where it needs ...

next page

Showing results 1-20

Overnight Databricks Data Engineer information

What is an overnight Databricks data engineer?

An Overnight Databricks Data Engineer is a professional who works primarily during night shifts to manage, design, and maintain big data pipelines and workflows using Databricks, a cloud-based data analytics platform. Their responsibilities often include developing and optimizing data processing jobs, ensuring data quality, and troubleshooting issues that arise during overnight data operations. This role is critical for organizations that require 24/7 data processing, continuous ETL jobs, or real-time analytics. Working overnight may also involve monitoring automated systems, performing scheduled data loads, and collaborating with global teams to ensure data availability and reliability.

What skills and qualifications are needed to thrive as an overnight Databricks data engineer?

To thrive as an Overnight Databricks Data Engineer, you need strong proficiency in data engineering, Python or Scala programming, and experience with big data technologies, typically supported by a relevant degree in computer science or a related field. Familiarity with Databricks, Apache Spark, cloud platforms (such as AWS or Azure), and certifications like Databricks Certified Data Engineer are highly valued. Attention to detail, problem-solving, and effective communication are essential soft skills, especially for troubleshooting and collaborating across shifts. These competencies ensure reliable data pipeline management and efficient resolution of issues during off-hours, maintaining seamless business operations.

What unique challenges do overnight Databricks data engineers face, and how can they be addressed?

Overnight Databricks Data Engineers often work with limited real-time support, which can present challenges when troubleshooting urgent data pipeline issues or system outages. To address this, it’s essential to develop strong problem-solving skills, document processes thoroughly, and leverage automated monitoring and alerting tools. Additionally, close collaboration with daytime teams during handoff periods ensures continuity and minimizes disruptions. Building a habit of proactive communication and maintaining detailed logs helps the entire team resolve issues efficiently and maintain data quality.

What is the difference between Overnight Databricks Data Engineer vs Data Engineer?

AspectOvernight Databricks Data Engineer
Work EnvironmentPrimarily remote or on-site, working overnight shifts to support global data operations
CertificationsDatabricks certifications, cloud platform credentials (AWS, Azure), data engineering certifications
Tools & TechnologiesDatabricks platform, Spark, cloud services, SQL, Python, ETL tools
Industry UsageTech, finance, healthcare, retail with 24/7 data needs

While both roles focus on data engineering, the Overnight Databricks Data Engineer specializes in managing data pipelines on the Databricks platform during overnight shifts, often supporting global operations. A Data Engineer may work across various platforms and shifts, with broader responsibilities in data architecture and pipeline development. The overnight role emphasizes specific platform expertise and shift timing, catering to organizations with continuous data processing needs.

What cities near Pompano Beach, FL are hiring for Overnight Databricks Data Engineer jobs?

Cities near Pompano Beach, FL with the most Overnight Databricks Data Engineer job openings:

Infographic showing various Overnight Databricks Data Engineer job openings in Pompano Beach, FL as of August 2026, with employment types broken down into 13% Internship, 62% Full Time, and 25% Part Time. Highlights an 87% In-person, and 13% Remote job distribution.

Data Engineer

GEI Consultants

West Palm Beach, FL • On-site

$110K - $133K/yr

Full-time

Medical, Dental, Vision, Life, Retirement, PTO

Re-posted 19 days ago


GEI Consultants rating

7.6

Company rating: 7.6 out of 10

Based on 7 frontline employees who took The Breakroom Quiz

287th of 450 rated engineering


Job description

Description
Your role at GEI.
The Data Engineer is responsible for designing, building, and maintaining the data pipelines and integrations that power GEI's AI solutions and digital initiatives. This role focuses on ensuring enterprise data is accessible, reliable, and governed so that AI capabilities can be deployed and scaled with confidence.
The Data Engineer plays a hands-on role by preparing and integrating the data foundations that AI solutions depend on. This includes building ingestion pipelines, managing data stores, implementing quality and governance controls, and supporting retrieval patterns such as RAG. This role works closely with AI Engineers, solution architects, and platform teams to ensure data infrastructure is production-ready, secure, and aligned with GEI standards.
Essential Responsibilities & Duties
  • Design, build, and maintain data pipelines that ingest, transform, and deliver enterprise data to AI solutions and business applications.
  • Develop and manage integrations across enterprise data sources using APIs, Graph connectors, event-driven architectures, and batch/streaming patterns.
  • Build and maintain data stores and indexing infrastructure that support retrieval-augmented generation (RAG) and other AI consumption patterns.
  • Implement data quality, validation, and lineage controls to ensure accuracy and trustworthiness of data feeding AI workflows.
  • Support and optimize data models underpinning Power BI dashboards and AI-enabled analytics.
  • Collaborate with AI Engineers to define data contracts and ensure pipeline outputs meet solution requirements for schema, latency, and freshness.
  • Instrument data pipelines for monitoring, alerting, cost control, and performance optimization.
  • Implement data governance and security controls including access management, encryption, and compliance with organizational data policies.
  • Identify data-related risks and support mitigation strategies in collaboration with architecture and platform teams.

Minimum Qualifications
  • 4+ years of data engineering experience, with demonstrated ability to build and operate production data pipelines.
  • Proficiency in Python and SQL; experience with PySpark or Spark is strongly preferred.
  • Experience with Azure data services, including Azure Data Factory, Azure Synapse Analytics, Azure Data Lake Storage, and Azure SQL.
  • Familiarity with Azure AI Search, Cosmos DB, or similar services used to support AI retrieval and storage patterns.
  • Experience building and managing ETL/ELT pipelines with structured, semi-structured, and unstructured data sources.
  • Knowledge of data modeling, schema design, and indexing strategies for both analytical and AI workloads.
  • Familiarity with infrastructure-as-code and CI/CD practices for data pipeline deployment (e.g., Terraform, Azure DevOps).
  • Knowledge of data governance principles, including data cataloging, lineage, access control, and privacy requirements.
  • Knowledge of security best practices for data solutions, including encryption at rest and in transit, role-based access control, and private networking.
  • Experience with Databricks, including Delta Lake and Unity Catalog, is a plus.
  • Prior experience in professional services, engineering, or construction environments is a plus.
  • Azure or Databricks certifications (e.g., Azure Data Engineer Associate, Azure Solutions Architect Expert, Databricks Data Engineer Professional) are a plus.

We are GEI.
Some of the world's most pressing problems - from climate change to sustainable development, to critical infrastructure and the future of our energy supply - need our brightest and diverse minds working together to create safer, more resilient communities for tomorrow.
We are technical experts, collaborators, and entrepreneurs who draw from diverse backgrounds to solve our clients' most complex challenges.
With several offices across North America, we offer a range of engineering, science, and technical consulting services. Our range of expertise, project types, and culture make us the choice for top talent in the AEC industry. See all our office locations here .
Employee-owned. Employee-focused.
As an employee-owned company, our employees support our flat leadership structure, have a say in how our business operates and benefit from our financial success. We are committed to employee growth with career development opportunities, competitive total rewards, a well-being program, flexible work arrangements and more. Our company culture is driven by our 4 Cs - we are Client-Centered, Curious, Collaborative, and Community Minded - which support our focus on sustainability, safety, diversity, equity and inclusion. Get to know us better by visiting GEI's career site here .
GEI's Total Rewards Package Includes
  • Market-Competitive Compensation, including Eligibility for an Annual Performance Bonus
  • Pay Range For This Position: $90,000.00 - $150,000.00/year
  • Comprehensive Benefits Program, including Medical, Dental, Vision, Life, Disability and More
  • Well-Being Program and Paid Parental Leave
  • Commuter Benefits
  • Hybrid Work Schedules and Cell Phone Stipends
  • GEI University (GEIU) with Continuing Education Assistance and Tuition Reimbursement
  • Connecting Conversation Program with a Focus on Professional Development and Opportunities for Advancement
  • Support and Financial Rewards for Publication Awards, Professional Dues, and Professional Licenses
  • Paid Holidays and Generous Paid Time Off Program
  • Rewards and Recognition
  • GEI-Funded Profit Sharing and 401(k)
  • Opportunity to be an Owner and Shareholder (Learn more here )
  • A Vibrant Culture that is Focused on Partnership, Sustainability, Giving Back to Our Communities and Diversity, Equity and Inclusion
  • And More...

PHYSICAL REQUIREMENTS
WORK ENVIRONMENT
Functional Demands:
Sedentary
x
Light
Medium
Other
Activity Level Throughout Workday (check one per row)
Physical Activity Requirements
Occasional
(0-35% of day)
Frequent
(33-66% of day)
Continuous
(67-100% of day)
Not Applicable
Sitting
x
Standing
x
Walking
x
Climbing
x
Lifting (floor to waist level) (in pounds)
x
Lifting (waist level and above) (in pounds)
x
Carrying objects
x
Push/pull
x
Twisting
x
Bending
x
Reaching forward
x
Reaching overhead
x
Squat/kneel/crawl
x
Wrist position deviation
x
Pinching/fine motor skills
x
Keyboard use/repetitive motion
x
Taste or smell (taste=never)
x
Talk or hear
x
Accurate 20/40
Very Accurate 20/20
Not Applicable
Near Vision
x
Far Vision
x
Yes
No
Not Applicable
Color Discrimination
Sensory Requirements
Minimal
Moderate
Accurate
Not Applicable
Depth perception
x
Hearing
x
Environment Requirements
Occupational Exposure Risk Potential
Reasonably Anticipated
Not Anticipated
Blood borne pathogens
x
Chemical
x
Airborne communicable diseases
x
Extreme temperatures
x
Radiation
x
Uneven surfaces or elevations
x
Extreme noise levels
x
Dust/particulate matter
x
Other (exposure risks):
Usual workday hours :
x
8
10
12
Other work hours
GEI is an AA/equal opportunity employer, including disabled and veterans.

What GEI Consultants employees say

Pay

Hours and flexibility

Workplace

Get the full story on Breakroom