Data Engineer
Manhattan, NY · On-site
$616/day
Data Engineer Job location: New York City, NY (Hybrid, 3 days in a week) Job Type: W2 Contract ... Advanced proficiency in Python, SQL Server, Snowflake, Azure Databricks, and PySpark. * Strong ...
Data Engineer
Manhattan, NY · On-site
$616/day
Data Engineer Job location: New York City, NY (Hybrid, 3 days in a week) Job Type: W2 Contract ... Advanced proficiency in Python, SQL Server, Snowflake, Azure Databricks, and PySpark. * Strong ...
Data Engineer
New York, NY · On-site
$125K - $150K/yr
Data Engineer Work location: New York City, NY (Hybrid, 3 days in a week) In-person Interview is ... Advanced proficiency in Python, SQL Server, Snowflake, Azure Databricks, and PySpark. * Strong ...
Quick apply
Data Engineer
New York, NY · On-site
$125K - $150K/yr
Data Engineer Work location: New York City, NY (Hybrid, 3 days in a week) In-person Interview is ... Advanced proficiency in Python, SQL Server, Snowflake, Azure Databricks, and PySpark. * Strong ...
Data Engineer
Princeton, NJ · On-site
$120K - $144K/yr
Build scalable data pipelines and ETL/ELT workflows using Databricks, Python, and PySpark. * Develop cloud-native data solutions on AWS and/or Azure. * Implement software engineering best practices ...
Quick apply
Data Engineer
Princeton, NJ · On-site
$120K - $144K/yr
Build scalable data pipelines and ETL/ELT workflows using Databricks, Python, and PySpark. * Develop cloud-native data solutions on AWS and/or Azure. * Implement software engineering best practices ...
Data Engineer
Princeton, NJ · On-site
$120K - $144K/yr
Build scalable data pipelines and ETL/ELT workflows using Databricks, Python, and PySpark. * Develop cloud-native data solutions on AWS and/or Azure. * Implement software engineering best practices ...
Quick apply
Data Engineer
Princeton, NJ · On-site
$120K - $144K/yr
Build scalable data pipelines and ETL/ELT workflows using Databricks, Python, and PySpark. * Develop cloud-native data solutions on AWS and/or Azure. * Implement software engineering best practices ...
Data Engineer
Jersey City, NJ · On-site
$119K - $143K/yr
Data Engineer Location: Jersey City, NJ Responsibilities ... Design and develop ETL/ELT pipelines using Databricks and PySpark . * Ingest data from multiple ...
Data Engineer
Jersey City, NJ · On-site
$119K - $143K/yr
Data Engineer Location: Jersey City, NJ Responsibilities ... Design and develop ETL/ELT pipelines using Databricks and PySpark . * Ingest data from multiple ...
Azure Data Engineer
Iselin, NJ · On-site
$116K - $139K/yr
Title: Azure Data Engineer Location: Iselin NJ - (3 Days from Office) Experience: 12+ Years ... Design, develop, and deploy Spark program in databricks environment to process and analyze large ...
Quick apply
Azure Data Engineer
Iselin, NJ · On-site
$116K - $139K/yr
Title: Azure Data Engineer Location: Iselin NJ - (3 Days from Office) Experience: 12+ Years ... Design, develop, and deploy Spark program in databricks environment to process and analyze large ...
Senior Data Engineer (Azure & Databricks)
Manhattan, NY · On-site
$116K - $158K/yr
... Databricks, distributed data processing, and enterprise data architecture, along with the ability to lead large data initiatives and collaborate with engineering and business teams. You will work ...
Senior Data Engineer (Azure & Databricks)
Manhattan, NY · On-site
$116K - $158K/yr
... Databricks, distributed data processing, and enterprise data architecture, along with the ability to lead large data initiatives and collaborate with engineering and business teams. You will work ...
Data Engineer - Manager
New York, NY · On-site
... Databricks Data Engineer Associate] is a plus - Designing and implementing thorough data architecture strategies that meet the current and future business needs - Developing and documenting data ...
Data Engineer - Manager
New York, NY · On-site
... Databricks Data Engineer Associate] is a plus - Designing and implementing thorough data architecture strategies that meet the current and future business needs - Developing and documenting data ...
Data Engineer - Manager
Florham Park, NJ · On-site
... Databricks Data Engineer Associate] is a plus - Designing and implementing thorough data architecture strategies that meet the current and future business needs - Developing and documenting data ...
Data Engineer - Manager
Florham Park, NJ · On-site
... Databricks Data Engineer Associate] is a plus - Designing and implementing thorough data architecture strategies that meet the current and future business needs - Developing and documenting data ...
Azure Data Engineer
Hamilton, NJ · On-site
$113K - $136K/yr
Role: Azure Data Engineer Location: Hamilton, NJ (4 days onsite) Duration: Long term ... Design and develop data pipelines using Azure Data Services and Databricks . * Build and optimize ...
Quick apply
Azure Data Engineer
Hamilton, NJ · On-site
$113K - $136K/yr
Role: Azure Data Engineer Location: Hamilton, NJ (4 days onsite) Duration: Long term ... Design and develop data pipelines using Azure Data Services and Databricks . * Build and optimize ...
Azure Data Engineer
Hamilton, NJ · On-site
$113K - $136K/yr
Role: Azure Data Engineer Location: Hamilton, NJ (4 days onsite) Duration: Long term ... Design and develop data pipelines using Azure Data Services and Databricks . * Build and optimize ...
Azure Data Engineer
Hamilton, NJ · On-site
$113K - $136K/yr
Role: Azure Data Engineer Location: Hamilton, NJ (4 days onsite) Duration: Long term ... Design and develop data pipelines using Azure Data Services and Databricks . * Build and optimize ...
Senior Data Engineer (Azure & Databricks)
Manhattan, NY · On-site
$116K - $158K/yr
... Databricks, distributed data processing, and enterprise data architecture, along with the ability to lead large data initiatives and collaborate with engineering and business teams. You will work ...
Senior Data Engineer (Azure & Databricks)
Manhattan, NY · On-site
$116K - $158K/yr
... Databricks, distributed data processing, and enterprise data architecture, along with the ability to lead large data initiatives and collaborate with engineering and business teams. You will work ...
Databricks Platform Engineer
New York, NY · On-site
This role focuses on platform engineering rather than data engineering or analytics development. Responsibilities Platform Administration Design, deploy, and manage Databricks workspaces across ...
Databricks Platform Engineer
New York, NY · On-site
This role focuses on platform engineering rather than data engineering or analytics development. Responsibilities Platform Administration Design, deploy, and manage Databricks workspaces across ...
Senior Data Engineer (Azure & Databricks)
Manhattan, NY · On-site
$116K - $158K/yr
... Databricks, distributed data processing, and enterprise data architecture, along with the ability to lead large data initiatives and collaborate with engineering and business teams. You will work ...
Quick apply
Senior Data Engineer (Azure & Databricks)
Manhattan, NY · On-site
$116K - $158K/yr
... Databricks, distributed data processing, and enterprise data architecture, along with the ability to lead large data initiatives and collaborate with engineering and business teams. You will work ...
Sr. Product Manager - Technical
New York, NY · On-site
$156K - $215K/yr
... Databricks Data Intelligence Platform and identify opportunities to improve the product experience.You will act as a bridge between technical field teams and product and engineering . Insights from ...
Sr. Product Manager - Technical
New York, NY · On-site
$156K - $215K/yr
... Databricks Data Intelligence Platform and identify opportunities to improve the product experience.You will act as a bridge between technical field teams and product and engineering . Insights from ...
Senior Data Warehouse Engineer
New York, NY · On-site
$116K - $157K/yr
Data Warehouse Engineer New York, New York Contract The client is strategically transitioning the ... Databricks Ecosystem: Create, manage, and optimize managed Delta tables within a Databricks ...
Senior Data Warehouse Engineer
New York, NY · On-site
$116K - $157K/yr
Data Warehouse Engineer New York, New York Contract The client is strategically transitioning the ... Databricks Ecosystem: Create, manage, and optimize managed Delta tables within a Databricks ...
Data Engineer
New York, NY · On-site
$140K - $180K/yr
As a Data Platform Engineer, you will be responsible for the underlying data architecture across Snowflake and Databricks, as well as building and optimizing various ETL pipelines to fuel both ...
Data Engineer
New York, NY · On-site
$140K - $180K/yr
As a Data Platform Engineer, you will be responsible for the underlying data architecture across Snowflake and Databricks, as well as building and optimizing various ETL pipelines to fuel both ...
Sr. Data Engineer with ML
New York, NY · On-site
$125K - $150K/yr
Title: Sr. Data Engineer Location: NYC,NY Duration: long term Position type: W2 contract Data ... The ideal candidate will have experience working with MLflow, Databricks, and open-source machine ...
Quick apply
Sr. Data Engineer with ML
New York, NY · On-site
$125K - $150K/yr
Title: Sr. Data Engineer Location: NYC,NY Duration: long term Position type: W2 contract Data ... The ideal candidate will have experience working with MLflow, Databricks, and open-source machine ...
Data Engineer
New York, NY · On-site
$125K - $150K/yr
Job Title: Sr Data engineer Location : NYC Experience - 8+ 5 Days Onsite Look for only New york and ... or Databricks, alternatively Hadoop), atleast one relational data stores (Postgres, Oracle or ...
Quick apply
Data Engineer
New York, NY · On-site
$125K - $150K/yr
Job Title: Sr Data engineer Location : NYC Experience - 8+ 5 Days Onsite Look for only New york and ... or Databricks, alternatively Hadoop), atleast one relational data stores (Postgres, Oracle or ...
Azure Hyperscale SQL & Databricks Engineer
Weehawken, NJ · On-site
$59.75 - $74.25/hr
You will collaborate with data scientists, analysts, and other engineers to deliver high ... Develop and optimize Databricks workflows (PySpark, Delta Lake) for large-scale data processing and ...
Quick apply
Azure Hyperscale SQL & Databricks Engineer
Weehawken, NJ · On-site
$59.75 - $74.25/hr
You will collaborate with data scientists, analysts, and other engineers to deliver high ... Develop and optimize Databricks workflows (PySpark, Delta Lake) for large-scale data processing and ...
Overnight Databricks Data Engineer information
What is the difference between Overnight Databricks Data Engineer vs Data Engineer?
| Aspect | Overnight Databricks Data Engineer |
|---|---|
| Work Environment | Primarily remote or on-site, working overnight shifts to support global data operations |
| Certifications | Databricks certifications, cloud platform credentials (AWS, Azure), data engineering certifications |
| Tools & Technologies | Databricks platform, Spark, cloud services, SQL, Python, ETL tools |
| Industry Usage | Tech, finance, healthcare, retail with 24/7 data needs |
While both roles focus on data engineering, the Overnight Databricks Data Engineer specializes in managing data pipelines on the Databricks platform during overnight shifts, often supporting global operations. A Data Engineer may work across various platforms and shifts, with broader responsibilities in data architecture and pipeline development. The overnight role emphasizes specific platform expertise and shift timing, catering to organizations with continuous data processing needs.
What unique challenges do overnight Databricks data engineers face, and how can they be addressed?
Overnight Databricks Data Engineers often work with limited real-time support, which can present challenges when troubleshooting urgent data pipeline issues or system outages. To address this, it’s essential to develop strong problem-solving skills, document processes thoroughly, and leverage automated monitoring and alerting tools. Additionally, close collaboration with daytime teams during handoff periods ensures continuity and minimizes disruptions. Building a habit of proactive communication and maintaining detailed logs helps the entire team resolve issues efficiently and maintain data quality.
What skills and qualifications are needed to thrive as an overnight Databricks data engineer?
To thrive as an Overnight Databricks Data Engineer, you need strong proficiency in data engineering, Python or Scala programming, and experience with big data technologies, typically supported by a relevant degree in computer science or a related field. Familiarity with Databricks, Apache Spark, cloud platforms (such as AWS or Azure), and certifications like Databricks Certified Data Engineer are highly valued. Attention to detail, problem-solving, and effective communication are essential soft skills, especially for troubleshooting and collaborating across shifts. These competencies ensure reliable data pipeline management and efficient resolution of issues during off-hours, maintaining seamless business operations.
What is an overnight Databricks data engineer?
An Overnight Databricks Data Engineer is a professional who works primarily during night shifts to manage, design, and maintain big data pipelines and workflows using Databricks, a cloud-based data analytics platform. Their responsibilities often include developing and optimizing data processing jobs, ensuring data quality, and troubleshooting issues that arise during overnight data operations. This role is critical for organizations that require 24/7 data processing, continuous ETL jobs, or real-time analytics. Working overnight may also involve monitoring automated systems, performing scheduled data loads, and collaborating with global teams to ensure data availability and reliability.
What cities near Edison, NJ are hiring for Overnight Databricks Data Engineer jobs? Cities near Edison, NJ with the most Overnight Databricks Data Engineer job openings:
Job description
Job Title: Data Engineer
Job location: New York City, NY (Hybrid, 3 days in a week)
Job Type: W2 Contract
Job Description:
Looking for skilled Data engineer with comprehensive experience in designing, developing, and maintaining scalable data solutions within the financial and regulatory domains. Proven expertise in leading end-to-end data architectures, integrating diverse data sources, and ensuring data quality and accuracy.
Core Competencies:
Key Responsibilities:
Job location: New York City, NY (Hybrid, 3 days in a week)
Job Type: W2 Contract
Job Description:
Looking for skilled Data engineer with comprehensive experience in designing, developing, and maintaining scalable data solutions within the financial and regulatory domains. Proven expertise in leading end-to-end data architectures, integrating diverse data sources, and ensuring data quality and accuracy.
Core Competencies:
- Advanced proficiency in Python, SQL Server, Snowflake, Azure Databricks, and PySpark.
- Strong understanding of relational databases, ETL processes, and data modeling.
- Expertise in system design, architecture, and implementing robust data pipelines.
- Hands-on experience with data validation, quality checks, and automation tools (Autosys, Control-M).
- Effective communicator with the ability to collaborate with business analysts, users, and global teams.
Key Responsibilities:
- Collaborate with business stakeholders to gather technical specifications and translate business requirements into technical solutions.
- Develop and optimize data models and schemas for efficient data integration and analysis.
- Lead application development involving Python, Pyspark, SQL, Snowflake, and Databricks platforms.
- Implement data validation procedures to maintain high data quality standards.
- Conduct comprehensive testing (UT, SIT, UAT) alongside business and testing teams.
- Provide ongoing support, troubleshooting, and maintenance in production environments.
- Contribute to architecture and design discussions to ensure scalable, maintainable data solutions.
- Experience with financial systems (capital markets, credit risk, and regulatory compliance applications).
About Apptad
Sourced by ZipRecruiter
Apptad offers strategic consulting, enterprise information management and digital transformation services. With globally connected offices in US and India along with a team of trained and certified IT resources, Apptad ensures quick and effective delivery to its customers.Apptad is relentlessly reinventing the outlook of how companies leverage data. With an effort to enable our customers the ability to solve biggest problems within their organization. We perceive our clients’ problems and respond with custom solutions instead of handing over boilerplate responses.
Industry
It services
Company size
501 - 1,000 Employees
Headquarters location
Reston, VA, US
Year founded
2018