ZipRecruiter

Log In

1

Databricks Data Engineer Jobs in New York, NY (NOW HIRING)

Summitpointaiglobal

DataBricks Data Engineer

New York, NY · On-site

$125K - $150K/yr

Databricks Data Engineer We are seeking a skilled and experienced Databricks Data Engineer to join our team. As a Databricks Data Engineer, you will be responsible for designing, developing, and ...

MDMS Recruiting

Databricks Data Engineer

Manhattan, NY · On-site

$126K - $151K/yr

Data Engineer, Databricks Location: New York NY (4 days onsite), w2 only, local candidates only Duration: 6 Months Must have Data Modelling, Data Lake, Building Dashboard, and Databricks, Sales Comp ...

Innova Solutions, Inc

DataBricks Data Engineer

Manhattan, NY · On-site

$126K - $151K/yr

As a Databricks Data Engineer, you will be responsible for designing, developing, and implementing data engineering solutions using the Databricks platform to support data ingestion, transformation ...

Overture Partners

DataBricks Data Engineer

New York, NY · On-site

$65 - $68/hr

This role is ideal for a hands-on engineer with deep expertise in Databricks, modern data engineering practices, and Sales Incentive Compensation (SIC) processes. Candidates with a proven track ...

PTR Global

Databricks Data Engineer

Manhattan, NY · On-site

$60 - $75/hr

Databricks Data Engineer Location: New York, New York Duration: Contract Job ID: 178866 Job Overview: We are seeking a skilled and experienced Applications Developer to join our team in New York, New ...

HAN IT Staffing Inc.

Databricks/Data Architect

Manhattan, NY · On-site

$70.25 - $90.50/hr

Databricks/Data Architect (Enterprise Data Platform) Experience: 14+ Years Location - NJ, Hybrid ... Design secure, scalable Lakehouse architecture using Delta Lake Data Engineering & Processing

GEI Consultants

Data Engineer

Manhattan, NY

$90K - $150K/yr

Azure or Databricks certifications (e.g., Azure Data Engineer Associate, Azure Solutions Architect Expert, Databricks Data Engineer Professional) are a plus. We are GEI. Some of the world's most ...

GEI Consultants

Data Engineer

New York, NY · On-site

$125K - $150K/yr

Azure or Databricks certifications (e.g., Azure Data Engineer Associate, Azure Solutions Architect Expert, Databricks Data Engineer Professional) are a plus. We are GEI. Some of the world's most ...

High Bridge Consulting LLC

Azure Databricks

Manhattan, NY · On-site

$80 - $90/hr

Data Engineer - Azure Databricks (Corporate Vertical Developer) We are seeking an experienced Data Engineer - Azure Databricks (Corporate Vertical Developer) to support multiple corporate business ...

next page

Showing results 1-20

All JobsDatabricks Data Engineer JobsDatabricks Data Engineer Jobs in New York, NY

Databricks Data Engineer information

See New York, NY salary details

$48.7K

$141.9K

$194.2K

How much do databricks data engineer jobs pay per year?

As of Aug 25, 2026, the average yearly pay for databricks data engineer in New York, NY is $141,914.00, according to ZipRecruiter salary data. Most workers in this role earn between $125,300.00 and $150,400.00 per year, depending on experience, location, and employer.

What is a Databricks data engineer?

A Databricks Data Engineer is responsible for designing, building, and maintaining scalable data pipelines on the Databricks platform. They work with Apache Spark, Delta Lake, and cloud services to process large datasets efficiently. Their role involves data ingestion, transformation, optimization, and ensuring data quality for analytics and machine learning. Additionally, they collaborate with data scientists, analysts, and business teams to deliver reliable data solutions.

What does a Databricks data engineer do?

A typical day for a Databricks Data Engineer involves developing and maintaining scalable data pipelines, optimizing big data workflows using Spark, and collaborating with data scientists, analysts, and other engineers. You will regularly work within cloud environments to manage and process large datasets, conduct troubleshooting, and ensure data reliability and performance. Daily tasks may also include writing code, participating in team meetings, and implementing best practices for data security and governance. This role is highly collaborative, requiring frequent communication to align on project goals and address any technical challenges. The dynamic, project-based structure helps expand your skills and offers growth opportunities into senior engineering or data architecture roles.

What are the key skills and qualifications needed to thrive as a Databricks data engineer?

To thrive as a Databricks Data Engineer, you need strong expertise in data engineering concepts, big data processing, and programming languages such as Python, Scala, or SQL, often supported by a degree in computer science or a related field. Proficiency in Databricks, Apache Spark, cloud platforms (like AWS, Azure, or GCP), and relevant certifications such as Databricks Certified Data Engineer are highly valued. Effective problem-solving, collaboration, and clear communication skills help engineers work efficiently within cross-functional teams. These skills are essential for designing scalable data pipelines, ensuring data quality, and delivering actionable analytics in dynamic business environments.

How much does a Databricks data engineer make?

A Databricks Data Engineer typically earns between $90,000 and $150,000 annually, depending on experience, location, and certifications. Senior roles or those with advanced skills in Spark, cloud platforms, and data pipeline development can earn higher salaries.

Is a Databricks Data Engineer in demand?

Databricks Data Engineers are in high demand due to the increasing adoption of cloud-based data platforms and big data processing. Skills in Apache Spark, cloud environments, and data pipeline development are highly sought after, leading to strong job growth in this field.

What are the most commonly searched types of Databricks Data Engineer jobs in New York, NY?

The most popular types of Databricks Data Engineer jobs in New York, NY are:

What are popular job titles related to Databricks Data Engineer jobs in New York, NY?

For Databricks Data Engineer jobs in New York, NY, the most frequently searched job titles are:

What job categories do people searching Databricks Data Engineer jobs in New York, NY look for?

The top searched job categories for Databricks Data Engineer jobs in New York, NY are:

Databricks Data Engineer jobs near you
Infographic showing various Databricks Data Engineer job openings in New York, NY as of August 2026, with employment types broken down into 100% Full Time. Highlights an 100% In-person job distribution, with an average salary of $143,000 per year, or $68.8 per hour.

DataBricks Data Engineer

Manhattan, NY • On-site

Software Guidance & Assistance
51 - 200 employees
Learn more about Software Guidance & Assistanceexternal

$126K - $151K/yr

Other

Re-posted 5 days ago

Job description

Software Guidance & Assistance, Inc., (SGA), is searching for a DataBricks Data Engineer for a CONTRACT assignment with one of our premier Insurance Services clients in New York, NY.
We are seeking a skilled and experienced Databricks Data Engineer to join our team. As a Databricks Data Engineer, you will be responsible for designing, developing, and implementing data engineering solutions using the Databricks platform to support data ingestion, transformation, performance reporting, analytics, sales incentive compensation processing, and enterprise data pipeline processes.
Responsibilities :
  • Collaborate with business stakeholders to understand their data requirements and translate them into scalable technical solutions.
  • Design and develop Databricks-based data pipelines, including data models, Delta Lake tables, and dashboards/notebooks.
  • Responsible for the overall Databricks architecture to ensure new pipelines and enhancements to existing workflows are designed in an integrated and optimal manner.
  • Maintain and optimize all current Databricks workspaces and pipelines; capture and deliver requirements for new or improved functionality to achieve further automation and integration of data and processes.
  • Design and implement data pipelines to support Sales Incentive Compensation (SIC) processes, including quota management, attainment calculations, commission processing, and payout reporting.
  • Partner with Sales Operations and Finance teams to understand incentive plan rules and translate them into accurate, auditable data transformations and models.
  • Perform testing and debugging of data pipelines and notebooks to identify and resolve issues and ensure optimal performance.
  • Provide technical support and troubleshooting for Databricks-based solutions, working closely with end-users and analysts to address their needs and resolve any data-related problems.
  • Stay up to date with Databricks features and enhancements (Unity Catalog, Delta Live Tables, Photon, etc.), and proactively identify opportunities to leverage them to improve data quality, performance, and analytics capabilities.
  • Collaborate with cross-functional teams, including finance, IT, and business intelligence teams, to ensure seamless integration and alignment of Databricks with other systems and processes.
  • Document technical specifications, data models, pipeline configurations, and development processes to ensure knowledge transfer and maintain system documentation.
Required Skills :
  • At least 7 years of experience in data engineering, with a minimum of 3 years hands-on experience building and managing Databricks solutions.
  • Extensive experience with Databricks platform components: Delta Lake, Delta Live Tables, Unity Catalog and Databricks Workflows.
  • Strong proficiency in Python and/or Scala for data engineering; SQL expertise required.
  • Strong experience with core data engineering practices including data ingestion, transformation (ETL/ELT), data modeling, and pipeline orchestration.
  • Functional and technical experience with Sales Incentive Compensation (SIC) - including incentive plan design, quota allocation, attainment tracking, commission calculations, and payout processing.
  • Familiarity with SIC platforms (e.g., Anaplan, Oracle ICM, Varicent) and experience integrating them with data engineering platforms is a strong plus.
  • Ability to understand complex incentive compensation rules and model them accurately in data pipelines and transformation logic.
  • Experience integrating Databricks with cloud platforms (Azure, AWS, or Google Cloud Platform) and data sources such as Azure Data Factory, Event Hubs, Kafka, or equivalent.
  • Passion and ability to create holistic, end-to-end, integrated data solutions.
  • Stakeholder management skills; ability to challenge constructively and translate complex business requirements into scalable data architectures - not just gather requirements.
  • Strong analytical and problem-solving skills, with the ability to understand complex data requirements and implement reliable, efficient solutions.
  • Excellent communication and collaboration skills, with the ability to work effectively with cross-functional teams and stakeholders.
  • Must work well in a team environment while being a resourceful, independent self-starter able to work effectively with minimal direction.
  • Skilled at documenting complex data architectures and pipelines in a professional manner.
  • Ability to work independently and manage multiple tasks and priorities in a fast-paced environment.
  • Passion for data quality, performance optimization, and delivering excellent end-user data experiences.
Preferred Skills :
  • Databricks Certified Data Engineer Associate or Professional certification is a plus.
SGA is a technology and resource solutions provider driven to stand out. We are a women-owned business. Our mission: to solve big IT problems with a more personal, boutique approach. Each year, we match consultants like you to more than 1,000 engagements. When we say let's work better together, we mean it. You'll join a diverse team built on these core values: customer service, employee development, and quality and integrity in everything we do. Be yourself, love what you do and find your passion at work. Please find us at .
SGA is an Equal Opportunity Employer and does not discriminate on the basis of Race, Color, Sex, Sexual Orientation, Gender Identity, Religion, National Origin, Disability, Veteran Status, Age, Marital Status, Pregnancy, Genetic Information, or Other Legally Protected Status. We are committed to providing access, equal opportunity, and reasonable accommodation for individuals with disabilities in employment, and our services, programs, and activities. Please visit our company to request an accommodation or assistance regarding our policy
#LI-AC1

Apply