ZipRecruiter

Log In

1

Databricks Engineer Jobs in Hudson, NY (NOW HIRING)

Transcend Business Solutions

Be Seen First

Senior Data Engineer

Albany, NY · Remote

$45 - $55/hr

Client also utilizes AWS and Databricks. Requirements: * Bachelor's degree in computer science, information technology, or a related field. * At least 7 years of experience in data engineering or a ...

InterSources Inc

Sr. Data Developer

Albany, NY · On-site

... with Databricks using PySpark and Databricks SQLImplement batch and incremental data loads ... developers, product managers, etc.) to define integration requirements and ensure successful ...

FirstLight Fiber

Carrier Voice Engineer

Albany, NY · On-site

$75 - $95/hr

Required Qualifications * 7+ years of experience in telecom network engineering, voice engineering ... MySQL, Snowflake, Databricks, Elasticsearch, or OpenSearch. * Familiarity with OSS/BSS ...

The Hertz Corporation

Sr Data Scientist

Albany, NY · On-site

$89.25 - $120.75/hr

You will work closely with data engineers, analysts, software developers and product managers ... Databricks * Experience with event-driven architectures and implementing analytics on streaming ...

Lthc

IT Platform Admin I/II/III/IV

Albany, NY · On-site

We are looking for someone who has solid experience with Databricks to round out our team ... Closely interacts with cross-functional teams, developers, QA personnel, and business teams to ...

Lthc

IT Platform Admin I/II/III/IV

Albany, NY · On-site

We are looking for someone who has solid experience with Databricks to round out our team ... Closely interacts with cross-functional teams, developers, QA personnel, and business teams to ...

Lthc

IT Platform Admin I/II/III/IV

Albany, NY · On-site

We are looking for someone who has solid experience with Databricks to round out our team ... Closely interacts with cross-functional teams, developers, QA personnel, and business teams to ...

All JobsDatabricks Engineer JobsDatabricks Engineer Jobs in Hudson, NY

Databricks Engineer information

See Hudson, NY salary details

$59.3K

$111.3K

$202.4K

How much do databricks engineer jobs pay per year?

As of Aug 24, 2026, the average yearly pay for databricks engineer in Hudson, NY is $111,315.00, according to ZipRecruiter salary data. Most workers in this role earn between $80,300.00 and $132,100.00 per year, depending on experience, location, and employer.

What is a Databricks engineer?

A Databricks Engineer is a data engineering professional who specializes in using the Databricks platform to build, manage, and optimize data pipelines and analytics solutions. They work with big data technologies like Apache Spark, Delta Lake, and cloud services to process and analyze large datasets efficiently. Their role often involves developing ETL (extract, transform, load) workflows, setting up data lakes, and ensuring data quality and performance for business intelligence and machine learning applications.

What are the key skills and qualifications needed to thrive as a Databricks engineer?

To thrive as a Databricks Engineer, you need strong expertise in big data processing, cloud platforms (like AWS or Azure), and proficiency with languages such as Python, SQL, and Scala, often supported by a degree in computer science or a related field. Familiarity with Apache Spark, Databricks Workspace, version control systems like Git, and relevant Databricks certifications are typically required. Strong analytical thinking, collaboration, and effective communication skills help you understand business needs and work seamlessly with data teams. These skills ensure efficient data pipeline development, scalable analytics solutions, and successful integration of Databricks into organizational workflows.

What are some common challenges faced by Databricks engineers when working with large-scale data pipelines?

Databricks Engineers often encounter challenges related to optimizing the performance and reliability of large-scale data pipelines. These can include efficiently managing cluster resources, handling data partitioning to prevent bottlenecks, and troubleshooting job failures due to resource constraints or data quality issues. Collaboration with data scientists, analysts, and DevOps teams is essential to ensure seamless integration and deployment of production workflows. Staying current with evolving Databricks features and best practices also plays a key role in overcoming these challenges.

How much does a Databricks engineer make?

A Databricks engineer's salary typically ranges from $90,000 to $150,000 annually, depending on experience, location, and skill level. Senior roles or those with specialized skills in Spark, cloud platforms, and data engineering can earn higher compensation, often including bonuses and benefits.

Is a Databricks engineer in demand?

Databricks engineers are in high demand due to the growing adoption of cloud-based data analytics and machine learning platforms. They typically require skills in Spark, SQL, and cloud environments like AWS or Azure, making them valuable in data-driven organizations across various industries.

What are popular job titles related to Databricks Engineer jobs in Hudson, NY?

For Databricks Engineer jobs in Hudson, NY, the most frequently searched job titles are:

What cities near Hudson, NY are hiring for Databricks Engineer jobs?

Cities near Hudson, NY with the most Databricks Engineer job openings:

Databricks Engineer jobs near you
Infographic showing various Databricks Engineer job openings in Hudson, NY as of August 2026, with employment types broken down into 88% Full Time, 8% Part Time, and 4% Contract. Highlights an 84% Physical, 6% Hybrid, and 10% Remote job distribution, with an average salary of $111,315 per year, or $53.5 per hour.

Senior Data Engineer

Transcend Business Solutions

Albany, NY • Remote

$45 - $55/hr

Contractor

Re-posted 13 days ago

Be Seen First

After you apply to this job, you can share why you’re interested to jump to the top of the candidate list.

Job description

Position Title:   Sr. Data Engineer
Location:  Fully Remote
Duration:  6 months (strong chance of extension)
Sparks experience is a must 
Green Card or US Citizen only
Description:
Client is building a new platform for the state of NY for all utility companies.  Data Engineer will focus on raw data from these utility companies, running Python or Scala scripts to ensure date quality.  Spark is utilized to load date into data frames to aggregate or curate the data, then pass to other teams.  Client also utilizes AWS and Databricks.
Requirements: 

  • Bachelor's degree in computer science, information technology, or a related field.
  • At least 7 years of experience in data engineering or a similar role.
  • Expert-level skills in Python, SQL databases such as PostgreSQL, and big data technologies such as Databricks and Spark.
  • Hands-on experience building cloud resident data pipelines in AWS.
  • Strong understanding of data governance, security, privacy, and retention policies and procedures.
  • Strong communication, collaboration, and problem-solving skills.
  • High proficiency using agile software tools like Jira and following mature DevOps practices using GIT, Docker, and CI servers like Jenkins.
  • Passion for data and innovation.

 Preferred Qualifications:
• Demonstrated capacity to work autonomously and proactively, with a proven track record of achieving results without constant supervision.
• Experience with ETL optimization, designing, coding, and tuning big data processes in Databricks.
• Sound knowledge of data lineage and data quality techniques.
• Experience in working with data science and machine learning models and frameworks
• Previous experience in the Energy or Utility industry in an analytic role.
• MS Degree in management information systems, computer programming, software engineering, data science, or an equivalent STEM field.

Transcend Business Solutions logo

About Transcend Business Solutions

Sourced by ZipRecruiter

Transcend Business Solutions is a Professional Services firm specializing in IT, Finance/Accounting, Administrative, Sales/Marketing and Executive placements nationwide. Its client base includes commercial and government entities. Transcend’s services include short and long term staffing, contract-to-hire staffing and permanent placements. Transcend prides itself on meticulous screening processes and careful attention to detail. Transcend adds value to their clients by saving them time and money, as they do the recruiting for their clients to fill urgent positions when timing is critical and HR staffing is limited.

Industry

It services

Company size

11 - 50 Employees

Headquarters location

Bethel, CT, US

Year founded

2003

Social media

Facebook

View All Transcend Business Solutions Jobs