1

Senior Databricks Data Engineer Jobs in Idaho (NOW HIRING)

Sr. Program Manager

Boise, ID ยท On-site

$110K - $110K/yr

Coordinate efforts across service teams, data engineers, BI developers, and third parties to ... Clearwater senior management. * Manage and report on budget for implementation. * Seek out ...

Senior FW Engineer - Pathfinding

Idaho City, ID ยท On-site

$126.96 - $203.20/hr

Come join our Data Center Engineering Team and work on one of the most advanced 3Dโ€‘NAND and SSD ... Senior Firmware (FW) engineer for the development of novel Solid State Drive (SSD) innovation ...

Data Governance Manager

Moscow, ID ยท On-site

$85K/yr

... research and senior leadership to build a governance atmosphere that supports data-informed ... Cloud-based data platforms and lakehouse architecture concepts (Databricks and Unity Catalog ...

As a Data Science Engineer, you will employ various techniques to analyze semiconductor manufacturing data, develop predictive models, and collaborate with engineers to improve processes and product ...

Senior FW Engineer - Pathfinding

Idaho City, ID ยท On-site

$115K - $152K/yr

Senior FW Engineering role working in the development of new prototypes to demonstrate novel ... Come join our Data Center Engineering Team and work on one of the most advanced 3D-NAND and SSD ...

Sr Engineer, Photo DRAM

Boise, ID ยท On-site

$100 - $130/hr

Req ID: JR91030 - Sr. Engineer, Photo DRAM Our vision is to transform how the world uses ... Proficiency in statistics, data analysis, Design of Experiments (DOE), and Statistical Process ...

Sr. Project Engineer

Meridian, ID ยท On-site

$96K - $125K/yr

Overview: The Sr. Project Engineer role will oversee and execute the project controls and ... Direct Field Engineers to gather and prepare data for submittal or transmittal to the customer ...

Sr. Project Engineer

Nampa, ID ยท On-site

$92K - $119K/yr

Overview: The Sr. Project Engineer role will oversee and execute the project controls and ... Direct Field Engineers to gather and prepare data for submittal or transmittal to the customer ...

Sr. Project Engineer

Nampa, ID ยท On-site

$92K - $119K/yr

Overview: The Sr. Project Engineer role will oversee and execute the project controls and ... Direct Field Engineers to gather and prepare data for submittal or transmittal to the customer ...

Sr. Project Engineer

Boise, ID ยท On-site

$94K - $122K/yr

Overview: The Sr. Project Engineer role will oversee and execute the project controls and ... Direct Field Engineers to gather and prepare data for submittal or transmittal to the customer ...

Sr. Project Engineer

Meridian, ID ยท On-site

$96K - $125K/yr

Overview: The Sr. Project Engineer role will oversee and execute the project controls and ... Direct Field Engineers to gather and prepare data for submittal or transmittal to the customer ...

Sr. Project Engineer

Nampa, ID ยท On-site

$92K - $119K/yr

Overview: The Sr. Project Engineer role will oversee and execute the project controls and ... Direct Field Engineers to gather and prepare data for submittal or transmittal to the customer ...

Sr. Project Engineer

Meridian, ID ยท On-site

$96K - $125K/yr

Overview: The Sr. Project Engineer role will oversee and execute the project controls and ... Direct Field Engineers to gather and prepare data for submittal or transmittal to the customer ...

Sr. Project Engineer

Boise, ID ยท On-site

$94K - $122K/yr

Overview: The Sr. Project Engineer role will oversee and execute the project controls and ... Direct Field Engineers to gather and prepare data for submittal or transmittal to the customer ...

Showing results 41-60

Senior Databricks Data Engineer information

What is a Senior Databricks Data engineer?

Senior Databricks Data Engineers are experienced professionals who design, develop, and optimize large-scale data processing pipelines using the Databricks platform. They work with big data technologies like Apache Spark, Delta Lake, and cloud platforms such as Azure or AWS. Their responsibilities include building and maintaining ETL processes, ensuring data quality, and collaborating with data scientists and analysts to deliver reliable, high-performance data solutions. As senior engineers, they also mentor junior team members and contribute to architectural decisions.

How does a Senior Databricks Data engineer typically collaborate with data scientists and analysts on large-scale projects?

A Senior Databricks Data Engineer works closely with data scientists and analysts to design, build, and optimize data pipelines that enable advanced analytics and machine learning initiatives. They often participate in cross-functional meetings to understand data requirements, translate them into scalable ETL processes, and ensure data quality and accessibility. Regular collaboration also involves troubleshooting data issues, optimizing Spark jobs for performance, and sharing best practices for data management. This close teamwork ensures that analytical teams have reliable, timely, and well-structured data to drive insights and decision-making.

What are the key skills and qualifications needed to thrive as a Senior Databricks Data engineer, and why are they important?

To thrive as a Senior Databricks Data Engineer, you need advanced expertise in data engineering concepts, big data technologies, and proficiency in programming languages like Python or Scala, usually backed by a bachelor's degree in computer science or a related field. Familiarity with Databricks, Apache Spark, cloud platforms (Azure, AWS, or GCP), and certifications like Databricks Certified Data Engineer are typically required. Strong problem-solving skills, effective communication, and the ability to collaborate across teams distinguish top performers in this role. These skills are essential to efficiently design scalable data solutions, optimize data workflows, and drive business insights in complex data environments.

What is the difference between Senior Databricks Data Engineer vs Data Engineer?

AspectSenior Databricks Data EngineerData Engineer
CredentialsTypically requires experience with Databricks, Spark, cloud platforms, and often certifications like Databricks Certified Data Engineer AssociateRequires knowledge of data pipelines, SQL, ETL tools, and often cloud platform experience, but less specialized in Databricks
Work EnvironmentWorks primarily within Databricks environment, focusing on big data processing and analyticsWorks across various data tools and platforms, including traditional ETL and cloud services
Industry UsageCommon in organizations leveraging Databricks for big data analytics and machine learningWidely used across industries for general data pipeline development and data management

The main difference is that a Senior Databricks Data Engineer specializes in using Databricks and Spark for big data solutions, often requiring specific certifications and experience. A Data Engineer has a broader focus on data pipeline development across various tools and platforms, with less emphasis on Databricks-specific skills.

Is a Senior Databricks Data Engineer in demand?

A Senior Databricks Data Engineer is in high demand due to the increasing adoption of cloud-based data platforms and the need for advanced data processing skills. Professionals with expertise in Spark, SQL, and cloud environments like Azure or AWS are particularly sought after in data-driven industries.

What are popular job titles related to Senior Databricks Data Engineer jobs in Idaho?

For Senior Databricks Data Engineer jobs in Idaho, the most frequently searched job titles are:

What job categories do people searching Senior Databricks Data Engineer jobs in Idaho look for?

The top searched job categories for Senior Databricks Data Engineer jobs in Idaho are:

What cities in Idaho are hiring for Senior Databricks Data Engineer jobs?

Cities in Idaho with the most Senior Databricks Data Engineer job openings:

Sr. Program Manager

Clearwater Analytics

Boise, ID โ€ข On-site

$110K - $110K/yr

Full-time

This job post hasย expired 2 days ago.ย Applications are no longer accepted.


Job description

Job Summary:
The Project Manager is responsible for defining and delivering data distribution, reporting, and analytics projects within the investment accounting and management domain. This role oversees project execution from scope definition to successful implementation, coordinating resources across internal service teams, data engineering teams, BI developers, and third-party partners to ensure the on-time, high-quality delivery of client reporting, data-sharing or insights solutions. The project manager will generate weekly status reports, hold regular project meetings with clients and the team, schedule and lead steering committee meetings with senior client decision makers and internal leadership. Serves as a trusted relationship manager ensuring timely, accurate responses to client inquiries and a smooth transition to steady-state servicing. Monitors and reports on project budgets and proactively seeks opportunities for continuous service improvements.
Responsibilities:
  • Serves as a trusted relationship manager responsible for ensuring timely, accurate, and thorough responses to all client inquiries and a successful transition to the steady-state servicing team.

  • Define and finalize the scope for reporting, data distribution, and insights/analytics projects.

  • Develop project plans, timelines, resource allocations, and risk management strategies for internal, client, and vendor participants.

  • Coordinate efforts across service teams, data engineers, BI developers, and third parties to deliver on-time, high-quality outcomes.

  • Generates weekly status reports, holds weekly status meetings with client and project team.

  • Schedules and leads steering committee meetings with C-level client decision makers and Clearwater senior management.

  • Manage and report on budget for implementation.

  • Seek out, recommend, and implement continuous service improvements.

  • Be the bridge between various business stakeholders including Client Servicing team, Sales team, and Development team.

  • Ability to run multiple simultaneous implementations with minimal oversight.

Required Skills:
  • Strong background in financial services (investment, banking, insurance, fintech).

  • Experience in data platform projects including Snowflake, data lakes, ETL workflows, and BI reporting.

  • Project manage in a matrix reporting environment.

  • Explores, trials, and provides trusted recommendations for the use of other tools and technologies as use cases arise.

  • Knowledge of investment accounting, financial reporting, data governance, and data security compliance.

  • Familiarity with Software-as-a-Service (SaaS) platforms and delivery model.

  • Strong computer skills, including proficiency in Microsoft Office.

  • Excellent attention to detail and strong documentation skills.

  • Technical skills in JIRA, Excel, Monday.com and Salesforce.

  • Outstanding verbal and written communication skills.

  • Strong organizational and interpersonal skills.

  • Exceptional problem-solving abilities.

Education and Experience:
  • Bachelor's & master's in finance, accounting, computer science or information systems.

  • 7+ years of relevant project management and implementation experience working with external clients.

  • Proven experience implementing software solutions within Asset Management, Market Data and/or Insurance space.

  • Consulting experience.

  • Securities or financial markets experience.