1

Senior Databricks Data Engineer Jobs in Idaho (NOW HIRING)

Data Engineer III

Boise, ID · On-site

$109K - $130K/yr

The Data Engineer III utilizes modern cloud data tools, distributed processing frameworks, and ... Build and support scalable cloud data solutions using Databricks, PySpark, SQL, and Azure-based ...

Data Engineer III

Boise, ID · On-site

$109K - $130K/yr

The Data Engineer III utilizes modern cloud data tools, distributed processing frameworks, and ... Build and support scalable cloud data solutions using Databricks, PySpark, SQL, and Azure-based ...

Data Engineer III

Boise, ID · On-site

$109K - $130K/yr

The Data Engineer III utilizes modern cloud data tools, distributed processing frameworks, and ... Build and support scalable cloud data solutions using Databricks, PySpark, SQL, and Azure-based ...

Data Engineer III

Boise, ID

$109K - $130K/yr

The Data Engineer III utilizes modern cloud data tools, distributed processing frameworks, and ... Build and support scalable cloud data solutions using Databricks, PySpark, SQL, and Azure-based ...

Data Engineer III

Boise, ID · On-site

$99K - $118K/yr

... DevOps, Databricks, SQL, and Data Modeling. • Strong verbal and written communication skills, contributing to team design activities and documentation. • Can apply critical thinking skills to ...

Senior Data & AI Platform Engineer

Boise, ID · On-site

$64 - $85.75/hr

This is a senior engineering role. You will architect, operate, and continuously improve cloud data and analytics platforms (e.g., Microsoft Fabric, Snowflake, Databricks) and own BI delivery ...

As a Senior Data Engineer at Corporate Tools, you will work closely with our Software and Analyst teams to manage everything that has to do with data. This role will help get large datasets into the ...

Data & AI Platform Engineer

Boise, ID · On-site

$109K - $130K/yr

... senior engineers. Job Responsibilities Platform Operations & Enablement * Support day-to-day ... Snowflake (preferred) or Microsoft Fabric or Databricks * A BI platform: Power BI or Tableau * CI ...

Senior Data Engineer

Boise, ID · On-site

$100K - $137K/yr

... a Senior Data Engineer or a similar role, preferably in the data management or analytics software industry. * Solid understanding of SQL and good grasp of relational and analytical database ...

Senior Data Engineer

Boise, ID · On-site

$110 - $150/hr

... as a Senior Data Engineer or a similar role,preferably in the data management or analytics software industry. * Solid understanding of SQL and good grasp of relational and analytical database ...

New

AI Data Engineer

Boise, ID

$109K - $130K/yr

As Senior AI Analytics Engineer, you will design and ship the AI agents, applications, and ... You'll sit closer to the business than a traditional data engineer. The job starts with a business ...

Data Platform Manager

Boise, ID · On-site

$140 - $180/hr

Strong technical background in data engineering, cloud services, and data platforms, like Databricks, and business intelligence platforms, like PowerBI. * Experience with the following technologies ...

Strong technical background in data engineering, cloud services, and data platforms, like Databricks, and business intelligence platforms, like PowerBI. * Experience with the following technologies ...

next page

Showing results 1-20

Senior Databricks Data Engineer information

What is a Senior Databricks Data engineer?

Senior Databricks Data Engineers are experienced professionals who design, develop, and optimize large-scale data processing pipelines using the Databricks platform. They work with big data technologies like Apache Spark, Delta Lake, and cloud platforms such as Azure or AWS. Their responsibilities include building and maintaining ETL processes, ensuring data quality, and collaborating with data scientists and analysts to deliver reliable, high-performance data solutions. As senior engineers, they also mentor junior team members and contribute to architectural decisions.

How does a Senior Databricks Data engineer typically collaborate with data scientists and analysts on large-scale projects?

A Senior Databricks Data Engineer works closely with data scientists and analysts to design, build, and optimize data pipelines that enable advanced analytics and machine learning initiatives. They often participate in cross-functional meetings to understand data requirements, translate them into scalable ETL processes, and ensure data quality and accessibility. Regular collaboration also involves troubleshooting data issues, optimizing Spark jobs for performance, and sharing best practices for data management. This close teamwork ensures that analytical teams have reliable, timely, and well-structured data to drive insights and decision-making.

What are the key skills and qualifications needed to thrive as a Senior Databricks Data engineer, and why are they important?

To thrive as a Senior Databricks Data Engineer, you need advanced expertise in data engineering concepts, big data technologies, and proficiency in programming languages like Python or Scala, usually backed by a bachelor's degree in computer science or a related field. Familiarity with Databricks, Apache Spark, cloud platforms (Azure, AWS, or GCP), and certifications like Databricks Certified Data Engineer are typically required. Strong problem-solving skills, effective communication, and the ability to collaborate across teams distinguish top performers in this role. These skills are essential to efficiently design scalable data solutions, optimize data workflows, and drive business insights in complex data environments.

What is the difference between Senior Databricks Data Engineer vs Data Engineer?

AspectSenior Databricks Data EngineerData Engineer
CredentialsTypically requires experience with Databricks, Spark, cloud platforms, and often certifications like Databricks Certified Data Engineer AssociateRequires knowledge of data pipelines, SQL, ETL tools, and often cloud platform experience, but less specialized in Databricks
Work EnvironmentWorks primarily within Databricks environment, focusing on big data processing and analyticsWorks across various data tools and platforms, including traditional ETL and cloud services
Industry UsageCommon in organizations leveraging Databricks for big data analytics and machine learningWidely used across industries for general data pipeline development and data management

The main difference is that a Senior Databricks Data Engineer specializes in using Databricks and Spark for big data solutions, often requiring specific certifications and experience. A Data Engineer has a broader focus on data pipeline development across various tools and platforms, with less emphasis on Databricks-specific skills.

Is a Senior Databricks Data Engineer in demand?

A Senior Databricks Data Engineer is in high demand due to the increasing adoption of cloud-based data platforms and the need for advanced data processing skills. Professionals with expertise in Spark, SQL, and cloud environments like Azure or AWS are particularly sought after in data-driven industries.

What are popular job titles related to Senior Databricks Data Engineer jobs in Idaho?

For Senior Databricks Data Engineer jobs in Idaho, the most frequently searched job titles are:

What job categories do people searching Senior Databricks Data Engineer jobs in Idaho look for?

The top searched job categories for Senior Databricks Data Engineer jobs in Idaho are:

What cities in Idaho are hiring for Senior Databricks Data Engineer jobs?

Cities in Idaho with the most Senior Databricks Data Engineer job openings:

Data Engineer III

Simplot Company

Boise, ID • On-site

$109K - $130K/yr

Full-time

Re-posted 16 days ago


J.R. Simplot rating

7.1

Company rating: 7.1 out of 10

Based on 48 frontline employees who took The Breakroom Quiz

217th of 444 rated food and drinks producers


Job description

Simplot is a family-owned, privately held global food and agriculture company headquartered in Boise, Idaho. Its integrated portfolio of companies includes food processing and food brands, phosphate mining, fertilizer manufacturing, farming, ranching and cattle production, and other enterprises related to agriculture. Simplot has major operations in nine countries with products and services available to customers worldwide.SummaryThis role applies intermediate to advanced data engineering principles, theories, and concepts to solve a range of data and platform challenges of varying complexity. The Data Engineer III utilizes modern cloud data tools, distributed processing frameworks, and professional knowledge acquired through specialized training, education, and experience. The role exercises professional judgment-from limited to independent decision-making-within defined standards and practices to determine and execute appropriate technical actions.The position develops practical expertise across data engineering domains including SQL-based transformation and modeling, cloud-native data platforms, and large-scale data processing using PySpark. The engineer acts as a collaborative and informed team member by providing technical analysis and recommendations in support of team and business outcomes, evaluating data engineering challenges and contributing to solution development through well-reasoned technical guidance.Why This Role is ExcitingWork with Leading Tools: Build and support scalable cloud data solutions using Databricks, PySpark, SQL, and Azure-based services.Expand Your Expertise: Grow skills in distributed data processing, data modeling, automation, and CI/CD within a modern lakehouse architecture.Join an Innovative Team: Be part of a data engineering team with a strong history of delivering robust, reliable, and scalable data solutions that support enterprise analytics and decision-making.Key ResponsibilitiesParticipates as a member of a data engineering team responsible for cloud data platforms and pipelinesMentors and guides other engineersConducts thorough analysis of technical and data requirements ranging from moderate to advanced complexity to support solution design and implementationDesigns, builds, and maintains data pipelines and transformations using SQL, Python, and PySparkDesigns, prepares and executes manual and/or automated test plans and scriptsLeverages advanced data engineering expertise to perform routine and complex maintenance, optimization, and production support, ensuring reliability, scalability, and performanceCollaborates effectively with business, analytics, and technical teams, leveraging strong interpersonal skills to drive alignment and trust in data solutionsDemonstrates technical leadership and exerts influence beyond immediate teamDesign, implement, and manage CI/CD pipelines for automated software deliveryBuild and maintain infrastructure as code (IaC) solutions using tools like TerraformSupport the release process by working closely with engineering teams to improve deployment speed and reliabilityMaintain documentation on new and existing implementations and practicesPresent and train the data engineering organization on innovations, best practices, and implementationsTypical EducationBachelor's degree (B.A. or B.S.) from 4 year college or university in Computer Science, Information Technology, Engineering, or related field.Relevant Experience5+ years data engineering experience and/or trainingAdvanced understanding of data engineering concepts with the ability to address complex data and platform challengesStrong proficiency in SQL for data transformation, optimization, and modelingProficient in one or more programming languages such as Python or .NETProficient in data application development using frameworks like Shiny, Streamlit, Gradle, and FastAPIExperience with Azure DevOps, Databricks, SQL, and Data ModelingExperience with infrastructure as code (IaC) tools (Terraform, Ansible, CloudFormation)Advanced understanding of version control systems (Git, SVN)Strong verbal and written communication skills, contributing to team design activities and documentationCan apply critical thinking skills to solving problems and a strong technical aptitudeExperience delivering data solutions through agile software development methodologiesPreferred (Nice to Have) QualificationsHands-on experience with PySpark and Databricks for building and operating scalable data solutionsProficiency in Python for data engineering workflows and automationExperience working in Azure-based data platforms such as Databricks, Azure Data Lake, and Azure DevOpsExperience delivering data solutions using Agile software development methodologiesExperience supporting or enabling analytics, BI, or data science workloadsOther InformationThis role reports to office at Simplot Headquarters in Boise, ID full-time.Job Requisition ID:26003Travel Required:Location(s):Simplot Headquarters - BoiseCountry:United States**The J.R. Simplot Company is proud to be an Equal Opportunity Employer and will consider all qualified applicants for employment without regard to race, color, religion, national origin, ancestry, age, sex, gender, gender identity, gender expression, genetic information, physical or mental disability, medical condition, sexual orientation, military or veteran status, marital status, or any other protected status. **#LI-MH1

What J.R. Simplot employees say

Pay

Benefits

Hours and flexibility

Workplace

Get the full story on Breakroom


Simplot logo

About Simplot

Sourced by ZipRecruiter

The J.R. Simplot Company is a diverse, privately held organization, with roots firmly planted in agriculture and agriculture-related businesses. The J.R. Simplot Company is a true farm-to-table company with operations that touch every aspect of agriculture, including seed production, farming and ranching, plant sciences, fertilizer manufacturing, food processing, commercial product development, and distribution.

Industry

Agriculture

Company size

10,000+ Employees

Headquarters location

Boise, ID, US

Social media