ZipRecruiter

Log In

1

Data Engineer Data Bricks Jobs in Calgary, AB (NOW HIRING)

ShyftLabs

Data Engineer

Calgary, AB

Position Overview We are looking for an experienced and versatile Data Engineer to join our dynamic and fast-growing team. If you are passionate about data, solving complex problems, and working ...

360training

Data Engineer (Canada)

Calgary, AB · Remote

Data Engineer We are seeking an experienced and skilled Data Engineer to join our innovative and fast-paced team. This role is vital in designing, developing, and optimizing complex data ...

Syndio

Staff Data Engineer

Calgary, AB

About the Role We're looking for a Staff Data Engineer to define the architecture and long-term evolution of Syndio's data platform as we scale into AI-driven products. This role owns the technical ...

Syndio

Staff Data Engineer

Calgary, AB · Remote

CA$180/hr

About the Role We're looking for a Staff Data Engineer to define the architecture and long-term evolution of Syndio's data platform as we scale into AI-driven products. This role owns the technical ...

Suncor

Mine Engineer, Data Analytics

Calgary, AB · On-site

Join us as a Specialist Mine Engineer, Data Analytics, and help transform complex operational data into insights that improve performance, efficiency, and decision-making across oil sands mining. In ...

Targeted Talent

Senior Data Engineer

Calgary, AB · Remote

We are looking for an experienced Senior Data Engineer for our client. This is a permanent position that is completely remote! Our client is a global enterprise company with a product that you've ...

Targeted Talent

Junior Data Engineer

Calgary, AB

We are looking for an experienced Junior Data Engineer for our client. This is a permanent position that is remote to start with later relocation to Calgary or Winnipeg . Our client is a global ...

Targeted Talent

Senior Data Engineer

Calgary, AB · Remote

We are looking for an experienced Senior Data Engineer for our client. This is a permanent position that is completely remote! Our client is a global enterprise company with a product that you've ...

United Airlines

Senior Data Engineer

Calgary, AB

CA$76K - CA$176K/yr

Job Summary We are seeking an experienced Data Engineer with strong expertise in Databricks, Apache Airflow, Python, and PySpark to design, build, and maintain scalable, high-performance data ...

Targeted Talent

Junior Data Engineer

Calgary, AB

We are looking for an experienced Junior Data Engineer for our client. This is a permanent position that is remote to start with later relocation to Calgary or Winnipeg . Our client is a global ...

Fullscript

Senior Data Engineer

Calgary, AB · Remote

CA$11K - CA$140K/yr

As the Senior Data Engineer, you'll be part of a small team that turns messy practitioner and clinical data into reliable, analysis-ready assets that enable causal outcome modeling, lab normalization ...

Miratech

Senior Data Engineer

Calgary, AB · On-site +1

The Senior Data Engineer is responsible for designing, developing, and supporting databases that power a large-scale IVR and contact center platform. The role is focused on backend database ...

next page

Showing results 1-20

All JobsData Engineer Data Bricks JobsData Engineer Data Bricks Jobs in Calgary, AB

Data Engineer Data Bricks information

What are Data Engineer Data Bricks?

A Data Engineer specializing in Databricks is a professional who designs, builds, and maintains data pipelines and infrastructure using the Databricks platform. Databricks is a cloud-based data analytics platform that facilitates big data processing, machine learning, and collaborative analytics. Data Engineers use Databricks to process large datasets, automate data workflows, and support data-driven decision-making for organizations. Their responsibilities often include cleaning and transforming data, optimizing data storage, and ensuring efficient data movement across systems.

What is the difference between Data Engineer Data Bricks vs Data Engineer Apache Spark?

AspectData Engineer Data BricksData Engineer Apache Spark
CredentialsTypically requires cloud platform certifications (Azure, AWS), Spark knowledge, and data engineering skillsRequires Spark expertise, programming skills, and often similar cloud certifications
Work EnvironmentCloud-based platforms with integrated tools, collaborative environment, managed servicesOn-premises or cloud, more manual setup, flexible environment
Industry UsagePopular in cloud-centric companies, data lakes, and analytics platformsWidely used across industries for big data processing, on-premises or cloud

Data Engineer Data Bricks focuses on cloud-based, managed Spark environments with integrated tools, while Data Engineer Apache Spark emphasizes core Spark skills applicable in various environments. Both roles require similar technical knowledge but differ mainly in platform and deployment context.

What are the key skills and qualifications needed to thrive as a Data Engineer specializing in Databricks, and why are they important?

To thrive as a Data Engineer specializing in Databricks, you need strong expertise in data modeling, ETL processes, and proficiency with programming languages such as Python or Scala, often supported by a degree in computer science or a related field. Familiarity with Databricks, Apache Spark, SQL, cloud platforms (like AWS or Azure), and relevant certifications (such as Databricks Certified Data Engineer) is typically required. Strong analytical thinking, problem-solving, and effective communication are crucial soft skills for collaborating with cross-functional teams and translating business needs into data solutions. These skills ensure efficient data pipeline development, reliable data management, and impactful analytics in data-driven organizations.

What are some common challenges Data Engineers face when working with Databricks, and how can they be addressed?

Data Engineers working with Databricks often encounter challenges related to optimizing large-scale data pipelines, managing cluster resources efficiently, and ensuring seamless data integration across varied sources. Addressing these issues typically involves staying current with Databricks best practices, such as implementing Delta Lake for reliable data storage, using job scheduling to automate workflows, and proactively monitoring cluster performance. Collaborating closely with data scientists and analysts is also crucial to align data models and streamline the analytics process.
What are popular job titles related to Data Engineer Data Bricks jobs in Calgary, AB? For Data Engineer Data Bricks jobs in Calgary, AB, the most frequently searched job titles are:
What job categories do people searching Data Engineer Data Bricks jobs in Calgary, AB look for? The top searched job categories for Data Engineer Data Bricks jobs in Calgary, AB are:
Data Engineer Data Bricks jobs near you

Data Engineer

ShyftLabs

Calgary, AB

Full-time

Medical, Dental, Vision

Posted 6 days ago

Job description

Position Overview

We are looking for an experienced and versatile Data Engineer to join our dynamic and fast-growing team. If you are passionate about data, solving complex problems, and working directly with enterprise stakeholders to translate business needs into scalable technical solutions, this role could be the perfect fit.

ShyftLabs is a growing data product company that was founded in early 2020 and works primarily with Fortune 500 companies. We deliver digital solutions built to help accelerate the growth of businesses across various industries by focusing on creating value through innovation.

In addition to strong technical expertise, we are seeking someone with strong business awareness and the ability to lead client and stakeholder communication. The ideal candidate will be comfortable collaborating with enterprise-level clients, translating complex technical concepts into business outcomes, and ensuring alignment between engineering execution and strategic objectives.

Job Responsibilities

  • Design, build, and maintain scalable and reliable batch and real-time ETL/ELT data pipelines using cloud services such as GCP Dataflow, Cloud Functions, Pub/Sub, and Cloud Composer.

  • Architect and implement robust data infrastructure capable of handling high-volume data ingestion and processing.

  • Develop and manage our central data warehouse in Google BigQuery.

  • Design and implement data models, schemas, and table structures optimized for performance, scalability, and long-term maintainability.

  • Write clean, efficient, and maintainable SQL and Python code to transform raw data into curated, analysis-ready datasets.

  • Build reliable transformation workflows that support analytics, reporting, and data science initiatives.

  • Monitor, troubleshoot, and optimize data infrastructure to ensure high performance, reliability, and cost efficiency.

  • Implement BigQuery best practices, including partitioning, clustering, query optimization, and materialized views.

  • Build and maintain curated data models that serve as the "source of truth" for business intelligence and reporting.

  • Ensure data is optimized and readily accessible for BI tools such as Looker and other analytics platforms.

  • Implement automated data quality checks, validation rules, and monitoring frameworks to ensure the integrity and reliability of data pipelines and warehouse systems.

  • Establish processes for data governance, observability, and lineage tracking.

  • Work closely with software engineers, data analysts, and data scientists to understand their data requirements and provide the necessary infrastructure and data products.

  • Lead and support client and stakeholder communication, working with enterprise clients to translate business needs into scalable data solutions.

  • Partner with product teams and leadership to ensure that technical data solutions align with business strategy and client expectations.

  • Take ownership of data platforms and architecture decisions, helping shape the future direction of our analytics and data infrastructure.

  • Identify opportunities to improve data reliability, automate workflows, and generate new insights through data.

  • Contribute to a collaborative, high-performing engineering culture with strong communication and teamwork.

Basic Qualifications

  • 5+ years of hands-on experience in data engineering, data integration, or data platform development.

  • Degree in Computer Science, Engineering, Mathematics, or related STEM discipline.

  • Strong programming and query skills in SQL and Python.

  • Experience working with distributed version control systems such as Git in an Agile/Scrum environment.

  • Experience designing and orchestrating ETL pipelines, particularly with Databricks.

  • Experience working within cloud environments (GCP, AWS, or Azure).

  • Experience with database systems such as MongoDB and Elasticsearch.

  • Strong understanding of data warehousing and dimensional modeling methodologies.

  • Hands-on experience with Airflow and Hadoop.

  • Experience using Docker for containerized workflows and reproducible environments.

  • Ability to identify opportunities to improve data quality, reliability, and automation.

  • Strong business awareness and communication skills, with the ability to collaborate with both technical teams and business stakeholders.

  • Experience within the retail industry is a plus.

Preferred Qualifications

  • Master's degree in Computer Science, Engineering, or related discipline.

  • Experience working with enterprise-scale data platforms and Fortune 500 clients.

  • Familiarity with Druid and its Python API, including Kafka integrations.

  • Strong experience using Apache Spark for large-scale data processing.

  • Experience designing real-time streaming data architectures.

  • Experience working with AI-driven platforms, data infrastructure supporting AI/ML systems, or agentic AI workflows

Why You'll Love Working at ShyftLabs
 
At ShyftLabs, your work matters. We're a growing data product company making a big impact with Fortune 500 clients and as we scale, you'll have the chance to shape solutions, influence strategy, and grow your career alongside us.
 
Here's what you can expect when you join our team:
-Work Arrangement: This role is currently fully remote, providing flexibility to work from home. As the team and organization continue to grow, there may be an opportunity for the role to transition into a hybrid work model in the future, with occasional in-office collaboration.
-Comprehensive Benefits: We cover 100% of health, dental, and vision insurance premiums for you and your dependents which means no out-of-pocket costs. Eligibility starts from day one itself.
-Growth & Learning: Access extensive learning and development resources to keep leveling up your skills.
 
Inclusion at ShyftLabs
 
We're building something big, and we want you on the journey with us. If you're ready to use data and innovation to make an impact, apply today and let's grow together.
 
ShyftLabs is an equal-opportunity employer committed to creating a safe, diverse, and inclusive environment. We encourage applicants of all backgrounds including ethnicity, religion, disability status, gender identity, sexual orientation, family status, age, and nationality to apply. If you require accommodation during the interview process, let us know and we'll be happy to support you.
apply for this job

Apply