Databricks Certified Data Engineer Associate / Professional * Databricks Certified Solutions Architect * AWS Certified Database Specialist or equivalent Cloud Certifications
Databricks Certified Data Engineer Associate / Professional * Databricks Certified Solutions Architect * AWS Certified Database Specialist or equivalent Cloud Certifications
Data Engineer - Manager
Phoenix, AZ · On-site
$99K - $232K/yr
... Data Engineer - Manager, you will play a pivotal role in transforming raw data into actionable ... Databricks and Snowflake - Guiding team members in data architecture development and database ...
Data Engineer - Manager
Phoenix, AZ · On-site
$99K - $232K/yr
... Data Engineer - Manager, you will play a pivotal role in transforming raw data into actionable ... Databricks and Snowflake - Guiding team members in data architecture development and database ...
Senior Data Engineer - Work From Home
Phoenix, AZ · On-site +1
$105K - $143K/yr
Keywords: Phoenix AZ Jobs, Senior Data Engineer, Snowflake, Databricks, Redshift, Airflow, DBT, Looker, Tableau, Sigma, SQL, Python, Scala, Business Intelligence, BI, Data Science, Quantitative ...
Senior Data Engineer - Work From Home
Phoenix, AZ · On-site +1
$105K - $143K/yr
Keywords: Phoenix AZ Jobs, Senior Data Engineer, Snowflake, Databricks, Redshift, Airflow, DBT, Looker, Tableau, Sigma, SQL, Python, Scala, Business Intelligence, BI, Data Science, Quantitative ...
GenAI Python Systems Engineer-Manager
Phoenix, AZ · On-site
$99K - $232K/yr
Azure Solutions Architect Expert, Azure Data Engineer Associate, Snowflake Core, Snowflake Databricks Data Engineer Associate] is a plus - Proficient in Python and SQL - Experience with Docker and ...
GenAI Python Systems Engineer-Manager
Phoenix, AZ · On-site
$99K - $232K/yr
Azure Solutions Architect Expert, Azure Data Engineer Associate, Snowflake Core, Snowflake Databricks Data Engineer Associate] is a plus - Proficient in Python and SQL - Experience with Docker and ...
Solution Data Engineer - DG Infomatica Engineer COMPANY: CK Global Tech DEPARTMENT: Enterprise ... Support data lineage and impact analysis across Snowflake, Databricks, and relational databases
Solution Data Engineer - DG Infomatica Engineer COMPANY: CK Global Tech DEPARTMENT: Enterprise ... Support data lineage and impact analysis across Snowflake, Databricks, and relational databases
Data Engineering Lead Location: Glendale, AZ - Hybrid/Onsite Duration : 6 TO 12 Months Contract ... The ideal candidate will possess deep architectural knowledge of Azure Data Lake and Databricks, a ...
Data Engineering Lead Location: Glendale, AZ - Hybrid/Onsite Duration : 6 TO 12 Months Contract ... The ideal candidate will possess deep architectural knowledge of Azure Data Lake and Databricks, a ...
Solution Data Engineer - DG Infomatica Engineer COMPANY: CK Global Tech DEPARTMENT: Enterprise ... Support data lineage and impact analysis across Snowflake, Databricks, and relational databases
Solution Data Engineer - DG Infomatica Engineer COMPANY: CK Global Tech DEPARTMENT: Enterprise ... Support data lineage and impact analysis across Snowflake, Databricks, and relational databases
GenAI Python Systems Engineer -Senior Manager
Phoenix, AZ · On-site
$124K - $280K/yr
Azure Solutions Architect Expert, Azure Data Engineer Associate, Snowflake Core, Snowflake Databricks Data Engineer Associate] is a plus - Proficient in Python and structured/unstructured data ...
GenAI Python Systems Engineer -Senior Manager
Phoenix, AZ · On-site
$124K - $280K/yr
Azure Solutions Architect Expert, Azure Data Engineer Associate, Snowflake Core, Snowflake Databricks Data Engineer Associate] is a plus - Proficient in Python and structured/unstructured data ...
Deep expertise with cloud-based data tools (Azure, Databricks, Synapse, Snowflake, or similar ... Experience mentoring other engineers and influencing engineering best practices. Preferred ...
Deep expertise with cloud-based data tools (Azure, Databricks, Synapse, Snowflake, or similar ... Experience mentoring other engineers and influencing engineering best practices. Preferred ...
Principal Data Engineer
Tempe, AZ · On-site
Deep expertise with cloud-based data tools (Azure, Databricks, Synapse, Snowflake, or similar ... Experience mentoring other engineers and influencing engineering best practices. Preferred ...
Principal Data Engineer
Tempe, AZ · On-site
Deep expertise with cloud-based data tools (Azure, Databricks, Synapse, Snowflake, or similar ... Experience mentoring other engineers and influencing engineering best practices. Preferred ...
Deep expertise with cloud-based data tools (Azure, Databricks, Synapse, Snowflake, or similar ... Experience mentoring other engineers and influencing engineering best practices. Preferred ...
Deep expertise with cloud-based data tools (Azure, Databricks, Synapse, Snowflake, or similar ... Experience mentoring other engineers and influencing engineering best practices. Preferred ...
Data Engineer II
Phoenix, AZ · On-site +1
$108K - $130K/yr
The Data Engineer II designs, builds, and maintains data pipelines and infrastructure that bring ... Knowledge of Microsoft Azure data related services such as Data Lake, Data Factory, Databricks, and ...
Data Engineer II
Phoenix, AZ · On-site +1
$108K - $130K/yr
The Data Engineer II designs, builds, and maintains data pipelines and infrastructure that bring ... Knowledge of Microsoft Azure data related services such as Data Lake, Data Factory, Databricks, and ...
Databricks Administrator
Phoenix, AZ · On-site
... Databricks, Apache Spark, Delta Lake, and modern data engineering practices ... Collaborates with data engineers, data scientists, analysts, business stakeholders, and technology ...
Databricks Administrator
Phoenix, AZ · On-site
... Databricks, Apache Spark, Delta Lake, and modern data engineering practices ... Collaborates with data engineers, data scientists, analysts, business stakeholders, and technology ...
Databricks Administrator
Tempe, AZ · On-site
... Databricks, Apache Spark, Delta Lake, and modern data engineering practices ... Collaborates with data engineers, data scientists, analysts, business stakeholders, and technology ...
Databricks Administrator
Tempe, AZ · On-site
... Databricks, Apache Spark, Delta Lake, and modern data engineering practices ... Collaborates with data engineers, data scientists, analysts, business stakeholders, and technology ...
Databricks Administrator
Tempe, AZ · On-site
... Databricks, Apache Spark, Delta Lake, and modern data engineering practices ... Collaborates with data engineers, data scientists, analysts, business stakeholders, and technology ...
Databricks Administrator
Tempe, AZ · On-site
... Databricks, Apache Spark, Delta Lake, and modern data engineering practices ... Collaborates with data engineers, data scientists, analysts, business stakeholders, and technology ...
... Databricks, Apache Spark, Delta Lake, and modern data engineering practices ... Collaborates with data engineers, data scientists, analysts, business stakeholders, and technology ...
... Databricks, Apache Spark, Delta Lake, and modern data engineering practices ... Collaborates with data engineers, data scientists, analysts, business stakeholders, and technology ...
... Databricks, Apache Spark, Delta Lake, and modern data engineering practices ... Collaborates with data engineers, data scientists, analysts, business stakeholders, and technology ...
... Databricks, Apache Spark, Delta Lake, and modern data engineering practices ... Collaborates with data engineers, data scientists, analysts, business stakeholders, and technology ...
Data Engineer - Senior Associate
$77K - $202K/yr
... Engineer - Senior Associate, you will focus on designing and building data infrastructure and ... Databricks Unified Data Analytics Platform for advanced data analytics and visualization ...
Data Engineer - Senior Associate
$77K - $202K/yr
... Engineer - Senior Associate, you will focus on designing and building data infrastructure and ... Databricks Unified Data Analytics Platform for advanced data analytics and visualization ...
Senior Manager Data Architecture
Tempe, AZ · On-site
$65.50 - $87.50/hr
... data engineering, BI, analytics, platform, governance, product, and business leaders. • Guide ... Snowflake, Databricks, lakehouse, warehouse, and data product patterns. • Stay technically ...
Senior Manager Data Architecture
Tempe, AZ · On-site
$65.50 - $87.50/hr
... data engineering, BI, analytics, platform, governance, product, and business leaders. • Guide ... Snowflake, Databricks, lakehouse, warehouse, and data product patterns. • Stay technically ...
Data Engineer-- Phoenix, AZ (Hybrid) 85255 on W2
Scottsdale, AZ · On-site
$70 - $80/hr
... Databricks. • Experience working with Azure data lake storage and Azure SQL Databases. • ... Azure DevOps, GitHub, and Jenkins. • Experience working on an Agile Development team and ...
Quick apply
Data Engineer-- Phoenix, AZ (Hybrid) 85255 on W2
Scottsdale, AZ · On-site
$70 - $80/hr
... Databricks. • Experience working with Azure data lake storage and Azure SQL Databases. • ... Azure DevOps, GitHub, and Jenkins. • Experience working on an Agile Development team and ...
Temporary Databricks Data Engineer information
What is the difference between Temporary Databricks Data Engineer vs Temporary Spark Data Engineer?
| Aspect | Temporary Databricks Data Engineer | Temporary Spark Data Engineer |
|---|---|---|
| Required Skills | Databricks platform, Spark, SQL, Python, cloud services | Apache Spark, Scala, Python, SQL, cloud environments |
| Certifications | Databricks Certified Data Engineer, cloud certifications | Apache Spark certifications, cloud certifications |
| Work Environment | Cloud-based Databricks platform, collaborative environment | On-premises or cloud Spark clusters, flexible environments |
| Industry Usage | Data engineering projects leveraging Databricks platform | Big data processing using Spark in various environments |
While both roles involve Spark and cloud skills, a Temporary Databricks Data Engineer specializes in the Databricks platform, offering integrated tools and collaborative features. A Temporary Spark Data Engineer focuses on Spark core technology, often working in diverse environments. The choice depends on the specific platform and tools used by the employer.
Job description
Job Title: Lead Data Platform Architect / Data bricks Migration Lead
Location: Remote
Position Type: Contract
Job Overview
We are seeking an accomplished, technology-driven Lead Data Platform Architect / Migration Specialist to spearhead the modernization of our core enterprise financial and tax allocation engines. In this role, you will lead the architectural design, definition of migration strategies, and hands-on implementation to transition large-scale legacy relational database systems (SQL Server/T-SQL) into a modern, cloud-native Databricks Lakehouse platform.
The ideal candidate will have extensive experience in high-throughput distributed systems, Databricks compute optimization, performance tuning, and complex pipeline orchestration.
Key Responsibilities
- Architecture & Strategy: Validate, refine, and own the target architecture on Databricks. Define robust migration strategies and production-ready reference patterns to convert 150+ complex stored procedures into PySpark and Structured/Declarative Pipelines (SDP).
- Pipeline Engineering: Design distributed processing frameworks, control flows, and configuration-driven parameter handling for both full and incremental recalculation modes.
- Performance Optimization: Address performance deltas between small and large workloads. Architect and implement acceleration techniques such as caching, partition pruning, cluster sizing, and offline/pre-calculation strategies to maintain sub-30-second user-facing reporting SLAs.
- Orchestration & Observability: Design and deploy enterprise-level pipeline orchestration using tools like Apache Airflow or Databricks Workflows. Integrate robust logging, error handling, and observability patterns into existing enterprise monitoring frameworks.
- Governance & Security: Implement data governance models, data lineage, and schema evolution utilizing tools like Unity Catalog.
- AI-Assisted Delivery & Code Quality: Establish best practices for AI-assisted code generation (e.g., using Claude or advanced LLMs), providing code-review patterns and refactoring frameworks to ensure maintainable and performant output.
- Team Enablement: Lead code walkthroughs, design reviews, and pair-programming sessions with the development team to accelerate knowledge transfer and technical excellence.
- Core Big Data Platform: Deep expert-level knowledge of Databricks (Lakehouse architecture, Delta Lake, Unity Catalog) and Apache Spark / PySpark.
- Legacy Database Expertise: Strong background in relational databases, with advanced proficiency in SQL Server, T-SQL, and Stored Procedures. Ability to reverse-engineer and refactor legacy database logic into distributed paradigms.
- Orchestration Tools: Hands-on experience with Apache Airflow or similar modern workflow orchestrators.
- Performance Tuning: Proven track record in cost optimization (FinOps), cluster tuning, autoscaling configurations, and handling skewed data profiles.
- CI/CD & DevOps: Experience with Infrastructure as Code (Terraform), data build tool (dbt), testing frameworks (PyTest), and automated Git-based workflows.
- Experience Level: 10+ years of experience in Data Engineering/Architecture, with at least 3+ years specifically leading large-scale cloud data migrations.
Education: Bachelor's or Master's degree in Computer Science, Engineering, or a related technical field.
- Databricks Certified Data Engineer Associate / Professional
- Databricks Certified Solutions Architect
- AWS Certified Database Specialist or equivalent Cloud Certifications
About Koantek
Sourced by ZipRecruiter
Industry
It services
Company size
11 - 50 Employees
Headquarters location
Chandler, AZ, US
Year founded
2020