Scottsdale, AZ · On-site
$115.80K - $139.10K/yr
... with Databricks & on-prem, structured streaming, delta lake concepts, and delta live tables ... Scala and Java programming Data lake concepts such as time travel and schema evolution and ...
Scottsdale, AZ · On-site
$115.80K - $139.10K/yr
... with Databricks & on-prem, structured streaming, delta lake concepts, and delta live tables ... Scala and Java programming Data lake concepts such as time travel and schema evolution and ...
Phoenix, AZ · Remote
$55.25 - $73.25/hr
Hadoop echo system, Spark, Databricks, and Azure-based services * Experience with medium to large ... The Data Engineer II is responsible for partnering with business unit leaders within NCR to analyze ...
Phoenix, AZ · Remote
$55.25 - $73.25/hr
Hadoop echo system, Spark, Databricks, and Azure-based services * Experience with medium to large ... The Data Engineer II is responsible for partnering with business unit leaders within NCR to analyze ...
Phoenix, AZ · On-site
$54.25 - $71.75/hr
Hadoop echo system, Spark, Databricks, and Azure-based services * Experience with medium to large ... The Data Engineer II is responsible for partnering with business unit leaders within NCR to analyze ...
Phoenix, AZ · On-site
$54.25 - $71.75/hr
Hadoop echo system, Spark, Databricks, and Azure-based services * Experience with medium to large ... The Data Engineer II is responsible for partnering with business unit leaders within NCR to analyze ...
Tempe, AZ · On-site
$99.60K - $156.50K/yr
Bachelor's Degree in Computer Science, Data Science, Engineering or equivalent software/services experience - Required * 4 years of experience in Working with SQL, Snowflake, Databricks, Spark and/or ...
Tempe, AZ · On-site
$99.60K - $156.50K/yr
Bachelor's Degree in Computer Science, Data Science, Engineering or equivalent software/services experience - Required * 4 years of experience in Working with SQL, Snowflake, Databricks, Spark and/or ...
Phoenix, AZ · On-site
$105.20K - $143K/yr
Design technical solutions for data pipelines leveraging technologies like Databricks and Snowflake to achieve optimal performance. Qualifications - 5+ years of experience working as a data engineer ...
Phoenix, AZ · On-site
$105.20K - $143K/yr
Design technical solutions for data pipelines leveraging technologies like Databricks and Snowflake to achieve optimal performance. Qualifications - 5+ years of experience working as a data engineer ...
$99.60K - $156.50K/yr
Bachelor's Degree in Computer Science, Data Science, Engineering or equivalent software/services experience - Required * 4 years of experience in Working with SQL, Snowflake, Databricks, Spark and/or ...
$99.60K - $156.50K/yr
Bachelor's Degree in Computer Science, Data Science, Engineering or equivalent software/services experience - Required * 4 years of experience in Working with SQL, Snowflake, Databricks, Spark and/or ...
Fountain Hills, AZ · On-site
$117K - $140.50K/yr
... Databricks & on Prem, Structured Streaming, Delta Lake concepts, and Delta Live Tables required • Experience with Spark Scala and Java programming • Data Lake concepts such as time travel and ...
Fountain Hills, AZ · On-site
$117K - $140.50K/yr
... Databricks & on Prem, Structured Streaming, Delta Lake concepts, and Delta Live Tables required • Experience with Spark Scala and Java programming • Data Lake concepts such as time travel and ...
Scottsdale, AZ · On-site
$78.18/hr
... Factory, Databricks, and Power BI, to transform and visualize data within a financial services ... data engineering and Power BI Requirements: Bachelor's degree in Computer Science or Information ...
Scottsdale, AZ · On-site
$78.18/hr
... Factory, Databricks, and Power BI, to transform and visualize data within a financial services ... data engineering and Power BI Requirements: Bachelor's degree in Computer Science or Information ...
Phoenix, AZ · On-site
$113.70K - $136.50K/yr
Azure Databricks * Azure Synapse Analytics * Azure Functions * Azure Blob Storage * Azure Logic Apps * C#,.NET/SQL Server. * Azure synapse * Azure DevOps * Azure Storage/ Data Lake * Extraction ...
Phoenix, AZ · On-site
$113.70K - $136.50K/yr
Azure Databricks * Azure Synapse Analytics * Azure Functions * Azure Blob Storage * Azure Logic Apps * C#,.NET/SQL Server. * Azure synapse * Azure DevOps * Azure Storage/ Data Lake * Extraction ...
Phoenix, AZ · On-site
Azure Databricks Engineer - Python / Synapse / Multi-Cloud Data Integration Location: Phoenix, AZ / Philadelphia, PA Competencies Must-Have: * Stellar hands-on expertise in Python for data ...
Phoenix, AZ · On-site
Azure Databricks Engineer - Python / Synapse / Multi-Cloud Data Integration Location: Phoenix, AZ / Philadelphia, PA Competencies Must-Have: * Stellar hands-on expertise in Python for data ...
Phoenix, AZ · On-site
Azure Databricks Engineer - Python / Synapse / Multi-Cloud Data Integration Location: Phoenix, AZ / Philadelphia, PA Competencies Must-Have: * Stellar hands-on expertise in Python for data ...
Phoenix, AZ · On-site
Azure Databricks Engineer - Python / Synapse / Multi-Cloud Data Integration Location: Phoenix, AZ / Philadelphia, PA Competencies Must-Have: * Stellar hands-on expertise in Python for data ...
Phoenix, AZ · On-site
$113.70K - $136.50K/yr
Data Engineer Location: Phoenix, AZ(Hybrid) Job Type: FTE Key Responsibilities Data Platform ... Design, develop, and maintain cloud-native data pipelines using Databricks, Microsoft Azure Data ...
Phoenix, AZ · On-site
$113.70K - $136.50K/yr
Data Engineer Location: Phoenix, AZ(Hybrid) Job Type: FTE Key Responsibilities Data Platform ... Design, develop, and maintain cloud-native data pipelines using Databricks, Microsoft Azure Data ...
$113.70K - $136.50K/yr
Databricks Nice to have: Informatica/ETL. Responsibilities * Design and develop ETL processes based ... Proven working experience as a data engineer * Bachelor degree or equivalent in Computer Science
Quick apply
$113.70K - $136.50K/yr
Databricks Nice to have: Informatica/ETL. Responsibilities * Design and develop ETL processes based ... Proven working experience as a data engineer * Bachelor degree or equivalent in Computer Science
Scottsdale, AZ · On-site
$115.80K - $139.10K/yr
Data Engineer I-(DE) Location: Scottsdale AZ (day 1 onsite) Duration: CTH and Fulltime Must have ... with Databricks & on Prem, Structured Streaming, Delta Lake concepts, and Delta Live Tables ...
Scottsdale, AZ · On-site
$115.80K - $139.10K/yr
Data Engineer I-(DE) Location: Scottsdale AZ (day 1 onsite) Duration: CTH and Fulltime Must have ... with Databricks & on Prem, Structured Streaming, Delta Lake concepts, and Delta Live Tables ...
Glendale, AZ · On-site
$103.60K - $124.40K/yr
Data Engineer Design, develop, and optimize scalable and efficient data processing pipelines and architectures within Azure Data Lake and Databricks, leveraging best practices for performance and ...
Glendale, AZ · On-site
$103.60K - $124.40K/yr
Data Engineer Design, develop, and optimize scalable and efficient data processing pipelines and architectures within Azure Data Lake and Databricks, leveraging best practices for performance and ...
CI/CD & DevOps: Experience with Infrastructure as Code (Terraform), data build tool (dbt), testing ... Preferred Certifications Databricks Certified Data Engineer Associate / Professional Databricks ...
CI/CD & DevOps: Experience with Infrastructure as Code (Terraform), data build tool (dbt), testing ... Preferred Certifications Databricks Certified Data Engineer Associate / Professional Databricks ...
The ideal candidate will possess deep architectural knowledge of Azure Data Lake and Databricks, a ... Azure certifications, such as Azure Data Engineer Associate or Azure Solutions Architect Expert.
The ideal candidate will possess deep architectural knowledge of Azure Data Lake and Databricks, a ... Azure certifications, such as Azure Data Engineer Associate or Azure Solutions Architect Expert.
Databricks Certified Data Engineer Associate / Professional * Databricks Certified Solutions Architect * AWS Certified Database Specialist or equivalent Cloud Certifications
Databricks Certified Data Engineer Associate / Professional * Databricks Certified Solutions Architect * AWS Certified Database Specialist or equivalent Cloud Certifications
Databricks Certified Data Engineer Associate / Professional * Databricks Certified Solutions Architect * AWS Certified Database Specialist or equivalent Cloud Certifications
Databricks Certified Data Engineer Associate / Professional * Databricks Certified Solutions Architect * AWS Certified Database Specialist or equivalent Cloud Certifications
Solution Data Engineer - DG Infomatica Engineer Company: CK Global Tech Department: Enterprise ... Support data lineage and impact analysis across Snowflake, Databricks, and relational databases
Solution Data Engineer - DG Infomatica Engineer Company: CK Global Tech Department: Enterprise ... Support data lineage and impact analysis across Snowflake, Databricks, and relational databases
| Aspect | Temporary Databricks Data Engineer | Temporary Spark Data Engineer |
|---|---|---|
| Required Skills | Databricks platform, Spark, SQL, Python, cloud services | Apache Spark, Scala, Python, SQL, cloud environments |
| Certifications | Databricks Certified Data Engineer, cloud certifications | Apache Spark certifications, cloud certifications |
| Work Environment | Cloud-based Databricks platform, collaborative environment | On-premises or cloud Spark clusters, flexible environments |
| Industry Usage | Data engineering projects leveraging Databricks platform | Big data processing using Spark in various environments |
While both roles involve Spark and cloud skills, a Temporary Databricks Data Engineer specializes in the Databricks platform, offering integrated tools and collaborative features. A Temporary Spark Data Engineer focuses on Spark core technology, often working in diverse environments. The choice depends on the specific platform and tools used by the employer.
$115.80K - $139.10K/yr
Other
This job post has expired 1 day ago. Applications are no longer accepted.
Must have: Skillset: Java, Scala, S3, Glue, AWS, Redshift
6-8 years of IT experience focusing on enterprise data architecture and management.
Experience in conceptual/logical/physical data modeling and expertise in relational and dimensional data modeling
Experience with Databricks & on-prem, structured streaming, delta lake concepts, and delta live tables required
Experience with Spark Scala and Java programming
Data lake concepts such as time travel and schema evolution and optimization
Structured streaming and delta live tables with Databricks as a bonus
Experience leading and architecting enterprise-wide initiatives specifically system integration, data migration, transformation, data warehouse build, data mart build, and data lakes implementation/support
Advanced level understanding of streaming data pipelines and how they differ from batch systems
Formalize concepts of how to handle late data, defining windows, and data freshness
Advanced understanding of ETL and ELT and ETL/ELT tools such as Data Migration Service etc
Understanding of concepts and implementation strategies for different incremental data loads such as tumbling window, sliding window, high watermarks, etc.
Familiarity and/or expertise with Great Expectations or other data quality/data validation frameworks a bonus
Familiarity with concepts such as late data, defining windows, and how window definitions impact data freshness
Advanced level SQL experience (joins, aggregation, windowing functions, common table expressions, RDBMS schema design performance optimization)
Indexing and partitioning strategy experience
Debug, troubleshoot, design, and implement solutions to complex technical issues
Experience with large-scale, high-performance enterprise big data application deployment and solution
Architecture experience in AWS environment a bonus
Familiarity working with Lambda specifically with how to push and pull data, how to use AWS tools to view data for processing massive data at scale a bonus
Experience with Gitlabs and CloudWatch and ability to write and maintain Gitlabs for supporting CI/CD pipelines
Experience working with AWS Lambdas for configuration and optimization and experience with S3
Familiarity with Schema Registry, and message formats such as Avro, ORC, etc.
