... of Data Architecture concepts in Big Data ecosystem (MUST). - Understanding of Enterprise Architecture concepts in AWS ecosystem(MUST). - Hands-on experience in AWS-(S3 Databricks RedShift)(MUST ...
... of Data Architecture concepts in Big Data ecosystem (MUST). - Understanding of Enterprise Architecture concepts in AWS ecosystem(MUST). - Hands-on experience in AWS-(S3 Databricks RedShift)(MUST ...
Data Engineer
Auburn Hills, MI · On-site
$108K - $130K/yr
Designs, builds and maintains scalable ETL/ELT pipelines using Databricks, Apache Spark, and Delta Lake * Develops and optimizes data workflows for batch and streaming data processing * Architects ...
Data Engineer
Auburn Hills, MI · On-site
$108K - $130K/yr
Designs, builds and maintains scalable ETL/ELT pipelines using Databricks, Apache Spark, and Delta Lake * Develops and optimizes data workflows for batch and streaming data processing * Architects ...
Data Engineer
$108K - $130K/yr
Designs, builds and maintains scalable ETL/ELT pipelines using Databricks, Apache Spark, and Delta Lake * Develops and optimizes data workflows for batch and streaming data processing * Architects ...
Data Engineer
$108K - $130K/yr
Designs, builds and maintains scalable ETL/ELT pipelines using Databricks, Apache Spark, and Delta Lake * Develops and optimizes data workflows for batch and streaming data processing * Architects ...
Data Engineer
Warren, MI · On-site
$107K - $129K/yr
... Databricks and between enterprise applications, including solutions that leverage DataStage and related integration technologies. You will partner closely with product owners, architects, data ...
Data Engineer
Warren, MI · On-site
$107K - $129K/yr
... Databricks and between enterprise applications, including solutions that leverage DataStage and related integration technologies. You will partner closely with product owners, architects, data ...
Own the end-to-end integration and data architecture across Finance Operate Platform layers ... Lead platform decisions on data tooling (Databricks vs. Alteryx vs. other) based on use case, scale ...
Own the end-to-end integration and data architecture across Finance Operate Platform layers ... Lead platform decisions on data tooling (Databricks vs. Alteryx vs. other) based on use case, scale ...
Data Engineer
Warren, MI · On-site
$107K - $129K/yr
... Databricks and between enterprise applications, including solutions that leverage DataStage and related integration technologies. You will partner closely with product owners, architects, data ...
Data Engineer
Warren, MI · On-site
$107K - $129K/yr
... Databricks and between enterprise applications, including solutions that leverage DataStage and related integration technologies. You will partner closely with product owners, architects, data ...
Senior Data Engineer (GCP, Big Data & Cloud Architecture)//Dearborn, MI//W2 Only
Dearborn, MI · On-site
$61.75 - $82.75/hr
Azure Data Factory, Databricks; Google BigQuery, Dataflow). Strong understanding of data ... Lead Data Architecture & Design: Oversee and contribute to the design, development, and ...
Quick apply
Senior Data Engineer (GCP, Big Data & Cloud Architecture)//Dearborn, MI//W2 Only
Dearborn, MI · On-site
$61.75 - $82.75/hr
Azure Data Factory, Databricks; Google BigQuery, Dataflow). Strong understanding of data ... Lead Data Architecture & Design: Oversee and contribute to the design, development, and ...
Data Engineer - Vehicle Configuration Optimization
Auburn Hills, MI · On-site
$108K - $130K/yr
Build and maintain data pipelines that ingest data from Snowflake into Databricks * Design and implement data transformations aligned to the medallion architecture (Bronze/Silver/Gold layers)
Data Engineer - Vehicle Configuration Optimization
Auburn Hills, MI · On-site
$108K - $130K/yr
Build and maintain data pipelines that ingest data from Snowflake into Databricks * Design and implement data transformations aligned to the medallion architecture (Bronze/Silver/Gold layers)
Lead Data Engineer
Detroit, MI · On-site
$101K - $133K/yr
Deloitte is seeking a Lead Data Engineer- Databricks to support the design, build, and delivery of ... Professionals in this area work across strategy, architecture, implementation, and deployment to ...
Lead Data Engineer
Detroit, MI · On-site
$101K - $133K/yr
Deloitte is seeking a Lead Data Engineer- Databricks to support the design, build, and delivery of ... Professionals in this area work across strategy, architecture, implementation, and deployment to ...
Full Stack Engineer
Auburn Hills, MI · On-site
Architect and manage cloud-based solutions using AWS services such as EC2, S3, Lambda, RDS, API Gateway, and related services * Integrate applications with Databricks and AWS-based data platforms to ...
Full Stack Engineer
Auburn Hills, MI · On-site
Architect and manage cloud-based solutions using AWS services such as EC2, S3, Lambda, RDS, API Gateway, and related services * Integrate applications with Databricks and AWS-based data platforms to ...
Machine Learning Engineer
$98K - $118K/yr
... using Databricks and Azure DevOps Your Skills * Solutions Delivery: End-to-end ownership of Azure data solutions-translating ambiguous business needs into robust architectural blueprints, then ...
Machine Learning Engineer
$98K - $118K/yr
... using Databricks and Azure DevOps Your Skills * Solutions Delivery: End-to-end ownership of Azure data solutions-translating ambiguous business needs into robust architectural blueprints, then ...
Senior Consultant | Cloud Integration | Azure Data Factory (ADF)
Ann Arbor, MI · On-site
$57.25 - $78/hr
Must Have Skills Databricks PySaprk SQL Nice to have skills Python Gen AI Detailed The client is ... Input architectural guidance for new implementation areas ensuring a robust foundation for ...
Senior Consultant | Cloud Integration | Azure Data Factory (ADF)
Ann Arbor, MI · On-site
$57.25 - $78/hr
Must Have Skills Databricks PySaprk SQL Nice to have skills Python Gen AI Detailed The client is ... Input architectural guidance for new implementation areas ensuring a robust foundation for ...
Architect and manage cloud-based solutions using AWS services such as EC2, S3, Lambda, RDS, API Gateway, and related services * Integrate applications with Databricks and AWS-based data platforms to ...
Architect and manage cloud-based solutions using AWS services such as EC2, S3, Lambda, RDS, API Gateway, and related services * Integrate applications with Databricks and AWS-based data platforms to ...
Jr. IT Data Analyst
Warren, MI · On-site
Experience working with big data in a cloud environment , particularly Azure and Databricks ... Support Product Managers, Scrum Leaders, and Architects with requirement documentation. * Set up ...
Quick apply
Jr. IT Data Analyst
Warren, MI · On-site
Experience working with big data in a cloud environment , particularly Azure and Databricks ... Support Product Managers, Scrum Leaders, and Architects with requirement documentation. * Set up ...
Data Engineer
Livonia, MI · On-site
$107K - $128K/yr
Advanced hands-on expertise with Databricks and the Azure data stack (Data Factory, Data Lake, Synapse, Analysis Services). * Strong working knowledge of the medallion architecture (bronze / silver ...
Data Engineer
Livonia, MI · On-site
$107K - $128K/yr
Advanced hands-on expertise with Databricks and the Azure data stack (Data Factory, Data Lake, Synapse, Analysis Services). * Strong working knowledge of the medallion architecture (bronze / silver ...
Vice President, Platform Engineering
$171K - $221K/yr
Provide architectural oversight across databases, pipelines, APIs, and cloud infrastructure ... Drive adoption of Databricks for advanced data engineering, including Data Lake, MLflow integration ...
Vice President, Platform Engineering
$171K - $221K/yr
Provide architectural oversight across databases, pipelines, APIs, and cloud infrastructure ... Drive adoption of Databricks for advanced data engineering, including Data Lake, MLflow integration ...
Vice President, Platform Engineering
Birmingham, MI · On-site
$171K - $221K/yr
Provide architectural oversight across databases, pipelines, APIs, and cloud infrastructure ... Drive adoption of Databricks for advanced data engineering, including Data Lake, MLflow integration ...
Vice President, Platform Engineering
Birmingham, MI · On-site
$171K - $221K/yr
Provide architectural oversight across databases, pipelines, APIs, and cloud infrastructure ... Drive adoption of Databricks for advanced data engineering, including Data Lake, MLflow integration ...
Sr. Software Engineer - AI Engineering and Productivity
Warren, MI · On-site
$115K - $151K/yr
You will help define patterns and best practices for SQL, Databricks (DBX), and AI/ML integrations ... Lead or contribute to solution design, including architecture, patterns, and technology choices ...
Sr. Software Engineer - AI Engineering and Productivity
Warren, MI · On-site
$115K - $151K/yr
You will help define patterns and best practices for SQL, Databricks (DBX), and AI/ML integrations ... Lead or contribute to solution design, including architecture, patterns, and technology choices ...
Sub-System Lead Engineer OR Senior Sub-System Lead Engineer (Chassis Data & Analytics)
Milford, MI · On-site
$90K - $118K/yr
Proficiency using the Databricks platform. * Familiarity with data and analytics architecture and principles. * Familiarity with continuous integration and continuous deployment methodologies and ...
Sub-System Lead Engineer OR Senior Sub-System Lead Engineer (Chassis Data & Analytics)
Milford, MI · On-site
$90K - $118K/yr
Proficiency using the Databricks platform. * Familiarity with data and analytics architecture and principles. * Familiarity with continuous integration and continuous deployment methodologies and ...
$93K - $122K/yr
... architecture, application development, Python, APIs, LLM-enabled solutions, Agile delivery, and ... Databricks Genie Spaces. -Experience with model-serving endpoints or managed AI services ...
$93K - $122K/yr
... architecture, application development, Python, APIs, LLM-enabled solutions, Agile delivery, and ... Databricks Genie Spaces. -Experience with model-serving endpoints or managed AI services ...
Databricks Architect information
What is the difference between Databricks Architect vs Data Engineer?
| Aspect | Databricks Architect | Data Engineer |
|---|---|---|
| Primary Focus | Designing and implementing data solutions on Databricks platform | Building, maintaining, and optimizing data pipelines and infrastructure |
| Skills & Certifications | Databricks certifications, Spark, cloud platforms (AWS, Azure), SQL | SQL, ETL tools, cloud platforms, programming (Python, Scala) |
| Work Environment | Data platforms, cloud environments, collaboration with data teams | Data pipelines, databases, cloud infrastructure, scripting |
While both roles work with data and cloud platforms, a Databricks Architect primarily focuses on designing and implementing data solutions using Databricks, whereas a Data Engineer builds and maintains the data pipelines and infrastructure that support these solutions. The Architect often oversees the technical design, while the Engineer handles the day-to-day pipeline development.
What are the key skills and qualifications needed to thrive as a Databricks Architect?
To thrive as a Databricks Architect, you need strong expertise in big data engineering, cloud platforms (such as Azure or AWS), distributed computing, and proficiency in languages like Python or Scala, typically supported by a relevant degree and cloud certifications. Familiarity with Databricks Workspace, Apache Spark, Delta Lake, and CI/CD tools is crucial for designing and implementing scalable data solutions. Excellent problem-solving, communication, and project management skills set top performers apart by enabling effective collaboration and solution delivery. These competencies are essential for architecting reliable, high-performance data platforms that drive business insights and innovation.
What are some common challenges Databricks Architects face when designing large-scale data solutions?
Databricks Architects often encounter challenges such as optimizing cluster performance for cost and efficiency, ensuring data security and compliance across distributed environments, and integrating Databricks with legacy systems or diverse data sources. They must carefully design data pipelines and workflows to handle large volumes of data without bottlenecks, and also collaborate closely with data engineers, data scientists, and IT teams to align on best practices. Staying updated with evolving Databricks features and cloud platform updates is also essential for success in this dynamic role.
What is a Databricks Architect?
A Databricks Architect is an IT professional who designs, implements, and manages data solutions using the Databricks platform, which is built on Apache Spark. They are responsible for creating scalable data pipelines, optimizing data workflows, and ensuring security and compliance within the cloud environment. Databricks Architects often work closely with data engineers, data scientists, and business stakeholders to deliver robust analytics solutions that drive business insights. Their expertise helps organizations leverage big data technologies efficiently and effectively.
What are the most commonly searched types of Databricks Architect jobs in Michigan? The most popular types of Databricks Architect jobs in Michigan are:
What are popular job titles related to Databricks Architect jobs in Michigan? For Databricks Architect jobs in Michigan, the most frequently searched job titles are:
What job categories do people searching Databricks Architect jobs in Michigan look for? The top searched job categories for Databricks Architect jobs in Michigan are:
What cities in Michigan are hiring for Databricks Architect jobs? Cities in Michigan with the most Databricks Architect job openings:
Contractor
This job post has expired today. Applications are no longer accepted.
Job description
Automotive Domain Experience - Good Communication skills - Understanding of Data Architecture concepts in Big Data ecosystem (MUST). - Understanding of Enterprise Architecture concepts in AWS ecosystem(MUST). - Hands-on experience in AWS-(S3 Databricks RedShift)(MUST) Scala(MUST) Spark(MUST) Databricks Talend - Hands-on experience in Shell scripting Java python Hive - Analyze complex business and technical problems related to the implementation of new technology and/or customization.
Hours : 8:00am to 5:00pm
Education :
Additional Job Details : Must Have Skills SparkSQL Apache Spark
Hours : 8:00am to 5:00pm
Education :
Additional Job Details : Must Have Skills SparkSQL Apache Spark
About Avani Technology Solutions
Sourced by ZipRecruiter
Industry
It services
Company size
201 - 500 Employees
Headquarters location
Rochester, NY, US
Year founded
2008