This is neither an architect nor a project management role; therefore, candidates with primarily ... Profiles of data engineers outside of Azure without demonstrated transferability to Data Factory ...
This is neither an architect nor a project management role; therefore, candidates with primarily ... Profiles of data engineers outside of Azure without demonstrated transferability to Data Factory ...
Data Developer II
Sherbrooke, QC · On-site
CA$35.06 - CA$46/hr
As a Data Developer II, you will be responsible for designing, implementing, and maintaining GEM ... Architect data solutions leveraging DBT for data transformation and Azure Data Factory for pipeline ...
Data Developer II
Sherbrooke, QC · On-site
CA$35.06 - CA$46/hr
As a Data Developer II, you will be responsible for designing, implementing, and maintaining GEM ... Architect data solutions leveraging DBT for data transformation and Azure Data Factory for pipeline ...
Data Developer II
CA$35.06 - CA$46/hr
As a Data Developer II, you will be responsible for designing, implementing, and maintaining GEM ... Architect data solutions leveraging DBT for data transformation and Azure Data Factory for pipeline ...
Data Developer II
CA$35.06 - CA$46/hr
As a Data Developer II, you will be responsible for designing, implementing, and maintaining GEM ... Architect data solutions leveraging DBT for data transformation and Azure Data Factory for pipeline ...
Data Developer
Montreal, QC · On-site
Working closely with architects and partners, you will ensure data solutions support product ... engineering work
Quick apply
Data Developer
Montreal, QC · On-site
Working closely with architects and partners, you will ensure data solutions support product ... engineering work
Our data science lab is one of the largest in the country, and data engineering is one of its main ... In this mission, you will be supported by business analysts and architects. We use Agile as our ...
Our data science lab is one of the largest in the country, and data engineering is one of its main ... In this mission, you will be supported by business analysts and architects. We use Agile as our ...
Our data science lab is one of the largest in the country, and data engineering is one of its main ... In this mission, you will be supported by business analysts and architects. We use Agile as our ...
Our data science lab is one of the largest in the country, and data engineering is one of its main ... In this mission, you will be supported by business analysts and architects. We use Agile as our ...
We are seeking a visionary and highly technical Senior ML Data Platform Developer to architect, implement, scale, and maintain the data engine powering our next-generation frontier models. In this ...
We are seeking a visionary and highly technical Senior ML Data Platform Developer to architect, implement, scale, and maintain the data engine powering our next-generation frontier models. In this ...
Specialist, Data Engineering
Montreal, QC · On-site
Reporting to the Lead Data Engineering, the Data Engineering Specialist is responsible for ... Collaborate with Data Analysts and Data Architects on defining data models, requirements, and ...
Specialist, Data Engineering
Montreal, QC · On-site
Reporting to the Lead Data Engineering, the Data Engineering Specialist is responsible for ... Collaborate with Data Analysts and Data Architects on defining data models, requirements, and ...
Partner with architecture, cloud, infrastructure, security, and data engineering teams to deliver scalable, secure, reusable, and supportable technology solutions. * Manage a portfolio of Data and AI ...
Partner with architecture, cloud, infrastructure, security, and data engineering teams to deliver scalable, secure, reusable, and supportable technology solutions. * Manage a portfolio of Data and AI ...
Partner closely with Revenue Systems, Product, and Data Engineering teams to deliver scalable solutions. * Evaluate prospective SaaS platforms and advise on architecture, integration requirements ...
Partner closely with Revenue Systems, Product, and Data Engineering teams to deliver scalable solutions. * Evaluate prospective SaaS platforms and advise on architecture, integration requirements ...
Senior Data Developer Who We Are 2K is headquartered in Novato, California and is a wholly owned ... What You Will Do Architect and automate scalable ETL pipelines to ingest and centralize diverse ...
Senior Data Developer Who We Are 2K is headquartered in Novato, California and is a wholly owned ... What You Will Do Architect and automate scalable ETL pipelines to ingest and centralize diverse ...
Provide technical leadership to multidisciplinary teams, including architects, engineers, data engineers, data scientists, and cloud, security, and governance specialists. * Contribute to the ...
Provide technical leadership to multidisciplinary teams, including architects, engineers, data engineers, data scientists, and cloud, security, and governance specialists. * Contribute to the ...
Partner with architecture, cloud, infrastructure, security, and data engineering teams to deliver scalable, secure, reusable, and supportable technology solutions. * Manage a portfolio of Data and AI ...
Partner with architecture, cloud, infrastructure, security, and data engineering teams to deliver scalable, secure, reusable, and supportable technology solutions. * Manage a portfolio of Data and AI ...
Contribute to the overall software architecture and design of data processing and analytics pipelines Required Qualifications: * Bachelor's degree in Computer Science, Engineering, or related subject ...
Quick apply
Contribute to the overall software architecture and design of data processing and analytics pipelines Required Qualifications: * Bachelor's degree in Computer Science, Engineering, or related subject ...
Senior Data Transfer Developer
Montreal, QC · On-site +1
As a Senior Data Transfer Developer, you will design, build, and evolve robust data transfer ... Define the architecture and evolution strategy for data transfer tools and integration platforms
Quick apply
Senior Data Transfer Developer
Montreal, QC · On-site +1
As a Senior Data Transfer Developer, you will design, build, and evolve robust data transfer ... Define the architecture and evolution strategy for data transfer tools and integration platforms
Minimum de 5 ans d'expérience comme Ingénieur de données * Expérience dans des organisations de ... Data Vault, Event-Driven Architecture ou Self-Service Analytics * Expérience dans des ...
Minimum de 5 ans d'expérience comme Ingénieur de données * Expérience dans des organisations de ... Data Vault, Event-Driven Architecture ou Self-Service Analytics * Expérience dans des ...
Expert, AI Engineer
Montreal-est, QC · On-site
The role collaborates with AIarchitects, platform engineers, AI operations, data scientists, data engineers,business partners, cybersecurity, governance, architecture, and vendor teams tomove AI use ...
Expert, AI Engineer
Montreal-est, QC · On-site
The role collaborates with AIarchitects, platform engineers, AI operations, data scientists, data engineers,business partners, cybersecurity, governance, architecture, and vendor teams tomove AI use ...
Expert, AI Engineer
Montreal-est, QC · On-site
The role collaborates with AIarchitects, platform engineers, AI operations, data scientists, data engineers,business partners, cybersecurity, governance, architecture, and vendor teams tomove AI use ...
Expert, AI Engineer
Montreal-est, QC · On-site
The role collaborates with AIarchitects, platform engineers, AI operations, data scientists, data engineers,business partners, cybersecurity, governance, architecture, and vendor teams tomove AI use ...
Architecte de données
Montreal, QC · On-site
Définir, documenter et faire évoluer les architectures de données (Data Warehouse, Data Lake ... Promouvoir l'adoption des pratiques DataOps, DevOps et CI/CD, incluant l'automatisation des tests ...
Quick apply
Architecte de données
Montreal, QC · On-site
Définir, documenter et faire évoluer les architectures de données (Data Warehouse, Data Lake ... Promouvoir l'adoption des pratiques DataOps, DevOps et CI/CD, incluant l'automatisation des tests ...
Security Architect
Brossard, QC · On-site
The Security Architect will work with Business groups, Architects, Developers and other team ... data protection * Analyzing requirements for cloud security tools and technology and support ...
Security Architect
Brossard, QC · On-site
The Security Architect will work with Business groups, Architects, Developers and other team ... data protection * Analyzing requirements for cloud security tools and technology and support ...
Data Engineer Architect information
What are the key skills and qualifications needed to thrive as a data engineer architect, and why are they important?
What is the difference between Data Engineer Architect vs Data Engineer?
| Aspect | Data Engineer Architect | Data Engineer |
|---|---|---|
| Credentials | Bachelor's/Master's in CS, certifications like AWS, GCP, or Azure | Bachelor's in CS, certifications like AWS, GCP, or Azure |
| Work Environment | Designs data infrastructure, collaborates with architects and stakeholders | Builds and maintains data pipelines, works with data storage and processing |
| Employer & Industry Usage | Used in organizations with complex data architecture needs | Common across industries for data processing tasks |
The main difference is that Data Engineer Architects focus on designing and planning the overall data infrastructure, while Data Engineers implement and maintain the pipelines and systems. Architects have a broader strategic role, whereas Engineers focus on execution and operational tasks.
How does a data engineer architect typically collaborate with data scientists and business analysts on large-scale projects?
What is a data engineer architect?
Contractor
This job post has expired 1 day ago. Applications are no longer accepted.
Job description
\n <\/div>
We are looking for an experienced data developer to support a new analytics platform in production and contribute to its upcoming release within a large financial services organization. The solution integrates data from multiple systems in an Azure cloud environment and makes it available through a data warehouse using Power BI. The project is progressing in iterations, each delivering value to users, until the planned handover to the operations team in summer 2027. You will be central to the stability and evolution of the solution: providing technical support after production releases, monitoring the platform, resolving issues with the team, developing ETL processes, and configuring data ingestion pipelines from source systems to data lakes. You will participate in data valuation and the configuration of the data warehouse according to the established model, perform unit testing, and document the processes.
<\/p>
<\/span>
<\/p>
The client is seeking a data developer with 8+ years of experience to initially provide production support for the Group Insurance Data Hub, while continuing to contribute to Release 2. The core of the role is data engineering on the Azure stack: data ingestion into data lakes, dimensional modeling (dimensions and facts), and data exposure using Power BI. The recurring keywords (ETL, ingestion pipelines, Data Factory, Synapse, unit testing, continuous integration) indicate that the ideal candidate will write and debug processing code, not be a Power BI report writer or functional analyst. The production support context requires someone capable of independently diagnosing and resolving anomalies within a standardized process environment. This is neither an architect nor a project management role; therefore, candidates with primarily strategic or decision\-making experience should be excluded.<\/span>
<\/p>
<\/span>
<\/p>
Responsibilities :
<\/p>\n
- \n
- Provide technical support to operations following production deployments and follow up on issues with project managers. <\/span>
<\/li>\n - Perform solution monitoring activities. <\/span>
<\/li>\n - Take responsibility for resolving solution anomalies, in collaboration with other members of the project team. <\/span>
<\/li>\n - Analyze system components, functional and non\-functional specifications, change requests, and any technical issues encountered. <\/span>
<\/li>\n - ETL Analysis and Development Configuration of data ingestion pipelines from source systems to appropriate data lakes Participation in data enhancement and data warehouse configuration (dimension\/fact configuration) according to the established data model Participation in data loading into tables Process breakdown and documentation Data profiling (tools, approaches) <\/span>
<\/li>\n - Performing unit testing Participating in production deployments Ensuring and performing updates to various databases and recommending any improvements aimed at optimizing their quality and efficiency.
<\/span><\/li>\n <\/ul><\/span>
Requirements<\/h3>REQUIREMENTS
<\/p>\n- \n
- 8+ years of hands\-on experience as a developer in a large enterprise | Required | All requirements met<\/span>
<\/span><\/li>\n - Excellent ETL knowledge and ETL development skills | Required | All requirements met<\/span>
<\/span><\/li>\n - Source system to data lake ingestion pipelines | Required | All requirements met<\/span>
<\/span><\/li>\n - Relational and dimensional models, dimension and fact configuration | Required | All requirements met<\/span>
<\/span><\/li>\n - Azure data storage (Data Lake, Blob Storage, Data Factory, Azure SQL Database, Synapse Analytics) | List of examples | Sufficient majority<\/span>
<\/span><\/li>\n - Power BI (Desktop, Service, components including gateway) | Required | All requirements met<\/span>
<\/span><\/li>\n - Unit testing approaches (TDD), automated testing, and continuous integration | List of examples | Sufficient majority<\/span>
<\/span><\/li>\n <\/ul>DESIRED<\/span>
<\/p>\n- \n
- Source code management and deployment (GitHub, GitHub Actions, Concourse) | List of examples | Sufficient majority<\/span>
<\/span><\/li>\n - Experience in data projects | Required | All requirements met<\/span>
<\/span><\/li>\n - Architecture patterns (Object\-Oriented, Cloud IaaS, CaaS, PaaS, SaaS, iPaaS) | List of examples | Sufficient majority<\/span>
<\/span><\/li>\n <\/ul>ASSET<\/span>
<\/p>\n- \n
- Domain\-Driven Design (DDD) | Required | Sufficient majority<\/span>
<\/span><\/li>\n - Application resilience and event\-driven architecture | List of examples | Sufficient majority<\/span>
<\/span><\/li>\n - Security principles and protocols (SSO, Auth0, SAML, OpenID, JWT, OAuth2, ABAC, RBAC) | List of examples | Sufficient Majority<\/span>
<\/span><\/li>\n - Note: The Azure stack is listed as an ecosystem; proficiency in most components with concrete projects is considered comprehensive. The absence of a single service does not disqualify you.<\/span>
<\/span><\/li>\n <\/ul><\/span>
<\/p>WHAT WE DON'T WANT<\/span>
<\/p>\n- \n
- Profiles of Power BI report writers without real experience in ETL development and data ingestion.<\/span>
<\/span><\/li>\n - Profiles of functional or BI analysts without experience writing data processing code.<\/span>
<\/span><\/li>\n - Profiles of architects or managers whose recent experience is in business intelligence rather than hands\-on development.<\/span>
<\/span><\/li>\n - Profiles of data engineers outside of Azure without demonstrated transferability to Data Factory and Synapse.<\/span>
<\/span><\/li>\n - Profiles of junior or intermediate profiles with less than 8 years of development experience in large companies.<\/span>
<\/span><\/li>\n - Profiles incapable of working independently in production support and accustomed to close supervision.<\/span>
<\/span><\/li>\n <\/ul>
<\/p>\n\n
\n <\/div><\/span>
\n <\/body>\n<\/html>
- Profiles of Power BI report writers without real experience in ETL development and data ingestion.<\/span>
- Domain\-Driven Design (DDD) | Required | Sufficient majority<\/span>
- Source code management and deployment (GitHub, GitHub Actions, Concourse) | List of examples | Sufficient majority<\/span>
- 8+ years of hands\-on experience as a developer in a large enterprise | Required | All requirements met<\/span>