Familiarity with data governance and lineage tools (e.g., Collibra, BigID, Manta). * Knowledge of CI/CD, Git, Jenkins , and code promotion strategies. * Strong verbal and written communication skills ...
Familiarity with data governance and lineage tools (e.g., Collibra, BigID, Manta). * Knowledge of CI/CD, Git, Jenkins , and code promotion strategies. * Strong verbal and written communication skills ...
Experience integrating with ServiceNow GRC, Archer, OneTrust, or BigID and building evidence pipelines mapped to control objectives. * Experience building pipelines for security information and event ...
Experience integrating with ServiceNow GRC, Archer, OneTrust, or BigID and building evidence pipelines mapped to control objectives. * Experience building pipelines for security information and event ...
Bigid information
What is the difference between Bigid vs Data Analyst?
| Aspect | Bigid | Data Analyst |
|---|---|---|
| Primary Role | Data privacy, data governance, and compliance management | Data collection, analysis, and reporting to support business decisions |
| Required Skills | Data privacy laws, data management tools, security protocols | Statistical analysis, data visualization, SQL, Excel |
| Work Environment | IT, legal, compliance teams within organizations | Business, marketing, finance teams across industries |
| Certifications | Data privacy certifications (CIPP, CIPM), data management certifications | Data analysis certifications (CAP, Microsoft Certified Data Analyst) |
Bigid focuses on data privacy and governance, ensuring organizations comply with regulations, while Data Analysts interpret data to inform business strategies. Both roles require data-related skills but serve different functions within organizations.
What are popular job titles related to Bigid jobs in Michigan?
For Bigid jobs in Michigan, the most frequently searched job titles are:
What job categories do people searching Bigid jobs in Michigan look for?
The top searched job categories for Bigid jobs in Michigan are:
Full-time
Re-posted 12 days ago
Job description
About the Role
We are seeking a highly experienced ETL Lead to design, lead, and optimize enterprise data integration workflows using IBM DataStage on Cloud Pak for Data (CP4D), AWS Glue & Lambda, and Snowflake. The ideal candidate will drive modern data transformation strategies for large-scale data ingestion pipelines supporting analytics, governance, and AI/ML workloads.
Key Responsibilities
- Lead the end-to-end design and implementation of ETL workflows for structured and semi-structured data from various sources (SFTP, DB2, Oracle, APIs).
- Architect and maintain data ingestion and transformation pipelines using IBM DataStage (CP4D) and AWS Glue/Lambda functions.
- Optimize data load performance and manage large data volumes with effective partitioning, incremental loads, and error handling.
- Collaborate with cloud engineers and data modelers to ensure data is curated for consumption in Snowflake (Silver/Gold/Platinum layers).
- Ensure data lineage, metadata management, and data quality in compliance with enterprise data governance standards.
- Partner with governance teams to ensure integration with Collibra, or other metadata and privacy tools.
- Support CI/CD integration, parameterization, and version control of ETL code via Git and DevOps pipelines.
- Lead and mentor a team of onshore/offshore ETL developers; establish best practices and code review processes.
- Troubleshoot production ETL issues and participate in on-call rotations as needed.
Required Qualifications
- 8+ years of enterprise data integration experience with at least 3+ years as a technical lead.
- Strong expertise in IBM DataStage, including modern deployments on Cloud Pak for Data (CP4D).
- Solid experience with AWS Glue (PySpark) and AWS Lambda for scalable, serverless data transformation.
- Proven knowledge of Snowflake data warehousing, including external stages, streams, tasks, and performance tuning.
- Experience with complex ETL orchestration involving parallel processing, dynamic parameterization, and error handling.
- Strong SQL, Python (preferred for Glue), and performance tuning skills.
- Understanding of data lakehouse architectures, S3, and ingestion patterns (batch/real-time).
- Familiarity with data governance and lineage tools (e.g., Collibra, BigID, Manta).
- Knowledge of CI/CD, Git, Jenkins, and code promotion strategies.
- Strong verbal and written communication skills; experience working in agile/scrum delivery model.
Preferred Qualifications
- IBM DataStage CP4D certification
- AWS Certified Data Analytics or Solutions Architect - Associate
- Snowflake SnowPro certification
- Experience working in regulated industries (e.g., financial services, utilities, healthcare)
About IntraEdge
Sourced by ZipRecruiter
At heart, we are a technology, products and services organization In our soul, it’s the people who make us what we are — the professionals we train and connect to next-level opportunities and the experts who create innovative solutions and value for our national and international partners. It’s true that innovative technology can provide a major boost to your business, but you also need the right talent pushing it forward. This critical combination is what we offer all of our partners: cutting edge tech solutions and the expertise to bring it to life.
Industry
It services
Company size
1,001 - 5,000 Employees
Headquarters location
Chandler, AZ, US
Year founded
2002