Job Summary:
ClifyX is a company seeking a Data Virtualization Engineer with expertise in Starburst. The role involves designing and implementing data virtualization solutions, optimizing query performance, and ensuring data quality across multiple platforms.
Responsibilities:
• Demonstrated expertise in Starburst Data Virtualization, including designing and implementing data virtualization solutions, optimizing query performance across distributed data sources, and integrating Starburst with enterprise data architectures.
• Analyze data mapping documents and business requirements to design comprehensive test plans and cases.
• Perform source-to-target data reconciliation, check data loading, and ensure transformation rules are applied correctly.
• Write complex SQL scripts for validation (count, data completeness, data consistency, data truncation).
• Identify, log, and track data defects using tools like JIRA or Client ALM or Octane.
• Automate test scripts and validate data volume, performance, and scalability.
• Expert-level knowledge of SQL for data analysis.
• Experience with tools such as Informatica and IDMC.
• Understanding of data warehouse concepts and architectures (e.g., star/snowflake schema).
• Familiarity with Hadoop or Spark is often preferred.
• Validate HiveQL, HDFS file structures, and data processing within the Hadoop cluster.
• Strong analytical and troubleshooting skills.
• Excellent communication for collaborating with developers and stakeholders.
Qualifications:
Required:
• Demonstrated expertise in Starburst Data Virtualization, including designing and implementing data virtualization solutions, optimizing query performance across distributed data sources, and integrating Starburst with enterprise data architectures.
• Analyze data mapping documents and business requirements to design comprehensive test plans and cases.
• Perform source-to-target data reconciliation, check data loading, and ensure transformation rules are applied correctly.
• Write complex SQL scripts for validation (count, data completeness, data consistency, data truncation).
• Identify, log, and track data defects using tools like JIRA or Client ALM or Octane.
• Automate test scripts and validate data volume, performance, and scalability.
• Expert-level knowledge of SQL for data analysis.
• Experience with tools such as Informatica and IDMC.
• Understanding of data warehouse concepts and architectures (e.g., star/snowflake schema).
• Validate HiveQL, HDFS file structures, and data processing within the Hadoop cluster.
• Strong analytical and troubleshooting skills.
• Excellent communication for collaborating with developers and stakeholders.
Preferred:
• Familiarity with Hadoop or Spark is often preferred.
• Domain: Banking knowledge, Payments knowledge preferred.
Company:
ClifyX provides innovative business solutions which satisfy requirements for mission-critical reliability, scalability, interoperations. Founded in 1998, the company is headquartered in South Plainfield, USA, with a team of 501-1000 employees. The company is currently Late Stage.