On Call Pyspark Developer Jobs (NOW HIRING)

@HYVE Solutions, missions to help customers, business partners, and employees achieve success through shared goals, strategies, resources and technology solutions.

Job Title: Data warehouse Administrator

Job description

We are looking for a hands-on Data Warehouse Administrator to manage the reliability, performance, and daily operations of our data warehouse platforms.

As Hyve continues to expand its business across North America, the complexity, scale, and criticality of our data platforms have increased significantly. This role supports a hybrid data environment combining traditional Hadoop-based systems and modern OLAP platforms such as ClickHouse and Vertica, along with cloud-based data services and analytics integrations.

The focus of this role is to ensure high availability, system reliability, and efficient data processing for business-critical analytics and reporting workloads. The candidate will work closely with data engineering, platform, and analytics teams to maintain stable production environments, improve observability, and drive operational excellence across data platforms.

Key Responsibilities:

Operate and support data warehouse platforms such as Hive, Hadoop, ClickHouse, and Vertica in production environments Own the stability, availability, and performance of data warehouse systems and supporting infrastructure Monitor system health, query performance, and resource utilization, and proactively identify potential issues Troubleshoot production incidents across data pipelines, ETL workflows, Spark jobs, and underlying infrastructure Perform root cause analysis for system failures, data issues, and performance bottlenecks Design and enhance monitoring, alerting, and observability for data platforms Automate repetitive operational tasks to improve efficiency and reduce manual intervention Manage deployment activities, configuration changes, patching, and system upgrades Support data workflows including ETL pipelines (e.g., Azkaban), PySpark/SparkSQL processing, and ingestion processes Support data platform integrations such as Azure Blob storage and Power BI Gateway connectivity Collaborate with data engineering, analytics teams, and vendors to improve system robustness and scalability Participate in on-call rotation and support incident response to ensure timely resolution Develop and maintain operational documentation, SOPs, and runbooks

Required Skills

Strong SQL skills with experience working on large-scale data systems Hands-on experience with data warehouse platforms (Hive, ClickHouse, Vertica, or similar) Experience supporting production data platforms with SLA/SLO awareness (required) Strong understanding of distributed systems, preferably within the Hadoop ecosystem Experience supporting ETL pipelines, data ingestion, and workflow orchestration tools (e.g., Azkaban, Airflow) Solid troubleshooting skills across data pipelines, query performance, and system/infrastructure layers Experience with monitoring, alerting, and observability tools Working knowledge of Linux systems in production environments Experience with scripting (Shell, Python, or similar) for automation Familiarity with deployment processes, environment management, patching, and upgrade activities Experience with Spark, PySpark, or SparkSQL troubleshooting Familiarity with cloud storage (e.g., Azure Blob) and BI integrations (e.g., Power BI Gateway) is a plus

Educational background and Working Experience

Bachelor's degree in Computer Science, Information Systems, or equivalent practical experience 3+ years of experience in data warehouse administration, data platform SRE, or production support roles Proven experience supporting large-scale data platforms in production environments Experience managing incidents, troubleshooting system failures, and driving resolution Familiarity with data warehouse architecture and large-scale data processing concepts Experience working with cross-functional teams including data engineering, platform, analytics teams, and external vendors Experience supporting business-critical systems with high availability and performance requirements

Salary- CAD $60000-$95,000

Salary GRV- USD $65,000-$95,000

@ HYVE Solutions, we believe employees are our greatest asset and we empower them to make a difference in our business. Diversity and inclusion make us all better. Qualified applicants will receive consideration for employment without regard to race, color, religion, sex, national origin, sexual orientation, gender identity, disability or protected veteran status.