Pb Consulting

6 jobs near Columbus, OH

Senior Big Data Engineer

New York, NY

$61 - $80.75/hr

We are seeking a Senior Big Data Engineer with 8+ years of IT experience and strong expertise in Hadoop, Spark, Python, and Snowflake. The ideal candidate will have hands-on experience building ...

New

OpenShift Engineer

Irving, TX ยท On-site

$50.75 - $69.50/hr

Position Summary We are seeking an experienced OpenShift Engineer to design, deploy, administer, and support enterprise OpenShift and Kubernetes platforms. The ideal candidate will be responsible for ...

New

Job Summary We are seeking an experienced Business Information Analyst (BIA) to support enterprise data warehouse and analytics modernization initiatives. The ideal candidate will bridge business and ...

New

Roles and Responsibilities * Design, implement, integrate, and support enterprise voice recording solutions, primarily using Verint/Verba platforms. * Manage end-to-end project delivery activities ...

New

Senior Infrastructure Engineer

Delray Beach, FL ยท On-site

$101K - $138K/yr

We are seeking an experienced Infrastructure Engineer to support and maintain enterprise infrastructure across compute, storage, virtualization, backup, and operating system platforms. The ideal ...

New

Roles and Responsibilities *Design, build, configure, and operate shared platform services supporting enterprise applications and third-party products. *Manage the integration, deployment, and ...

New

$61 - $80.75/hr

Full-time

Posted yesterday

New


Job description

We are seeking a Senior Big Data Engineer with 8+ years of IT experience and strong expertise in Hadoop, Spark, Python, and Snowflake. The ideal candidate will have hands-on experience building scalable data pipelines, migrating data from Hadoop to Snowflake using PySpark, and developing enterprise ETL solutions.

Roles and Responsibilities
  • Design, develop, and maintain scalable data pipelines using Hadoop, Spark, Python, and Snowflake.
  • Perform data migration from Hadoop to Snowflake using PySpark frameworks and libraries.
  • Build and optimize ETL workflows for large-scale data ingestion, transformation, and validation.
  • Develop and optimize complex SQL queries for data processing and analytics.
  • Ensure data quality, performance, and reliability across enterprise data platforms.
  • Collaborate with cross-functional teams to gather requirements, troubleshoot issues, and deliver data solutions.
Required Qualifications
  • 8+ years of overall IT experience in data engineering or big data development.
  • Strong hands-on experience with Hadoop, Apache Spark, Python, and Snowflake.
  • Experience migrating enterprise data from Hadoop to Snowflake using PySpark.
  • Solid understanding of ETL processes, data integration, and data transformation techniques.
  • Strong SQL skills with experience writing and optimizing complex queries.
  • Excellent analytical, problem-solving, and communication skills.
  • Experience working in Unix/Linux environments. (Preferred)