Job Title: Data Engineer
Location: Rochester, NY
Employment Type: Full-Time (W2 Only)
Job Description:
Key Responsibilities:
- Design, build, and maintain scalable data pipelines for batch and real-time data processing
- Develop ETL/ELT processes to ingest, transform, and store large volumes of structured and unstructured data
- Work with data architects, analysts, and stakeholders to ensure data quality and accessibility
- Optimize data workflows and troubleshoot pipeline failures or performance issues
- Implement data governance, security, and compliance best practices
- Collaborate with DevOps and cloud teams to deploy and monitor data solutions
Required Skills:
- 8+ years of experience in data engineering or related roles
- Strong experience with SQL, Python, or Scala
- Hands-on with data pipeline tools: Apache Spark, Airflow, Kafka, NiFi, or similar
- Expertise in cloud platforms: AWS (Glue, Redshift, S3), Azure (Data Factory, Synapse), or GCP (BigQuery, Dataflow)
- Familiarity with data warehousing concepts and tools
- Experience with version control (Git) and CI/CD pipelines
- Strong problem-solving and communication skills
Preferred Qualifications:
- Experience with Delta Lake, Snowflake, or Databricks
- Knowledge of infrastructure-as-code tools like Terraform or CloudFormation
- Familiarity with data security frameworks and compliance (HIPAA, GDPR, etc.)
- Exposure to big data ecosystems: Hadoop, Hive, Presto, etc.
If interested please share your resume @ joshnar@openkyber.com