We are seeking experienced Data Engineers with strong expertise in Apache Spark, AWS, Kubernetes/EKS, and Big Data platforms.
Required Skills:
5+ years of Data Engineering experience
Strong hands-on experience with Apache Spark
Experience with Amazon EKS / EMR on EKS
Big Data technologies: Hadoop, Hive, Trino
Strong Python or Scala development skills
Advanced SQL (window functions, joins, complex queries)
Kubernetes administration and troubleshooting
AWS services: S3, EMR, Glue, Athena, Lambda
Experience processing large-scale datasets and tuning Spark jobs
Familiarity with AI tools such as GitHub Copilot, ChatGPT, Claude, or Amazon Q
Preferred Skills:
CI/CD (GitLab, Jenkins, GitHub Actions, ArgoCD)
Terraform / Infrastructure as Code
Docker, Prometheus, Grafana
Spark on Kubernetes
Financial Services experience