Big Data Engineer
Location: Rockville, MD or McLean, VA (Hybrid)
Interview: F2F Mandatory
Candidates: Local to DC / VA / MD Only
Must-Have Skills:
Apache Spark
Hadoop Ecosystem
Scala & Hive
Python or Perl Scripting
Expert-level Complex SQL (Window Functions, Multi-Table Joins)
AWS – S3, EMR, Glue, Athena
GitHub & CI/CD Pipelines
Agile Methodologies & Test Automation
AI Tools – GitHub Copilot, ChatGPT, Amazon Q (Prompt Engineering)
💼 Preferred:
Financial Services / Banking Domain Experience
Key Responsibilities:
Build and optimize enterprise-scale Big Data pipelines
Performance tuning for Spark, Hadoop & SQL workloads
Develop scalable AWS data solutions
Implement CI/CD, automated testing & data quality validation
Utilize AI-assisted development tools to improve engineering productivity
🎯 Experience Required:
5+ Years of Big Data Engineering Experience
Strong expertise in Spark, Hadoop, Hive & Scala
Hands-on AWS Data Services (S3, EMR, Glue, Athena)
Advanced SQL optimization & performance tuning