Job Title: AWS Data Engineering Lead
Location: San Francisco, CA(Locals Preferred but ok in US)
Mode: Hybrid(3 day a week onsite)
Employment type: Contract
Role Summary
We are seeking a highly skilled AWS Data Engineering Lead with strong hands-on experience in building scalable data platforms on AWS. The ideal candidate will lead data engineering initiatives, design robust data pipelines, perform code reviews, and ensure best practices in data modeling and governance.
Key Responsibilities
Lead the design and development of scalable data pipelines using AWS services
Architect and optimize data solutions using Amazon Redshift and AWS Athena
Develop and maintain ETL/ELT pipelines using Python
Drive data modeling (dimensional & normalized models) for analytics and reporting
Perform code reviews and enforce coding standards, best practices, and CI/CD processes
Collaborate with cross-functional teams including analytics, BI, and business stakeholders
Ensure data quality, governance, and performance optimization
Mentor and guide junior data engineers and enforce engineering excellence
Required Skills & Experience
• 8+ years in data engineering with 3+ years in a leadership/lead role
• Strong hands-on experience with:
AWS Redshift
AWS Athena
S3, Glue, Lambda (nice to have but expected in ecosystem)
• Advanced Python programming for data engineering
• Strong expertise in data modeling (star/snowflake schemas, normalization)
• Experience with large-scale data processing and optimization
• Proven experience in code reviews, design reviews, and mentoring
• Familiarity with SQL performance tuning and query optimization
Experience with Airflow or other orchestration tools
Exposure to real-time data processing (Kinesis, Kafka)
Knowledge of DevOps practices (CI/CD, Git, automated testing)
Experience with data visualization tools or BI platforms