Role: Senior AWS Data Engineer/Architect.
Location: Piscatway, NJ (Day 1 onsite Hybrid)
Position type: W2 contract
About the Role
You will design and build scalable data pipelines on AWS, integrating multiple data sources (telephony, CRM, LLM outputs) into a unified analytics platform serving business analysts and operational reporting teams.
Job Description:
- Architect and implement cloud-native data pipelines on AWS
- Build serverless compute layers using Lambda, Step Functions, and Airflow
- Design data lake storage strategies using S3, Glue, Athena, and Redshift
- Integrate real-time data streams via Kinesis and SQS
- Collaborate with business analysts to translate reporting requirements into schema and pipeline design
- Own data quality, pipeline monitoring, and alerting via CloudWatch
- Lead schema design for Athena and Postgres tables — DDL, partitioning, indexing
- Evaluate and integrate AI/ML services — Bedrock, Comprehend, Transcribe
- Document architecture decisions and maintain runbooks
Must Have
- overall 10 to 15+ with 6+ years AWS data engineering experience
- Expert Python — data transformation, boto3, async processing
- Deep knowledge of: S3, Lambda, SQS, Kinesis, Step Functions, EventBridge, DynamoDB, Glue, Athena, Redshift, Airflow
- Airflow — production DAG development and debugging
- SQL — complex queries, window functions, partitioning, performance tuning
- IAM — roles, policies, cross-account access, permissions boundaries
- Experience designing event-driven, serverless architectures at scale
- Strong understanding of data lake patterns — partitioning, file formats, crawlers
Nice to Have
- Amazon Connect / telephony platform experience
- LLM integration — prompt engineering, Bedrock, API gateway patterns
- Amazon Transcribe / Call Analytics
- Terraform / CloudFormation
- QuickSight dashboarding
- Multi-account AWS organisation management