Sr. Data engineer
Location: Reston, VA
Duration: long term
ย
Mandatory need:ย
ย Candidate have to be ex-Fannie Mae, and they have to be able to work out of Reston, VA on a hybrid basis.
ย
Must Haves:
- Experience with Python for data engineering and ETL development.
- Strong experience in SQL for data manipulation and complex query building.
- Hands-on experience with AWS Lambda for serverless data processing.
- Experience building ETL pipelines using AWS Glue.
- Experience working with data warehouse solutions (e.g., Redshift, BigQuery, etc.).
- Experience with Snowflake as a cloud data warehouse.
- Experience using Apache Airflow for workflow orchestration.
- Experience with Spark or PySpark for large-scale data processing.
- Experience usingApache Airflowfor workflow orchestration
Key Responsibilities:
- Design, build, and maintain scalable and reliable data pipelines using Python and SQL
- Develop ETL processes using AWS Glue, AWS Lambda, and other AWS services.
- Build and maintain data integrations between internal systems and external data sources.
- Work with Data Warehouses to model and manage large-scale datasets for analytics and reporting.
- Ensure data quality, integrity, and security across the data pipeline.
- Collaborate with data scientists, analysts, and other engineers to deliver business-critical data solutions.
- Monitor data pipelines and troubleshoot issues proactively.
- Experience with Fannie Maeโs data governance frameworks (e.g., DataHub, BCAP).
- Knowledge of GSE-specific regulations (FHFA, Dodd-Frank).
- Certifications: Azure Data Engineer (DP-203), Databricks, or AWS.
- Experience with real-time data streaming (Kafka, Event Hubs).