Remote Manager Etl Jobs (NOW HIRING)

Redan LLC is seeking a highly experienced Data Engineer (ETL Developer) to design, build, and optimize AWS-native data pipelines, transforming high-priority regulatory datasets into a secure, governed enterprise data platform.In this role you will own the full lifecycle of ETL pipeline development - designing, building, testing, and deploying serverless, event-driven workflows that ingest and transform 30+ priority datasets (e.g., R1 annual reports, waybill, financial and cost-of-capital data) into a Medallion (Bronze-Silver-Gold) architecture. You will build the supporting data models, schemas, and validation frameworks, capture lineage, and produce the technical documentation that keeps every pipeline reliable, auditable, and scalable.The ideal candidate brings deep AWS-native data-engineering expertise, a data- and quality-first mindset, and strong collaboration skills. You must be adaptive to changing priorities, comfortable in an Agile environment, and effective at partnering with database, governance, and analytics stakeholders to sequence and deliver datasets under SLA.What You'll Be DoingAs the Data Engineer (ETL Developer) at Redan, you will:Design, build, test, and deploy ETL/ELT pipelines for priority datasets using AWS-native services (Glue, Lambda, Step Functions, Redshift, RDS PostgreSQL, S3) or approved AWS-hosted third-party toolsBuild serverless, event-driven data workflows within a Medallion (Bronze-Silver-Gold) Lakehouse architecture, with built-in error handling, retries, and notificationsDevelop supporting data models, schemas, validation frameworks, and database structures; enhance data models to support expanded analytics and reportingImplement scalable data validation and quality checks - schema enforcement, error handling, and lineage capture (e.g., Great Expectations)Produce complete technical documentation - ERDs, data dictionaries, pipeline specifications, lineage diagrams, and deployment packagesCollaborate with the client to prioritize datasets, define sequencing, and identify phased deployment optionsSupport thorough testing across development, staging, and production environments; ensure pipelines support automated retries, idempotent reprocessing, and scale to 2x baseline data volumeApply infrastructure-as-code (Terraform) for consistent, repeatable deployments, and integrate pipelines into CI/CDEnsure pipelines meet performance standards - ≥97% monthly successful run rate, ≥98% data-validation pass rate, and data freshness within defined SLA windowsSupport ATO maintenance, FISMA compliance, and protection of PII and CUI in coordination with the agency IT and security teamsProfile of SuccessRequired:Minimum 5 years of data-engineering experience designing and maintaining AWS-based data pipelines (7+ preferred)Proven hands-on experience with AWS data services - Glue, Lambda, Step Functions, and S3 - building serverless, event-driven ETL/ELT workflowsExperience implementing Medallion/Lakehouse designs with tiered refinement layersExperience administering or building on Amazon Redshift, RDS (PostgreSQL or SQL Server), or comparable managed data storesProficiency in Python and SQL, plus PySpark, Pandas, or similar data-processing frameworksExperience with data-validation tools (e.g., Great Expectations), data catalogs (AWS Glue, Lake Formation), CI/CD, and infrastructure-as-code (Terraform)Experience designing relational and dimensional schemas, indexes, and partition strategies, with validation, error handling, and lineage captureExperience delivering under SLAs with documented quality controls and formal acceptance in a federal or regulated environmentFamiliarity with Agile/Scrum methodologies and ceremoniesExcellent written and oral communication; strong troubleshooting and attention to detailPreferred:AWS certification (e.g., Data Engineer - Associate, Developer - Associate, or Solutions Architect - Associate/Professional)Experience with public open-data platforms (CKAN, Huwise) and BI/visualization toolsExperience supporting optional AI/RAG data initiatives (document ingestion, retrieval) aligned to federal AI guidance (OMB M-26-04)Familiarity with federal data-management expectations - auditability, traceability, metadata, and quality frameworksPrior federal experience; ability to ramp quickly on a regulatory-domain contextConditions of EmploymentU.S. Citizenship is requiredMust obtain and maintain a favorably adjudicated Minimum Background Investigation (MBI, Moderate Risk) prior to accessing client systems, and maintain that clearance level throughout the period of performanceFully remote; work performed within the continental United States; no travel is required or anticipated