Senior Data Performance Engineer (ETL Developer With Performance Tuning Experience)
Location: Austin TX (Remote) Hire Type: Contract
Client Name: LPL Financials/Altimetrik
Key Skills to Evaluate โ Ability to write complex SQL queries, DB query tuning questions, strategy/process to optimize large data volume processing time, ETL
Skill and Experience Required
- Experience in consuming large data volume
- Advance SQL skills
- Optimize strategy process for data handling for aggregation tables (Minimize processing time for large data volume)
- Experience in data loading with complex model for data and batch orchestration
- Throughput understanding, monitoring for efficient data loading
- Identifying bottlenecks and resource investigation
- Experience in periodic ETL code maintenance and setting up SLA for cross functional team
- Implementing necessary techniques to improve ETL performance in both DB and Application
- Improving query performance by turning ad re-evaluating data model
- Identifying dependency impact on both data and Application
Duties and Responsibilities
- Performance analysis and documenting factors (bottleneck, memory handling and inefficiency area which needs improvement)
- Identifying and documenting execution benchmarks and metrics
- Optimization on application and database
- Validation techniques for data and orchestration
- Documentation for optimization and operations
- Implementation alert mechanism in case of potential impact to downstream
- Collecting and documenting the metrics for each ETL application