Job Title: Big Data Engineer
Job Location: Atlanta, GA (Day 1 Onsite, Hybrid)
Job Type: Contract
Job Description: - 8 to 10 years of IT industry experience
- 5 to 7 years Designing and implementing highly performance data ingestion & transformation pipelines from multiple sources using Databricks and ADF Azure Pipelines
- Experience in Developing scalable and re-usable frameworks for ingestion and transformation of large data sets.
- Experience building data lakes & data warehouses to support operational intelligence and business intelligence
- Experience working with SAP and Non-SAP ERP systems ; Good exposure to Order2Cash, Procure2Pay domain area
- Integrating the end to end data pipeline to take data from source systems to target data repositories ensuring the quality and consistency of data is maintained at all times.
- 3 years' Experience with Optimization and Tuning Experience.
- 3 to 5 years' experience with Azure Synapse, IOT hub, Event hub, Streaming analytics.
- 3 to 5 years' experience with Github or other code repositories.
- Good Understanding of Azure Cloud Architecture
- Strong programming experience with back end languages such as Python and SQL
- Strong Experience with Orchestration tools like Airflow