Job Summary:
Tata Consultancy Services is seeking a Senior Engineer for the position of Data Programmer ETL Data Engineer. The role involves designing and maintaining data ingestion solutions, building ETL pipelines, and collaborating with teams to ensure data quality and compliance.
Responsibilities:
• Design, develop, test, implement, document, and maintain data ingestion and integration solutions for on-premises and cloud data lakes
• Build and maintain Extract, Transform, Load/Extract, Load, Transform (ETL/ELT) pipelines to ingest data from various enterprise systems into data lakes (e.g., AWS S3, Azure Data Lake, Hadoop)
• Develop and manage Application Program Interfaces (APIs) and connectors for real-time and batch data ingestion
• Collaborate with data architects and engineers to ensure data quality, security, and compliance during ingestion
• Monitor and optimize data pipeline performance and troubleshoot data ingestion issues
• Support migration and integration efforts between legacy systems and modern cloud data platforms
• Implement data governance and metadata management best practices in ingestion workflows
Qualifications:
Required:
• BACHELOR OF COMPUTER SCIENCE
• 5+ years of experience with data engineering and/or data processing tools
• Experience with programming languages
• Experience with relational databases (SQL Server or Oracle)
• Experience with cloud-platform technologies (AWS, Azure, GCP)
• Experience with cloud containerization
• Experience with DevOps / DevSecOps
• 3+ years of experience with Object Oriented Design and Programming in a high-level language like C#, .NET, Java, SQL, HTML, and CSS
• Experience in a role that required the ability to work both independently and collaboratively
• Experience with cloud-native data ingestion and processing services (AWS Glue, Azure Data Factory, Google Cloud Dataflow)
• Experience with data lake architecture, data modeling, and metadata management
• Experience with real-time data streaming and event-driven architecture
• Experience with data security, encryption, and compliance standards in aerospace and/or regulated industries
• Experience working in Agile and/or Scaled Agile environments
• Experience with verbal and written communication skills to effectively collaborate with cross-functional teams
Company:
Tata Consultancy Services is a business solutions company that specializes on information technology services and consulting. It is a sub-organization of Tata Group. Founded in 1968, the company is headquartered in Mumbai, IND, with a team of 10001+ employees. The company is currently Late Stage.