Job Summary:
Tata Consultancy Services is a leading technology company, and they are seeking a Technical Lead Data Engineer to develop and maintain data pipelines. The role involves collaborating with data scientists and AI/ML teams, ensuring data quality, and optimizing data processing performance.
Responsibilities:
• Develop and maintain data pipelines using Python for data ingestion, transformation, and processing
• Design and implement ETL/ELT workflows for large-scale data systems
• Work with structured and unstructured data from multiple data sources
• Collaborate with data scientists and AI/ML teams to support model development and deployment
• Build and manage data integration frameworks and workflows
• Ensure data quality, validation, and governance across all pipelines
• Optimize data processing performance and scalability
• Develop and manage data storage solutions such as data lakes and data warehouses
• Automate repetitive tasks and improve operational efficiency
• Monitor and troubleshoot data pipelines and workflows
• Implement best practices for coding, testing, and documentation
• Support AI/ML use cases by preparing and delivering clean, usable datasets
• Work with orchestration tools like Airflow for scheduling workflows
• Collaborate with cross-functional teams for data-related requirements
Qualifications:
Required:
• BACHELOR OF COMPUTER SCIENCE
• Minimum 10 years of experience
• Python
• ETL/ELT pipelines
• SQL
• PySpark/Pandas
• Big Data (Spark, Hadoop)
• Airflow
• Data Modeling & Warehousing
• AI/ML data pipelines
• Cloud (AWS/Azure/GCP)
• Data Integration
• Git
Company:
Tata Consultancy Services is a business solutions company that specializes on information technology services and consulting. It is a sub-organization of Tata Group. Founded in 1968, the company is headquartered in Mumbai, IND, with a team of 10001+ employees. The company is currently Late Stage.