Job Summary:
LTM is seeking a Senior Python Data Engineer with expertise in Apache Spark and Python to design and implement scalable data solutions. The role involves developing and maintaining large-scale data processing systems, collaborating with cross-functional teams, and ensuring data quality and integrity.
Responsibilities:
• Design build and deploy scalable data pipelines leveraging Apache Spark and Python
• Analyze complex data sets to identify trends patterns and insights to support business decisions
• Monitor and troubleshoot data pipeline issues to ensure high availability and performance
• Mentor junior team members and provide technical guidance on Python and Spark best practices
• Collaborate with data scientists analysts and other stakeholders to deliver datadriven solutions
• Stay updated with emerging technologies and recommend improvements to existing data infrastructure
Qualifications:
Required:
• 3 to 5 years of experience specializing in Apache Spark and Python
• Develop and maintain large-scale data processing systems using Apache Spark
• Write efficient reusable and testable Python code for data ingestion, transformation, and analysis
• Collaborate with cross-functional teams to understand data requirements and deliver robust data pipelines
• Optimize data workflows for performance and reliability in a distributed computing environment
• Participate in code reviews and contribute to best practices for data engineering and Python development
• Ensure data quality and integrity through rigorous testing and validation processes
• Design, build, and deploy scalable data pipelines leveraging Apache Spark and Python
• Analyze complex data sets to identify trends, patterns, and insights to support business decisions
• Monitor and troubleshoot data pipeline issues to ensure high availability and performance
• Mentor junior team members and provide technical guidance on Python and Spark best practices
• Collaborate with data scientists, analysts, and other stakeholders to deliver data-driven solutions
• Stay updated with emerging technologies and recommend improvements to existing data infrastructure
Company:
LTM is a worldwide technology consulting and digital solutions company that empowers businesses in a variety of sectors. Founded in 1996, the company is headquartered in Mumbai, IND, with a team of 10001+ employees. The company is currently Late Stage.