Job Summary:
Morgan Stanley is a global leader in financial services, continuously evolving and innovating to better serve clients and communities. The role of Data Engineer focuses on developing and maintaining software solutions that support business needs, particularly through the design and implementation of ETL frameworks and data analysis.
Responsibilities:
• Design, develop, and implement robust PySpark‑based ETL frameworks with error handling and fault tolerance in distributed cluster environments.
• Perform data enquiry, data analysis and data sourcing in Relational and Big Data database environments.
• Develop a thorough understanding of technology systems, data stores, data pipelines, job streams, and downstream data consumers.
• Translate business requirements into data models and program design specifications
• Modify ETL and related programs to implement changes driven by evolving business requirements
• Respond to queries from business analysts and developers regarding data access, query design, and performance optimization.
• Troubleshoot data issues and collaborate with data providers and upstream teams to identify root causes and drive resolution. Provide Level‑3 (L3) production support as needed.
• Use AI‑enabled tools to accelerate data mapping, data lineage creation, and data profiling, improving turnaround time and overall data quality.
Qualifications:
Required:
• Experience with coding in all: Pyspark, Python, SQL
• Strong knowledge of relational databases and data modeling
• Strong SQL query-writing skills
• Strong analytical and troubleshooting skills.
• At least 5 years financial industry technology experience and knowledge of financial services data
• Good verbal and written communication skills
Preferred:
• Hands-on Experience with Graph Database/Stardog
• Experience with coding Autosys job definitions
• Experience with Data Modeling tools (e.g., Power Designer)
• Experience in Linux Shell
• Experience in Java Development
• Experience and Understanding of Data Quality Rules and Implementation
Company:
Morgan Stanley is a financial services institution that delivers capital management, investment banking, and advisory solutions. Founded in 1935, the company is headquartered in New York, USA, with a team of 10001+ employees. The company is currently Late Stage.