Job Summary:
JPMorgan Chase is a leading financial institution that is transforming how the firm leverages data, artificial intelligence, and machine learning. They are seeking a Senior Principal Software Engineer to architect and implement advanced data platforms that power insights and innovation across the company, focusing on scalable Databricks and Spark solutions.
Responsibilities:
• Leads the design, build, and troubleshooting of a scalable Databricks/Spark data platform and analytics workloads across cloud environments.
• Develops and maintains secure, production-grade Python code; perform code reviews, debugging, and engineering quality improvements across the team.
• Owns delivery of scalable data pipelines and analytics solutions on Databricks, applying strong distributed computing and performance troubleshooting practices.
• Executes creative software solutions, design, development, and technical troubleshooting with ability to think beyond routine or conventional approaches to build solutions or break down technical problems
• Develops secure high-quality production code, and reviews and debugs code written by others
• Lead the design and development of scalable data pipelines and analytics solutions using Databricks, Spark, and cloud platforms
• Define and implement best practices for data engineering, data lake architecture, and distributed computing
• Solves the companies most challenging cloud data platform problems by building innovative technical solutions around Data Lake Tools.
• Identifies opportunities to eliminate or automate remediation of recurring issues to improve overall operational stability of software applications and systems
• Adds to team culture of diversity, opportunity, inclusion, and respect
• Mentor and guide technical teams, fostering a culture of continuous learning and excellence in software engineering practices
Qualifications:
Required:
• Formal training or certification on software engineering concepts and 10+ years applied experience
• Expert-level proficiency in Databricks, Apache Spark, and distributed data processing
• Hands-on experience with Python application program development with use of automated unit testing
• Hands-on practical experience delivering system design, application development, testing, and operational stability
• Hands-on practical experience with terraform development and understanding of terraform enterprise
• Hands-on experience with GitHub / Bitbucket code versioning tool, Jenkins build tool and pypi / maven artifactory integrations
• Knowledge of Big Data distributed compute frameworks like Spark
Preferred:
• Experience with Agile development processes, as needed (SCRUM/KANBAN) using JIRA.
• Experience in Data pipelines using Spark
• Experience in managing product release lifecycle at enterprise level.
Company:
With a history tracing its roots to 1799 in New York City, JPMorganChase is one of the world's oldest, largest, and best-known financial institutions—carrying forth the innovative spirit of our heritage firms in global operations across 100 markets. Founded in 2000, the company is headquartered in New York, USA, with a team of 10001+ employees. The company is currently Late Stage.