Remote Databricks Data Engineer Jobs in Billerica, MA

Employer: John Hancock Life Insurance Company (USA)
Job Site: 200 Berkeley Street, Boston, MA 02116
Job Title: Data Engineer

Job Duties:

• Discover hidden information using massive datasets and leveraging advanced data analytics and machine learning techniques to enable data-driven strategic decision-making. Duties include:
• Design, build and maintain data pipelines for ETL/ELT processes for large scale datasets;
• Migrate legacy data architectures to Azure and AWS leveraging cloud-native services for scalability;
• Develop and optimize Spark based pipelines using databricks for large-scale data processing and Synpse for creating data pipelines;
• Automate complex workflows for data ingestion, transformation, and delivery using Airflow;
• Create interactive dashboards to communicate insights to business stakeholders;
• Design and manage relational MSSQL, PostgreSQL, and NoSQL (MongoDB) databases for diverse use cases;
• Implement secure and compliant pipelines including governance policies for sensitive data;
• Integrate various data sources to streamline data processing and analysis using REST APIs;
• Collaborate with data scientists to build pipelines for training and deploying machine learning models;
• Work with cross-functional teams to gather requirements and deliver tailored data solutions;
• Set up monitoring and alerting systems to ensure data pipeline health and reliability;
• Use Docker to built and deploy applications and ensure consistency across development and production environments; and
• Identify inefficiencies in existing workflows and implement process improvements to reduce costs.

This position is eligible for fully remote work from any location in the United States.

Minimum Requirements:
Master's degree or foreign equivalent in Computer Science, Electrical Engineering, Electronic Engineering, Information Systems or related field and 3 years of experience with Python, SQL, and ETL processes.

Experience must include the following, which may have been gained concurrently:

1) 3 years of experience with cloud platforms including AWS and Azure.
2) 3 years of experience using distributed computing frameworks including Spark, Databricks and Synapse.
3) 2 years of experience with orchestration tools including Apache Airflow.
4) 3 years of experience with data visualization tools including Power BI and Tableau.
5) 3 years of experience with database systems including SQL and NoSQL.
6) 3 years of experience using data governance, compliance, and security practices.
7) 3 years of experience with REST APIs and integration frameworks.
8) 3 years of machine learning and predictive modeling experience.
9) 3 years of experience with monitoring tools including Splunk and CloudWatch.
10) 2 years of experience using DevOps practices and containerization.

Salary: $137,946 per year

The role being advertised is an existing vacancy.

About Manulife and John Hancock

Manulife Financial Corporation is a leading international financial services provider, helping people make their decisions easier and lives better. To learn more about us, visit https://www.manulife.com/en/about/our-story.html.

Manulife is an Equal Opportunity Employer

At Manulife/John Hancock, we embrace our diversity. We strive to attract, develop and retain a workforce that is as diverse as the customers we serve and to foster an inclusive work environment that embraces the strength of cultures and individuals. We are committed to fair recruitment, retention, advancement and compensation, and we administer all of our practices and programs without discrimination on the basis of race, ancestry, place of origin, colour, ethnic origin, citizenship, religion or religious beliefs, creed, sex (including pregnancy and pregnancy-related conditions), sexual orientation, genetic characteristics, veteran status, gender identity, gender expression, age, marital status, family status, disability, or any other ground protected by applicable law.

It is our priority to remove barriers to provide equal access to employment. A Human Resources representative will work with applicants who request a reasonable accommodation during the application process. All information shared during the accommodation request process will be stored and used in a manner that is consistent with applicable laws and Manulife/John Hancock policies. To request a reasonable accommodation in the application process, contact hr@manulife.com.

Referenced Salary Location

Salary range is expected to be between

Employees also have the opportunity to participate in incentive programs and earn incentive compensation tied to business and individual performance. The actual salary will vary depending on local market conditions, geography and relevant job-related factors such as knowledge, skills, qualifications, experience, and education/training. If you are applying for this role outside of the primary location, please contact hr@manulife.com for the salary range for your location.

Manulife/John Hancock offers eligible employees a wide array of customizable benefits, including health, dental, mental health, vision, short- and long-term disability, life and AD&D insurance coverage, adoption/surrogacy and wellness benefits, and employee/family assistance plans. We also offer eligible employees various retirement savings plans (including pension/401(k) savings plans and a global share ownership plan with employer matching contributions) and financial education and counseling resources. Our generous paid time off program in the U.S. includes up to 11 paid holidays, 3 personal days, 150 hours of vacation, and 40 hours of sick time (or more where required by law) each year, and we offer the full range of statutory leaves of absence.

We use data and analytics technologies, such as artificial intelligence (AI), and automated processing tools, to analyze and process the information you provide to us or third parties in the application process. For more information, please refer to our personal information collection statement.

Know Your Rights I Family & Medical Leave I Employee Polygraph Protection I Right to Work I E-Verify