Developer Analyst Data/ Data Engineer

Role: Developer Analyst Data/ Data Engineer

Location: Canada/Remote

Duration: 6+ Months

Job Description:

Monitor, troubleshoot, and resolve issues within the Palantir Foundry platform, ensuring high availability, performance, and security.

Implement and manage PySpark data pipelines ensuring scalable, secure environments with high availability.

Advocate for and implement best practices in data security and compliance, adhering to healthcare industry standards and regulations.

Collaborate with the data architecture team to maintain and enhance integrations between Palantir Foundry and AWS cloud infrastructure.

Exceptional problem-solving abilities and a detail-oriented approach to managing complex data engineering tasks.

Excellent communication skills, capable of collaborating effectively across multidisciplinary teams.

Strong background working with PySpark and SQL, able to troubleshoot issues and optimize transforms to ensure data integrity and scalability.

Adaptability and a keenness to learn new technologies and tools, with a willingness to grow into roles that may involve more direct work on data pipelines.

Experience with data lake technologies, including table formats (e.g., Iceberg, Hudi, Delta Lake) and AWS Lake Formation, is highly valued.

Interest in or experience with streaming technologies (e.g., Apache Flink, Google Cloud Dataflow/Beam), to support future contributions to real-time data processing initiatives.

Understanding of the FHIR standard and experience with healthcare data management, which would be beneficial in ensuring compliance and effectiveness of data solutions within the healthcare domain.