As a AWS Databricks Developer you will be a part of an Agile team to build healthcare applications and implement new features while adhering to the best coding development standards .
Responsibilities:
· Strong expertise in Databricks, Spark/PySpark, Teradata, AWS, and DevOps practices
· While driving end-to-end data engineering initiatives in an Agile environment.
· Key Responsibilities Collaborate with business and technical stakeholders to understand requirements and translate them into scalable data solutions.
· Design, document, and implement cloud-native data architectures and engineering solutions.
· Develop high-performance ETL/ELT pipelines using Spark and PySpark. Build and optimize data ingestion, transformation, and loading processes for enterprise-scale data platforms
Technical Skills
· Spark & PySpark Development Databricks (Delta Lake, Notebooks, Pipelines, Cluster Management)
· Teradata SQL Development (Teradata SQL, Hive SQL, Spark SQL)
· Ab Initio Shell Scripting (Unix/Linux, KSH)
· AWS Cloud Services (S3, EC2, Lambda, Glue, SNS, SQS, ECS, IAM, CloudWatch) Data Warehouse & Data Lake Implementation CI/CD & DevOps Tools (Git, Jenkins, Artifactory)
· Production Support & Monitoring Agile Methodologies Preferred Skills Jira & Confluence.
· Healthcare Domain Experience Enterprise Scheduling Tools (CA7) Cloud Data Migration & Modernization Azure/AWS Integration
Experience: -
10+Years
Location: - Austin, TX(Hybrid)
Educational Qualifications: -
- Engineering Degree – BE/ME/BTech/MTech/BSc/MSc.
· Technical certification in multiple technologies is desirable.
Skills: -
Mandatory skills:
Databricks, PySpark , Ab Initio, Teradata ,AWS , Healthcare