Java Engineer
Java 8
Springboot
Git โ DevOps (pipelines are built and handled by the Infra/DevOps team)
Kafka โ Need to have a good pubsub understanding & consume/producer APIs
ETL experience โ Databricks is really what they want, but donโt consider it a must have. ETL though is a must have. Need to be able to work on the data side (i.e. build ingestion pipelines) as well as rest based microservices
Azure & NoSQL (Cosmos)
If we have someone with AWS, that would be ok but less preferred
Testing skills โ ideally would have someone w/some Automation experience They have JMeter, Selenium, Cucumber, Cypress etc.
Nice to have
Search capability
High Level Scope:
The Data Engineers create the pipelines and land the data, once it gets to the data lake the Engineers build services for the data as well as batch capabilities
Software Engineering Environment Overview
Java 8+, Spring Boot 2.0.0+, maven
Angular w/ Micro Frontend architecture, using Enterprise common module for development (Angular version 8+)
UI, API Unit, Integration/Contract, End-to-End, testing frameworks and methodologies (e.g., Spock, Jasmine, Jest, Cucumber, Junit, Mockito, etc.)
Open API Specification
Performance Testing (JMeter, Gatling, K6)
Cloud-Native Application Architecture:
Domain-Driven Designed Microservices
Event-driven architectures and patterns
API Gateways
Application Databases:
Distributed databases (Cosmos DB)
SQL (MySQL, Postgres)
Redis
Snowflake
Data Pipelines:
Azure Event Hubs (Kafka protocol)
Databricks (Spark v3.0.0+ on Deltalake)
Azure Data Factory
Application Security:
Contrast
Twistlock
DevOps:
Containers (Docker 18.0.0+ / containers)
Kubernetes (1.