Please go through the below requirement and let me know your interest.
Role: SPARK DEVELOPER
Location : NJ Camden
Duration: Long term
Passion in Data Engineering, Programming Technologies like Scala or Java.
Strong Object-oriented programming and design skills, preferably in Java or
Scala programming with Spark Framework
Excellent analytical and problem-solving skills, oral and written
Experience building scalable, reliable, distributed Unix-based systems with
Big Data processing technologies (MapReduce, Hadoop, HBase, Cassandra,
other NO SQL solutions).
Experience designing and implementing data ingestion and transformation for
big data platforms. (Spark, Kafka, S3 Parquet, HDFS, Athena etc.).
Proven track record designing highly parallelized data ingestion and
transformation jobs in Spark including Spark Streaming.
Production experience working with EMR clusters.
Strong relational Database (AWS RDS, Postgres, MySQL) skills.
Lead team of developers take care of all data ingestion request from various
Experience working with Elastic Search.
GitHub Code repository skill is mandatory.
Good SQL programming skills.
Python programming skill is a plus.
Knowledge on AWS services and CI/CD is a plus.