Develop web applications and tools for the effective management and operation of big data platform
Analyze and improve stability, efficiency, and scalability of the platform
Work closely with Architects, lead engineers and business on product design and features.
Mentor and coach junior engineers on various design and development aspects of big data platform.
Prototype ideas quickly using cutting edge technologies
Qualifications and Requirements
Bachelors or Master's degree or equivalent in computer science or related field with minimum of 5 years of directly related work experience.
Experience of developing large distributed systems using core Java and/or Scala Experience in at least one scripting language such as Python or Ruby.
Experience in applications to process large amounts of structured and unstructured data using big data technologies like Hadoop, Hive, Spark, Storm etc.
Knowledge and experience working with various data sources like web services (rest, soap), unstructured data files, flat files, message queues, and xml based events, databases.
Experience with UNIX/ Linux and shell scripting
Firsthand experience handling petabytes of data is highly preferred.
Excellent verbal and written communication skills.
Proven track record on delivering results, especially in the area of writing high-performance, reliable and maintainable code.
Ability to adapt to new development environments, changing business requirements and learning new systems highly desired.
Experience with large distributed services is a plus as is building/operating highly available systems
Ability to work well in a team environment and be able to effectively drive cross-team solutions that have complex dependencies and requirements in a fast-paced environment
Strong technical vision, presentation and technology leadership skills.
Ability to coach and mentor fellow team members