Apply Now

ZipRecruiter
Posted on

Big Data Engineer

VBeyond in Sunnyvale, CA, USA

Big Data Engineer
Location: Sunnyvale, CA


Job Roles & Responsibilities:--

" Responsible for identifying and designing automation opportunities

" Build a working knowledge of all existing operational analytics and data pipeline methods and functionality

" Create effective and automated processes to drive efficiency and consistency across all areas of big data and advanced analytics projects

" Work closely with peers and leadership within Technology Services to develop an automation framework

" Create an infrastructure to support continued growth in the open source environment


Basic Qualifications:

" 10+ Years of experience in SQL queries and working with NoSQL, RDBMS

" Bachelor's in Business, Information Technology, Computer Science, Economics or other related discipline or equivalent work-related experience

" Apache Hadoop software library knowledge

" Proficient with automation tools and framework design

" Experience in automation scripting and web application development

" Strong personal and organizational skills to execute project deliverables

" Excellent verbal and written communication skills to lead a cross functional team

Skills: Must haves:

Data Engineer with background of data science as he will be converting Python Client model program into Java or Scala

Core programming Skills : Java, Scala and Python

Knowledge of Hadoop Ecosystem and Spark

Preferred Qualifications:

" MBA or equivalent degree

" Experience in using Java, pySpark, Python, Scala, Spark, Shell script, Spark with Python, Spark streaming and SQL.

" Background in ETL and data warehousing

" Sqoop, Hive and Big data concepts.

" Shell scripting

" ADF, AWS Cloud, ADLS is good to have "

Posted date: 25 days ago

View all Jobs at VBeyond