Job Title: Data Engineer ( python, pyspark, scala, airflow)
Location:Sunnyvale CA ( Hybrid )
Duration: 6 to 12+ Months
Rate: DOE
Job description:
Bachelor or master's degree in computer science, Software Engineering, or a related field.
Proven experience (7+ years) as a data Engineer, preferably with a focus on software development, distributed systems.
Solid understanding of data engineering concepts, database design, ETL processes and data mining.
Proficiency in working with data technologies including SQL, Python, Spark, Scala, Hadoop and related technologies and tools.
Experience with ETL tools such as Apache Airflow, digdag, oozie.
Experience with CI/CD processes and tools such as Jenkins and Maven
Strong understanding of metadata management, data lineage and data quality and tools.
Familiarity with Cloud Computing Services such as Google GCP and Microsoft Azure, as well as Distributed Storage Systems like Hive and Elastic Search a plus.
Experience implementing operational best practices such as monitoring, alerting, validation and exception handling.
Strong analytical, problem-solving skills with the ability to optimize, troubleshoot and debug data process and pipelines.
Excellent communication skills to collaborate effectively with cross-functional teams and present performance analysis findings.
Experience supporting and working with cross-functional teams and influence them with solutions in a dynamic environment.
Experience in AdTech and advertising measurement
Knowledge of analytical tools such as Tableau/ or Looker is preferred.