Job Title: Data Engineer.Location: Sunnyvale, CA. Duration: Long Term Contract.Direct Client: Req.Key Qualifications - 6+ years of hands-on data modeling and data engineering experience.
- Strong expertise in dimensional modeling and data warehousing.
- Database design and development experience with relational or MPP databases such as Snowflake/Postgres/ Oracle/ Teradata/ Vertica.
- Experience in design and development of custom ETL pipelines using SQL and scripting languages (Python/ Shell/ Golang).
- Proficiency in advanced SQL, performance tuning.
- Hands on experience with Big-Data platforms like Spark, Dremio, Hadoop, MapReduce, Hive etc.
- Experience with Java, Scala, and Python.
- Experience with cloud computing platforms like AWS, and Google Cloud.
- Familiarity with version control systems, CI/CD practices, testing, and migration tools for database and software.
- Experience working with APIs.
- Experience with real time data processing using Apache Kafka or Spark Streaming is a big plus.
- Ability to learn and adapt to new tools and technologies.
- Analytical and mathematical mind, capable of evaluating and solving various complex problems.
- Ability to work individually or as part of a team.
- Ability to learn quickly in a fast-paced environment.
- Excellent oral and written communication skills.
Job Description: - Architect, develop, and test large scale data solutions, to provide efficient analytical and reporting capabilities across global and regional sales and finance teams.
- Develop highly scalable data pipelines to load data from various source systems, use Apache Airflow to orchestrate, schedule and monitor the workflows.
- Build generic and reusable solutions that can scale and utilize various technologies and frameworks to solve complex business requirements.
- Understand existing solutions, fine-tune them, and support them as needed to meet high standards of data and software quality.
Education & Experience:• BS or MS in Engineering/ Computer Science