Required Qualifications:
- 4 plus years of Software Engineering experience, or equivalent demonstrated through one or a combination of the following: work or consulting experience, training, military experience, education.
- Minimum 4 years of handon experience with:
- Building data pipeline using bigdata stack (Hadoop, Hive, pySpark, python)
- Amazon AWS S3 - Object storage, security, data service integration with S3
- Data modelling and database design.
- Job Scheduler - Autosys
- PowerBI, Dremio
- Unix/shell scripting, CICD pipeline
- Exposure in GCP cloud data engineering is a plus.
Note:
Manager Notes:
- The candidates need to be proactive; they can't wait to be told what to do
- Must be accountable along with the technical skills
- The tech stack mentioned, these are the technologies being used to build data pipelines
- They need to model, design the data, build pipelines, applying logic to the data to transform the data and troubleshoot
- They should have a strong understanding and implementation of Autosys
- Ability to automate using spark, Python, Hadoop/Hive
- Should have a fundamental background in database design (MySQL or any standard database)
- Exposure to Cloud data engineering is a big plus, not required
- Financial services experience is a plus, but not requiredhaving domain knowledge is helpful
Technical Assessment:
- Client needs a clear understanding of tech work experience; they need to be able to describe the work they have done
- Overall problem solving, so given a problem how efficiently does their thought process drive towards a solution?
PART OF THE PILOT PROGRAM:
- Duration: 24month contract with possible conversion to FTE
Location:
- Chandler, AZ only option
- 3 days a week in office.