We are looking for a Senior Data engineer to join our growing team. You will work on improving our data infrastructure, while building out our new data warehouse and business intelligence tools. You will get to make decisions, architect solutions and elevate the organization by solving real problems that will allow the business to make key decisions. Excellent growth opportunity to grow with a startup that is moving fast!
Responsibilities: Build real-time data capture and transformation functionality across all products Work with other engineers to enhance data models and improve data query efficiency Create complex data queries to facilitate ad hoc and exploratory analytics Act as in-house data expert and make recommendations regarding standards quality and timeliness Build out technology stack for Business Intelligence and Data Warehouse Clean data: review for data inconsistencies and identify opportunities to improve data collection process Wrangle/Munge data: transform or map data from one raw data form into another format with the intent of making it more appropriate and valuable for analytics Develop, construct, test and maintain architectures such as databases and large-scale data processing systems Design, construct, install, test and maintain highly scalable data management systems Build high-performance algorithms, prototypes, predictive models and proof of concepts Research opportunities for data acquisition and new uses for existing data Employ a variety of languages and tools (e.g. scripting languages) to marry systems together Recommend ways to improve data reliability, efficiency and quality Collaborate with analysts and team members on project goals and targeted, relevant data sets Build or recommend data visualization tools and business intelligence tools such as interactive dashboards and automated reports, to enable leaders to make swift, fact-based decisions
Qualifications: Bachelor's degree in computer science, software/computer engineering, applied math, statistics or related field required 4+ years of related experience as a data engineer 4+ SQL-based technologies (e.g. PostgreSQL and MySQL) 2+ NoSQL technologies (e.g. Cassandra and MongoDB) Experience with Python, ETL, Big Data, pipelines, AirFlow, AWS. Experience with Hadoop-based technologies (e.g. MapReduce, Hive and Pig) Good with scripting languages (Python, Perl, etc.) Data warehousing solutions Predictive modeling, NLP and text analysis Statistical analysis and modeling Machine learning and data mining