Analytics Data Engineer

Title: Analytics Data Engineer

Location: New York, NY OR Collegeville, PA OR Lake Forest, IL OR Boulder, CO OR San Francisco, CA MUST be onsite

Duration: 1 year+

The ideal candidate is a self-motived teammate, skilled in a broad set of data processing techniques with the ability to adapt and learn quickly, provide results with limited direction, and choose the best possible data processing solution is a must.

ROLE RESPONSIBILITIES:

Reporting to the head of Analytics Engineering this person will collaborate with data scientists, reporting/data visualization specialists, business, marketing teams all working together to identify requirements that will derive the creation of data pipelines and other data products. You will work closely with the Digital team to understand the architecture and internal APIs involved in upcoming and ongoing projects. We are seeking an outstanding person to play a pivotal role in helping the analysts & business users make decisions using data and visualizations. You will partner with key partners across the business, data science & marketing teams as you design and build query friendly data structures.

• Translate business requirements by business team into data and engineering specifications
• Build scalable data sets based on specifications from the available raw data and derive business metrics/insights
• Understand and Identify server APIs that needs to be instrumented for data analytics and align events for execution in already established data pipelines
• Explore and understand sophisticated data sets, identify and formulate correlational rules between heterogenous sources for effective analytics and reporting
• Process, clean and validate the integrity of data used for analysis
• Develop Python and Shell Scripts for data ingestion and stitching from external data sources for business insights
• Partner with data scientists to build scalable modeling features pipeline
• Work closely with analytics and data science teams to develop robust data pipeline and analytics visualization

PREFERRED CANDIATE LOCATION: NYC, Collegeville PA, Lake Forest IL, Boulder CO, San Francisco)

BASIC QUALIFICATIONS:

• 10 + years of overall experience with in a technical environment, 7+ years of experience as a Data Engineer, must have a bachelor degree
• Must have a bachelor degree - preferably in engineering, economics, statistics, computer science, or related quantitative field.
• Relevant professional experience with Big Data systems, pipelines and data processing
• Preferred experience in Applied Econometrics, Statistics, Data Mining, Machine Learning, Analytics, Mathematics, Operations Research, Industrial Engineering, or related field
• data engineering skillset, building pipelines, ETL, automating experimentation from data science teams. End to end, starting from source system to pipeline is important.
• Practical hands-on experience with technologies like Apache Hadoop, Apache Pig, Apache Hive, Apache Sqoop & Apache Spark
• Experience working in Dataiku is a plus but not required
• Ability to understand API Specs, identify relevant API calls , extract data and implement data pipelines & SQL-friendly data structures
• Identify Data Validation rules and alerts based on data publishing specifications for data integrity and anomaly detection
• Understanding on various distributed file formats such as Apache AVRO, Apache Parquet and common methods in data transformation
• Expertise in Python, Unix Shell scripting and Dependency driven job schedulers
• Expertise in Core JAVA, Oracle, Teradata and ANSI SQL
• Familiarity with rule based tools and APIs for multi stage data correlation on large data sets is a plus!
• Candidate demonstrates a breadth of diverse leadership experiences and capabilities including: the ability to influence and collaborate with peers, develop and coach others, oversee and guide the work of other colleagues to achieve meaningful outcomes and create business impact.