Skip to Main Content

Data Engineer

Alianza
Pleasant Grove, UT
  • Posted: over a month ago
  • Full-Time
Job Description

Alianza is looking for an experienced and results driven Data Engineer. The successful candidate will be the technical engine of the data team, building Python applications to ingest streaming and extracted data and persist to cloud storage. Will use Python and SQL with AWS cloud technologies to automate the generation and delivery of reports. Will utilize CI/CD technologies to fully automate the release of all compute and storage components to the cloud. Work with our data architect and Java developers to design creative, high-quality, data-oriented insights and dashboards. Significant focus of the position will be on streaming data pipelines, distributed datalake architectures, and AWS services. Question the status quo. Write clean, testable, resilient code. Make things go fast and have fun doing it!

Key Duties and Responsibilities:

  • Participate in the process of designing, data engineering, and developing data services (Streaming, ETL/ELT, Real-time analytics, Reporting) using Python, SQL and AWS services
  • Adhere to modern methodologies for designing, coding, and testing
  • Build connected, fully automated data systems and pipeline
  • Work effectively with remote teams in various remote time zones
  • Prepare data for prescriptive and predictive modeling
  • Combine raw information from different sources into usable format
  • Implements processes and systems to monitor data quality, ensuring production data is always accurate and available for key stakeholders and business processes that depend on it
  • Identify and implement automatable tasks and reusable frameworks
  • Participate in sprint planning meetings and provide reasonable estimations
  • Research and propose new process, techniques, or tools as solutions. Able to produce technical diagrams, explanations, and written documentation to promote proposed solutions
  • Collaborate with data team members to ensure all services are reliable, maintainable, and well-integrated into existing platforms
  • Review functional and technical designs to identify areas of risk and/or missing requirements

Requirements

  • 3+ years of Python development experience, preferably writing modules that implement part of a streaming or batch ETL system in a cloud hosted environment
  • 3+ years of SQL experience (No-SQL experience is a plus)
  • 3+ years of experience with schema design and dimensional data modeling
  • Ability in managing and communicating data warehouse / lake designs to stakeholders
  • Experience designing, building, and maintaining data processing systems
  • At least 3 years experience with modern DevOps automation ecosystems, preferably Git/GitHub/Bitbucket, Buildkite or Ansible (or similar)
  • Real-world experience handling large data volumes (terabytes of storage and billions of rows)
  • At least 3 years experience configuring, using, and performance tuning AWS cloud services: preferably S3, Glue, Athena, Kinesis, Firehose, Lambda, Cloudwatch, ECS, API Gateway, RDS (Postgres), SQS, SNS, SES
  • Experience using AWS Redshift (or similar)
  • Experience with CloudFormation or TerraForm
  • Ability to prioritize, learn quickly, and do high-quality work
  • Demonstrate understanding of modern APIs and endpoints, like REST and GraphQL
  • Working understanding of Agile dev methodologies, especially Scrum and Kanban
  • Good listener, communicator, collaborator, and documenter
  • Proficient with Linux and shell scripting
  • Experience with data warehouse, data mart, OLAP, dimensional modeling, Kimball method
  • Good understanding of relational and document database concepts and best practices
  • Know how to design a clean, performance-optimized relational data model, and reverse engineer existing databases into physical data model diagrams
  • Experience using C*, Spark, Kafka, KSQL, Confluent, Pulsar and/or Kinesis helpful
  • Automated testing experience using JUNIT or equivalent
  • Some experience in software engineering (front, middle, back or all three) and application architecture

Benefits

Weve got you covered. From 401k, generous PTO, Fitness related reimbursement, flexible work arrangements and excellent medical, dental, and vision - were there for you!

Alianza

Address

Pleasant Grove, UT
USA

Industry

Technology

View all jobs at Alianza

What email should the hiring manager reach you at?

By clicking the button above, I agree to the ZipRecruiter Terms of Use and acknowledge I have read the Privacy Policy, and agree to receive email job alerts.