Skip to Main Content
← Back to Jobs

Software Developer (Big Data Development)

HI ANSR Tempe ,AZ
  • Posted: 10 days ago
  • Contractor
Job Description

Location: Tempe, AZ

Duration: Long-term Contract

Software Developer (Big Data Development)

12 month contract

State Farm – Tempe, AZ

400 E Rio Salado Parkway, Tempe AZ 85281

***Remote position in the US until restrictions are lifted and then it will be 100% onsite in Tempe, AZ

 

Top 3 Requirements:

  1. Must have AWS experience in the following: Lambda, Kinesis, Athena, Glue
  2. Must have scripting/automation experience with Python, Shell, SQL
  3. Must have Hadoop ecosystem experience in the following: Spark, Flume, Kafka

 

Job Description:

Enterprise Interactions is tasked with making customer interactions seamless across channels with minimal effort required of our

customers. To achieve this result, we are building orchestration engines, rules engines, and routing tools. The Data Intelligence

team is in charge of our on-prem Hadoop data store, as well as, the strategic direction architecture, migration, and build out of our

AWS data store and data pipelines.

 

Duties and responsibilities of the position:

  • Understand data requirements and build solutions on the platforms to satisfy those requirements
  • Use of the Hadoop ecosystem tools to build extractions for business partners
  • Use of AWS services and tools to build solutions enabling big data machine learning models (not the models themselves but
  • beneficial if they have some model building knowledge)
  • Technical Skills (industry knowledge 5+ years):
  • High level of experience & knowledge of the following AWS services (2-3+ years):
  • ElasticSearch + Kibana
  • Athena
  • Glue
  • DocumentDB (2+ years)
  • DynamoDB/MongoDB (2+ years)
  • Sagemaker (as part of a pipeline and not the ML/AI)
  • S3
  • EC2
  • Lambda functions (2+ years)
  • Cloudwatch (2+ years)
  • Kinesis Data Streams (2+ years)
  • Kinesis Data Firehose (2+ years)
    • Expert knowledge of the following programming languages:
  • Python (5+ years)
  • Shell (bash, borne, or C) (5+ years)
  • Extract Transform & Load formats/languages (5+ years):
  • Parquet
  • CSV
  • JSON
  • SQL (5+ years in a big data environment) - Petabyte size preferred
  • Github or Gitlab and git usage
    • Expert knowledge of the following Hadoop ecosystem programs:
  • Hive (3+ years)
  • Spark (4+ years)
  • Solr (4+ years) -- expert knowledge of indexing processing
  • Flume & Kafka (2+ years)
  • Hadoop infrastructure - nodes, edges, etc (3+ years)
  • Competencies
  • Strong Verbal and written communication skills
  • A great attitude and a team player bringing innovation to the team
  • Open to work on existing or new software
  • Exhibits DevOps mindset where team is accountable for product from inception to sunset
  • Ability to work on an Agile Scrum team
  • Additional Experience considered as beneficial:
  • Java - Spring/SpringBoot
  • Pivotal Cloud Foundry (PCF)
  • This resource will be located at Marina Heights, Building 2, Floor 14
  • Strong intermediate to senior skill level

HI ANSR

Why Work Here?

Awesome CEO, great benefits, and a lot of rooms for growth!

Address

400 E Rio Salado Parkway
Tempe, AZ
USA

Website

What email should the hiring manager reach you at?

By clicking the button above, I agree to the ZipRecruiter Terms of Use and acknowledge I have read the Privacy Policy, and agree to receive email job alerts.

What email should we contact you at once we get salary info from the hiring manager?

By clicking the button above, I agree to the ZipRecruiter Terms of Use and acknowledge I have read the Privacy Policy, and agree to receive email job alerts.

Our qualification feature is only available to registered members - what email address would you like for us to keep on file?

By clicking the button above, I agree to the ZipRecruiter Terms of Use and acknowledge I have read the Privacy Policy, and agree to receive email job alerts.