1

Spark Data Analyst Jobs (NOW HIRING)

Job Summary : eTeam is seeking a Hadoop Spark Data Engineer to join their team. The role requires ... analysis, and problem?solving, along with effective cross?functional communication skills ...

Work with Spark, Python, and PySpark to support large-scale data processing and analysis. Support healthcare data integrations involving FHIR and clinical data. Monitor data pipelines and ...

Data Engineer

Austin, TX · On-site

$113K - $136K/yr

... Spark data pipelines leveraging Airflow scheduler/executor framework Qualifications : Required : • 4+ years of relevant industry experience • Demonstrated ability to analyze large data sets to ...

Analyze large scale complex business data (time series data, structured/unstructured) from various ... Experience writing code in Python, R, Scala, and distributed computing technologies like Spark.

Analyze large scale complex business data (time series data, structured/unstructured) from various ... Experience writing code in Python, R, Scala, and distributed computing technologies like Spark.

Analyze large scale complex business data (time series data, structured/unstructured) from various ... Experience writing code in Python, R, Scala, and distributed computing technologies like Spark.

Analyze large scale complex business data (time series data, structured/unstructured) from various ... Experience writing code in Python, R, Scala, and distributed computing technologies like Spark.

Analyze large scale complex business data (time series data, structured/unstructured) from various ... Experience writing code in Python, R, Scala, and distributed computing technologies like Spark.

Analyze large scale complex business data (time series data, structured/unstructured) from various ... Experience writing code in Python, R, Scala, and distributed computing technologies like Spark.

AWS Data Engineer

Atlanta, GA · On-site

$80K - $120K/yr

Required 5+ years of development experience in making API calls, SQL queries, Spark, data manipulation/transformation, analysis and visualization * Hands on experience with CI/CD pipeline tools such ...

Analyze large scale complex business data (time series data, structured/unstructured) from various ... Experience writing code in Python, R, Scala, and distributed computing technologies like Spark.

This position involves analysing complex datasets to derive actionable insights that will inform ... Familiarity with big data technologies (e.g., Hadoop, Spark)

next page

Showing results 1-20

Spark Data Analyst information

What are popular job titles related to Spark Data Analyst jobs?

For Spark Data Analyst jobs, the most frequently searched job titles are:

Python/Spark Data Engineers

Wilmington, DE • On-site

InterSources Inc
Recruiting and Staffing Services • 51 - 200 employees

Full-time

Re-posted 23 days ago


Key responsibilities

  • Migrate legacy on-prem platform to the cloud and modernize data processing workflows.

  • Manipulate and move Ab Initio data to AWS using Python, Spark, and other Big Data frameworks.

  • Develop and maintain data pipelines for data ingestion and transformation, ensuring proper data flow and integration.


Job description

Job Summary:
InterSources Inc is a Small Business Enterprise specializing in IT Consulting and Staffing Solutions. They are seeking Python/Spark Data Engineers to modernize their Retail Banking Data Transformation Team's legacy platform to the cloud, focusing on data migration and enabling data analysts to build products in a unified data ecosystem.
Responsibilities:
• Looking for data engineers to migrate legacy on-prem platform and modernizing to the cloud.
• A lot of Ab Initio data needs to be manipulated and moved to AWS.
• Python-MUST, Scala, Spark, AWS (ECS, EC2, EMR, Lambdas, etc.).
• If they don't have Spark but solid Python that's OK.
• If they don't have Python, but solid Java and Py-Spark, will consider that.
• CI/CD pipeline with Jenkins.
• Good understanding of data and data analysis, how data flows, how data is joined, etc.
• As-Is and To-Be experience.
• At least 3 years of experience developing Data Pipelines for Data Ingestion or Transformation using Java or Scala or Python.
• At least 2 years' experience in the following Big Data frameworks: File Format (Parquet, AVRO, ORC, etc..).
• At least 3 years of developing applications with Monitoring, Build Tools, Version Control, Unit Test, TDD, Change Management to support DevOps.
• At least 3 years of experience with SQL and Shell Scripting experience.
• At least 2 years of experience with software design and must have an understanding of cross-systems usage and impact.
Qualifications:
Required:
• Python-MUST, Scala, Spark, AWS (ECS, EC2, EMR, Lambdas, etc.)
• If they don't have Spark but solid Python that's OK. If they don't have Python, but solid Java and Py-Spark, will consider that
• CI/CD pipeline with Jenkins
• 5+ years' experience with Data Engineering
• Good understanding of data and data analysis, how data flows, how data is joined, etc.
• As-Is and To-Be experience
• At least 3 years of experience developing Data Pipelines for Data Ingestion or Transformation using Java or Scala or Python
• At least 2 years' experience in the following Big Data frameworks: File Format (Parquet, AVRO, ORC, etc..)
• At least 3 years of developing applications with Monitoring, Build Tools, Version Control, Unit Test, TDD, Change Management to support DevOps
• At least 3 years of experience with SQL and Shell Scripting experience
• At least 2 years of experience with software design and must have an understanding of cross-systems usage and impact
Company:
InterSources Inc. solves operational problems where protection, performance, compliance, AI, and workforce capability must work together. Founded in 2007, the company is headquartered in Fremont, USA, with a team of 501-1000 employees. The company is currently Late Stage.

InterSources logo

About InterSources

Sourced by ZipRecruiter

In 2007, Our journey began as pioneers in the realm of technology and security. Since then, InterSources Inc. has evolved into a trusted partner, leading the way in Cloud Security, Cybersecurity, PLG Consulting, Digital Transformation, and Professional Services. With a rich history of excellence and a forward-thinking approach, we continue to secure your digital future and drive innovation. Explore our legacy of success and discover the possibilities that lie ahead.

Industry

Recruiting and staffing services

Company size

51 - 200 Employees

Headquarters location

Fremont, CA, US

Social media