1

Intern Streaming Data Engineer Jobs in Arizona (NOW HIRING)

Big Data Engineer II

Phoenix, AZ

$55.75 - $73.75/hr

Test the engineering resilience of software and automation tools. * Be part of an enthusiastic ... Kafka streams or queues * Experience with GitHub and leveraging CI/CD pipelines * Experience with ...

Data engineering experience with Spark, Airflow/dbt, streaming, data modeling or ML/data science background feature engineering, experimentation or model evaluation * Experience with MLOps/LLMOps ...

Data engineering experience with Spark, Airflow/dbt, streaming, data modeling or ML/data science background feature engineering, experimentation or model evaluation * Experience with MLOps/LLMOps ...

Senior Data Engineer (20187)

Phoenix, AZ · On-site

$97K - $132K/yr

Position Summary We are seeking a highly skilled Senior Data Engineer to design, build, and ... Understanding of streaming and event-driven architectures (e.g., Kafka, Kinesis) for real-time data ...

Senior Data Engineer (20187)

Phoenix, AZ · On-site

$97K - $132K/yr

Position Summary We are seeking a highly skilled Senior Data Engineer to design, build, and ... Understanding of streaming and event-driven architectures (e.g., Kafka, Kinesis) for real-time data ...

Senior Data Engineer II (Hybrid)

Scottsdale, AZ · On-site

$106K - $145K/yr

Your Impact We are seeking a Senior Data Engineer II to play a pivotal role in building and ... AI-driven work-streams across Finance, Sales, Operations, and other business functions.

Senior Data Engineer II (Hybrid)

Scottsdale, AZ · On-site +1

$106K - $145K/yr

Your Impact We are seeking a Senior Data Engineer II to play a pivotal role in building and ... AI-driven work-streams across Finance, Sales, Operations, and other business functions.

Data/Information Architect

Tempe, AZ · On-site

$61 - $78.50/hr

In depth understanding of Spark Architecture including Spark Core, Spark SQL, Data Frames, Spark Streaming, RDD caching, Spark MLib. * Good to have any programming language experience with Python ...

Data/Information Architect

Tempe, AZ · On-site

$61 - $78.50/hr

In depth understanding of Spark Architecture including Spark Core, Spark SQL, Data Frames, Spark Streaming, RDD caching, Spark MLib. * Good to have any programming language experience with Python ...

Showing results 41-60

Intern Streaming Data Engineer information

What is the difference between Intern Streaming Data Engineer vs Intern Data Analyst?

AspectIntern Streaming Data EngineerIntern Data Analyst
Required SkillsKnowledge of streaming platforms (e.g., Kafka, Spark Streaming), programming (Python, Java), data pipeline developmentData analysis, SQL, Excel, basic statistical skills
Work EnvironmentDeveloping real-time data pipelines, working with big data toolsAnalyzing stored data, generating reports and insights
Industry UsageTech, finance, e-commerce companies focusing on real-time data processingMarketing, business intelligence, research departments

The Intern Streaming Data Engineer focuses on building and maintaining real-time data pipelines using streaming technologies, requiring programming and big data skills. In contrast, the Intern Data Analyst primarily analyzes stored data to generate insights, emphasizing statistical and reporting skills. Both roles are common in data-driven industries but serve different functions within data management and analysis.

What does an Intern Streaming Data Engineer do?

An Intern Streaming Data Engineer assists in designing, developing, and maintaining systems that process real-time data streams. They typically work with technologies like Apache Kafka, Apache Flink, or Spark Streaming to collect, process, and analyze data as it arrives. Their responsibilities may include writing code, troubleshooting data pipelines, and collaborating with senior engineers to ensure data flows efficiently. The role is ideal for students or recent graduates looking to gain hands-on experience with big data and real-time analytics.

What types of projects or tasks can an Intern Streaming Data Engineer expect to work on during their internship?

As an Intern Streaming Data Engineer, you can expect to work on projects involving the development, testing, and optimization of real-time data pipelines. Typical tasks may include assisting with the integration of streaming platforms like Apache Kafka or AWS Kinesis, writing and debugging code to process large volumes of incoming data, and collaborating with senior engineers to ensure data quality and reliability. You'll often work within a team of data engineers and analysts, gaining hands-on experience with the latest big data tools and contributing to solutions that support real-time analytics and business decision-making.

What are the key skills and qualifications needed to thrive as an Intern Streaming Data Engineer, and why are they important?

To thrive as an Intern Streaming Data Engineer, you typically need foundational knowledge in computer science, data engineering concepts, and familiarity with real-time data processing. Experience with tools like Apache Kafka, Apache Flink, or Spark Streaming, and programming languages such as Python or Java, is often preferred. Strong problem-solving skills, attention to detail, and effective teamwork and communication abilities help set candidates apart. These skills and qualifications are crucial for efficiently building, maintaining, and troubleshooting streaming data pipelines in dynamic data-driven environments.
What are the most commonly searched types of Streaming Data Engineer jobs in Arizona? The most popular types of Streaming Data Engineer jobs in Arizona are:
What are popular job titles related to Intern Streaming Data Engineer jobs in Arizona? For Intern Streaming Data Engineer jobs in Arizona, the most frequently searched job titles are:
What job categories do people searching Intern Streaming Data Engineer jobs in Arizona look for? The top searched job categories for Intern Streaming Data Engineer jobs in Arizona are:

$55.75 - $73.75/hr

Full-time

Re-posted yesterday


Job description

Key Responsibilities:

Strong HIVE, SPARK, SQL, UNIX

  • Develop and design software applications, translating user needs into system architecture. Assess and validate application performance and integration of component systems and provide process flow diagrams. Test the engineering resilience of software and automation tools.
  • Be part of an enthusiastic, high performing technology team developing solutions to drive engagement and loyalty within our existing cardmember base and attract new customers to the Amex brand.
  • The position will also play a critical role partnering with other development teams, testing and quality, and production support, to meet implementation dates and allow smooth transition throughout the development life-cycle.
  • The successful candidate will be focused on building and executing against a strategy and roadmap focused on moving from monolithic, tightly coupled, batch-based legacy platforms to a loosely coupled, event-driven, microservices-based architecture to meet our long-term business goals.

Must Have Qualifications:

  • .
  • 5+ years of software development experience and leading teams of engineers and scrum teams
  • 3+ years of hands-on experience of working with Map-Reduce, Hive, Spark (core, SQL and PySpark)
  • Hands-on experience on writing and understanding complex SQL(Hive/PySpark-dataframes), optimizing joins while processing huge amount of data
  • Experience in UNIX shell scripting

Additional Good to have requirements:

  • Solid Datawarehousing concepts
  • Knowledge of Financial reporting ecosystem will be a plus
  • Experience with Data Visualization tools like Tableau, SiSense, Looker
  • Expert on Distributed ecosystem
  • Hands-on experience with programming using Python/Scala
  • Expert on Hadoop and Spark Architecture and its working principle
  • Ability to design and develop optimized Data pipelines for batch and real time data processing
  • Should have experience in analysis, design, development, testing, and implementation of system applications
  • Demonstrated ability to develop and document technical and functional specifications and analyze software and system processing flows
  • Aptitude for learning and applying programming concepts.
  • Ability to effectively communicate with internal and external business partners. Preferred Qualifications:
  • Knowledge of cloud platforms like GCP/AWS, building Microservices and scalable solutions, will be preferred
  • 2+ years of experience in designing and building solutions using Kafka streams or queues
  • Experience with GitHub and leveraging CI/CD pipelines
  • Experience with NoSQL i.e., HBase, Couchbase, MongoDB

Education:Employment Type: FULL_TIME

IntraEdge logo

About IntraEdge

Sourced by ZipRecruiter

At heart, we are a technology, products and services organization In our soul, it’s the people who make us what we are — the professionals we train and connect to next-level opportunities and the experts who create innovative solutions and value for our national and international partners. It’s true that innovative technology can provide a major boost to your business, but you also need the right talent pushing it forward. This critical combination is what we offer all of our partners: cutting edge tech solutions and the expertise to bring it to life.

Industry

It services

Company size

1,001 - 5,000 Employees

Headquarters location

Chandler, AZ, US

Year founded

2002

Social media