ZipRecruiter

Log In

1

Big Data Engineer Intern Jobs in California (NOW HIRING)

Cypress HCM

Data Engineer

Mountain View, CA

$70 - $95/hr

Looking for world class server software engineers with Big Data Infrastructure and Data warehousing experience to join our technology innovation group focused on the rapid development of AI driven ...

E*Pro, Inc.

Big Data Developer

San Jose, CA · On-site

$62 - $80.50/hr

Hadoop Big Data Technologies HBase Linux Core Java Mongo DB Big Data Architecture knowledge is prefered Additional Information All your information will be kept confidential according to EEO ...

TestingXperts

Big Data Developer (Spark)

Cupertino, CA

$65.50 - $84.75/hr

Big Data Developer (Spark) Location: Cupertino, CA Duration: 6 to 12 months Interview: Phone and Skype - Spark and Scala, Java, Hadoop MR Unix, Desired years of experience* : 10- 12 years of ...

Jobsbridge

Big Data Lead

Alameda, CA · On-site

Be it core Java, full-stack Java, Web/UI designers, Big Data or Cloud or Mobility developers/architects, we have them all. 8+ years of experience. Design, develop and implement big data solutions on ...

Glow Networks

Data Engineer

Mountain View, CA · On-site

$135K - $162K/yr

Job Role: Data Engineer Location: Mountain View, CA (Hybrid 3days onsite, 2 days remote ... Leverage advanced tools like Databricks for big data processing, ensuring the data is accessible ...

KBR

Big Data Systems Engineer

Los Angeles, CA · Hybrid

Big Data Systems Engineer Belong, Connect, Grow, with KBR! KBR's National Security Solutions (NSS) team provides high-end engineering and advanced technology solutions to our customers in the ...

Sapta Global Inc

Big Data Developer

Signal Hill, CA · Remote

$56.50 - $73.50/hr

This global organization is expanding their data department. They want a Sr. Developer who is comfortable working with business stakeholders/users. Be responsible for helping the business users ...

Jobsbridge

Sr. SOFTWARE ENGINEER/Big Data

San Jose, CA · On-site

$65.25 - $86.50/hr

Mentor and coach junior engineers on various design and development aspects of big data platform. Prototype ideas quickly using cutting edge technologies Qualifications and Requirements Bachelors or ...

Collabera

Lead Datawarehouse /Big Data

Torrance, CA · On-site

Big Data/Netezza Integration, comfortable in usage of the Sqoop, Linux Shell scripting, related utilities and the R programming. * Excellent knowledge of Hadoop architecture and administration and ...

Apex Informatics

AWS Data Engineer

San Francisco, CA · On-site

$134K - $162K/yr

AWS Data Engineer Location: San Francisco and jersey city ( 3 days onsite 2 days remote) look for ... Leverage Spark and other big data technologies to process and analyze large datasets. • ...

Brevian.ai

Data Engineer

Sunnyvale, CA · On-site

$134K - $161K/yr

Job title Data Engineer Position overview We are looking for an experienced Data Engineer to join ... Implement and manage big data systems, including but not limited to Kafka, EMR, and data pipelines ...

previous pagenext page

Showing results 21-40

All JobsBig Data Engineer Intern JobsBig Data Engineer Intern Jobs in California

Big Data Engineer Intern information

What does a Big Data Engineer Intern do?

A Big Data Engineer Intern assists with designing, building, and maintaining large-scale data processing systems. They often work with technologies such as Hadoop, Spark, and SQL to manage and analyze large datasets. Interns may help develop data pipelines, clean and organize data, and support senior engineers in optimizing data workflows. This role provides hands-on experience in handling big data tools and working on real-world data engineering projects.

What are the key skills and qualifications needed to thrive as a Big Data Engineer Intern?

To thrive as a Big Data Engineer Intern, you need a solid understanding of programming (especially Python, Java, or Scala), data structures, and basic knowledge of distributed computing concepts, typically supported by coursework or relevant projects. Familiarity with big data tools like Hadoop, Spark, and data querying languages such as SQL, as well as exposure to cloud platforms like AWS or Azure, is highly valuable. Strong analytical thinking, problem-solving abilities, and communication skills help interns collaborate effectively and learn quickly in dynamic environments. These skills and qualities are crucial for handling large-scale datasets and supporting the development of data-driven solutions within engineering teams.

What are some common challenges a Big Data Engineer Intern might face when working with large datasets?

As a Big Data Engineer Intern, you'll often encounter challenges related to managing the scale and complexity of massive datasets. These can include optimizing data ingestion pipelines for speed and efficiency, troubleshooting data quality issues, and ensuring data privacy and security. Additionally, you may need to quickly learn new tools or frameworks, such as Hadoop or Spark, and collaborate closely with data scientists and engineers to ensure data is structured and accessible for analysis. Developing problem-solving skills and being proactive in seeking help from your team can help you overcome these hurdles.

What is the difference between Big Data Engineer Intern vs Data Engineer?

AspectBig Data Engineer InternData Engineer
CredentialsRelevant coursework, some internshipsBachelor's or master's in CS, experience preferred
Work EnvironmentInternship, learning-focused, entry-level projectsFull-time, professional projects, team collaboration
Industry UsageTech, finance, healthcare, startupsSame industries, more responsibility
Search & Comparison IntentEntry-level, internship opportunitiesCareer advancement, full-time roles

The main difference between a Big Data Engineer Intern and a Data Engineer is experience level and responsibility. Interns are typically students or early learners gaining exposure, while Data Engineers are full-time professionals managing complex data systems. Internships serve as stepping stones toward full-time data engineering careers.

What are the most commonly searched types of Big Data Engineer jobs in California?

The most popular types of Big Data Engineer jobs in California are:

What cities in California are hiring for Big Data Engineer Intern jobs?

Cities in California with the most Big Data Engineer Intern job openings:

Big Data Engineer Intern jobs near you

Principal Data Engineer - (Hadoop/Big Data, AWS, Python, Kinesis) - Irvine, CA - Onsite - Contr[...]

Central Business Solutions, Inc

Irvine, CA • On-site

$150 - $190/hr

Other

Posted 8 days ago

Job description

Principal Data Engineer – (Hadoop/Big Data, AWS, Python, Kinesis) - Irvine, CA - Onsite - Contract to Hire - AS
  • Irvine, CA

Position: Senior Data Engineer – (Hadoop/Big Data, AWS, Python, Kinesis)
Location: Irvine, CA - Onsite role
Position Type: Contract to Hire

Responsibilities

You will be responsible for all aspects of data acquisition, data transformation, analytics scheduling and operationalization to drive high-visibility, cross-division outcomes. Investigate, evaluate, test and recommend technical solutions for future systems. They will support software developers, database architects, data scientists on data initiatives and will contribute optimal data delivery architecture.

What you will be doing:
  • Lead the creation of data environments and/or data sets to serve a wide range of data users, including but not limited to Data Scientists, Data Analysts, Business Analysts etc.
  • Perform offline analysis of large data sets using components of a big data software ecosystem.
  • Validate the solution of root cause analysis escalated by various technical staff in multiple organizations and with differing levels of expertise.
  • Investigate, evaluate, test and recommend technical solutions for future systems.
Data Management
  • Own product data sets from the definition phase through to production deployment (end-to-end).
  • Provide solutions for the design and implementation of Hadoop EMR Cluster/ Big Data Infrastructure.
  • Deploy Hadoop/Big Data/Spark and database storage Infrastructures in AWS cloud.
  • Monitor HDFS/Hadoop/Spark and related software releases, third-party utilities with emphasis on overall system performance.
  • Lead and develop tools and procedures to monitor and automate system tasks on servers and clusters
  • Lead and collaborate with other teams to design, develop, and deploy data tools that support both operations and product use cases.
Data Design
  • Lead and design distributed, scalable, and reliable data pipelines that ingest and process data at scale and in real-time.
  • Lead and design big data technologies and prototype solutions to improve data processing architecture.
QualificationsWhat we are looking for:
  • Bachelor’s degree in computer science, computer engineering, or a related technical field.
  • 12+ years of professional experience as a data software engineer; or 16+ years of related experience as a data software engineer in lieu of 4-year degree.
  • 2+ years of experience with AWS cloud or other cloud Big Data computing design, provisioning, and tuning.
  • Related AWS certification, preferred.
  • Previous experience as a Data Engineer / Database Administrator and/or Business Intelligence Analyst.
  • Expertise in database concepts, object and data modeling techniques and design principles.
  • Expertise in database architectures, software, and facilities
  • Expertise with programming languages - Python (required), Scala, Ruby, R Database technologies - SQL, performance tuning concepts, AWS RDS, RedShift, MySQL
  • Expertise with big data batch processing tools: Hadoop MapReduce, ElasticSearch, PIG, Hive, Cascading/Scalding, Apache Spark, AWS EMR
  • Expertise with stream-processing systems: Kinesis, Kafka, MQTT
  • Expertise with relational NoSQL databases including DyanamoDB
  • Expertise in writing JSON, XML, YAML and other data definition schemas
  • Excellent verbal and written communication skills necessary to effectively collaborate in a team environment and present and explain technical information and provide advice to management.
  • Ability to work on advanced complex technical projects or business issues requiring state of the art technical knowledge or industry.
  • Ability to work on significant and unique issues where analysis of situations or data requires an evaluation of intangibles.
  • Exercises independent judgment in methods, techniques and evaluation criteria for obtaining results.
  • Ability to lead and mentor junior engineers and colleagues.
#J-18808-Ljbffr

Apply