ZipRecruiter

Log In

1

Hdfs Jobs (NOW HIRING)

Inherent Technologies

Big Data Developer

Jersey City, NJ · On-site

$55.25 - $71.75/hr

Spark Scala Hive/HDFS/HQL Linux Based Hadoop Ecosystem (HDFS, Impala, Hive, HBase, etc.) Experience in Big data technologies , real time data processing platform(Spark Streaming) experience would be ...

Jobsbridge

Hadoop Developer with Java

New York, NY · On-site

Requirements: Expert programming competence in language Java Experience with Hadoop/HDFS/MapReduce Experience with HBase/NoSQL or similar technology is plus Excellent problem solving and ...

Jobsbridge

Senior Hadoop Developer

Seattle, WA · On-site

Experience in importing and exporting data using Sqoop from HDFS to Relational Database Systems and vice-versa. Hands on experience in configuring and working with Flume to load the data from ...

Jobsbridge

Bigdata Lead

Nashville, TN · On-site

Expertise working in Hive, Pig, HDFS, FLUME, SQOOP and Map reduce. Expert in creating hive UDF. Experience in debugging and solving problems which occurs in Eco system. Experience scripting for ...

Jobsbridge

Hadoop Developer

San Francisco, CA · On-site

Company Description Intelliswift Software, Inc Requirements 3-5 years of experience with the Hadoop ecosystem and Big Data technologies Hands-on experience with the Hadoop stack (HDFS, MapReduce ...

LTM

Hadoop Administrator

Tampa, FL · On-site

Knowledge on Apache Distribution have to manually setup all the configurations CoreSite HDFS Site, YARN Site and Map Red Site * Aware of the configuration setup using Hadoop distribution like ...

Jobsbridge

Hadoop Developer with Java

New York, NY · On-site

Requirements: Expert programming competence in language Java Experience with Hadoop/HDFS/MapReduce Experience with HBase/NoSQL or similar technology is plus Excellent problem solving and ...

Sonsoft Inc

Hadoop Develope r HDFS

Plano, TX · On-site

Company Description Sonsoft , Inc. is a USA based corporation duly organized under the laws of the Commonwealth of Georgia. Sonsoft Inc. is growing at a steady pace specializing in the fields of ...

The Pennsylvania State University

HDFS is a dynamic, multidisciplinary and collaborative department, committed to excellence, innovation and impact in understanding and improving the lives of individuals and families in diverse ...

previous pagenext page

Showing results 21-40

All JobsHdfs Jobs

Hdfs information

See salary details

$41.5K

$112.9K

$164.5K

How much do hdfs jobs pay per year?

As of Aug 13, 2026, the average yearly pay for hdfs in the United States is $112,891.00, according to ZipRecruiter salary data. Most workers in this role earn between $93,500.00 and $129,500.00 per year, depending on experience, location, and employer.

What is an HDFS administrator?

HDFS administrators are IT professionals responsible for managing and maintaining the Hadoop Distributed File System (HDFS), which is a core component of the Hadoop ecosystem. Their primary duties include installing, configuring, monitoring, and optimizing HDFS clusters to ensure data reliability, availability, and performance. They also handle tasks such as backup and recovery, security management, troubleshooting, and capacity planning. By ensuring the smooth operation of HDFS, they support big data processing and analytics within organizations.

What are the key skills and qualifications needed to thrive as an HDFS administrator?

To thrive as an HDFS Administrator, you need a solid understanding of Hadoop ecosystem concepts, distributed file systems, and experience with Linux/Unix environments, often supported by a degree in computer science or a related field. Familiarity with Hadoop tools (such as HDFS, YARN, MapReduce), cluster management tools (like Ambari or Cloudera Manager), and relevant certifications (like Hortonworks or Cloudera certifications) is typically required. Strong analytical thinking, problem-solving skills, and effective communication help in diagnosing issues and collaborating with development and data teams. These skills are vital for ensuring data reliability, optimizing performance, and supporting large-scale data operations in enterprise environments.

What is the difference between Hdfs vs Hadoop Administrator?

AspectHdfsHadoop Administrator
Primary RoleDistributed storage system for big dataManaging and maintaining Hadoop ecosystem including HDFS
Required SkillsKnowledge of HDFS architecture, data storage, and managementHDFS, cluster setup, troubleshooting, security, and performance tuning
Work EnvironmentData storage infrastructure within big data environmentsHadoop clusters in enterprise data centers or cloud platforms
CertificationsHadoop certifications often include HDFS modulesHadoop certifications with focus on administration and HDFS management

Hdfs is a core component of the Hadoop ecosystem, focusing on distributed data storage. A Hadoop Administrator manages and maintains HDFS along with other Hadoop components, ensuring smooth operation of big data environments. While Hdfs involves understanding data storage architecture, the Hadoop Administrator's role encompasses broader responsibilities like cluster management, security, and troubleshooting.

What are some common challenges HDFS administrators face when managing large-scale data clusters?

HDFS Administrators often encounter challenges such as maintaining data reliability across numerous nodes, optimizing storage utilization, and ensuring high availability of data. Balancing performance while handling hardware failures and performing regular upgrades or scaling tasks can also be complex. Effective monitoring and troubleshooting of issues, as well as coordinating with data engineers and developers to support evolving data needs, are key aspects of the role.
More about Hdfs jobs
What cities are hiring for Hdfs jobs? Cities with the most Hdfs job openings:
What states have the most Hdfs jobs? States with the most job openings for Hdfs jobs include:
What job categories do people searching Hdfs jobs look for? The top searched job categories for Hdfs jobs are:
Hdfs jobs near you
Infographic showing various Hdfs job openings in the United States as of August 2026, with employment types broken down into 80% Full Time, 2% Part Time, and 18% Contract. Highlights an 88% Physical, 4% Hybrid, and 8% Remote job distribution, with an average salary of $112,891 per year, or $54.3 per hour.

Data Engineer - Hadoop to Databricks Migration

Interon IT Solutions

Chantilly, VA • Remote

Full-time

Re-posted 7 days ago

Job description

Senior Data Engineer – Hadoop to Databricks Migration

Location: Remote
Employment Type: W2

Job Description

We are looking for an experienced Senior Data Engineer with strong hands-on experience in Hadoop to Databricks migration.

The candidate will be responsible for migrating legacy Hadoop, HDFS, Hive, and Spark workloads to Databricks and modernizing existing data pipelines using PySpark and Delta Lake.

Key Responsibilities

  • Migrate Hadoop and HDFS workloads to Databricks.
  • Analyze existing Hadoop, Hive, and Spark environments.
  • Migrate large-scale datasets and Hive tables to Databricks.
  • Convert legacy Hive, MapReduce, and Spark jobs to PySpark.
  • Build and maintain ETL/ELT pipelines using Databricks.
  • Develop data solutions using Python, PySpark, Spark SQL, and SQL.
  • Implement Delta Lake and Databricks Lakehouse solutions.
  • Perform source-to-target data mapping and transformation.
  • Validate migrated data for accuracy and completeness.
  • Troubleshoot data migration and pipeline issues.
  • Optimize Spark and PySpark jobs for performance.
  • Support migration testing, production deployment, and post-migration validation.
  • Work with architects and engineering teams during the migration process.
  • Document migration processes and technical solutions.

Required Skills

  • 8+ years of Data Engineering or Big Data experience.
  • Strong Hadoop to Databricks migration experience.
  • Strong experience with Hadoop, HDFS, Hive, and Spark.
  • Hands-on experience with Databricks.
  • Strong Python, PySpark, Spark SQL, and SQL skills.
  • Experience converting legacy Hadoop workloads to Databricks.
  • Strong ETL/ELT pipeline development experience.
  • Experience with Delta Lake and Databricks Lakehouse.
  • Experience with data validation and reconciliation.
  • Strong Spark performance tuning experience.
  • Experience with Git and CI/CD.
  • Strong troubleshooting and communication skills.

Preferred Skills

  • Cloudera or Hortonworks to Databricks migration experience.
  • Unity Catalog.
  • Databricks Workflows and Jobs.
  • Auto Loader and Delta Live Tables.
  • AWS, Azure, or GCP experience.
  • Hadoop modernization and decommissioning experience.