ZipRecruiter

Log In

1

Hadoop Python Jobs in Virginia (NOW HIRING)

Alliance Sourcing Network

Data Engineer

Arlington, VA · On-site

$131K - $158K/yr

The ideal candidate must have 8+ years of hands-on data engineering experience building large-scale ETL pipelines using Apache Spark, Hadoop, Python, and SQL. They also need a strong background in ...

New

Fusion Global Solutions

Data Engineer

Arlington, VA · On-site

$131K - $158K/yr

Spark Hadoop Python Level of Competency: [Foundational, Intermediate, Advanced or Expert] Advanced Summary Role: * Support the design, implementation, and maintenance of enterprise ETL processes for ...

New

Palnar

Machine Learning with Python Development

Richmond, VA · On-site

$49.75 - $68.75/hr

... Hadoop stack Exposure/experience in NLP is preferable, experience with Deep Learning methods is preferable Education: Requires bachelor's degree in a highly quantitative field (Computer Science ...

Polar IT Services

AWS Python Developer

Reston, VA · On-site +1

$52.25 - $72/hr

AWS Python Developer with AI experience Location: Reston, VA Mode of Work: 3 Days hybrid Top Skills ... Knowledge of big data technologies ( Spark, Hadoop, Databricks). Background in NLP, computer vision ...

Polar IT Services

AWS Python Developer

Reston, VA · Hybrid

$52.25 - $72/hr

AWS Python Developer with AI experience Location: Reston, VA Mode of Work: 3 Days hybrid Top Skills ... Knowledge of big data technologies ( Spark, Hadoop, Databricks). Background in NLP, computer vision ...

JTEC Consulting

Python Developer (Mid-Senior)

Chantilly, VA · On-site

$150K - $175K/yr

Experience with large-scale, massively parallel distributed data processing tools including Spark, Hadoop, Presto, NiFi * Programming experience using Python, Java, Perl, C, C++ * Experience with ELK ...

Mavens Guild

Senior Spark & Python Developer

Mclean, VA · On-site

$122K - $165K/yr

Drawing from your vast hands-on experience in Python (PySpark), Spark, REST, Java, and Scala, you ... Experience working in a distributed computing infrastructure like Hadoop and/or Spark * Critical ...

Mavens Guild

Senior Spark & Python Developer

Mclean, VA · On-site

$122K - $165K/yr

Drawing from your vast hands-on experience in Python (PySpark), Spark, REST, Java, and Scala, you ... Experience working in a distributed computing infrastructure like Hadoop and/or Spark * Critical ...

Mavens Guild

Senior Spark & Python Developer

Mclean, VA · On-site

$122K - $165K/yr

Drawing from your vast hands-on experience in Python (PySpark), Spark, REST, Java, and Scala, you ... Experience working in a distributed computing infrastructure like Hadoop and/or Spark * Critical ...

next page

Showing results 1-20

All JobsHadoop Python JobsHadoop Python Jobs in Virginia

Hadoop Python information

Is Hadoop admin a good career?

Hadoop administration is a viable career path for those interested in managing big data infrastructure, requiring skills in Hadoop ecosystem tools, Linux, and scripting. It offers opportunities in data management, analytics, and cloud environments, with demand driven by data-driven business needs. Certifications like Cloudera or Hortonworks can enhance job prospects.

Are Python still in demand in 2026?

Python remains highly in demand for roles like Hadoop Python developers, as it is widely used for data processing, scripting, and automation in big data environments. Its versatility and strong community support ensure continued relevance, especially when combined with skills in Hadoop, Spark, and cloud platforms.

Does Hadoop work with Python?

Hadoop can work with Python through tools like Hadoop Streaming, which allows Python scripts to process data within Hadoop jobs. Additionally, frameworks such as PySpark enable Python developers to work with Apache Spark on Hadoop clusters for big data processing. Knowledge of these tools is beneficial for Hadoop Python roles.

What are the key skills and qualifications needed to thrive as a Hadoop Python Developer, and why are they important?

To thrive as a Hadoop Python Developer, you need a strong understanding of distributed computing, Hadoop ecosystem components (like HDFS, MapReduce, Hive, or Pig), and advanced Python programming skills, often supported by a degree in computer science or related field. Familiarity with tools such as Apache Spark, Sqoop, and workflow schedulers (like Oozie or Airflow), along with experience in handling big data platforms, is typically required. Problem-solving abilities, attention to detail, and effective communication help developers collaborate with teams and translate business requirements into scalable data solutions. These skills and qualifications are essential for efficiently processing and analyzing large datasets, ensuring data reliability, and driving business insights.

What is the highest paying job in Python?

The highest paying Python-related jobs include roles such as Machine Learning Engineer, Data Scientist, and Quantitative Analyst, often requiring advanced skills in algorithms, statistics, and frameworks like TensorFlow or scikit-learn. These positions typically offer salaries exceeding $120,000 annually, especially with experience and relevant certifications.

What is the difference between Hadoop Python vs Hadoop Java Developer?

AspectHadoop PythonHadoop Java Developer
Required CredentialsPython programming skills, Hadoop certificationsJava programming skills, Hadoop certifications
Work EnvironmentData analysis, scripting, data pipeline developmentCore development, system integration, big data application coding
Industry UsageData science, analytics, machine learning projectsData infrastructure, platform development, system optimization

Hadoop Python and Hadoop Java Developer roles both involve working with Hadoop ecosystems, but Python focuses more on data analysis and scripting, while Java is geared towards core development and system integration. The choice depends on your programming expertise and career goals within big data environments.

What is a Hadoop Python developer?

A Hadoop Python developer is a software professional who specializes in using Python programming language to develop, implement, and maintain applications that process and analyze large datasets within the Hadoop ecosystem. They leverage Python libraries like PySpark to write scalable data processing scripts, interact with Hadoop components such as HDFS, and optimize big data workflows. These developers play a critical role in building data pipelines, performing data transformation, and supporting analytics projects in organizations that handle vast amounts of data.

How do Hadoop Python developers typically collaborate with data engineers and analysts on large-scale data projects?

Hadoop Python developers frequently work alongside data engineers and analysts to design, implement, and optimize data pipelines for handling vast datasets. They are responsible for writing Python scripts that interface with Hadoop components, ensuring data is processed efficiently and meets project requirements. Regular communication with data engineers helps align on infrastructure and architectural decisions, while close collaboration with analysts ensures data outputs are accurate and actionable. Agile methodologies and daily stand-ups are common, fostering teamwork and quick problem-solving.
What are popular job titles related to Hadoop Python jobs in Virginia? For Hadoop Python jobs in Virginia, the most frequently searched job titles are:
What job categories do people searching Hadoop Python jobs in Virginia look for? The top searched job categories for Hadoop Python jobs in Virginia are:
What cities in Virginia are hiring for Hadoop Python jobs? Cities in Virginia with the most Hadoop Python job openings:
Hadoop Python jobs near you

Data Engineer - Hadoop to Databricks Migration

Interon IT Solutions LLC

Chantilly, VA • On-site

Other

Posted 3 days ago

New

Job description

Senior Data Engineer Hadoop to Databricks Migration

Location: Remote
Employment Type: W2

Job Description

We are looking for an experienced Senior Data Engineer with strong hands-on experience in Hadoop to Databricks migration.

The candidate will be responsible for migrating legacy Hadoop, HDFS, Hive, and Spark workloads to Databricks and modernizing existing data pipelines using PySpark and Delta Lake.

Key Responsibilities

  • Migrate Hadoop and HDFS workloads to Databricks.
  • Analyze existing Hadoop, Hive, and Spark environments.
  • Migrate large-scale datasets and Hive tables to Databricks.
  • Convert legacy Hive, MapReduce, and Spark jobs to PySpark.
  • Build and maintain ETL/ELT pipelines using Databricks.
  • Develop data solutions using Python, PySpark, Spark SQL, and SQL.
  • Implement Delta Lake and Databricks Lakehouse solutions.
  • Perform source-to-target data mapping and transformation.
  • Validate migrated data for accuracy and completeness.
  • Troubleshoot data migration and pipeline issues.
  • Optimize Spark and PySpark jobs for performance.
  • Support migration testing, production deployment, and post-migration validation.
  • Work with architects and engineering teams during the migration process.
  • Document migration processes and technical solutions.

Required Skills

  • 8+ years of Data Engineering or Big Data experience.
  • Strong Hadoop to Databricks migration experience.
  • Strong experience with Hadoop, HDFS, Hive, and Spark.
  • Hands-on experience with Databricks.
  • Strong Python, PySpark, Spark SQL, and SQL skills.
  • Experience converting legacy Hadoop workloads to Databricks.
  • Strong ETL/ELT pipeline development experience.
  • Experience with Delta Lake and Databricks Lakehouse.
  • Experience with data validation and reconciliation.
  • Strong Spark performance tuning experience.
  • Experience with Git and CI/CD.
  • Strong troubleshooting and communication skills.

Preferred Skills

  • Cloudera or Hortonworks to Databricks migration experience.
  • Unity Catalog.
  • Databricks Workflows and Jobs.
  • Auto Loader and Delta Live Tables.
  • AWS, Azure, or Google Cloud Platform experience.
  • Hadoop modernization and decommissioning experience.

Apply