1

Hadoop Python Jobs in California (NOW HIRING)

Talend, Pig, Python, Hive knowledge is a must. * Familiar with all components of the BigData stack in detail, e.g., Hadoop, Pig, Hive, HBase, Oozie * Advanced experience with large BigData or Data ...

Python SRE

Redwood City, CA

$61.50 - $84.75/hr

Python SRE Redwood City, CA Contract Responsibilities: * 3+ years of experience designing, building ... Hadoop and MySQL)

Python Developer

San Francisco, CA

$59.25 - $81.50/hr

Hadoop ecosystems, Kafka, real-time streaming, data lakes * Data Modeling: dimensional models ... Full Stack Python * FrontEnd: React/Angular * Backend: FastAPI / Flask * Data layer: SQLServer ...

At least 2 years of experience with Big Data & Analytics solutions - Hadoop, MapReduce, Pig, Hive ... Development experience in Java, Python, Scala. * Experience in cloud technologies preferred - AWS ...

At least 2 years of experience with Big Data & Analytics solutions - Hadoop, MapReduce, Pig, Hive ... Development experience in Java, Python, Scala. * Experience in cloud technologies preferred - AWS ...

next page

Showing results 1-20

Hadoop Python information

What are the key skills and qualifications needed to thrive as a Hadoop Python Developer, and why are they important?

To thrive as a Hadoop Python Developer, you need a strong understanding of distributed computing, Hadoop ecosystem components (like HDFS, MapReduce, Hive, or Pig), and advanced Python programming skills, often supported by a degree in computer science or related field. Familiarity with tools such as Apache Spark, Sqoop, and workflow schedulers (like Oozie or Airflow), along with experience in handling big data platforms, is typically required. Problem-solving abilities, attention to detail, and effective communication help developers collaborate with teams and translate business requirements into scalable data solutions. These skills and qualifications are essential for efficiently processing and analyzing large datasets, ensuring data reliability, and driving business insights.

How do Hadoop Python developers typically collaborate with data engineers and analysts on large-scale data projects?

Hadoop Python developers frequently work alongside data engineers and analysts to design, implement, and optimize data pipelines for handling vast datasets. They are responsible for writing Python scripts that interface with Hadoop components, ensuring data is processed efficiently and meets project requirements. Regular communication with data engineers helps align on infrastructure and architectural decisions, while close collaboration with analysts ensures data outputs are accurate and actionable. Agile methodologies and daily stand-ups are common, fostering teamwork and quick problem-solving.

What is a Hadoop Python developer?

A Hadoop Python developer is a software professional who specializes in using Python programming language to develop, implement, and maintain applications that process and analyze large datasets within the Hadoop ecosystem. They leverage Python libraries like PySpark to write scalable data processing scripts, interact with Hadoop components such as HDFS, and optimize big data workflows. These developers play a critical role in building data pipelines, performing data transformation, and supporting analytics projects in organizations that handle vast amounts of data.

What is the difference between Hadoop Python vs Hadoop Java Developer?

AspectHadoop PythonHadoop Java Developer
Required CredentialsPython programming skills, Hadoop certificationsJava programming skills, Hadoop certifications
Work EnvironmentData analysis, scripting, data pipeline developmentCore development, system integration, big data application coding
Industry UsageData science, analytics, machine learning projectsData infrastructure, platform development, system optimization

Hadoop Python and Hadoop Java Developer roles both involve working with Hadoop ecosystems, but Python focuses more on data analysis and scripting, while Java is geared towards core development and system integration. The choice depends on your programming expertise and career goals within big data environments.

What job categories do people searching Hadoop Python jobs in California look for? The top searched job categories for Hadoop Python jobs in California are:
What cities in California are hiring for Hadoop Python jobs? Cities in California with the most Hadoop Python job openings:
Hadoop Developer

Full-time

Posted 18 hours ago


Job description

Company Description

Sonsoft , Inc. is a USA based corporation duly organized under the laws of the Commonwealth of Georgia. Sonsoft Inc. is growing at a steady pace specializing in the fields of Software Development, => Software Consultancy and Information Technology Enabled Services.

Job Description

Responsibilities:

  • Responsible for data Ingestion, data quality, development, production code management and testing/deployment strategy in BigData development (Hadoop).
  • Acts as a lead in identification and troubleshooting processing issues impacting timely availability of data in the BigData or delivery of critical reporting within established SLAs. Provide mentoring to Level 2 production support team.
  • Identifies and recommends technical improvements in production application solutions or operational processes in support of BigData platform and information delivery assets (ie, data quality, performance, supporting Data scientists etc.)
  • Focuses on the overall stability and availability of the BigData platform and the associated interfaces and transport protocols.
  • Researches, manages and coordinates resolution of complex issues through root cause analysis as appropriate
  • Establishes and maintains productive relationships with technical leads of key operational sources systems providing data to BigData plaform.
  • Establishes and maintains productive relationships with technical leads of key infrastructure support areas, such as system/Infra engineers.
  • Participate in daily standup meetings.
  • Ensure adherence to established problem / incident management, change management and other internal IT processes
  • Responsible for communication related to any day to day issues and problem resolutions. Communication may include direct department management as well downstream/upstream application contacts and business partners.
  • Ensures comprehensive knowledge transition from development teams on new or modified applications moving to ongoing production support.
  • Seeks improvement opportunities in design, solution implementation approaches in partnership with development team for ensuring the performance and health of the BigData platform.
  • Ensures timely and accurate escalation of issues to management


Requirements:

  • At least 2+ years developing and supporting data ingestion using Talend for BigData/Hadoop. (sourced from Teradata, Oracle, files etc)
  • Java, Oozie knowledge is preferable. Talend, Pig, Python, Hive knowledge is a must.
  • Familiar with all components of the BigData stack in detail, e.g., Hadoop, Pig, Hive, HBase, Oozie
  • Advanced experience with large BigData or Data warehouse environment is a plus.
  • Possess a strong technology, data, and production support background.
  • Proven experience working with onshore/off shore support team.
  • Previous experience working in a high paced, high pressure Production Support environment.
  • Proven analytical and problem solving skills for assessment of complex production support issues and recommend / implement effective solutions
  • Previous experience in using IT Ticketing processes for managing incidents and issue resolution and conversant with established Change control / Change management standards
  • Natural technical and functional curiosity
  • Familiar with Agile Methodology.
  • Excellent communication skills.


Preferred

  • Experience in Design and architecture review.
  • Ability to work in team in diverse/ multiple stakeholder environment
  • Ability to work in Onsite Offshore model
  • Experience in Financial Services Domain.
  • Experience and desire to work in a Global delivery environment.
Qualifications
  • Bachelor's degree or foreign equivalent required from an accredited institution. Will also consider three years of progressive experience in the specialty in lieu of every year of education.
  • At least 4 years of experience with Information Technology.
Additional Information

** U.S. citizens and those authorized to work in the U.S. are encouraged to apply. We are unable to sponsor at this time.

Note:-

  1. This is a Full-Time Permanent job opportunity for you.
  2. Only US Citizen, Green Card Holder, TN Visa, GC-EADH4-EAD & L2-EAD can apply.
  3. No OPT-EAD & H1B Consultants please.
  4. Please mention your Visa Status in your email or resume.

Sonsoft logo

About Sonsoft

Sourced by ZipRecruiter

Sonsoft , Inc. is a USA based corporation duly organized under the laws of the Commonwealth of Georgia. Sonsoft Inc. is growing at a steady pace specializing in the fields of Software Development, Software Consultancy and Information Technology Enabled Services.

Industry

It services

Company size

51 - 200 Employees

Headquarters location

Alpharetta, GA, US

Year founded

2007