Technical Skills Core Technologies Python Big Data / Hadoop Data Warehouse Spark PySpark HQL SQL AWS / Cloud Platforms Quality Engineering Test Automation ETL Testing Data Validation Testing API ...
Technical Skills Core Technologies Python Big Data / Hadoop Data Warehouse Spark PySpark HQL SQL AWS / Cloud Platforms Quality Engineering Test Automation ETL Testing Data Validation Testing API ...
Quality Assurance Architect - Hadoop / Big Data / Python
Pittsburgh, PA · On-site
$62 - $79.50/hr
Technical Skills Core Technologies • Python • Big Data / Hadoop • Data Warehouse • Spark • PySpark • HQL • SQL • AWS / Cloud Platforms Quality Engineering • Test Automation • ETL ...
Quality Assurance Architect - Hadoop / Big Data / Python
Pittsburgh, PA · On-site
$62 - $79.50/hr
Technical Skills Core Technologies • Python • Big Data / Hadoop • Data Warehouse • Spark • PySpark • HQL • SQL • AWS / Cloud Platforms Quality Engineering • Test Automation • ETL ...
... developed - Deep SQL and Python in data science and machine learning space good in finance ... Hadoop, etc. are all plusses - Years of experience are not really required, more focused on ...
... developed - Deep SQL and Python in data science and machine learning space good in finance ... Hadoop, etc. are all plusses - Years of experience are not really required, more focused on ...
Candidate must have both python development and ETL testing experience and able to handle the testing work independently. MUST HAVE SKILLS: 8 years, minimum 6 years • Hadoop - mandatory • Python ...
Quick apply
Candidate must have both python development and ETL testing experience and able to handle the testing work independently. MUST HAVE SKILLS: 8 years, minimum 6 years • Hadoop - mandatory • Python ...
Kafka/Spark Developer
Pittsburgh, PA · On-site
Hadoop Ecosystem (HDFS) * Impala * Oracle * Oracle RBDMS Audit * Postgre SQL * Python * SQL What you can expect from us: Together, as owners, let's turn meaningful insights into action. Life at CGI ...
Kafka/Spark Developer
Pittsburgh, PA · On-site
Hadoop Ecosystem (HDFS) * Impala * Oracle * Oracle RBDMS Audit * Postgre SQL * Python * SQL What you can expect from us: Together, as owners, let's turn meaningful insights into action. Life at CGI ...
Kafka/Spark Developer
Pittsburgh, PA · On-site
Hadoop Ecosystem (HDFS) * Impala * Oracle * Oracle RBDMS Audit * Postgre SQL * Python * SQL What you can expect from us: Together, as owners, let's turn meaningful insights into action. Life at CGI ...
Kafka/Spark Developer
Pittsburgh, PA · On-site
Hadoop Ecosystem (HDFS) * Impala * Oracle * Oracle RBDMS Audit * Postgre SQL * Python * SQL What you can expect from us: Together, as owners, let's turn meaningful insights into action. Life at CGI ...
Machine Learning Operations Engineer - Pittsburgh, PA, Strongsville, OH, or Dallas, TX - Full Time
Pittsburgh, PA · On-site
Amazon Web Services Cloud, Apache Hadoop YARN,Apache Kafka, AWS SageMaker,Big Data, Analytics & Operations,Hadoop Hive,Machine Learning,Pandas,Python * 6+ years of experience in software engineering ...
Machine Learning Operations Engineer - Pittsburgh, PA, Strongsville, OH, or Dallas, TX - Full Time
Pittsburgh, PA · On-site
Amazon Web Services Cloud, Apache Hadoop YARN,Apache Kafka, AWS SageMaker,Big Data, Analytics & Operations,Hadoop Hive,Machine Learning,Pandas,Python * 6+ years of experience in software engineering ...
Data Engineer Senior - Data Products Organization (Cloudera Hadoop)
Pittsburgh, PA · On-site
$65K - $171K/yr
... Hadoop, Spark ... 3m Python, Kafka, and complex orchestration. - Communication and lead experience over a group of ...
Data Engineer Senior - Data Products Organization (Cloudera Hadoop)
Pittsburgh, PA · On-site
$65K - $171K/yr
... Hadoop, Spark ... 3m Python, Kafka, and complex orchestration. - Communication and lead experience over a group of ...
Data Engineer/ETL
Pittsburgh, PA · On-site
Data Engineer - ETL with Python, Hadoop & Snowflake Responsibilities • Organize business needs into ETL/ELT logical models and ensure data structures are designed for flexibility to support ...
Data Engineer/ETL
Pittsburgh, PA · On-site
Data Engineer - ETL with Python, Hadoop & Snowflake Responsibilities • Organize business needs into ETL/ELT logical models and ensure data structures are designed for flexibility to support ...
Software Engineer Principal
Pittsburgh, PA · On-site
$131K - $175K/yr
Required Skills • Java, Spring boot, Microservices • Python • Unix • Kafka/ MQ/ REST API • Mongo DB / Oracle • Hadoop/Iceberg • FircoSoft- Lexis Nexis Suite Certifications : ACAMS ...
Quick apply
Software Engineer Principal
Pittsburgh, PA · On-site
$131K - $175K/yr
Required Skills • Java, Spring boot, Microservices • Python • Unix • Kafka/ MQ/ REST API • Mongo DB / Oracle • Hadoop/Iceberg • FircoSoft- Lexis Nexis Suite Certifications : ACAMS ...
Software Engineer Principal
Pittsburgh, PA · On-site
$131K - $175K/yr
Required Skills • Java, Spring boot, Microservices • Python • Unix • Kafka/ MQ/ REST API • Mongo DB / Oracle • Hadoop/Iceberg • FircoSoft- Lexis Nexis Suite Certifications : ACAMS ...
Quick apply
Software Engineer Principal
Pittsburgh, PA · On-site
$131K - $175K/yr
Required Skills • Java, Spring boot, Microservices • Python • Unix • Kafka/ MQ/ REST API • Mongo DB / Oracle • Hadoop/Iceberg • FircoSoft- Lexis Nexis Suite Certifications : ACAMS ...
Software Engineer Principal
Pittsburgh, PA · On-site
$131K - $175K/yr
Required Skills • Java, Spring boot, Microservices • Python • Unix • Kafka/ MQ/ REST API • Mongo DB / Oracle • Hadoop/Iceberg • FircoSoft- Lexis Nexis Suite Certifications : ACAMS ...
Software Engineer Principal
Pittsburgh, PA · On-site
$131K - $175K/yr
Required Skills • Java, Spring boot, Microservices • Python • Unix • Kafka/ MQ/ REST API • Mongo DB / Oracle • Hadoop/Iceberg • FircoSoft- Lexis Nexis Suite Certifications : ACAMS ...
Software Engineer Principal
Pittsburgh, PA · On-site
$131K - $175K/yr
Required Skills • Java, Spring boot, Microservices • Python • Unix • Kafka/ MQ/ REST API • Mongo DB / Oracle • Hadoop/Iceberg • FircoSoft- Lexis Nexis Suite Certifications : ACAMS ...
Quick apply
Software Engineer Principal
Pittsburgh, PA · On-site
$131K - $175K/yr
Required Skills • Java, Spring boot, Microservices • Python • Unix • Kafka/ MQ/ REST API • Mongo DB / Oracle • Hadoop/Iceberg • FircoSoft- Lexis Nexis Suite Certifications : ACAMS ...
Software Engineer Principal
Pittsburgh, PA · On-site
$131K - $175K/yr
Required Skills • Java, Spring boot, Microservices • Python • Unix • Kafka/ MQ/ REST API • Mongo DB / Oracle • Hadoop/Iceberg • FircoSoft- Lexis Nexis Suite Certifications : ACAMS ...
Quick apply
Software Engineer Principal
Pittsburgh, PA · On-site
$131K - $175K/yr
Required Skills • Java, Spring boot, Microservices • Python • Unix • Kafka/ MQ/ REST API • Mongo DB / Oracle • Hadoop/Iceberg • FircoSoft- Lexis Nexis Suite Certifications : ACAMS ...
Software Engineer Principal
Pittsburgh, PA · On-site
$131K - $175K/yr
Required Skills • Java, Spring boot, Microservices • Python • Unix • Kafka/ MQ/ REST API • Mongo DB / Oracle • Hadoop/Iceberg • FircoSoft- Lexis Nexis Suite Certifications : ACAMS ...
Quick apply
Software Engineer Principal
Pittsburgh, PA · On-site
$131K - $175K/yr
Required Skills • Java, Spring boot, Microservices • Python • Unix • Kafka/ MQ/ REST API • Mongo DB / Oracle • Hadoop/Iceberg • FircoSoft- Lexis Nexis Suite Certifications : ACAMS ...
Software Engineer Principal
Pittsburgh, PA · On-site
$131K - $175K/yr
Required Skills • Java, Spring boot, Microservices • Python • Unix • Kafka/ MQ/ REST API • Mongo DB / Oracle • Hadoop/Iceberg • FircoSoft- Lexis Nexis Suite Certifications : ACAMS ...
Quick apply
Software Engineer Principal
Pittsburgh, PA · On-site
$131K - $175K/yr
Required Skills • Java, Spring boot, Microservices • Python • Unix • Kafka/ MQ/ REST API • Mongo DB / Oracle • Hadoop/Iceberg • FircoSoft- Lexis Nexis Suite Certifications : ACAMS ...
Software Engineer Principal
Pittsburgh, PA · On-site
$131K - $175K/yr
Required Skills • Java, Spring boot, Microservices • Python • Unix • Kafka/ MQ/ REST API • Mongo DB / Oracle • Hadoop/Iceberg • FircoSoft- Lexis Nexis Suite Certifications : ACAMS ...
Quick apply
Software Engineer Principal
Pittsburgh, PA · On-site
$131K - $175K/yr
Required Skills • Java, Spring boot, Microservices • Python • Unix • Kafka/ MQ/ REST API • Mongo DB / Oracle • Hadoop/Iceberg • FircoSoft- Lexis Nexis Suite Certifications : ACAMS ...
Software Engineer Principal
Pittsburgh, PA · On-site
$131K - $175K/yr
Required Skills • Java, Spring boot, Microservices • Python • Unix • Kafka/ MQ/ REST API • Mongo DB / Oracle • Hadoop/Iceberg • FircoSoft- Lexis Nexis Suite Certifications : ACAMS ...
Quick apply
Software Engineer Principal
Pittsburgh, PA · On-site
$131K - $175K/yr
Required Skills • Java, Spring boot, Microservices • Python • Unix • Kafka/ MQ/ REST API • Mongo DB / Oracle • Hadoop/Iceberg • FircoSoft- Lexis Nexis Suite Certifications : ACAMS ...
Software Engineer Principal
Pittsburgh, PA · On-site
$131K - $175K/yr
Required Skills • Java, Spring boot, Microservices • Python • Unix • Kafka/ MQ/ REST API • Mongo DB / Oracle • Hadoop/Iceberg • FircoSoft- Lexis Nexis Suite Certifications : ACAMS ...
Quick apply
Software Engineer Principal
Pittsburgh, PA · On-site
$131K - $175K/yr
Required Skills • Java, Spring boot, Microservices • Python • Unix • Kafka/ MQ/ REST API • Mongo DB / Oracle • Hadoop/Iceberg • FircoSoft- Lexis Nexis Suite Certifications : ACAMS ...
Software Engineer Principal
Pittsburgh, PA · On-site
$131K - $175K/yr
Required Skills • Java, Spring boot, Microservices • Python • Unix • Kafka/ MQ/ REST API • Mongo DB / Oracle • Hadoop/Iceberg • FircoSoft- Lexis Nexis Suite Certifications : ACAMS ...
Quick apply
Software Engineer Principal
Pittsburgh, PA · On-site
$131K - $175K/yr
Required Skills • Java, Spring boot, Microservices • Python • Unix • Kafka/ MQ/ REST API • Mongo DB / Oracle • Hadoop/Iceberg • FircoSoft- Lexis Nexis Suite Certifications : ACAMS ...
Hadoop Python information
See Pittsburgh, PA salary details
$10.04 - $15.59
1% of jobs
$15.59 - $21.15
0% of jobs
$21.15 - $26.71
0% of jobs
$26.71 - $32.27
0% of jobs
$32.27 - $37.83
0% of jobs
$37.83 - $43.39
0% of jobs
$43.39 - $48.94
4% of jobs
$48.94 - $54.50
15% of jobs
$55.22 is the 25th percentile. Wages below this are outliers.
$54.50 - $60.06
37% of jobs
$62.76 is the 75th percentile. Wages above this are outliers.
$60.06 - $65.62
36% of jobs
$65.62 - $71.18
6% of jobs
$10
$58
$71
How much do hadoop python jobs pay per hour?
Is Hadoop admin a good career?
Are Python still in demand in 2026?
Does Hadoop work with Python?
What are the key skills and qualifications needed to thrive as a Hadoop Python Developer, and why are they important?
What is the highest paying job in Python?
What is the difference between Hadoop Python vs Hadoop Java Developer?
| Aspect | Hadoop Python | Hadoop Java Developer |
|---|---|---|
| Required Credentials | Python programming skills, Hadoop certifications | Java programming skills, Hadoop certifications |
| Work Environment | Data analysis, scripting, data pipeline development | Core development, system integration, big data application coding |
| Industry Usage | Data science, analytics, machine learning projects | Data infrastructure, platform development, system optimization |
Hadoop Python and Hadoop Java Developer roles both involve working with Hadoop ecosystems, but Python focuses more on data analysis and scripting, while Java is geared towards core development and system integration. The choice depends on your programming expertise and career goals within big data environments.
What is a Hadoop Python developer?
How do Hadoop Python developers typically collaborate with data engineers and analysts on large-scale data projects?
Full-time
Medical, Dental, Vision, Life, Retirement, PTO
Posted 11 days ago
PNC Bank rating
7.7
Based on 343 frontline employees who took The Breakroom Quiz
91st of 170 rated banks
Job description
We are seeking an experienced Quality Assurance Architect to lead the design, implementation, and continuous improvement of enterprise-wide quality engineering practices for large-scale Big Data, Hadoop, and Data Warehouse platforms. This role will drive test strategy, automation architecture, and quality governance across complex data ecosystems while collaborating with cross-functional teams in an onsite-offshore delivery model.
The ideal candidate brings strong expertise in SDLC and STLC processes, hands-on technical knowledge of Python, Big Data technologies, Spark/PySpark, HQL/SQL, and experience working within AWS/Cloud environments.
Key Responsibilities
Define and implement QA architecture, test strategies, and quality frameworks for Big Data, Hadoop, and Data Warehouse applications.
Establish best practices across the Software Development Life Cycle (SDLC) and Software Testing Life Cycle (STLC).
Lead a team of 3-5 QA engineers, providing technical guidance, mentoring, and performance oversight.
Coordinate delivery across onsite and offshore teams, ensuring effective communication, planning, and execution.
Design and implement scalable test automation solutions for data ingestion, transformation, processing, and reporting systems.
Develop and maintain automated validation frameworks using Python and related technologies.
Collaborate with Architects, Product Owners, Developers, Data Engineers, and Business stakeholders to ensure high-quality releases.
Create test strategies covering functional, integration, regression, performance, ETL, data validation, and end-to-end testing.
Validate data pipelines and large datasets across Hadoop, Spark, Data Warehouse, and Cloud platforms.
Perform root cause analysis of defects and drive continuous quality improvements.
Define quality metrics, reporting mechanisms, and release readiness criteria.
Support Agile, Scrum, and DevOps practices with a quality-first mindset.
Qualifications
Bachelor's degree in Computer Science, Information Technology, Engineering, or a related discipline.
Extensive experience in Quality Assurance, Test Architecture, or Quality Engineering roles.
Strong knowledge of SDLC and STLC methodologies across enterprise application environments.
Proven experience leading teams of 3-5 members in onsite-offshore delivery models.
Strong hands-on development and automation experience using Python.
Experience testing and validating solutions built on Big Data/Hadoop ecosystems.
Strong expertise in Data Warehouse and ETL testing.
Experience working with Apache Spark and PySpark environments.
Proficiency in HQL and SQL for complex data validation and analysis.
Experience working with AWS or other cloud platforms.
Knowledge of CI/CD pipelines and modern test automation frameworks.
Strong analytical, problem-solving, and communication skills.
Preferred Skills
Experience with Hadoop ecosystem tools such as Hive, HDFS, YARN, and related technologies.
Exposure to data quality frameworks and metadata validation tools.
Experience with performance and scalability testing for distributed data platforms.
Knowledge of Agile, DevOps, and Continuous Testing practices.
Familiarity with data governance, data lineage, and compliance controls.
Relevant QA, Cloud, or Big Data certifications are a plus.
Technical Skills
Core Technologies
Python
Big Data / Hadoop
Data Warehouse
Spark
PySpark
HQL
SQL
AWS / Cloud Platforms
Quality Engineering
Test Automation
ETL Testing
Data Validation Testing
API Testing
Functional Testing
Integration Testing
Regression Testing
Performance Testing
Methodologies
SDLC
STLC
Agile/Scrum
DevOps
CI/CD
This role is ideal for a senior-quality professional who can combine test architecture leadership, deep data-platform expertise, and hands-on Python development skills to drive quality across complex enterprise data ecosystems.PNC is an in-office company that fosters a supportive culture where employees can thrive and achieve balance. We encourage candidates to connect with their recruiter and hiring manager to understand workplace expectations and ensure the role aligns with their goals.PNC will not provide sponsorship for employment visas or participate in STEM OPT for this position.Job Description
- Responsible for development and support of processes, practices and tools necessary to produce quality products/services and to manage risk.
- Researches and recommends hardware and software purchases for software quality assurance program. Selects and implements formal QA methodologies.
- Architects and implements agile testing practices and tools. Evaluates, recommends and implements enterprise-wide defect-tracking software.
- Assists in planning and estimation of Quality Assurance support for new programs and projects. Conducts audits and reviews.
- Supports Quality Assurance specialists on programs or projects. Conducts program reviews and complex process audits.
PNC Employees take pride in our reputation and to continue building upon that we expect our employees to be:
- Customer Focused - Knowledgeable of the values and practices that align customer needs and satisfaction as primary considerations in all business decisions and able to leverage that information in creating customized customer solutions.
- Managing Risk - Assessing and effectively managing all of the risks associated with their business objectives and activities to ensure they adhere to and support PNC's Enterprise Risk Management Framework.
Successful candidates must demonstrate appropriate knowledge, skills, and abilities for a role. Listed below are skills, competencies, work experience, education, and required certifications/licensures needed to be successful in this position.
Preferred SkillsAdobe Spark, Apache Hadoop, Big Data, Competitive Advantages, Customer Solutions, Data Warehousing (DW), Design, Enterprise Architecture Framework, Machine Learning (ML), Risk Assessments, Technical KnowledgeCompetenciesAccuracy and Attention to Detail, Analytical Thinking, Emerging Technologies, Influencing, IT Architecture, Process Management, Software Development Life Cycle, Software Product Design/Architecture, Software Quality Assurance And TestingWork ExperienceRoles at this level typically require a university / college degree, with 5+ years of industry-relevant experience. Specific certifications are often required. In lieu of a degree, a comparable combination of education, job specific certification(s), and experience (including military service) may be considered.EducationBachelorsCertificationsNo Required Certification(s)LicensesNo Required License(s)Pay TransparencyBase Salary: $91,000.00 - $169,000.00Salaries may vary based on geographic location, market data and on individual skills, experience, and education. This role is incentive eligible with the payment based upon company, business and/or individual performance.Application WindowGenerally, this opening is expected to be posted for two business days from 07/17/2026, although it may be longer with business discretion.BenefitsPNC offers a comprehensive range of benefits to help meet your needs now and in the future. Depending on your eligibility, options for full-time employees include: medical/prescription drug coverage (with a Health Savings Account feature), dental and vision options; employee and spouse/child life insurance; short and long-term disability protection; 401(k) with PNC match, pension and stock purchase plans; dependent care reimbursement account; back-up child/elder care; adoption, surrogacy, and doula reimbursement; educational assistance, including select programs fully paid; a robust wellness program with financial incentives.In addition, PNC generally provides the following paid time off, depending on your eligibility: maternity and/or parental leave; up to 11 paid holidays each year; 9 occasional absence days each year, unless otherwise required by law; between 15 to 25 vacation days each year, depending on career level; and years of service.To learn more about these and other programs, including benefits for full time and part-time employees, visitpncthrive.com.
Disability Accommodations StatementIf an accommodation is required to participate in the application process, please contact us via email at AccommodationRequest@pnc.com. Please include "accommodation request" in the subject line title and be sure to include your name, the job ID, and your preferred method of contact in the body of the email. Emails not related to accommodation requests will not receive responses. Applicants may also call 877-968-7762 and say "Workday" for accommodation assistance. All information provided will be kept confidential and will be used only to the extent required to provide needed reasonable accommodations.
At PNC we foster an inclusive and accessible workplace. We provide reasonable accommodations to employment applicants and qualified individuals with a disability who need an accommodation to perform the essential functions of their positions.
PNC provides equal employment opportunity to qualified persons regardless of race, color, sex, religion, national origin, age, sexual orientation, gender identity, disability, veteran status, or other categories protected by law.
This position is subject to the requirements of Section 19 of the Federal Deposit Insurance Act (FDIA) and, for any registered role, the Secure and Fair Enforcement for Mortgage Licensing Act of 2008 (SAFE Act) and/or the Financial Industry Regulatory Authority (FINRA), which prohibit the hiring of individuals with certain criminal history.
California ResidentsRefer to the California Consumer Privacy Act Privacy Notice to gain understanding of how PNC may use or disclose your personal information in our hiring practices.
About PNC Bank
Sourced by ZipRecruiter
Industry
Banking and credit intermediation
Company size
10,000+ Employees
Headquarters location
Pittsburgh, PA, US
Year founded
1852