1

Big Data Platform Engineer Jobs (NOW HIRING)

Data Platform Engineer

New York, NY ยท On-site

$125K - $150K/yr

The Challenge Data Platform Engineer will be part of an innovative Enterprise data team that ... Hands-on experience with Data Warehouse technologies (Snowflake, Redshift) and Big Data ...

We are looking for a Cloud Platform Engineer with experience in Cloud technology (AWS), Python ... Big Data / Cloud technology. As a result, the candidate will be expected to work autonomously ...

Platform Engineer

Columbia, MD ยท Hybrid

$163K - $213K/yr

Platform Engineer (7031)Columbia, MDDescription We are looking for a Cloud Platform Engineer with ... Prior experience or familiarity with DISA's Big Data Platform or other Big Data systems (e.g.

Platform Engineer

Augusta, GA ยท Hybrid

$164K - $213K/yr

Platform Engineer (8020)Augusta, GADescription We are looking for a Cloud Platform Engineer with ... Prior experience or familiarity with DISA's Big Data Platform or other Big Data systems (e.g.

Platform Engineer

San Antonio, TX ยท Hybrid

$132K - $172K/yr

Platform Engineer (6835)San Antonio, TXDescription We are looking for a Cloud Platform Engineer ... Prior experience or familiarity with DISA's Big Data Platform or other Big Data systems (e.g.

Platform Engineer

San Antonio, TX ยท Hybrid

$164K - $213K/yr

Platform Engineer (8019)San Antonio, TX We are looking for a Cloud Platform Engineer with ... Prior experience or familiarity with DISA's Big Data Platform or other Big Data systems (e.g.

Data Platform Engineer

Atlanta, GA ยท On-site

$100K - $150K/yr

As a Data Platform Engineer, you will contribute to building the modern Data platform at Prizepicks ... Extensive experience in Big data technologies like Spark, Flink, Kafka or Kinesis, Argo/Airflow ...

Data Platform Engineer

Atlanta, GA ยท On-site +1

$100K - $150K/yr

As a Data Platform Engineer, you will contribute to building the modern Data platform at Prizepicks ... Extensive experience in Big data technologies like Spark, Flink, Kafka or Kinesis, Argo/Airflow ...

Platform Engineer

San Antonio, TX ยท Hybrid

$164K - $213K/yr

Platform Engineer (6369)San Antonio, TXDescription We are looking for a Cloud Platform Engineer ... Prior experience or familiarity with DISA's Big Data Platform or other Big Data systems (e.g.

OR ยท On-site

$114K - $137K/yr

... engineering experience, particularly in Big data technologies including and not limited to Spark, Trino, Druid, Iceberg, Hadoop framework, Kafka and Flink. * Prior experience supporting platforms ...

next page

Showing results 1-20

People also search for

Big Data Platform Engineer information

See salary details

$15

$62

$88

How much do big data platform engineer jobs pay per hour?

As of Jun 10, 2026, the average hourly pay for big data platform engineer in the United States is $62.98, according to ZipRecruiter salary data. Most workers in this role earn between $53.61 and $70.91 per hour, depending on experience, location, and employer.

What are the key skills and qualifications needed to thrive as a Big Data Platform Engineer, and why are they important?

To thrive as a Big Data Platform Engineer, you need strong expertise in distributed computing, data architecture, and programming languages like Java, Python, or Scala, typically supported by a degree in computer science or a related field. Familiarity with big data tools and frameworks such as Hadoop, Spark, Kafka, and cloud platforms (e.g., AWS, Azure) as well as certifications like Cloudera or AWS Big Data are often required. Problem-solving, adaptability, and effective communication are essential soft skills for collaborating with cross-functional teams and addressing complex data challenges. These skills and qualities are crucial for designing, optimizing, and maintaining robust data solutions that drive business insights and innovation.

What is the difference between Big Data Platform Engineer vs Data Engineer?

AspectBig Data Platform EngineerData Engineer
Primary FocusDesigning, building, and maintaining big data infrastructure and platformsDeveloping data pipelines, ETL processes, and managing data storage
Skills & CertificationsBig data technologies (Hadoop, Spark), cloud platforms, scriptingSQL, Python, data modeling, ETL tools
Work EnvironmentData infrastructure teams, cloud environments, large-scale data systemsData teams, analytics, and application development environments
Industry UsageTech companies, finance, healthcare with large data needsAny industry requiring data integration and analytics

While both roles involve working with data, Big Data Platform Engineers focus on building and maintaining the infrastructure for big data processing, whereas Data Engineers develop data pipelines and manage data flow for analysis. Both roles often collaborate but serve different core functions within data ecosystems.

What are some typical challenges a Big Data Platform Engineer faces when integrating new data sources into an existing platform?

Big Data Platform Engineers often encounter challenges like ensuring data compatibility, maintaining data quality, and minimizing disruption to ongoing operations when integrating new sources. They need to address issues such as data format inconsistencies, varying data latency, and scaling ingestion pipelines to handle increased loads. Collaboration with data architects, data scientists, and business stakeholders is essential to align integration efforts with organizational needs and compliance requirements. Effective troubleshooting and automation can help streamline the integration process and maintain platform stability.

What are Big Data Platform Engineers?

Big Data Platform Engineers are technology professionals who design, build, and maintain large-scale data processing systems. They work with tools and frameworks such as Hadoop, Spark, and cloud-based solutions to manage, process, and analyze vast amounts of structured and unstructured data. Their role involves ensuring data pipelines are reliable, scalable, and secure, supporting data scientists and analysts in extracting valuable insights from big data. They also optimize system performances and troubleshoot issues related to data storage and processing. Overall, they play a crucial role in enabling data-driven decision-making within organizations.
More about Big Data Platform Engineer jobs
What job categories do people searching Big Data Platform Engineer jobs look for? The top searched job categories for Big Data Platform Engineer jobs are:
Platform Engineer - Big Data

Platform Engineer - Big Data

Noblesoft Technologies

Rockville, VA โ€ข On-site

$51.75 - $68.25/hr

Contractor

Posted 11 days ago


Job description

Role: Senior Platform Engineer - Big Data (AWS | EMR | EKS)ย 

Location:ย Rockville, MD, Tysons Corner, VA or Woodbridge, NJ or Jersey City, NJ (3 days onsite per week)

Duration:ย 6 months (long-term extensions)

ย 

Notes:

ย Senior Platform Engineer โ€“ Big Data (AWS | EMR | EKS)

  • Build and modernize a largeโ€‘scaleย AWS big data platformย (EMR, S3, Athena, Trino) supporting enterprise analytics
  • Help drive platform evolution towardย cloudโ€‘native, containerized workloads on AWS EKS (Kubernetes)
  • Work at the intersection ofย software engineering, big data, and platform engineeringย โ€” not ETLโ€‘only
  • Design and operateย Sparkโ€‘based data workloads, optimizing performance, reliability, and cost
  • Implementย CI/CD and Infrastructure as Codeย (Terraform / CloudFormation) for data platforms
  • Ideal for engineers with aย strong backend or platform backgroundย whoโ€™ve grown into big data

Job Description:

Overview

We are seeking aย Senior Platform Engineer with deep Big Data experienceย to help design, operate, and modernize a largeโ€‘scale data platform on AWS. This role goes beyond traditional ETL or pipeline development โ€” it is focused onย building and evolving the underlying data platformย that supports analytics, reporting, and future AI/ML use cases.

The current environment is built primarily onย AWS EMR and S3, with a strong query layer usingย Athena and Trino. The team is actively modernizing the platform and evaluatingย AWS EKS (Kubernetes)ย as part of a shift toward more cloudโ€‘native, containerized data workloads.

This role is ideal for an engineer with aย software or platform engineering background who moved into big data, rather than a pure ETL developer.


Key Responsibilities

  • Design, build, and operate scalableย big data platforms on AWS, with S3 as the core data lake.
  • Develop and optimizeย Sparkโ€‘based workloads on EMR, including performance tuning and cost optimization.
  • Support and enhance federated query engines such asย Athena and Trinoย for largeโ€‘scale analytics.
  • Contribute to theย modernization of the data platform, including evaluation and adoption ofย Kubernetes/EKSย for data services and workloads.
  • Build and operateย data services and platform componentsย using containerized deployments (Docker + EKS).
  • Implement and maintainย Infrastructure as Codeย using Terraform and/or CloudFormation.
  • Design and supportย CI/CD pipelinesย for data and platform workloads.
  • Partner with data engineers, analytics teams, and stakeholders to ensure the platform is reliable, performant, and extensible.
  • Monitor and troubleshoot platform issues across clusters, pipelines, and query engines using CloudWatch and related tooling.
  • Continuously evaluate new technologies and propose improvements to the overall data architecture.

Required Qualifications

  • 8+ years of experience inย Big Data, Platform Engineering, or Data Engineeringย roles.
  • Strong handsโ€‘on experience withย AWS, including:
    • EMR
    • S3
    • Athena
    • AWS Glue / Glue Data Catalog
  • Solid experience withย Sparkย (PySpark or Scala) and distributed data processing.
  • Strongย SQLย skills, particularly with large datasets (Athena, Trino, Presto, etc.).
  • Experience withย Dockerย and containerized applications.
  • Working knowledge ofย Kubernetes, with exposure toย AWS EKSย strongly preferred.
  • Experience implementingย CI/CD pipelinesย (Jenkins, GitHub Actions, or similar).
  • Infrastructure as Code experience usingย Terraform and/or CloudFormation.
  • Strong scripting and programming skills (Python preferred).
  • Ability to think at aย platform and architecture level, not just task execution.

Nice to Have

  • Experience runningย Spark on Kubernetes (EKS).
  • Trino/Presto performance tuning experience.
  • Experience preparing data platforms forย AI/ML workloads.
  • Observability tooling experience (CloudWatch, Grafana, Prometheus).
  • Background as aย software engineerย before moving into big data.