Berkeley Heights, NJ · On-site
$54 - $74/hr
... shuffle/skew optimization, job cost reduction • Set coding standards and lead code/design reviews ... Own production reliability -- on-call ownership, incident response, root-cause analysis for ...
Berkeley Heights, NJ · On-site
$54 - $74/hr
... shuffle/skew optimization, job cost reduction • Set coding standards and lead code/design reviews ... Own production reliability -- on-call ownership, incident response, root-cause analysis for ...
$53 - $72.50/hr
... shuffle/skew optimization, job cost reduction • Set coding standards and lead code/design reviews ... Own production reliability -- on-call ownership, incident response, root-cause analysis for ...
$53 - $72.50/hr
... shuffle/skew optimization, job cost reduction • Set coding standards and lead code/design reviews ... Own production reliability -- on-call ownership, incident response, root-cause analysis for ...
Garwood, NJ · On-site
$52.50 - $72/hr
... shuffle/skew optimization, job cost reduction • Set coding standards and lead code/design reviews ... Own production reliability -- on-call ownership, incident response, root-cause analysis for ...
Garwood, NJ · On-site
$52.50 - $72/hr
... shuffle/skew optimization, job cost reduction • Set coding standards and lead code/design reviews ... Own production reliability -- on-call ownership, incident response, root-cause analysis for ...
$52.75 - $72.25/hr
... shuffle/skew optimization, job cost reduction • Set coding standards and lead code/design reviews ... Own production reliability -- on-call ownership, incident response, root-cause analysis for ...
$52.75 - $72.25/hr
... shuffle/skew optimization, job cost reduction • Set coding standards and lead code/design reviews ... Own production reliability -- on-call ownership, incident response, root-cause analysis for ...
$53 - $72.75/hr
... shuffle/skew optimization, job cost reduction • Set coding standards and lead code/design reviews ... Own production reliability -- on-call ownership, incident response, root-cause analysis for ...
$53 - $72.75/hr
... shuffle/skew optimization, job cost reduction • Set coding standards and lead code/design reviews ... Own production reliability -- on-call ownership, incident response, root-cause analysis for ...
$56 - $76.75/hr
... shuffle/skew optimization, job cost reduction • Set coding standards and lead code/design reviews ... Own production reliability -- on-call ownership, incident response, root-cause analysis for ...
$56 - $76.75/hr
... shuffle/skew optimization, job cost reduction • Set coding standards and lead code/design reviews ... Own production reliability -- on-call ownership, incident response, root-cause analysis for ...
$49.25 - $67.75/hr
... shuffle/skew optimization, job cost reduction • Set coding standards and lead code/design reviews ... Own production reliability -- on-call ownership, incident response, root-cause analysis for ...
$49.25 - $67.75/hr
... shuffle/skew optimization, job cost reduction • Set coding standards and lead code/design reviews ... Own production reliability -- on-call ownership, incident response, root-cause analysis for ...
Verona, NJ · On-site
$53 - $72.50/hr
... shuffle/skew optimization, job cost reduction • Set coding standards and lead code/design reviews ... Own production reliability -- on-call ownership, incident response, root-cause analysis for ...
New
Verona, NJ · On-site
$53 - $72.50/hr
... shuffle/skew optimization, job cost reduction • Set coding standards and lead code/design reviews ... Own production reliability -- on-call ownership, incident response, root-cause analysis for ...
New
$52.75 - $72.50/hr
... shuffle/skew optimization, job cost reduction • Set coding standards and lead code/design reviews ... Own production reliability -- on-call ownership, incident response, root-cause analysis for ...
$52.75 - $72.50/hr
... shuffle/skew optimization, job cost reduction • Set coding standards and lead code/design reviews ... Own production reliability -- on-call ownership, incident response, root-cause analysis for ...
$52.75 - $72.50/hr
... shuffle/skew optimization, job cost reduction • Set coding standards and lead code/design reviews ... Own production reliability -- on-call ownership, incident response, root-cause analysis for ...
New
$52.75 - $72.50/hr
... shuffle/skew optimization, job cost reduction • Set coding standards and lead code/design reviews ... Own production reliability -- on-call ownership, incident response, root-cause analysis for ...
New
$54.75 - $75/hr
... shuffle/skew optimization, job cost reduction • Set coding standards and lead code/design reviews ... Own production reliability -- on-call ownership, incident response, root-cause analysis for ...
$54.75 - $75/hr
... shuffle/skew optimization, job cost reduction • Set coding standards and lead code/design reviews ... Own production reliability -- on-call ownership, incident response, root-cause analysis for ...
$51.75 - $70.75/hr
... shuffle/skew optimization, job cost reduction • Set coding standards and lead code/design reviews ... Own production reliability -- on-call ownership, incident response, root-cause analysis for ...
$51.75 - $70.75/hr
... shuffle/skew optimization, job cost reduction • Set coding standards and lead code/design reviews ... Own production reliability -- on-call ownership, incident response, root-cause analysis for ...
$55 - $75.50/hr
... shuffle/skew optimization, job cost reduction • Set coding standards and lead code/design reviews ... Own production reliability -- on-call ownership, incident response, root-cause analysis for ...
$55 - $75.50/hr
... shuffle/skew optimization, job cost reduction • Set coding standards and lead code/design reviews ... Own production reliability -- on-call ownership, incident response, root-cause analysis for ...
$50.50 - $69.25/hr
... shuffle/skew optimization, job cost reduction • Set coding standards and lead code/design reviews ... Own production reliability -- on-call ownership, incident response, root-cause analysis for ...
$50.50 - $69.25/hr
... shuffle/skew optimization, job cost reduction • Set coding standards and lead code/design reviews ... Own production reliability -- on-call ownership, incident response, root-cause analysis for ...
$54 - $74.25/hr
... shuffle/skew optimization, job cost reduction • Set coding standards and lead code/design reviews ... Own production reliability -- on-call ownership, incident response, root-cause analysis for ...
$54 - $74.25/hr
... shuffle/skew optimization, job cost reduction • Set coding standards and lead code/design reviews ... Own production reliability -- on-call ownership, incident response, root-cause analysis for ...
$53.25 - $73/hr
... shuffle/skew optimization, job cost reduction • Set coding standards and lead code/design reviews ... Own production reliability -- on-call ownership, incident response, root-cause analysis for ...
$53.25 - $73/hr
... shuffle/skew optimization, job cost reduction • Set coding standards and lead code/design reviews ... Own production reliability -- on-call ownership, incident response, root-cause analysis for ...
$54 - $74/hr
... shuffle/skew optimization, job cost reduction • Set coding standards and lead code/design reviews ... Own production reliability -- on-call ownership, incident response, root-cause analysis for ...
$54 - $74/hr
... shuffle/skew optimization, job cost reduction • Set coding standards and lead code/design reviews ... Own production reliability -- on-call ownership, incident response, root-cause analysis for ...
$51.25 - $70.50/hr
... shuffle/skew optimization, job cost reduction • Set coding standards and lead code/design reviews ... Own production reliability -- on-call ownership, incident response, root-cause analysis for ...
$51.25 - $70.50/hr
... shuffle/skew optimization, job cost reduction • Set coding standards and lead code/design reviews ... Own production reliability -- on-call ownership, incident response, root-cause analysis for ...
Madison, NJ · On-site
$53.25 - $73.25/hr
... shuffle/skew optimization, job cost reduction • Set coding standards and lead code/design reviews ... Own production reliability -- on-call ownership, incident response, root-cause analysis for ...
Madison, NJ · On-site
$53.25 - $73.25/hr
... shuffle/skew optimization, job cost reduction • Set coding standards and lead code/design reviews ... Own production reliability -- on-call ownership, incident response, root-cause analysis for ...
$53.25 - $73/hr
... shuffle/skew optimization, job cost reduction • Set coding standards and lead code/design reviews ... Own production reliability -- on-call ownership, incident response, root-cause analysis for ...
$53.25 - $73/hr
... shuffle/skew optimization, job cost reduction • Set coding standards and lead code/design reviews ... Own production reliability -- on-call ownership, incident response, root-cause analysis for ...
$15.87 - $18.60
0% of jobs
$18.60 - $21.33
5% of jobs
$21.33 - $24.06
4% of jobs
$24.06 - $26.79
11% of jobs
$27.62 is the 25th percentile. Wages below this are outliers.
$26.79 - $29.52
15% of jobs
The median wage is $31.57 / hr.
$29.52 - $32.26
19% of jobs
$32.26 - $34.99
12% of jobs
$34.99 - $37.72
6% of jobs
$38.32 is the 75th percentile. Wages above this are outliers.
$37.72 - $40.45
9% of jobs
$40.45 - $43.18
8% of jobs
$43.18 - $45.91
11% of jobs
$15
$32
$45
The most popular types of Shuffle Master jobs are:
$54 - $74/hr
Other
Posted 15 days ago
Responsibilities:
• Architect and build scalable, fault-tolerant data pipelines using Apache Spark (Java)
• Lead design of batch and streaming ETL/ELT systems handling large data volumes
• Deep-dive performance tuning: partitioning strategy, memory management, shuffle/skew optimization, job cost reduction
• Set coding standards and lead code/design reviews across the team
• Drive technical decisions on data architecture, storage formats, and pipeline orchestration
• Mentor mid-level and junior engineers; act as a technical escalation point
• Partner with product, analytics, and platform teams to translate requirements into scalable systems
• Own production reliability — on-call ownership, incident response, root-cause analysis for pipeline failures
• Evaluate and introduce new tools/frameworks where they improve the system
• Contribute to capacity planning and cost optimization for cluster infrastructure
Required Qualifications
• Bachelor’s or Master’s degree in Computer Science, Engineering, or related field
• 7+ years of professional Java development experience
• 5+ years hands-on experience with Apache Spark in production environments
• Expert-level understanding of distributed systems: fault tolerance, data locality, shuffle mechanics, resource management
• Proven track record designing systems processing terabyte+ scale data
• Strong SQL skills and deep familiarity with columnar storage formats (Parquet, ORC, Avro, Delta Lake/Iceberg)
• Experience with cluster managers (YARN, Kubernetes) and cloud-managed Spark
• Proficiency with Kafka
• Strong grasp of CI/CD, containerization, and infrastructure-as-code practices