ZipRecruiter

Log In

1

Senior Pyspark Developer Jobs (NOW HIRING)

Purple Drive Technologies

pyspark lead

Owings, MD · On-site

$54 - $71.25/hr

... experience with PySpark, Apache Spark, and Python. • Strong Hands on experience with SQL and ... developers and review code for best practices and efficiency. Bhargav Akkula Senior Account Manager ...

Mavens Guild

Senior Spark & Python Developer

Mclean, VA · On-site

$122.80K - $165.30K/yr

In a senior developer role, you will design and build data flow and data integration processes to ... Drawing from your vast hands-on experience in Python (PySpark), Spark, REST, Java, and Scala, you ...

Mavens Guild

Senior Spark & Python Developer

Mclean, VA · On-site

$122.80K - $165.30K/yr

In a senior developer role, you will design and build data flow and data integration processes to ... Drawing from your vast hands-on experience in Python (PySpark), Spark, REST, Java, and Scala, you ...

Mavens Guild

Senior Spark & Python Developer

Mclean, VA · On-site

$122.80K - $165.30K/yr

In a senior developer role, you will design and build data flow and data integration processes to ... Drawing from your vast hands-on experience in Python (PySpark), Spark, REST, Java, and Scala, you ...

Aptonet

Senior Manager - Data Engineering

Boston, MA · Hybrid

Senior Manager - Data Engineering Boston | Hybrid (4 Days Onsite) Long-Term Contract to Hire ... Optimize large-scale data transformations using PySpark * Work with structured and semi-structured ...

New

next page

Showing results 1-20

All JobsSenior Pyspark Developer Jobs

Senior Pyspark Developer information

What cities are hiring for Senior Pyspark Developer jobs? Cities with the most Senior Pyspark Developer job openings:
What are the most commonly searched types of Pyspark Developer jobs? The most popular types of Pyspark Developer jobs are:
Senior Pyspark Developer jobs near you
Senior Algorithm Developer - PySpark / SQL

Senior Algorithm Developer - PySpark / SQL

ACA Group

Durham, NC

Other

Posted 8 days ago

Job description

Senior Algorithm Developer - PySpark / SQL

Company Overview:
ACA Global delivers market abuse surveillance solutions to institutional investors, hedge funds, and asset managers. The Market Abuse Surveillance (MAS) platform monitors trading activity across equities, fixed income, and derivatives to identify potential regulatory and policy violations.

The Opportunity:
This role sits on the Market Abuse Surveillance Product Development team and focuses on validating, optimizing, and advancing a PySparkbased surveillance platform. Following a multiyear algorithm migration initiative, the emphasis is now on production quality, performance optimization, and nextgeneration algorithm development. The position blends deep PySpark/Python and SQL expertise with financial markets and regulatory domain knowledge.

What You'll Do:
Validate and QA migrated surveillance algorithms by reconciling PySpark outputs against legacy SQL baselines across multiple client environments
Optimize PySpark algorithms and Spark infrastructure to meet processing SLAs across large data volumes
Enhance and develop new surveillance algorithms aligned to evolving regulatory and client requirements
Support legacy SQL systems during transition and ensure data integrity and auditability

Technical Skill Set:
3+ years of handson PySpark/Python development in production environments
Strong Spark expertise (DataFrames, SQL functions, windowing, joins, optimization, execution plans)
5+ years of advanced SQL experience (CTEs, window functions, performance tuning, stored procedures)
Experience operating within the Spark ecosystem (EMR, Iceberg, Spark UI)
Strong AWS experience (S3, EMR, IAM, CloudWatch, cost optimization)
Familiar with CI/CD, Git workflows, JIRA, automated testing, and code review practices

Domain Expertise (or Strong Willingness to Learn):
Financial instruments: equities, fixed income, and derivatives
Trade lifecycle and portfolio concepts
Market abuse and regulatory surveillance (KYC/AML, best execution, fair dealing)
Institutional trading behavior and surveillance patterns

Experience Profile:
5+ years total software development experience, including largescale data processing systems
Proven track record delivering productionready data or algorithmic platforms
Strong validation, testing, and reconciliation experience across complex data systems
Background in fintech, RegTech, or financial services strongly preferred
Experience working in agile teams with crossfunctional stakeholders (QA, DevOps, Product)

What Success Looks Like:
Quickly ramp on MAS platform architecture and algorithm logic
Validate and productionready multiple surveillance algorithms with auditready documentation
Improve algorithm performance and stability across client environments
Contribute to new algorithm development and nextgeneration platform initiatives
Become a subject matter expert on specific surveillance domains or platform components

Impression:
This is a senior, handson algorithm development role ideal for someone who enjoys working at the intersection of big data engineering, Python/Spark optimization, and financial regulatory logic in a productioncritical environment.

Apply