Principal Data Engineer
Waltham, MA · Hybrid
This role requires deepexpertisein Java-based backend engineering,microservicesarchitecture, event-driven systems, Apache Kafka, Apache Flink, cloud-native platforms, and AWS technologies. The ideal ...
Waltham, MA · Hybrid
This role requires deepexpertisein Java-based backend engineering,microservicesarchitecture, event-driven systems, Apache Kafka, Apache Flink, cloud-native platforms, and AWS technologies. The ideal ...
Waltham, MA · Hybrid
This role requires deepexpertisein Java-based backend engineering,microservicesarchitecture, event-driven systems, Apache Kafka, Apache Flink, cloud-native platforms, and AWS technologies. The ideal ...
San Antonio, TX · On-site
$50/hr
Apache Flink on AWS Cloud, enabling scalable, low-latency, and fault-tolerant data processing platforms for business-critical use cases (e.g., Fraud detection, AML). * Core Technical Skills: * Strong ...
Quick apply
San Antonio, TX · On-site
$50/hr
Apache Flink on AWS Cloud, enabling scalable, low-latency, and fault-tolerant data processing platforms for business-critical use cases (e.g., Fraud detection, AML). * Core Technical Skills: * Strong ...
Cupertino, CA · On-site
$141K - $169K/yr
Experienced Poweruser (at least 2 years of running production applications) of Apache Flink or Committer to Apache Flink. BS or MS degree in computer science or equivalent professional experience.
Cupertino, CA · On-site
$141K - $169K/yr
Experienced Poweruser (at least 2 years of running production applications) of Apache Flink or Committer to Apache Flink. BS or MS degree in computer science or equivalent professional experience.
Waltham, MA · On-site
This role requires deep expertise in Java-based backend engineering, microservices architecture, event-driven systems, Apache Kafka, Apache Flink, cloud-native platforms, and AWS technologies. The ...
Waltham, MA · On-site
This role requires deep expertise in Java-based backend engineering, microservices architecture, event-driven systems, Apache Kafka, Apache Flink, cloud-native platforms, and AWS technologies. The ...
Dallas, TX · On-site
... Flink deployments 1. Confluent Kafka / Apache Kafka Kafka topic design and partition management Producer/consumer configuration and optimization Schema Registry setup and governance Kafka broker ...
New
Dallas, TX · On-site
... Flink deployments 1. Confluent Kafka / Apache Kafka Kafka topic design and partition management Producer/consumer configuration and optimization Schema Registry setup and governance Kafka broker ...
New
Provide technical leadership in building and maintaining the data infrastructure and products for platform; process continuous data streams in near real-time using Apache Flink; use Prometheus and ...
New
Provide technical leadership in building and maintaining the data infrastructure and products for platform; process continuous data streams in near real-time using Apache Flink; use Prometheus and ...
New
... using Apache Flink etc 6Must have prior experience with open table formats like Apache Iceberg Hudi etc 7Must have exposure to Cloudera data lake environment should have exposure to Snowflake ...
... using Apache Flink etc 6Must have prior experience with open table formats like Apache Iceberg Hudi etc 7Must have exposure to Cloudera data lake environment should have exposure to Snowflake ...
$117K - $140K/yr
Apache Spark Structured Streaming is acceptable instead of Flink * Design and maintain batch and hybrid ETL pipelines using SQL Server and SSIS * Own data quality, observability, and reliability ...
New
$117K - $140K/yr
Apache Spark Structured Streaming is acceptable instead of Flink * Design and maintain batch and hybrid ETL pipelines using SQL Server and SSIS * Own data quality, observability, and reliability ...
New
We are building an innovative data processing engine that is transforming how Apache Spark, Apache Flink, Ray, and others operate on diverse, large-scale data. Our team of engineers drive and adopt ...
We are building an innovative data processing engine that is transforming how Apache Spark, Apache Flink, Ray, and others operate on diverse, large-scale data. Our team of engineers drive and adopt ...
Seattle, WA · On-site
$139K - $183K/yr
Responsibilities : • Lead the development, architecture, and maintenance of real-time streaming pipelines with Apache Flink, Kafka, and related tools to ensure low-latency, reliable data delivery ...
Seattle, WA · On-site
$139K - $183K/yr
Responsibilities : • Lead the development, architecture, and maintenance of real-time streaming pipelines with Apache Flink, Kafka, and related tools to ensure low-latency, reliable data delivery ...
We are building an innovative data processing engine that is transforming how Apache Spark, Apache Flink, Ray, and others operate on diverse, large-scale data. Our team of engineers drive and adopt ...
We are building an innovative data processing engine that is transforming how Apache Spark, Apache Flink, Ray, and others operate on diverse, large-scale data. Our team of engineers drive and adopt ...
Seattle, WA · On-site
$130K - $156K/yr
Responsibilities : • Lead the development, architecture, and maintenance of real-time streaming pipelines with Apache Flink, Kafka, and related tools to ensure low-latency, reliable data delivery ...
Seattle, WA · On-site
$130K - $156K/yr
Responsibilities : • Lead the development, architecture, and maintenance of real-time streaming pipelines with Apache Flink, Kafka, and related tools to ensure low-latency, reliable data delivery ...
San Antonio, TX · On-site
Build and maintain Apache Flink pipeline jobs for real-time data processing and rule execution * Develop backend services using Java (Spring Boot) and Go (Golang) * Design and implement RESTful APIs ...
San Antonio, TX · On-site
Build and maintain Apache Flink pipeline jobs for real-time data processing and rule execution * Develop backend services using Java (Spring Boot) and Go (Golang) * Design and implement RESTful APIs ...
New York, NY · On-site
Apache Flink or related technologies: For advanced real-time stream processing, complex event processing (CEP), and stateful computations. * Apache Pinot or related technologies: For ultra-low ...
New York, NY · On-site
Apache Flink or related technologies: For advanced real-time stream processing, complex event processing (CEP), and stateful computations. * Apache Pinot or related technologies: For ultra-low ...
Manhattan, NY · On-site
Snowflake, DBT, Apache Flink, Iceberg ( Mandatory skills ). Experience with ETL tools, SQL, Data Modelling, Python, Cloud Platforms ( e,g, AWS, Azure, Google Cloud Platform ), Data Security.
Manhattan, NY · On-site
Snowflake, DBT, Apache Flink, Iceberg ( Mandatory skills ). Experience with ETL tools, SQL, Data Modelling, Python, Cloud Platforms ( e,g, AWS, Azure, Google Cloud Platform ), Data Security.
San Antonio, TX · On-site
$51.75 - $65.75/hr
Apache Flink (stateful stream processing, CEP, event-driven pipelines). * Programming: Java 11+, Spring Boot, Microservices architecture. * Frontend (optional): ReactJS, Node.js, HTML5, CSS3 for BPM ...
San Antonio, TX · On-site
$51.75 - $65.75/hr
Apache Flink (stateful stream processing, CEP, event-driven pipelines). * Programming: Java 11+, Spring Boot, Microservices architecture. * Frontend (optional): ReactJS, Node.js, HTML5, CSS3 for BPM ...
New York, NY · On-site
$134K - $176K/yr
We rely heavily on open source technologies, such as Apache Flink, Kafka, Redis, Solr and Hadoop. We are proud to be the earliest adopters of Apache Flink and one of the largest users in the firm. We ...
New York, NY · On-site
$134K - $176K/yr
We rely heavily on open source technologies, such as Apache Flink, Kafka, Redis, Solr and Hadoop. We are proud to be the earliest adopters of Apache Flink and one of the largest users in the firm. We ...
Manhattan, NY · On-site
$116K - $158K/yr
Design and manage real-time streaming solutions using Kafka, KSQL, and Apache Flink * Implement and enforce comprehensive data quality frameworks, including validation, profiling, monitoring, and ...
New
Manhattan, NY · On-site
$116K - $158K/yr
Design and manage real-time streaming solutions using Kafka, KSQL, and Apache Flink * Implement and enforce comprehensive data quality frameworks, including validation, profiling, monitoring, and ...
New
Boulder, CO · On-site
$120K - $165K/yr
Oversee the development of stream processing applications using Apache Spark or Apache Flink, and implement real-time data transformations and analytics using KSQL. * Data Storage: Design and ...
Quick apply
Boulder, CO · On-site
$120K - $165K/yr
Oversee the development of stream processing applications using Apache Spark or Apache Flink, and implement real-time data transformations and analytics using KSQL. * Data Storage: Design and ...
$184K - $324K/yr
Preferred Qualifications Good knowledge of Apache Iceberg and Apache Kafka. Experience working on or building connectors from Flink to any of the data sources. Knowledge of Yarn, Kubernetes or other ...
$184K - $324K/yr
Preferred Qualifications Good knowledge of Apache Iceberg and Apache Kafka. Experience working on or building connectors from Flink to any of the data sources. Knowledge of Yarn, Kubernetes or other ...
$44.23 - $47.49
10% of jobs
$49.30 is the 25th percentile. Wages below this are outliers.
$47.49 - $50.74
28% of jobs
The median wage is $53.53 / hr.
$50.74 - $54
15% of jobs
$54 - $57.26
6% of jobs
$57.26 - $60.51
5% of jobs
$60.51 - $63.77
4% of jobs
$63.77 - $67.02
2% of jobs
$69.95 is the 75th percentile. Wages above this are outliers.
$67.02 - $70.28
5% of jobs
$70.28 - $73.54
6% of jobs
$73.54 - $76.79
6% of jobs
$76.79 - $80.05
12% of jobs
$44
$60
$80
| Aspect | Apache Flink | Apache Spark Developer |
|---|---|---|
| Primary Focus | Real-time stream processing | Batch and stream processing |
| Work Environment | Distributed data processing systems, often in real-time applications | Big data analytics, batch jobs, and some streaming |
| Required Skills | Java, Scala, streaming concepts, distributed systems | Java, Scala, SQL, big data frameworks |
| Industry Usage | Finance, IoT, real-time analytics | Data warehousing, analytics, machine learning |
Apache Flink and Apache Spark Developers both work with big data frameworks, but Flink specializes in real-time stream processing, while Spark covers both batch and streaming tasks. Choosing between them depends on the specific data processing needs of the organization.

Full-time
Medical, Dental, Vision, Retirement, PTO
Re-posted yesterday
As a leading financial services and healthcare technology company based on revenue, SS&C is headquartered in Windsor, Connecticut, and has 27,000+ employees in 35 countries. Some 20,000 financial services and healthcare organizations, from the world's largest companies to small and mid-market firms, rely on SS&C for expertise, scale, and technology.
Job Description
Principal Data Engineer
Locations:Waltham, MA - Hybrid
About the Role
We areseekinga highly skilled and hands-onPrincipal Data Engineerto lead the design, and development of scalable real-time data platforms and distributed data processing systems. This role requires deepexpertisein Java-based backend engineering,microservicesarchitecture, event-driven systems, Apache Kafka, Apache Flink, cloud-native platforms, and AWS technologies.
The ideal candidate will have extensive experience building enterprise-scale streaming platforms, developing resilient microservices,optimizinglarge-scale data pipelines, and driving engineering best practices. This role will collaborate closely with Product, Architecture, Application Development, Analytics, SRE, and DevOps teams to deliver highly scalable, reliable, and high-performance data solutions.
Why Join SS&C
SS&C combines proprietary technology with deep industryexpertiseto support complex financial and health care operations. Our teams design, implement, andoperatesolutions that help clients manage data, automate processes, and scale their businesses with confidence.
You will work with industry experts, modern platforms, and evolving technologies, gaining exposure to real-world operational challenges and large-scale enterprise environments.
How You Will Make an Impact
Lead the design, and development of scalable real-time data platforms and event-driven streaming solutions using Apache Kafka, Apache Flink, Java, Spring Boot, and AWS cloud-native technologies.
Design and implement high-performance batch and streaming data pipelines with advanced stream-processing capabilities including stateful processing, windowing, event-time processing, checkpointing, fault tolerance, andexactly oncesemantics.
Develop scalable microservices, REST APIs, reusable data frameworks, and enterprise data processing components.
Drive platform modernization, technical design reviews, engineering standards, and adoption of innovative technologies to improve scalability, reliability, performance, and operational efficiency.
Design andmaintaincloud-native infrastructure, CI/CD pipelines, deployment automation, and containerized applications using Kubernetes, Docker, Terraform/CloudFormation, ECS/EKS, and AWS services including S3, MSK, Redshift, Aurora, RDS, Lambda, Glue, and CloudWatch.
Designoptimizedrelational and analytical data models using Oracle, PostgreSQL, Redshift, and Aurora, including performance tuning, indexing, partitioning, and query optimization.
Implement observability, monitoring, alerting, logging, data quality validation, and reconciliation frameworks to ensure operational excellence and platform reliability.
Troubleshoot complex production issues, perform root-cause analysis, and collaborate with SRE and DevOps teams to improve platform stability, scalability, and deployment automation.
Provide technical leadership, mentorship, and guidance to engineering teams while driving best practices, governance, and continuous improvement initiatives.
Required Experience
Strongexpertisein Java, Spring Boot, REST API development, and Microservices Architecture
Proficiencyin Python is preferred; experience with Node.js is a plus
Strong hands-on experience with Apache Kafka, Kafka Connect, Kafka Streams, Apache Flink, and AWS MSK
Extensive experience designing and developing cloud-native applications on AWS
Solidexpertisein Kubernetes, Docker, Terraform/CloudFormation, ECS, and EKS environments
Strong knowledge of Oracle, PostgreSQL, Amazon Redshift, and Amazon Aurora databases
Experience with data modeling, database optimization, query tuning, indexing, and performance improvement strategies
Proven experience developing and maintaining CI/CD pipelines using Jenkins, GitHub Actions, GitLab CI/CD, Maven/Gradle, and SonarQube
Strongexpertisein monitoring, logging, and observability tools including CloudWatch, Prometheus, Grafana, ELK Stack, and related operational frameworks
What Sets You Apart
Bachelor's or master'sdegree in computer science, Engineering, Information Systems, or a related field
8+ years of software engineering or data engineering experience
5+ years of hands-on experience with Apache Kafka and event-driven architectures
4+ years of experience with Apache Flink and real-time stream processing
Strong experience designing scalable, fault-tolerant, andhighly availabledistributed systems
Proven experience leading enterprise-scale platform initiatives and mentoring engineering teams
Join SS&C, where innovation meets global opportunities.Click heretoapply.
#LI-PE1
#LI-HYBRID
Unless explicitly requested or approached by SS&C Technologies, Inc. or any of its affiliated companies, the company will not accept unsolicited resumes from headhunters, recruitment agencies, or fee-based recruitment services.
SS&C Technologies offers a comprehensive total rewards package designed to support your wellbeing, growth, and future. Our benefits include medical, dental, and vision coverage; a 401(k) plan with company match; paid time off, holidays, and parental leave; and professional development reimbursement opportunity.Actual base salary will vary based on several factors, including but not limited to relevant skills, prior experience, education, demonstrated performance, and geographic location.Massachusetts: The expected base salary for the position is between 160,000 USD to 170,000 USD.Applications will be accepted on an ongoing basis until the position is filled.
SS&C Technologies is an Equal Employment Opportunity employer and does not discriminate against any applicant for employment or employee on the basis of race, color, religious creed, gender, age, marital status, sexual orientation, national origin, disability, veteran status or any other classification protected by applicable discrimination laws.
Sourced by ZipRecruiter
Real estate
10,000+ Employees
Duluth, GA, US
1924