Saint Louis, MO · On-site
StreamSets Developer Location: Remote Job Type: Long Term Contract Position Overview We are looking for an experienced StreamSets Developer to design, develop, implement, and support enterprise-scale ...
New
Quick apply
Saint Louis, MO · On-site
StreamSets Developer Location: Remote Job Type: Long Term Contract Position Overview We are looking for an experienced StreamSets Developer to design, develop, implement, and support enterprise-scale ...
New
Kafka / StreamSets Developer (Onsite) Locations: Louisville, KY | Houston, TX Visa: H1B / H4 EAD | Long-term Responsibilities * Build and support real-time data streaming using Apache Kafka * Develop ...
Quick apply
Kafka / StreamSets Developer (Onsite) Locations: Louisville, KY | Houston, TX Visa: H1B / H4 EAD | Long-term Responsibilities * Build and support real-time data streaming using Apache Kafka * Develop ...
Jersey City, NJ · On-site
Required Skills Technical Skills- ,Kafka,Apache Airflow,Streamsets Domain Skills- 5.Nice to have skills Techincal Skills- Domain Skills- 6.Technology Data Management 7.Shift Day 9 TO 6 8.Roles ...
Jersey City, NJ · On-site
Required Skills Technical Skills- ,Kafka,Apache Airflow,Streamsets Domain Skills- 5.Nice to have skills Techincal Skills- Domain Skills- 6.Technology Data Management 7.Shift Day 9 TO 6 8.Roles ...
Dublin, CA · On-site +1
$113K - $195K/yr
The Engineer II role focuses on designing, building, and optimizing data ingestion pipelines using StreamSets or similar data integration tools. It involves developing and maintaining Python-based ...
Dublin, CA · On-site +1
$113K - $195K/yr
The Engineer II role focuses on designing, building, and optimizing data ingestion pipelines using StreamSets or similar data integration tools. It involves developing and maintaining Python-based ...
Dublin, CA · On-site
$113K - $195K/yr
The Engineer II role focuses on designing, building, and optimizing data ingestion pipelines using StreamSets or similar data integration tools. It involves developing and maintaining Python-based ...
Dublin, CA · On-site
$113K - $195K/yr
The Engineer II role focuses on designing, building, and optimizing data ingestion pipelines using StreamSets or similar data integration tools. It involves developing and maintaining Python-based ...
Dublin, CA · On-site
$113K - $195K/yr
The Engineer II role focuses on designing, building, and optimizing data ingestion pipelines using StreamSets or similar data integration tools. It involves developing and maintaining Python-based ...
Dublin, CA · On-site
$113K - $195K/yr
The Engineer II role focuses on designing, building, and optimizing data ingestion pipelines using StreamSets or similar data integration tools. It involves developing and maintaining Python-based ...
Dublin, CA · On-site
$113K - $195K/yr
The Engineer II role focuses on designing, building, and optimizing data ingestion pipelines using StreamSets or similar data integration tools. It involves developing and maintaining Python-based ...
Dublin, CA · On-site
$113K - $195K/yr
The Engineer II role focuses on designing, building, and optimizing data ingestion pipelines using StreamSets or similar data integration tools. It involves developing and maintaining Python-based ...
Dublin, CA · On-site
$81K - $136K/yr
The Applications Analyst role focuses on developing and supporting data ingestion workflows using StreamSets and related technologies. It involves assisting in building and maintaining data pipelines ...
Dublin, CA · On-site
$81K - $136K/yr
The Applications Analyst role focuses on developing and supporting data ingestion workflows using StreamSets and related technologies. It involves assisting in building and maintaining data pipelines ...
Juno Beach, FL · On-site
Streamsets or Equivalent Data Pipeline technology * Creating ETL's * Analyzing Business Process (SIPOC , Process Maps, Etc.) * Git, Bitbucket, or Other CMS * Python & JSON (Data wrangling skills)
Juno Beach, FL · On-site
Streamsets or Equivalent Data Pipeline technology * Creating ETL's * Analyzing Business Process (SIPOC , Process Maps, Etc.) * Git, Bitbucket, or Other CMS * Python & JSON (Data wrangling skills)
Dublin, CA · Remote
$81K - $136K/yr
The Applications Analyst role focuses on developing and supporting data ingestion workflows using StreamSets and related technologies. It involves assisting in building and maintaining data pipelines ...
Dublin, CA · Remote
$81K - $136K/yr
The Applications Analyst role focuses on developing and supporting data ingestion workflows using StreamSets and related technologies. It involves assisting in building and maintaining data pipelines ...
$113K - $195K/yr
The Engineer II role focuses on designing, building, and optimizing data ingestion pipelines using StreamSets or similar data integration tools. It involves developing and maintaining Python-based ...
$113K - $195K/yr
The Engineer II role focuses on designing, building, and optimizing data ingestion pipelines using StreamSets or similar data integration tools. It involves developing and maintaining Python-based ...
Dublin, CA · On-site
$81K - $136K/yr
The Applications Analyst role focuses on developing and supporting data ingestion workflows using StreamSets and related technologies. It involves assisting in building and maintaining data pipelines ...
Dublin, CA · On-site
$81K - $136K/yr
The Applications Analyst role focuses on developing and supporting data ingestion workflows using StreamSets and related technologies. It involves assisting in building and maintaining data pipelines ...
Dublin, CA · On-site
$113K - $195K/yr
The Engineer II role focuses on designing, building, and optimizing data ingestion pipelines using StreamSets or similar data integration tools. It involves developing and maintaining Python-based ...
Dublin, CA · On-site
$113K - $195K/yr
The Engineer II role focuses on designing, building, and optimizing data ingestion pipelines using StreamSets or similar data integration tools. It involves developing and maintaining Python-based ...
Dublin, CA · On-site
$81K - $136K/yr
The Applications Analyst role focuses on developing and supporting data ingestion workflows using StreamSets and related technologies. It involves assisting in building and maintaining data pipelines ...
Dublin, CA · On-site
$81K - $136K/yr
The Applications Analyst role focuses on developing and supporting data ingestion workflows using StreamSets and related technologies. It involves assisting in building and maintaining data pipelines ...
Dublin, CA · On-site
$81K - $136K/yr
The Applications Analyst role focuses on developing and supporting data ingestion workflows using StreamSets and related technologies. It involves assisting in building and maintaining data pipelines ...
Dublin, CA · On-site
$81K - $136K/yr
The Applications Analyst role focuses on developing and supporting data ingestion workflows using StreamSets and related technologies. It involves assisting in building and maintaining data pipelines ...
Dublin, CA · On-site
$81K - $136K/yr
The Applications Analyst role focuses on developing and supporting data ingestion workflows using StreamSets and related technologies. It involves assisting in building and maintaining data pipelines ...
Dublin, CA · On-site
$81K - $136K/yr
The Applications Analyst role focuses on developing and supporting data ingestion workflows using StreamSets and related technologies. It involves assisting in building and maintaining data pipelines ...
Manhattan, NY · On-site
$57.75 - $74.50/hr
... StreamSets & Databricks • Experience in developing TDD/BDD unit-tests and work with Quality Assurance team members on defect triage and resolution • Must have experience working in the Financial ...
Manhattan, NY · On-site
$57.75 - $74.50/hr
... StreamSets & Databricks • Experience in developing TDD/BDD unit-tests and work with Quality Assurance team members on defect triage and resolution • Must have experience working in the Financial ...
Manhattan, NY · On-site
$63 - $80.50/hr
... StreamSets & Databricks • Experience in developing TDD/BDD unit-tests and work with Quality Assurance team members on defect triage and resolution • Proactively participates in Agile ceremonies ...
Manhattan, NY · On-site
$63 - $80.50/hr
... StreamSets & Databricks • Experience in developing TDD/BDD unit-tests and work with Quality Assurance team members on defect triage and resolution • Proactively participates in Agile ceremonies ...
Collaborate with engineering teams on data ingestion using StreamSets or similar technologies. * Support DBT-based data transformation and implement efficient ELT pipelines. * Create proof of ...
Quick apply
Collaborate with engineering teams on data ingestion using StreamSets or similar technologies. * Support DBT-based data transformation and implement efficient ELT pipelines. * Create proof of ...
Irving, TX · On-site
$53.50 - $70.75/hr
... Kudu StreamSets MapReduce Presto HDFS Zookeeper NOSQL Hive Pig Hue Solr Sqoop AWS Oozie Kafka spark Hbase Linux/UNIX Shell Scripting • Experience in Project source code management and trouble ...
Irving, TX · On-site
$53.50 - $70.75/hr
... Kudu StreamSets MapReduce Presto HDFS Zookeeper NOSQL Hive Pig Hue Solr Sqoop AWS Oozie Kafka spark Hbase Linux/UNIX Shell Scripting • Experience in Project source code management and trouble ...
$56.69 is the 25th percentile. Wages below this are outliers.
$54.57 - $56.97
28% of jobs
The median wage is $58.47 / hr.
$56.97 - $59.38
35% of jobs
$61.78 is the 75th percentile. Wages above this are outliers.
$59.38 - $61.78
12% of jobs
$61.78 - $64.18
2% of jobs
$64.18 - $66.59
3% of jobs
$66.59 - $68.99
3% of jobs
$68.99 - $71.39
3% of jobs
$71.39 - $73.80
3% of jobs
$73.80 - $76.20
3% of jobs
$76.20 - $78.61
3% of jobs
$78.61 - $81.01
3% of jobs
$54
$62
$81
A StreamSets job is a scheduled or manually triggered execution of a data pipeline within StreamSets Data Collector or Control Hub. It enables automated data movement between sources and destinations, ensuring data flow reliability and efficiency. Jobs can be monitored, scheduled, and managed centrally, allowing for real-time tracking and troubleshooting.
To excel in a StreamSets Engineer role, you need strong experience in data integration, ETL (Extract, Transform, Load) processes, and a solid understanding of data pipeline architecture. Proficiency with StreamSets Data Collector, DataOps platforms, and supporting technologies like SQL, cloud services (AWS, Azure, GCP), and scripting languages is highly valued; relevant certifications in data engineering are also beneficial. Excellent problem-solving skills, teamwork, and effective communication help you work seamlessly with data analysts, developers, and business stakeholders. These skills are crucial to ensure reliable, scalable data flows and successful integration projects across dynamic business environments.
StreamSets Engineers often encounter challenges like handling large volumes of diverse data, ensuring pipeline scalability, and optimizing for data quality and performance. Addressing these requires proactive monitoring, designing fault-tolerant architectures, and utilizing built-in validation and error-handling features in StreamSets platforms. Engineers typically collaborate with both data engineers and business teams to understand evolving requirements and resolve issues efficiently. Staying current with platform updates and industry best practices is also key to overcoming technical and operational hurdles. By anticipating and addressing these challenges, StreamSets Engineers help companies maintain reliable and agile data infrastructures.
The most popular types of Streamsets jobs are:
States with the most job openings for Streamsets jobs include:
The top searched job categories for Streamsets jobs are:
StreamSets Developer
Location: Remote
Job Type: Long Term Contract
Position Overview
We are looking for an experienced StreamSets Developer to design, develop, implement, and support enterprise-scale data integration and data ingestion pipelines. The ideal candidate will have strong hands-on experience with StreamSets Data Collector, ETL/ELT, real-time data integration, APIs, databases, cloud platforms, and data engineering technologies.
This is a Remote opportunity.
Key Responsibilities
Design, develop, configure, and maintain data ingestion pipelines using StreamSets.
Build scalable ETL/ELT pipelines for batch and real-time data integration.
Develop and maintain StreamSets Data Collector (SDC) pipelines and data flows.
Integrate data from multiple sources including databases, APIs, files, cloud platforms, and enterprise applications.
Configure StreamSets origins, processors, destinations, and pipeline parameters.
Develop data transformation, cleansing, enrichment, validation, and routing logic.
Monitor pipeline performance and troubleshoot data processing and integration issues.
Implement error handling, data quality checks, logging, and recovery mechanisms.
Work with structured and semi-structured data including JSON, XML, CSV, Avro, and Parquet.
Integrate StreamSets with relational and NoSQL databases.
Develop integrations with cloud-based data platforms and data warehouses.
Optimize pipelines for performance, scalability, reliability, and throughput.
Required Skills
Strong hands-on experience with StreamSets Data Collector (SDC).
Experience designing and developing StreamSets pipelines.
Strong ETL/ELT and data integration experience.
Strong SQL skills.
Experience with relational databases such as Oracle, SQL Server, PostgreSQL, or MySQL.
Experience working with APIs and web services.
Strong understanding of REST APIs.
Experience with JSON, XML, CSV, Avro, and Parquet.
Preferred Skills
Experience with StreamSets Transformer and StreamSets Control Hub.
Experience with cloud platforms such as AWS, Azure, or GCP.
Experience with cloud data platforms such as Snowflake, Databricks, or BigQuery.
Experience with Kafka and event-driven data integration.
Experience with Hadoop/HDFS or other distributed data platforms.
Experience with Python or Java.
Experience with CI/CD tools such as Jenkins, GitHub Actions, GitLab, or Azure DevOps.
Experience with Docker/Kubernetes is a plus.
Experience working with data warehouses and data lakes.
Knowledge of data governance, metadata management, and data quality.
Qualifications
Bachelor's degree in Computer Science, Information Technology, Engineering, or a related field preferred.
5+ years of experience in data engineering, ETL, data integration, or related technologies.
Strong StreamSets development experience is required.
Excellent analytical, troubleshooting, communication, and problem-solving skills.
Sourced by ZipRecruiter
In the dynamic landscape of today’s business environment, flexibility is key. At Centstone, we understand the unique demands of your industry and offer tailored Contract Hiring solutions to empower your organization with the right talent when you need it most.
Recruiting and staffing services
51 - 200 Employees
Hazlet, NJ, US
2022
