Search results: StreamSets

Showing 46 of 5233

Enable self-service deployment of new JARs, JKS and custom libraries without requiring NFS or S3 buckets and without requiring SDC restarts

Very often users want to add new jars or have their own java key stores. Currently, these are done administratively and that too requires an S3 or NFS location and then requires a restart of the data collector. This involves engaging the administr...

8 months ago in StreamSets 0 Under review

1 VOTE

Support Change Data Capture from MariaDB

Customers who have adopted MariaDB and seek to capture and replicate changes from it

9 months ago in StreamSets 0 Not under consideration

1 VOTE

Have the ability to store the error records from and HTTP stage or JDBC stage seperately.

This feature request is to have the ability to write the erroneous records from an http stage (client/processor) or jdbc stages directly to a dedicated data source(local fs/table). Currently the failed records along with logs from all stages are w...

10 months ago in StreamSets 0 Under review

1 VOTE

Provide an option for Deferred merge method in Snowflake destination

https://quickstarts.snowflake.com/guide/connectors_example_push_based_java/img/e5a0394034661f7.pdf Deferred merge is a pattern whereby you maintain a temporary or hot data table (1) with changed or new records for an interval of time. When that ti...

10 months ago in StreamSets 0 Under review

1 VOTE

Data Collector thread consuming CPU after closing preview

Faulty code, such as an infinite loop in a Groovy Evaluator stage, will not destroy threads after closing a pipeline preview. The lingering threads will consume CPU resources until the engine is restarted. The request for this Idea is to implement...

12 months ago in StreamSets 0 Is a defect

1 VOTE

StreamSets Platform: SDK: Support for time-based SLAs on long-running jobs

Historically, StreamSets Control Hub and Data Collector had rules and alerts that could notify if pipelines/jobs hit a certain record count and other related metrics. These are only somewhat useful, such as for jobs which typically have a certain ...

12 months ago in StreamSets 0 Planned for future release

1 VOTE

Subscriptions on job failure is firing during job failover between data collectors

For high availability usually a job is setup to run on a data collector label associated with more than one data collectors. If a job is failed over from one data collector to another due to some issues the subscription gets fired as a job failure...

about 1 year ago in StreamSets 1 Is a defect

1 VOTE

SST Kafka Producer "Send Message Keys" key field to be sent as json format

Product - StreamSets Transformer for SparkVersion - 5.6.1 Customer is looking to send the Kafka Producer "Send Message Keys" key field to be sent as json format. They are using Transformer and want to pass Key Field in Kafka destination. Ideally i...

about 1 year ago in StreamSets 0 Under review

1 VOTE

Snowflake Destination does not support "Array" data type.

IBM StreamSets Control Hub | PlatformSDC 5.10 High level pipeline logic:MongoDB → Snowflake The customer is attempting to ingest data from MongoDB and write it into Snowflake. They utilize the “Array” datatype a considerable amount in both MongoDB...

about 1 year ago in StreamSets 0 Functionality already exists

1 VOTE

Snowflake Destination does not support "Object" data type.

IBM StreamSets Control Hub | PlatformSDC 5.10 High level pipeline logic:MongoDB → Snowflake The customer is attempting to ingest data from MongoDB and write it into Snowflake. They utilize the “Object” datatype a considerable amount in both MongoD...

about 1 year ago in StreamSets 0 Delivered

Please enter your email address

FILTER BY CATEGORY