Skip to Main Content
IBM Data and AI Ideas Portal for Customers
Hide about this portal


This portal is to open public enhancement requests against products and services offered by the IBM Data & AI organization. To view all of your ideas submitted to IBM, create and manage groups of Ideas, or create an idea explicitly set to be either visible by all (public) or visible only to you and IBM (private), use the IBM Unified Ideas Portal (https://ideas.ibm.com).


Shape the future of IBM!

We invite you to shape the future of IBM, including product roadmaps, by submitting ideas that matter to you the most. Here's how it works:


Search existing ideas

Start by searching and reviewing ideas and requests to enhance a product or service. Take a look at ideas others have posted, and add a comment, vote, or subscribe to updates on them if they matter to you. If you can't find what you are looking for,


Post your ideas

Post ideas and requests to enhance a product or service. Take a look at ideas others have posted and upvote them if they matter to you,

  1. Post an idea

  2. Upvote ideas that matter most to you

  3. Get feedback from the IBM team to refine your idea


Specific links you will want to bookmark for future use

Welcome to the IBM Ideas Portal (https://www.ibm.com/ideas) - Use this site to find out additional information and details about the IBM Ideas process and statuses.

IBM Unified Ideas Portal (https://ideas.ibm.com) - Use this site to view all of your ideas, create new ideas for any IBM product, or search for ideas across all of IBM.

ideasibm@us.ibm.com - Use this email to suggest enhancements to the Ideas process or request help from IBM for submitting your Ideas.

IBM Employees should enter Ideas at https://ideas.ibm.com


ADD A NEW IDEA

StreamSets

Showing 53

Logs filtering for different job categories

Elevate Credit requested a feature to filter sdc logs data and identify different jobs categories such as financial jobs for auditing purposes.
11 days ago in StreamSets 0 Under review

CDC-style ingestion using Google BigQuery as a source in SDC

Google BigQuery origin does not natively support CDC. As part of requirement in our project , we are expecting to use the CDC type ingestion for Google BigQuery as a source in Streamsets. Please consider this requirement and enable this functional...
18 days ago in StreamSets 2 Under review

Notification of a Failed Job Run from a Scheduled Task

Would like to be able to receive a notification when a Scheduled Task fails to start a job. Jobs stuck in a job status that is not inactive will fail to start and would like either an option to be notified of a failure when configuring the Schedul...
about 2 months ago in StreamSets 0 Under review

Snowpipe Streaming destination for Snowflake

Current Snowflake destination has performance limitations due to the nature of file-based process of uploading to Snowflake. Since 2023, Snowflake supports Snowpipe Streaming ingestion which doesn't have problems related to file-based upload, has ...
19 days ago in StreamSets 0 Under review

Handle Redis password as a credential field in Redis Destination rather than in plain text within the URL

Increases security
about 1 month ago in StreamSets 1 Under review

Notification for Jobs in Activating or Deactivating After an Amount of Time

Control Hub Subscriptions events that would be the closest to monitoring this would be a Job Status Change. The job statuses Activating and Deactivating themselves are necessary and we would not want a notification every time a job went to these s...
about 2 months ago in StreamSets 0 Under review

Expand credential fields to include. endpoint URLs

Expand credential fields to include endpoint URLs. This would allow better security for example in the case where a Redis URL contains a password as well as better parameterization whenmoving connections across environments. One can already retrie...
about 1 month ago in StreamSets 0 Under review

Security permission set at group level for template -> objects created -> when pipeline/job template/job Whenever a pipeline/job template/job created in the StreamSets, we can have ACL to allow/restrict others to work on it. But, in case of job template, others cannot see the job instances created on top of it even they are in ACL. So, only owner can see what is happening while processing a file. StreamSets team said, it is a bug on their end. When can we expect this issue fix as only the person who created the template can see the logs.

(Streamsets Group permission set on template newly created objects) Whenever a pipeline/job template/job created in the StreamSets, we can have ACL to allow/restrict others to work on it. But, in case of job template, others cannot see the job ins...
about 1 month ago in StreamSets 0 Under review

AWS_MSK_IAM SASL_MECHANISM support for Kafka stages

Ability to use connections to connect to Kafka endpoint, access provided through IAM role via the AWS_MSK_IAM SASL mechanism. Currently, Kafka stages allows Security Protocol=CUSTOM for manually configuring Java Properties for the Kafka Client, bu...
about 2 months ago in StreamSets 0 Under review

Add support for top level union schemas in Kafka Avro schema support

Support top-level unions for Avro schemas instead of just top-level record schemas. Example top-level union: ["null", { "type": "record", "name": "SampleRecord", "fields": [ { "name": "id", "type": "string" }, { "name": "name", "type": "strin...
about 2 months ago in StreamSets 0 Under review