Skip to Main Content
IBM Data Platform Ideas Portal for Customers


This portal is to open public enhancement requests against products and services offered by the IBM Data Platform organization. To view all of your ideas submitted to IBM, create and manage groups of Ideas, or create an idea explicitly set to be either visible by all (public) or visible only to you and IBM (private), use the IBM Unified Ideas Portal (https://ideas.ibm.com).


Shape the future of IBM!

We invite you to shape the future of IBM, including product roadmaps, by submitting ideas that matter to you the most. Here's how it works:


Search existing ideas

Start by searching and reviewing ideas and requests to enhance a product or service. Take a look at ideas others have posted, and add a comment, vote, or subscribe to updates on them if they matter to you. If you can't find what you are looking for,


Post your ideas

Post ideas and requests to enhance a product or service. Take a look at ideas others have posted and upvote them if they matter to you,

  1. Post an idea

  2. Upvote ideas that matter most to you

  3. Get feedback from the IBM team to refine your idea


Specific links you will want to bookmark for future use

Welcome to the IBM Ideas Portal (https://www.ibm.com/ideas) - Use this site to find out additional information and details about the IBM Ideas process and statuses.

IBM Unified Ideas Portal (https://ideas.ibm.com) - Use this site to view all of your ideas, create new ideas for any IBM product, or search for ideas across all of IBM.

ideasibm@us.ibm.com - Use this email to suggest enhancements to the Ideas process or request help from IBM for submitting your Ideas.

IBM Employees should enter Ideas at https://ideas.ibm.com



ADD A NEW IDEA

Search results: StreamSets

Showing 12 of 1687

StreamSets MongoDB Atlas Origin Fails with Time-Series Collections

The Issue StreamSets MongoDB Atlas origin cannot read data from MongoDB Atlas time-series collections. The pipeline fails during initialization with this error: Error: [MongoDB Atlas 1] Stage 'MongoDBAtlas_1' initialization error: com.mongodb.Mon...
3 months ago in StreamSets 4 Planned for future release

UI Modifications: Job details visible on engine details page and also on logs. Data collector details visible on Job instance page.

The customer wanted following modifications on the Platform UI:1. On the engine details page, under running pipelines section, currently only the pipeline details are shown in UI, such as pipeline name, type, status, last reported, etc. The custom...
about 1 month ago in StreamSets 1 Under review

Needed a new option that would stop any job to instantiate a pipeline inside a data collector then when all the currently running pipeline will terminate then the data collector would shutdown automatically

Needed a new option that would stop any job to instantiate a pipeline inside a data collector then when all the currently running pipeline will terminate then the data collector would shutdown automatically. 1 provide a lock at the control plan le...
2 months ago in StreamSets 0 Needs more information

Add ability to delete orphaned jobs on Platform

Currently, the only way to delete orphaned jobs is to remove the directories using these commands: rm -rf /data/pipelines/<pipeline ID> rm -rf /data/runInfo/<pipeline ID> Please add the ability to delete orphaned jobs for either the fo...
about 1 year ago in StreamSets 1 Future consideration

Enable reading NUMBER(1) columns in New Oracle CDC stage as INTEGER rather than BYTE

There is an existing CI in the old system for this; adding it to the Ideas portal for customer visibility. StreamSets documentation explains that we convert Oracle's Number type to SDC data types based on precision and scale, converting NUMBER fie...
10 months ago in StreamSets 0 Under review

Support list in field mapping for MongoDB Lookup Stage

Customer has raised a request to specify list (array) in the “SDC field” while defining Document to SDC Field Mappings in MongoDB atlas lookup processor stage. Usually we specify field names for mapping but here we require to fetch the records whe...
12 months ago in StreamSets 2 Needs more information

Adding resource files to Deployable Transformer for Snowflake engines by introducing External Resource for Platform Users

In the same way that StreamSets Data Collector (SDC) allows for the upload of external resources via the user interface, there should be a similar option available for the Deployed Transformer for Snowflake. Use Case 1:According to our organizatio...
8 months ago in StreamSets 0 Under review

Mongo "processor" stage (for delete / insert etc) so we can guarantee order of operations

A mongo 'processing' stage that can do inserts / deletes that can be used in the middle of processing rather than only upon destination, effectively to guarantee the order in which this occurs. I'd like to handle an update scenario by first deleti...
6 months ago in StreamSets 0 Under review

Multiple Pipeline and Job Selection for Engine Assignment

To assign or change SDC engine assignment for pipelines and jobs it is currently required that an admin go into each pipeline and job one-at-a-time, edit the object into draft mode, change the assigned engine, then check in the object. Please make...
10 months ago in StreamSets 1 Functionality already exists

Provide an option for Deferred merge method in Snowflake destination

https://quickstarts.snowflake.com/guide/connectors_example_push_based_java/img/e5a0394034661f7.pdf Deferred merge is a pattern whereby you maintain a temporary or hot data table (1) with changed or new records for an interval of time. When that ti...
10 months ago in StreamSets 0 Under review