IBM Data and AI Ideas Portal for Customers


This portal is to open public enhancement requests against products and services offered by the IBM Data & AI organization. To view all of your ideas submitted to IBM, create and manage groups of Ideas, or create an idea explicitly set to be either visible by all (public) or visible only to you and IBM (private), use the IBM Unified Ideas Portal (https://ideas.ibm.com).


Shape the future of IBM!

We invite you to shape the future of IBM, including product roadmaps, by submitting ideas that matter to you the most. Here's how it works:


Search existing ideas

Start by searching and reviewing ideas and requests to enhance a product or service. Take a look at ideas others have posted, and add a comment, vote, or subscribe to updates on them if they matter to you. If you can't find what you are looking for,


Post your ideas

Post ideas and requests to enhance a product or service. Take a look at ideas others have posted and upvote them if they matter to you,

  1. Post an idea

  2. Upvote ideas that matter most to you

  3. Get feedback from the IBM team to refine your idea


Specific links you will want to bookmark for future use

Welcome to the IBM Ideas Portal (https://www.ibm.com/ideas) - Use this site to find out additional information and details about the IBM Ideas process and statuses.

IBM Unified Ideas Portal (https://ideas.ibm.com) - Use this site to view all of your ideas, create new ideas for any IBM product, or search for ideas across all of IBM.

ideasibm@us.ibm.com - Use this email to suggest enhancements to the Ideas process or request help from IBM for submitting your Ideas.

IBM Employees should enter Ideas at https://ideas.ibm.com


ADD A NEW IDEA

Search results: StreamSets

Showing 9 of 1578

Enable reading NUMBER(1) columns in New Oracle CDC stage as INTEGER rather than BYTE

There is an existing CI in the old system for this; adding it to the Ideas portal for customer visibility. StreamSets documentation explains that we convert Oracle's Number type to SDC data types based on precision and scale, converting NUMBER fie...
6 months ago in StreamSets 0 Under review

Mongo "processor" stage (for delete / insert etc) so we can guarantee order of operations

A mongo 'processing' stage that can do inserts / deletes that can be used in the middle of processing rather than only upon destination, effectively to guarantee the order in which this occurs. I'd like to handle an update scenario by first deleti...
2 months ago in StreamSets 0 Submitted

Adding resource files to Deployable Transformer for Snowflake engines by introducing External Resource for Platform Users

In the same way that StreamSets Data Collector (SDC) allows for the upload of external resources via the user interface, there should be a similar option available for the Deployed Transformer for Snowflake. Use Case 1:According to our organizatio...
4 months ago in StreamSets 0 Under review

Support list in field mapping for MongoDB Lookup Stage

Customer has raised a request to specify list (array) in the “SDC field” while defining Document to SDC Field Mappings in MongoDB atlas lookup processor stage. Usually we specify field names for mapping but here we require to fetch the records whe...
7 months ago in StreamSets 0 Under review

Add ability to delete orphaned jobs on Platform

Currently, the only way to delete orphaned jobs is to remove the directories using these commands: rm -rf /data/pipelines/<pipeline ID> rm -rf /data/runInfo/<pipeline ID> Please add the ability to delete orphaned jobs for either the fo...
9 months ago in StreamSets 0 Future consideration

Multiple Pipeline and Job Selection for Engine Assignment

To assign or change SDC engine assignment for pipelines and jobs it is currently required that an admin go into each pipeline and job one-at-a-time, edit the object into draft mode, change the assigned engine, then check in the object. Please make...
6 months ago in StreamSets 1 Functionality already exists

Provide an option for Deferred merge method in Snowflake destination

https://quickstarts.snowflake.com/guide/connectors_example_push_based_java/img/e5a0394034661f7.pdf Deferred merge is a pattern whereby you maintain a temporary or hot data table (1) with changed or new records for an interval of time. When that ti...
6 months ago in StreamSets 0 Under review

Feature to preserve offset between job runs and SDCs without enabling failover

Customer is requesting for an option in Control Hub to preserve the offset between job runs without enabling Job Failover. This is because they usually have only 1 SDC running at a time, but when they upgrade to a different SDC engine, they want t...
9 months ago in StreamSets 0 Future consideration

Oracle CDC: Add the ability to mine only the archived redo logs with Primary DB

The customer is testing a 3 pipeline design pattern of Oracle CDC → Snowflake use-case on SDC 5.10, Oracle RAC DB with PDB. They are testing the jobs in a test environment with production like volumes. During the test, they noticed in the logs tha...
9 months ago in StreamSets 0 Needs more information

By clicking the "Post Comment" or "Submit Idea" button, you are agreeing to the IBM Ideas Portal Terms of Use.
Do not place IBM confidential, company confidential, or personal information into any field.