IBM Data Platform Ideas Portal for Customers


This portal is to open public enhancement requests against products and services offered by the IBM Data Platform organization. To view all of your ideas submitted to IBM, create and manage groups of Ideas, or create an idea explicitly set to be either visible by all (public) or visible only to you and IBM (private), use the IBM Unified Ideas Portal (https://ideas.ibm.com).


Shape the future of IBM!

We invite you to shape the future of IBM, including product roadmaps, by submitting ideas that matter to you the most. Here's how it works:


Search existing ideas

Start by searching and reviewing ideas and requests to enhance a product or service. Take a look at ideas others have posted, and add a comment, vote, or subscribe to updates on them if they matter to you. If you can't find what you are looking for,


Post your ideas

Post ideas and requests to enhance a product or service. Take a look at ideas others have posted and upvote them if they matter to you,

  1. Post an idea

  2. Upvote ideas that matter most to you

  3. Get feedback from the IBM team to refine your idea


Specific links you will want to bookmark for future use

Welcome to the IBM Ideas Portal (https://www.ibm.com/ideas) - Use this site to find out additional information and details about the IBM Ideas process and statuses.

IBM Unified Ideas Portal (https://ideas.ibm.com) - Use this site to view all of your ideas, create new ideas for any IBM product, or search for ideas across all of IBM.

ideasibm@us.ibm.com - Use this email to suggest enhancements to the Ideas process or request help from IBM for submitting your Ideas.

IBM Employees should enter Ideas at https://ideas.ibm.com



ADD A NEW IDEA

Search results: Spectrum Conductor

Showing 25 of 5232

Consumer being truncated when using egosh CLI

Egosh is quicker than the REST API to match consumers back to the spark instance groups. However, the consumer is truncated if the value is greater than 40 characters, which is not useful. This occurs on the following commands: egosh user roles4us...
over 1 year ago in Spectrum Conductor / Version 2.5.1 0 Submitted

Agnostic/Generic Instance Groups and Resource Scheduler

We are in need of agnostic/generic instance groups and an   agnostic/genericresource scheduler.*) agnostic/genericresource schedulerThere is a common need for our data scientists to schedule a "pure" non-Spark TensorFlow Python...
over 5 years ago in Spectrum Conductor / Version 2.4.1 0 Future consideration

PySpark Kernel unable to read/extract when connected to external database using Kerberos Keytab

IBM JRE supplied as part of Sym 7.3.1 + Conductor 2.5 is incompatible with current use-case Use-case: We have a client that uses Spark/Notebooks (PySpark kernel) to connect an external database via ODBC using kerberos. Whenever they try to connect...
over 4 years ago in Spectrum Conductor / Future Version 3 Delivered

Add Spark3.2.0 with Java 11 support enabled

Spark 3.2.0 version have a lot of features which benefits market risk applications. The key enhancements to Query compilation/optimization/execution, shuffle efficiency, ORC upgrade will improve the Risk calculation, serving data to UI and running...
about 3 years ago in Spectrum Conductor / Version 2.5.1 3 Delivered

Run SparkCleanup service per individual Instance group instead of centrally

We would like SparkCleanup service to run as execution user of each individual Instance Group, rather than centrally as cluster admin. This will avoid the need to do preliminary work to make sure execution users of SIG are part of cluster admin un...
about 4 years ago in Spectrum Conductor / Future Version 0 Delivered

SIG specific data and logs clean up

Conductor clean up service currently supports periodic clean up of data and logs with global cluster level retention parameters. Request is to support custom log/data retentions of files at per SIG level overriding global settings.
over 4 years ago in Spectrum Conductor / Version 2.4.1 1 Delivered

Accessing Dataconnector in conductor using python from GPU server

Hello Team, we have setup a connector in GPU to access HDFS from our CPU cluster. However, i am able to access the file in HDFS using spark but not using python. I would like to understand how to access HDFS using python commands. Connector Name: ...
about 5 years ago in Spectrum Conductor / Version 2.4.1 0 Future consideration

Add driver_id field to ELK API on 2.4.1 version

We are currently using Conductor rest call, however due to some limitations e.g. Memory numbers are not correct, we are looking at exploring the ELK API where most of the data are correctly available. But driver_id is missing, please add the same ...
about 5 years ago in Spectrum Conductor / Version 2.4.1 1 Delivered

Functionality/API to undeploy SIGs on hosts

Spectrum conductor provides APIs and UI functionality to deploy SIGs to all or selected cluster members. There are at times corruption on the member nodes due to disk out of space or misconfiguration, or state issues. This feature should clean up ...
about 5 years ago in Spectrum Conductor / Version 2.4.1 0 Future consideration

Address security concern related to user notebook folders in spectrum conductor

Spectrum conductor is being used in the bank for workload/resource management for spark cluster and would like to see a new enhancement to improve the security of the user data stored within the jupyter notebook folder. Currently the notebook fold...
over 5 years ago in Spectrum Conductor / Version 2.4 1 Delivered

By clicking the "Post Comment" or "Submit Idea" button, you are agreeing to the IBM Ideas Portal Terms of Use.
Do not place IBM confidential, company confidential, or personal information into any field.