IBM Data and AI

Welcome to the IBM Data and AI Ideas Portal for Clients!

We welcome and appreciate your feedback on IBM Data and AI Products to help make them even better than they are today!
Before you submit an idea, please perform a search first as a similar idea may have already been reported in the portal. If a related idea is not yet listed, please create a new idea and include with it a description which includes expected behavior as well as why having this feature would improve the service and how it would address your use case.
IBM Employees:
Clients:
  • Our team welcomes any feedback and suggestions you have for improving our offerings / products! This forum allows us to connect your offering / product improvement ideas with IBM product and engineering teams.

  • If you have not registered on this portal please click on the following link and register. To complete registration you will need to open the email you will receive from Aha to confirm your identity. http://ibm.biz/IBM-Data-and-AI-Portal-Register

Additional Information:
  • The shorter URL for this site is: https://ibm.biz/IBM-Data-and-AI-Ideas

  • To view our roadmaps: http://ibm.biz/Data-and-AI-Roadmaps

  • Reminder: This is not the place to submit defects or support needs, please use normal support channel for these cases

  • Please do not use the Ideas Portal for reporting bugs - we ask that you report bugs or issues with the product by contacting IBM support.

S3 connector request for Datastage (TS003424088)

Using Infosphere Information Server 11.7.1. Service Pack 2, we noticed that we are unable to create a data connection for Amazon S3 in DataStage to a private endpoint (not the usual public Amazon endpoints).

We are unable to read/write information through a data stage job from a bucket. The same problem we have encoutered in IMAM also.

IBM Engineering team provided some development jars, and an extra variable was added in Administrator Client, through PMR (Case TS003424088), in order to solve the problem, but an enchancement to the product is nedeed.

On the IMAM side the environent variable was added to dsenv.

  • Avatar32.5fb70cce7410889e661286fd7f1897de Guest
  • Sep 2 2020
  • Under Review
Who would benefit from this IDEA? ING Data Lakes
How should it work?

We should be able to establish connection to S3 Buckets (S3A and S3 connectivity) and read/write objects through the already present Datastage Amazon S3 connector. IIS should be able to connect to any endpoint that provides S3/S3A API compliance (private / public).

An option to skip endpoint SSL certificate validation in DEV & TEST is also required.

Also, we should be able to import metadata from S3 Buckets files / objects into IGC using IMAM (osh file needs to be present in the bucket for every file that has to be imported).

Idea Priority High
Priority Justification Introduce the Object Storage technology inside Data Lake
Customer Name ING
  • Attach files
  • Admin
    Virginie Grandhaye commented
    3 Sep 12:28pm

    Thank you for submitting this idea. We will review the feasibility of it, and keep you posted soon.

NOTICE TO EU RESIDENTS: per EU Data Protection Policy, if you wish to remove your personal information from the IBM ideas portal, please login to the ideas portal using your previously registered information then change your email to "anonymous@euprivacy.out" and first name to "anonymous" and last name to "anonymous". This will ensure that IBM will not send any emails to you about all idea submissions