IBM Data and AI

Welcome to the IBM Data and AI Ideas Portal for Clients!

We welcome and appreciate your feedback on IBM Data and AI Products to help make them even better than they are today!
Before you submit an idea, please perform a search first as a similar idea may have already been reported in the portal. If a related idea is not yet listed, please create a new idea and include with it a description which includes expected behavior as well as why having this feature would improve the service and how it would address your use case.
IBM Employees:
Clients:
  • Our team welcomes any feedback and suggestions you have for improving our offerings / products! This forum allows us to connect your offering / product improvement ideas with IBM product and engineering teams.

  • If you have not registered on this portal please click on the following link and register. To complete registration you will need to open the email you will receive from Aha to confirm your identity. http://ibm.biz/IBM-Data-and-AI-Portal-Register

Additional Information:
  • The shorter URL for this site is: https://ibm.biz/IBM-Data-and-AI-Ideas

  • To view our roadmaps: http://ibm.biz/Data-and-AI-Roadmaps

  • Reminder: This is not the place to submit defects or support needs, please use normal support channel for these cases

  • Please do not use the Ideas Portal for reporting bugs - we ask that you report bugs or issues with the product by contacting IBM support.

Support for Custom URL within File connector HDFS

We need to import data files and folders as well as the file structure to IGC from Atlas HDFS, which is not possible when using Custom url.

  • Avatar32.5fb70cce7410889e661286fd7f1897de Guest
  • Sep 18 2020
  • Not Under Consideration
How should it work?

Add functionality to the connector to overcome the limitations regarding the API.

Idea Priority Medium
Customer Name Hans Norén
  • Attach files
  • Admin
    Scott Brokaw commented
    20 Oct 12:53am

    For Parquet, this is a limitation in the Parquet API itself - we can reconsider this if this restriction is lifted.

  • Avatar40.8f183f721a2c86cd98fddbbe6dc46ec9
    Guest commented
    21 Sep 09:31am

    Hi Scott, please find details in the support case TS004059285 that Hans addressed with our support team. Regards Oliver

  • Avatar40.8f183f721a2c86cd98fddbbe6dc46ec9
    Guest commented
    18 Sep 12:41pm

    Hi,

    Yes, using the File connector HDFS in IMAM resulting in errors.

    IBM Engineering team has confirmed that there is no support for importing Parquet files (and folders) and file structure due to third party API limitations, that prevents IBM from providing the functionality.

  • Admin
    Scott Brokaw commented
    18 Sep 12:21pm

    Hi Hans,

    Thank you for submitting this idea. We do have support for custom URL within the File Connector in DataStage:

    https://www.ibm.com/support/knowledgecenter/SSZJPZ_11.7.0/com.ibm.swg.im.iis.mmi.doc/topics/r_dcparams_FileConn.html

    Can you clarify what capability you are looking for that doesn't exist? i.e. Are you trying to use the Connector from the context of IMAM/IGC? Is there a particular feature of the Connector that you are finding is not working when using the custom url? etc

NOTICE TO EU RESIDENTS: per EU Data Protection Policy, if you wish to remove your personal information from the IBM ideas portal, please login to the ideas portal using your previously registered information then change your email to "anonymous@euprivacy.out" and first name to "anonymous" and last name to "anonymous". This will ensure that IBM will not send any emails to you about all idea submissions