Skip to Main Content
IBM Data and AI Ideas Portal for Customers


This portal is to open public enhancement requests against products and services offered by the IBM Data & AI organization. To view all of your ideas submitted to IBM, create and manage groups of Ideas, or create an idea explicitly set to be either visible by all (public) or visible only to you and IBM (private), use the IBM Unified Ideas Portal (https://ideas.ibm.com).


Shape the future of IBM!

We invite you to shape the future of IBM, including product roadmaps, by submitting ideas that matter to you the most. Here's how it works:


Search existing ideas

Start by searching and reviewing ideas and requests to enhance a product or service. Take a look at ideas others have posted, and add a comment, vote, or subscribe to updates on them if they matter to you. If you can't find what you are looking for,


Post your ideas

Post ideas and requests to enhance a product or service. Take a look at ideas others have posted and upvote them if they matter to you,

  1. Post an idea

  2. Upvote ideas that matter most to you

  3. Get feedback from the IBM team to refine your idea


Specific links you will want to bookmark for future use

Welcome to the IBM Ideas Portal (https://www.ibm.com/ideas) - Use this site to find out additional information and details about the IBM Ideas process and statuses.

IBM Unified Ideas Portal (https://ideas.ibm.com) - Use this site to view all of your ideas, create new ideas for any IBM product, or search for ideas across all of IBM.

ideasibm@us.ibm.com - Use this email to suggest enhancements to the Ideas process or request help from IBM for submitting your Ideas.

IBM Employees should enter Ideas at https://ideas.ibm.com


Status Not under consideration
Workspace DataStage
Created by Guest
Created on May 20, 2020

Godala

We have a single record in a file with word count 456331887

wc -c mdmn_GCRM_20180505004107.xml

456331887

I specified $APT_DEFAULT_TRANSPORT_BLOCK_SIZE=500000000 but max value of APT_DEFAULT_TRANSPORT_BLOCK_SIZE is 268435456.due to this i am getting below warning

the valid range is 8192 to 268435456; setting the block size to 131072.

Please let me know how to increase the APT_DEFAULT_TRANSPORT_BLOCK_SIZE to 456331887 since in the file record block size is 456331887.

Attaching the log

Needed by Date Jul 31, 2020
  • Guest
    Reply
    |
    Jun 5, 2020

    I am combing the record in etl job only. Etl will not support to combine the record.

  • Guest
    Reply
    |
    Jun 5, 2020

    DataStage currently does not support individual records larger than 256 MB. There should be implementation options available to split the record to a manageable size and either re-join it or otherwise fill the requirement.

  • Guest
    Reply
    |
    Jun 5, 2020

    Why cann't IBM support a big record why cant they create a patch and give

  • Guest
    Reply
    |
    Jun 5, 2020

    We are generating the large account in data stage only. As per the the requirement we need the entire record in a single line.

  • Guest
    Reply
    |
    Jun 3, 2020

    You seem to be trying to process a single record that is > 256 MB. In this case, before the record is passed into DataStage, the record would need to be broken up into smaller pieces.