Skip to Main Content
IBM Data and AI Ideas Portal for Customers


This portal is to open public enhancement requests against products and services offered by the IBM Data & AI organization. To view all of your ideas submitted to IBM, create and manage groups of Ideas, or create an idea explicitly set to be either visible by all (public) or visible only to you and IBM (private), use the IBM Unified Ideas Portal (https://ideas.ibm.com).


Shape the future of IBM!

We invite you to shape the future of IBM, including product roadmaps, by submitting ideas that matter to you the most. Here's how it works:


Search existing ideas

Start by searching and reviewing ideas and requests to enhance a product or service. Take a look at ideas others have posted, and add a comment, vote, or subscribe to updates on them if they matter to you. If you can't find what you are looking for,


Post your ideas

Post ideas and requests to enhance a product or service. Take a look at ideas others have posted and upvote them if they matter to you,

  1. Post an idea

  2. Upvote ideas that matter most to you

  3. Get feedback from the IBM team to refine your idea


Specific links you will want to bookmark for future use

Welcome to the IBM Ideas Portal (https://www.ibm.com/ideas) - Use this site to find out additional information and details about the IBM Ideas process and statuses.

IBM Unified Ideas Portal (https://ideas.ibm.com) - Use this site to view all of your ideas, create new ideas for any IBM product, or search for ideas across all of IBM.

ideasibm@us.ibm.com - Use this email to suggest enhancements to the Ideas process or request help from IBM for submitting your Ideas.

IBM Employees should enter Ideas at https://ideas.ibm.com


Status Not under consideration
Workspace Db2 for z/OS
Created by Guest
Created on Jun 7, 2019

Make VPSEQT 100 XI-refresh feature delivered in PI59168 available for non-PGSTEAL-NONE pools or objects.

In PI59168, IBM delivered an enhancement for PGSTEAL NONE bufferpools, whereby setting VPSEQT to 100, Db2 would automatically refresh objects that experienced pseudo-close. This rectified a huge issue at our shop where pseudo-closed objects had to be re-read synchronously into the bufferpool.

However, we still experience issues with pseudo-close in pools configured with PGSTEAL(LRU). We would like to see this refresh mechanism available for objects in those pools as well.

Implementing the VPSEQT 100 enhancement for non-PGSTEAL-NONE pools, however, would not be an option, since the auto-refresh could potentially flush all buffers from the pool, and for general-use pools, we would like to reserve some pages for random access. (this is not an issue with PGSTEAL-NONE pools, since the pool is big enough to house everything in memory)

Instead of relying on the VPSEQT parameter, we'd like to see a way to designate, either at the object level or the pool-level, an auto-refresh mechanism that, when an object is pseudo-closed and XI activity occurs, Db2 takes the initiative to re-load the object into memory.

  • Admin
    Janet Figone
    Reply
    |
    Aug 21, 2019

    Dear Mark, We definitely understand the requirement to eliminate synchronous re-fetch of cached pages after a pseudo close. Note that this only occurs on pseudo closes which cause the pageset/partition to convert from GBP-dependent to Non GBP-dependent (i.e. not all pseudo closes, and in most cases a small minority). Nonetheless, we understand the impact. For PGSTEAL(NONE) buffer pools, APAR PI59168 should provide a solution. For Non PGSTEAL(NONE) buffer pools, we still don't have a solution. Most customers understand the rationale for removing the buffer pool scan logic in V10 (this logic caused significant CPU overhead as buffer pool sizes grew larger) - the tradeoff was that all cached pages belonging to the pageset/part were marked invalid for these psuedo close cases, sometimes causing an increase in synchronous I/O due to having to refresh these pages the next time they were referenced. This is a good tradeoff in almost all cases, but by eliminating a bigger problem we did cause a smaller problem. The proposed solution of "CLOSE NEVER" is a possibility, although there are some considerations that need to be carefully thought through. Pseudo Opened pagesets/parts are not candidates for physical close. So it could be possible to hit DSMAX and not have any datasets as physical close candidates because they are all pseudo opened and CLOSE NEVER. Also, ideally, we would like to reduce the number of knobs and complexity of the DDL and go towards a model where Db2 can automatically do the right thing without users needing to constantly tweak ever-more complex knobs. In this case, perhaps Db2 could automatically adjust an object to "CLOSE NEVER" behavior if we observe that it is negatively impacted by the increased synch I/O after pseudo close. This kind of a change could obviously impact recovery time for the object, so any "autonomics" along these lines would need to also take that into account.

    Sincerely,

    Db2 for z/OS Development

  • Guest
    Reply
    |
    Aug 21, 2019

    Thanks IBM. I understand how it would be difficult to identify specific candidate pages if not using PGSTEAL(NONE) and caching the entire object.

     

    This still remains a challenge for us, so if you do determine a better way to eliminate the overhead of synchronous re-fetch after an XI, it would be greatly appreciated.

     

    One such alternative may be this:

     

    https://ibm-data-and-ai.ideas.aha.io/ideas/DB24ZOS-I-904

     

     

    Thanks

    -Mark

  • Admin
    Janet Figone
    Reply
    |
    Aug 21, 2019

    Dear Mark,

    Thank you for submitting this Idea to the Db2 for z/OS team. We have reviewed it and found it to be a good idea, but it would be very difficult to implement, for reasons that would not be apparent to users.

    The problem is that for non PGSTEAL(NONE) buffer pools, when a pageset is pseudo closed the pages get XI'd at the pageset level in a "bulk" operation, we avoid scanning the buffer pool (as of V10 and beyond) for performance reasons. So we have no way of knowing which pages were XI'd, and therefore which pages would need to be prefetched back into the BP after the pseudo close.

    We appreciate your input to the Db2 for z/OS development team. We also hope that you will continue to submit ideas for improvements as customer feedback is a key component to shaping the future direction for Db2 for z/OS.

    Sincerely,

    Db2 for z/OS Development