This idea has been merged into another idea. To comment or vote on this idea, please visit DB24LUW-I-304 purescale support HADR ROS.
Right now, Db2 Purescale primary operational databases are delivering transactional data services in a primary location. Meantime in a secondary location, owning the same Purescale configuration and computing capability is running the HADR secondary role for high availability. Resource utilization of secondary site in less than 20% of the potential and it's the best platform to execute complex Read Only query and large offload of data generated by Warehousing ETL, now targeted toward the primary database. We mitigate the impact of this non-transactional workload adding Uncommitted Read isolation level in most of involved queries. Anyway it is really a waste of resources to keep empty more than 80% of allocated processors and I/O HBA and RAM of the secondary location, except in a potential Disaster Recovery. In production primary database are executing more than 3.000 parallel SQL transactions by more than 1 million users on +20TB compressed and 15.000 tables. INAIL owns 8 purescale simila clusters in the two locations. HADR ROS on purescale will be the best solution to rebalance the workload among the different location because, due to the integration of Primary DB2 with multiple components, as Appl. Server, Security, Oracle database and so on, it's not possible to split the production in the two different locations, although Db2 itself allow this option. About Db2 Shadow Table, number of tables, kind of data, volume of transactions and CDC efforts and consume to replicate do not suggest this solution.
|Who would benefit from this IDEA?||It's a win/win situation. INAIL will contains the operational workload on primary location, improve the performance of the transactional database, improve the satisfaction of Analytic and Datawarehouse users and finally receive a satisfactory ROI for HW/SW investment in the secondary location. IBM will move from 100 DB2 PVU in the secondary location (HADR licensing for secondary) to the full licensing of thousands of PVU and tens of processors (+50 P8) EC Processor P8 120 PVU/each.|
How should it work?
We do not need full data integrity on HADR ROS, aware of continuos rollfoward of updated records keeping on on the secondary database, so HADR ROS is the primary solution. In alternative there are two additional options,: 1. on the secondary location we could create a different database. Here we need a supported DB2 procedure to "temporary" interrupt the HADR replication, perform a full backup and restart HADR always in rollforward pending. Using this backup we could execute an indirect restore on a new database dedicated for Big Query and ETL Offload. After we could replicate this procedure using delata backup. 2. Implement a local Auxiliary database in R/O superasync capturing the changes locally, from the secondary HADR (right now not supported in DB2, something of similar olready exist in Informix). Up to 4 hours of delay fo data from the primary operational database are more than reasonable and accettable. If you think about a different solution, you are welcome. Our Db2 Lab Advocate is Patrick See of IBM US.
|Priority Justification||We must decide ASAP the strategy because this situation is impacting the core business applications. If this functionality will not be available in a short time we will implement a direct replication from operational database to the Cloudera Datalake.|
|IBM's success depends on gathering feedback from customers like yourself. Aha Ideas Portal is the third party tool through which IBM Offering Managers gather feedback from customers such as yourself.|
|IBM is a global organization with business processes, management structures, technical systems and service provider networks that cross borders. As such, the information collected through Aha Ideas Portal (Customer Name, Customer Email Address) will be stored by them in the United States, and handled only as per IBM's instructions and policies. Your data (Name and Email Address) will NOT be shared with other IBM customers.|
|In order to safeguard your information in Aha, do not leave your workstation unattended while using this application, log off after using it, and print only if necessary. If you need to make a hardcopy, remember to pick up the print-out immediately, keep it under lock, and destroy it immediately when no longer needed.|
|NOTICE TO EU RESIDENTS: per EU Data Protection Policy, if you wish to remove your personal information from the IBM ideas portal, please login to the ideas portal using your previously registered information then change your email to "email@example.com" and first name to "anonymous" and last name to "anonymous". This will ensure that IBM will not send any emails to you about all idea submissions|