Skip to Main Content
IBM Power Ideas Portal


This portal is to open public enhancement requests against IBM Power Systems products, including IBM i. To view all of your ideas submitted to IBM, create and manage groups of Ideas, or create an idea explicitly set to be either visible by all (public) or visible only to you and IBM (private), use the IBM Unified Ideas Portal (https://ideas.ibm.com).


Shape the future of IBM!

We invite you to shape the future of IBM, including product roadmaps, by submitting ideas that matter to you the most. Here's how it works:

Search existing ideas

Start by searching and reviewing ideas and requests to enhance a product or service. Take a look at ideas others have posted, and add a comment, vote, or subscribe to updates on them if they matter to you. If you can't find what you are looking for,

Post your ideas
  1. Post an idea.

  2. Get feedback from the IBM team and other customers to refine your idea.

  3. Follow the idea through the IBM Ideas process.


Specific links you will want to bookmark for future use

Welcome to the IBM Ideas Portal (https://www.ibm.com/ideas) - Use this site to find out additional information and details about the IBM Ideas process and statuses.

IBM Unified Ideas Portal (https://ideas.ibm.com) - Use this site to view all of your ideas, create new ideas for any IBM product, or search for ideas across all of IBM.

ideasibm@us.ibm.com - Use this email to suggest enhancements to the Ideas process or request help from IBM for submitting your Ideas.

Status Not under consideration
Workspace IBM i
Categories Db2 for i
Created by Guest
Created on Jul 22, 2021

Optimize sparse index build on partitioned table

The index build process is currently not using the information on a partitioned table when building the index:

We have a big table partitioned by range on a column.
When we build an sparse index on this table only including values in this column greater than a certain value, even though rows in a partition could never be included in the index (because of the range of values), the indexer goes through all the rows in the partition - wasting time and CPU on this.

It would be great if the indexer checked the range partition information and only processed the partitions where a hit is possible.

EDIT: Just discovered that even though no keys are in the index partition, it still occupies a lot of storage - here are the numbers from SYSINDEXSTAT for a partitioned EVI index:

PARTITION / NUMBER_KEYS / INDEX_SIZE
PART000001 / 0 / 11469369344
PART000002 / 2202143097 / 10781892608
PART000003 / 698188190 / 2835640320

So in addition to the wasted time and CPU, there is also a lot of wasted storage...


Use Case:

Imagine having a partitioned table TABLE1 with the columns
ID integer,
LINE integer,
STAT char(1) and other columns,
partitioned by RANGE on ID where
PART000001 is between MINVALUE and 5000 excluding,
PART000002 is between 5000 including and 10000 excluding
etc.

Creating a sparse index on TABLE1 where ID >= 7000, the indexer should not read PART000001 at all, since all values for ID is lower than 7000 and will not be included in the index anyway.


Idea priority Low
  • Guest
    Reply
    |
    Sep 27, 2021

    IBM does not intend to provide a solution to this request at this time, so it is being closed.

    With a large number of higher priority items that the database team would like to implement, and a very small number of queries that would likely be able to take advantage of this enhancement, the cost of providing this solution is not considered worth the investment.

    The query optimizer is normally efficient at implementing index plans so there is very little benefit to using sparse indexes. If the query includes the partitioning key, the optimizer will generate a plan which avoids touching the unreferenced partitions, including the unreferenced index partitions.

  • Guest
    Reply
    |
    Sep 13, 2021

    The CEAC has reviewed this requirement and recommends that IBM view this as a “nice to have” LOW priority feature.

    Background: The COMMON Europe Advisory Council (CEAC) members have a broad range of experience in working with small and medium-sized IBM i customers. CEAC has a crucial role in working with IBM i development to help assess the value and impact of individual RFEs on the broader IBM i community and has therefore reviewed your RFE.

    To find out how CEAC help to shape the future of IBM i, see CEAC @ ibm.biz/BdYSYj and the article "The Five Hottest IBM i RFEs Of The Quarter" at ibm.biz/BdYSZT

    Therese Eaton – CEAC Program Manager, IBM