Update statistics after Index Rebuild ?

  • Do we still need to do this after the index was rebuilt ?

    Thanks .

  • Yes, but column statistics only, not index statistics (they got updated with the index rebuild)

    Gail Shaw
    Microsoft Certified Master: SQL Server, MVP, M.Sc (Comp Sci)
    SQL In The Wild: Discussions on DB performance with occasional diversions into recoverability

    We walk in the dark places no others will enter
    We stand on the bridge and no one may pass
  • But only update the column statistics if the automatic statistics updates are not adequate for maintaining them.

    "The credit belongs to the man who is actually in the arena, whose face is marred by dust and sweat and blood"
    - Theodore Roosevelt

    Author of:
    SQL Server Execution Plans
    SQL Server Query Performance Tuning

  • I've always been a little fuzzy on this one - So, is just executing sp_updatestats a safe bet after indexing? Realizing that rebuilildng indexes will only affect the stats for those indexes that get rebuilt, is that sufficient? The sp_updatestats determines which ones need updating anyway, correct?

    ______________________________________________________________________________Never argue with an idiot; Theyll drag you down to their level and beat you with experience

  • MyDoggieJessie (8/16/2016)


    I've always been a little fuzzy on this one - So, is just executing sp_updatestats a safe bet after indexing? Realizing that rebuilildng indexes will only affect the stats for those indexes that get rebuilt, is that sufficient? The sp_updatestats determines which ones need updating anyway, correct?

    Well, sp_updatestats has a sophisticated algorithm that it uses to determine if statistics should be updated. If the rowmod counter is > 0, meaning, if one row has been touched, sp_updatestats will update the statistic in question.

    So imagine this scenario. You rebuild the index, which means that you get a full scan set of statistics, about as accurate a set of statistics you're going to get. After that index rebuild is done, you rebuild several other indexes. In the mean time, a single row is inserted/updated/deleted so that the rowmod counter goes up. After rebuilding all the other indexes, you run sp_updatestats. This then proceeds to replace your statistics that have just been created using a full scan with a set of sampled statistics, which, by their nature, are generally less accurate than the full scan statistics.

    In short, no, you can't both rebuild indexes and then run sp_updatestats with any assurance that you're not actively harming your performance.

    "The credit belongs to the man who is actually in the arena, whose face is marred by dust and sweat and blood"
    - Theodore Roosevelt

    Author of:
    SQL Server Execution Plans
    SQL Server Query Performance Tuning

  • Grant Fritchey (8/16/2016)


    MyDoggieJessie (8/16/2016)


    I've always been a little fuzzy on this one - So, is just executing sp_updatestats a safe bet after indexing? Realizing that rebuilildng indexes will only affect the stats for those indexes that get rebuilt, is that sufficient? The sp_updatestats determines which ones need updating anyway, correct?

    Well, sp_updatestats has a sophisticated algorithm that it uses to determine if statistics should be updated. If the rowmod counter is > 0, meaning, if one row has been touched, sp_updatestats will update the statistic in question.

    So imagine this scenario. You rebuild the index, which means that you get a full scan set of statistics, about as accurate a set of statistics you're going to get. After that index rebuild is done, you rebuild several other indexes. In the mean time, a single row is inserted/updated/deleted so that the rowmod counter goes up. After rebuilding all the other indexes, you run sp_updatestats. This then proceeds to replace your statistics that have just been created using a full scan with a set of sampled statistics, which, by their nature, are generally less accurate than the full scan statistics.

    In short, no, you can't both rebuild indexes and then run sp_updatestats with any assurance that you're not actively harming your performance.

    I though the number of row mods needed was based on the number of rows in the table, and was either a fixed number or a percentage of the total rows, but not a single row (unless perhaps a temp table or a table that had zero rows before).

    SQL DBA,SQL Server MVP(07, 08, 09) "It's a dog-eat-dog world, and I'm wearing Milk-Bone underwear." "Norm", on "Cheers". Also from "Cheers", from "Carla": "You need to know 3 things about Tortelli men: Tortelli men draw women like flies; Tortelli men treat women like flies; Tortelli men's brains are in their flies".

  • Gotcha, so it would make more sense to run the stats before the index rebuilds...if use a more concentrated/targeted process before the indexing rebuilds even take place...

    ______________________________________________________________________________Never argue with an idiot; Theyll drag you down to their level and beat you with experience

  • ScottPletcher (8/16/2016)


    Grant Fritchey (8/16/2016)


    MyDoggieJessie (8/16/2016)


    I've always been a little fuzzy on this one - So, is just executing sp_updatestats a safe bet after indexing? Realizing that rebuilildng indexes will only affect the stats for those indexes that get rebuilt, is that sufficient? The sp_updatestats determines which ones need updating anyway, correct?

    Well, sp_updatestats has a sophisticated algorithm that it uses to determine if statistics should be updated. If the rowmod counter is > 0, meaning, if one row has been touched, sp_updatestats will update the statistic in question.

    So imagine this scenario. You rebuild the index, which means that you get a full scan set of statistics, about as accurate a set of statistics you're going to get. After that index rebuild is done, you rebuild several other indexes. In the mean time, a single row is inserted/updated/deleted so that the rowmod counter goes up. After rebuilding all the other indexes, you run sp_updatestats. This then proceeds to replace your statistics that have just been created using a full scan with a set of sampled statistics, which, by their nature, are generally less accurate than the full scan statistics.

    In short, no, you can't both rebuild indexes and then run sp_updatestats with any assurance that you're not actively harming your performance.

    I though the number of row mods needed was based on the number of rows in the table, and was either a fixed number or a percentage of the total rows, but not a single row (unless perhaps a temp table or a table that had zero rows before).

    Straight from the code for sys.sp_updatestats:

    if ((@ind_rowmodctr is null) or (@ind_rowmodctr <> 0) or ((@is_ver_current is not null) and (@is_ver_current = 0)))

    And you can see the query used to retrieve the @ind_rowmodctr value:

    select name, indid, rowmodctr from sys.sysindexes

    where id = @table_id and indid > 0 and indexproperty(id, name, 'ishypothetical') = 0

    and indexproperty(id, name, 'iscolumnstore') = 0

    order by indid

    And it isn't manipulated in any other location throughout the rest of the code. Since rowmodctr is just an incremental value, one modification and you have a value that is <>0. No calculations at all are in the code that I can see.

    "The credit belongs to the man who is actually in the arena, whose face is marred by dust and sweat and blood"
    - Theodore Roosevelt

    Author of:
    SQL Server Execution Plans
    SQL Server Query Performance Tuning

  • MyDoggieJessie (8/16/2016)


    Gotcha, so it would make more sense to run the stats before the index rebuilds...if use a more concentrated/targeted process before the indexing rebuilds even take place...

    Yeah, pretty much. This stuff isn't easy. Although, for most of us, most of the time, the easy way works fine.

    "The credit belongs to the man who is actually in the arena, whose face is marred by dust and sweat and blood"
    - Theodore Roosevelt

    Author of:
    SQL Server Execution Plans
    SQL Server Query Performance Tuning

  • I though the number of row mods needed was based on the number of rows in the table, and was either a fixed number or a percentage of the total rows, but not a single row (unless perhaps a temp table or a table that had zero rows before).

    I think your thinking of the algorithm for auto update stats. It works different than the logic used in sp_updatestats.

    Sue

  • Also worth mentioning is that the rowmodctr value after 2005 is just an estimate. Microsoft says it will be, something along the lines of, "mostly the same values" as it was in 2005 and earlier. So, while it may be a somewhat inaccurate number, it's the one that most of us will use to understand what's changed. Jason Strate has a more accurate calculation on his blog if you really need to track down a more precise count of rows that have been modified.

    "The credit belongs to the man who is actually in the arena, whose face is marred by dust and sweat and blood"
    - Theodore Roosevelt

    Author of:
    SQL Server Execution Plans
    SQL Server Query Performance Tuning

  • Heh... I keep it simple. I've not done any index maintenance on my "money maker" box since 18 Jan 2016 and performance has actually and significantly improved. I do, however, rebuild statistics.

    --Jeff Moden


    RBAR is pronounced "ree-bar" and is a "Modenism" for Row-By-Agonizing-Row.
    First step towards the paradigm shift of writing Set Based code:
    ________Stop thinking about what you want to do to a ROW... think, instead, of what you want to do to a COLUMN.

    Change is inevitable... Change for the better is not.


    Helpful Links:
    How to post code problems
    How to Post Performance Problems
    Create a Tally Function (fnTally)

  • Hey Jeff - care to share your job script for the stats?

    😀

    ______________________________________________________________________________Never argue with an idiot; Theyll drag you down to their level and beat you with experience

  • Thank you for the feedback. It's much appreciated. One question though : Is it possible to replace Index rebuild with update statistics - fullscan?

  • ScottPletcher (8/16/2016)


    I though the number of row mods needed was based on the number of rows in the table, and was either a fixed number or a percentage of the total rows, but not a single row (unless perhaps a temp table or a table that had zero rows before).

    The fixed number/percentage is used for the automatic stats update. sp_updatestats (the procedure) will update the stats if more than 0 rows have changed since the last stats update.

    Gail Shaw
    Microsoft Certified Master: SQL Server, MVP, M.Sc (Comp Sci)
    SQL In The Wild: Discussions on DB performance with occasional diversions into recoverability

    We walk in the dark places no others will enter
    We stand on the bridge and no one may pass

Viewing 15 posts - 1 through 15 (of 35 total)

You must be logged in to reply to this topic. Login to reply