Post reply

Missing Records in Flat File Output

  • May 5, 2010 at 9:25 am

    #140107

    First of all, I am not sure if this is an SSIS issue but I just wanted to get some input to see if I'm designing this package incorrectly. Here is the scenario:

    I have a package with 2 sequence containers. Container A contains a series of SQL Tasks that Insert and Update records in a history table. On Container A "Success" Container B executes a series of Data Flow Tasks that create a couple of flat files based upon queries of the history table that was updated by the Container A tasks.

    I have noticed one instance where the flat file did not contain all of the records that should have been selected from the history table. I am wondering if it's possible that the Container B SELECT queries are running before that Container A INSERT/UPDATE queries have been committed in the DB.

    Or was this just a random fluke of some sort? I have always assumed that the workflow precedence of "On Success" means that all of the tasks have fully completed.

    I have left the Transaction properties at their default values of "Serializable" and "Supported" for all of the components.

    Any insight welcome. Thanks

  • May 5, 2010 at 9:46 am

    #1162572

    Your assumption is true.. but before going ahead did you check your updated table for those records. Do you see them?

  • May 5, 2010 at 10:02 am

    #1162590

    Yes, I have an SSRS report that displays the history table. So for a particular day the report said that we should have, say, $1,000 in transactions. However, the flat file that is used to post these transactions into another system contained only $800 total transactions.

    So you do not think this might be due to uncommmitted updates either?

    I have developed quite a few SSIS packages that we run daily and have not run into a situation like this before with any of them.

    Well, may be I will add an additional task to read the flat file back to verify totals.

  • May 5, 2010 at 10:08 am

    #1162598

    Is it possible to post some screen shots here ??

Viewing 4 posts - 1 through 3 (of 3 total)

You must be logged in to reply to this topic. Login to reply

Cookies on SQLServerCentral

This website stores cookies on your computer.

These cookies are used to improve your website experience and provide more personalized services to you, both on this website and through other media.

To find out more about the cookies we use, see our Privacy Policy