Missing Records in Flat File Output

  • First of all, I am not sure if this is an SSIS issue but I just wanted to get some input to see if I'm designing this package incorrectly. Here is the scenario:

    I have a package with 2 sequence containers. Container A contains a series of SQL Tasks that Insert and Update records in a history table. On Container A "Success" Container B executes a series of Data Flow Tasks that create a couple of flat files based upon queries of the history table that was updated by the Container A tasks.

    I have noticed one instance where the flat file did not contain all of the records that should have been selected from the history table. I am wondering if it's possible that the Container B SELECT queries are running before that Container A INSERT/UPDATE queries have been committed in the DB.

    Or was this just a random fluke of some sort? I have always assumed that the workflow precedence of "On Success" means that all of the tasks have fully completed.

    I have left the Transaction properties at their default values of "Serializable" and "Supported" for all of the components.

    Any insight welcome. Thanks

  • Your assumption is true.. but before going ahead did you check your updated table for those records. Do you see them?

  • Yes, I have an SSRS report that displays the history table. So for a particular day the report said that we should have, say, $1,000 in transactions. However, the flat file that is used to post these transactions into another system contained only $800 total transactions.

    So you do not think this might be due to uncommmitted updates either?

    I have developed quite a few SSIS packages that we run daily and have not run into a situation like this before with any of them.

    Well, may be I will add an additional task to read the flat file back to verify totals.

  • Is it possible to post some screen shots here ??

Viewing 4 posts - 1 through 3 (of 3 total)

You must be logged in to reply to this topic. Login to reply