Flat File Layout Check

  • Hey Everyone.

    Each week we receive flat files which we import into our db using SSIS.

    There are no column headings in flatfiles. And we expect each file to be in the proper layout.

    However that's not always the case and some flatfiles tend to get corrupted.

    I would like to verify the layout of the flatfile before i import it into a database.

    Any ideas?

    Alex S
  • It depends.  If you want to verify the entire file before processing, you are probably going to need a script task to run through the file and check each line.

    If you want to process the file and only process those rows that do conform to the expected layout, you can use a conditional split, or possibly use the error output to send nonconforming rows to a different table.

    hth

    Tim

    Tim Mitchell, Microsoft Data Platform MVP
    Data Warehouse and ETL Consultant
    TimMitchell.net | @Tim_Mitchell | Tyleris.com
    ETL Best Practices

  • Thank for the reply Tim.

    I'll try Conditional split bu I think the Error output is the way to go for me.

    Alex S

Viewing 3 posts - 1 through 2 (of 2 total)

You must be logged in to reply to this topic. Login to reply