Identifying problems in a source CSV

  • I've got a DTS which imports a CSV of approx 13Mb and 40,000 records. I'm getting the error "Invalid delimited data: text qualifier must be followed by a column delimiter (except the last column)" when I run the data pump task into my database.

    The task has been running for 18 months without issues so I'm certain its a change in the source CSV. I imported it to Access and it worked fine though.

    How do I find out which line in the CSV the task failed on in DTS? I could at least look through that row by hand in that case.

    Thanks very much guys!

  • Is that CSV file is populated everyday or is it appended. In case it is appended everyday and if it was working fine till yesterday, may be you can check only rows that are added today (if I have understood the problem correctly).

    Are you running this DTS through job? If you are running it directly from the designer, the DTS transforms rows in defined batches(1000, 2000,3000...), so I think it fails at the batch in which the problematic row exists..

    Hope it helps...

    [font="Verdana"]Renuka__[/font]

  • The CSV is repopulated every day.

    I'm not getting any line numbers reported at all actually, I get the error almost instantly. I've looked through the first few lines and can't see anything that should be a problem.

    I also can't work out why the file will import to access but not SQL...

  • chris.surfleet (7/17/2008)


    I'm not getting any line numbers reported at all actually, I get the error almost instantly. I've looked through the first few lines and can't see anything that should be a problem.

    ...

    Chris,

    if I remember well this is what you can do :

    Open the properties of the datapump task and choose the options tab, supply a name in the exception file and run the dts again.

    It should supply the number of the faulty line in the exception file.

    Marc

    (Should this not work there is always the option of splitting the csv file in halves thus identifying the faulty halve which you then split up again and .... but that only as a last resort)

Viewing 4 posts - 1 through 3 (of 3 total)

You must be logged in to reply to this topic. Login to reply