bids flatfile connection manager issue w/ Double quotes in the file

  • I have a process that consumes a text qualified comma delimited file and processes it every hour. Every now and again the file has "" two double quotes in it. The client is stating that two double quotes in the file stands for one. Is there a setting in the flatfile connection manager that would allow me to handle the double double quotes properly?

    an example would be

    "1","heelow world","this string should "" have a double quote in it","test

    My ssis is chocking on ""

  • Isn't there a Text Qualifier in the connection manager where you value " when all your imported columns are quoted, or when you want you exported columns quoted?

  • yea. that's the thing. i have the text qualifier set to double quote. however it's choking on the two double quotes between should and have below. I was hoping there is some sort of escape key i can force in ssis.

    "1","heelow world","this string should "" have a double quote in it","test"

  • anyone have any helpful input other than that i should stop using ssis for transformations?

  • You have a couple of options

    1. import the data to a staging table without the text qualifier and remove the double quotes with a replace when inserting into the final table

    2. use a script task to remove the double quotes in the flat file before importing.

Viewing 5 posts - 1 through 4 (of 4 total)

You must be logged in to reply to this topic. Login to reply