October 8, 2008 at 10:32 am
Hello All,
I have an SSIS package which loads data from a csv file to a database table. The format of the file looks as follows.
Total Loaded5
Total Failed3
ColAColBColC ColD
323345217701439.65 success
356301018880348 failed
87537519057295.3 failed
378678020879239.29 failed
343131325153235.61 success
I want to ignore first two rows and the header row and just load the data into table. I tried to use DataRowsToSkip option but I'm getting the error saying "Error: The column data for column "Column 3" overflowed the disk I/O buffer.". Could any one provide the solution for this.
Your response is greatly appreciated.
Thanks in advance,
-Amith Vemuganti
October 8, 2008 at 12:59 pm
There are a few ways you can do this. You can either:
1) Use a Script component as a source and eliminate the first 2 rows and read the rest into the buffer
2) Prior to your data flow task which reads this file use a control flow script task with the streamreader and streamwriter objects to read the file, eliminate the two rows and write the file out again. Your data flow task would then see a cleaned flat file.
Personally I'd go with #2 as its pretty straigh forward and will only take roughly 5-10 lines of code.
Strick
October 8, 2008 at 2:15 pm
You could simply instruct the data flow task to ignore the error as well. You should see that option if you right click on the right data flow component.
----------------------------------------------------------------------------------
Your lack of planning does not constitute an emergency on my part...unless you're my manager...or a director and above...or a really loud-spoken end-user..All right - what was my emergency again?
Viewing 3 posts - 1 through 2 (of 2 total)
You must be logged in to reply to this topic. Login to reply