Importing CSV file Error

Question

Importing CSV file Error

prabusonatech

SSC Enthusiast

Points: 179
More actions
February 24, 2010 at 4:24 am

#219439

Hi,
I m trying to Import 2GB of CSV file into SQL server Table using IMPORT/EXPORT Wizard.It's loading the CSV file data upto 1116499th rows in the table.At the time it reaches 1116499th row, I m getting the error like,
Copying to [XXX].[dbo].[YYY] (Error)Messages Error 0xc020209c: Data Flow Task: The column data for column "SDI_Type_Level_1" overflowed the disk I/O buffer.(SQL Server Import and Export Wizard)
Error 0xc0202092: Data Flow Task: An error occurred while processing file "D:\data\data_grp\xxx.csv" on data row 1116499.
The CSV filesize is 2GB. Since the file size 2gb I couldn't open it.
I have tried with Bulk insert option - but no luck.I m getting bulk insert failed.the column too long in the data file for row 1,coulmn 77.
I have 77 columns in that CSV file.
Can anyone help me what is the issue?

Viewing 6 posts - 1 through 5 (of 5 total)

You must be logged in to reply to this topic. Login to reply

kyleheath33 Ten Centuries Points: 1089 More actions · Answer 1

From looking at other posts about that error message (not had it before myself) it looks as if there is a issue with the data you are trying to import, in the links below they also had 2GB file imports and used 3rd party tools to open there docs. Have a look at the links below to see if they help you out.

http://insanesql.blogspot.com/2009/01/ssis-importing-files.html

http://sql.richarddouglas.co.uk/archive/2009/11/ssis-overflowed-disk-io-buffer.html

Welsh Corgi SSC Guru Points: 116520 More actions · Answer 2

Have you tried going into debug mode, stepping through the code,checking the variables, etc?

For better, quicker answers on T-SQL questions, click on the following...
http://www.sqlservercentral.com/articles/Best+Practices/61537/

For better answers on performance questions, click on the following...
http://www.sqlservercentral.com/articles/SQLServerCentral/66909/

Welsh Corgi SSC Guru Points: 116520 More actions · Answer 3

Consider creating an error log file, etc...

For better, quicker answers on T-SQL questions, click on the following...
http://www.sqlservercentral.com/articles/Best+Practices/61537/

For better answers on performance questions, click on the following...
http://www.sqlservercentral.com/articles/SQLServerCentral/66909/

emily-1119612 SSCarpal Tunnel Points: 4166 More actions · Answer 4

Maybe this will help.

http://codingpad.maryspad.com/2007/06/29/splitting-large-csv-files/

emily-1119612 SSCarpal Tunnel Points: 4166 More actions · Answer 5

If you are using the Import/Export wizard I believe you can still save the package at the end of the process even though its failing. Then open the package in BIDS and resolve any error messages.