Problems loading large (wide?) XLS/CSV files into Sql 2008

  • Hi,

    (Sql 2008, SSIS 2008)

    customer has at least quite wide XLS's that should be loaded into db.

    I Have tried

    SSIS (xls format and csv), MS Import Wizard (xls format and csv) and Bulk Insert (csv)

    but every time I get an error

    "output column "h1_TR2" (2284)" failed because truncation occurred, and the truncation row disposition on "output column "h1_TR2" (2284)"...

    or

    "...out of disk I/O"

    or

    "Msg 4864, Level 16, State 1, Line 2

    Bulk load data conversion error (type mismatch or invalid character for the specified codepage) for row 4, column 27 (Sääntö2).

    Msg 4832, Level 16, State 1, Line 2

    Bulk load: An unexpected end of file was encountered in the data file."

    or

    you name it..:)

    The column that supposedly causes this varies depending on the method used...:)

    I have tried to delete parts of the file and the best I have managed is to get the first 4900 rows in (CSV format) but the rest of the file (copied into another csv) always crashes no matter what I delete away. Actually the secondary of the split files always crashes immediately

    There are no column separators along the data.

    I've not had any time to investigate the data with some special editor to see the special characters etc...

    The fun part is that the customer can do this (to the same db) with Import Wizard in one of his computers but not with the other.

    Any ideas?

    Ville

  • Any ideas?

    I would start by taking Excel out of the equation. Output the data to CSV (or fixed-width) and work from there.

    The absence of evidence is not evidence of absence.
    Martin Rees

    You can lead a horse to water, but a pencil must be lead.
    Stan Laurel

  • Seems there are some issues with your file.

    unexpected end of file

    data conversion error

    truncation occurred

    Those don't sound good. Open the CSV file with a decent text editor and look for anomalies.

    Need an answer? No, you need a question
    My blog at https://sqlkover.com.
    MCSE Business Intelligence - Microsoft Data Platform MVP

  • I've viewed with Excell, notepad, wordpad - cant' find any anomalities. and like I said the customers import wizard works in one computer.... could this be some service pack issue...

    Phil: Leave excell - yes I have tried with CSV many times already

    (I have already added scripts to replace this part of the data flow - I just load them from existing db data but in the end I need to have some solution....)

  • I said a "decent" text editor.

    Try notepad++ and configure it to show all symbols.

    Maybe you are missing some row delimiters or something like that.

    Need an answer? No, you need a question
    My blog at https://sqlkover.com.
    MCSE Business Intelligence - Microsoft Data Platform MVP

  • yes i know but i don't have time to install and try now - must continue forward. thanks, v

Viewing 6 posts - 1 through 5 (of 5 total)

You must be logged in to reply to this topic. Login to reply