Importing data that includes blanks
-
OK, using NCR teradata SQL.
Due to space restrictions on our systems data was archived last year to a tab delimited txt file. I am now trying to restore this data to a new table. The table has been created, but when i try to import data, because there are blanks in some of the fields it keeps failing. There are 46 fields per record of which up to 35 may have blanks or contain data.
To give some indication of the size of the problem the txt file is @ 700mb in size.
what i need is someway of being able to import that will append teh blanks to the corerct fields. These blanks will vary from record to record. I have access to SQL7 which i can link tot eh teradata warehouse if needed.
the other option is for a data editor that i can load teh file into and then "find and replace" the blanks with a 0. Tried using access, but it falls over as size of the table is inexcess of 1.5gb.
Any suggestions?
-
1. For big text files I'm using KEDIT for Windows (http://www.kedit.com), because it remaind me of my ol' times on XEDIT (Ibm VM Mainframe software, some 20 years ago....
) with it I've successfully edited files of 400-500 MB in short time. It does'nt read all the file in memory, and it has very powerful commands.... 2 or you can vrite a very small vbScript looping around 'read a line', 'change spaces to zeros' 'write a line', but this will probably run a long time...
HTH
Luigi
PS: Don't mind if Kedit seems old.... I'm using it today and very often because of the powerful commands and the very easy macro language,
-
how are you trying to do the import and what error messages are coming up?
-
Ok, things have moved on. Have eventually managed to 1. use a mchine with a shed load of memory 2gb to open the txt file.
2. Used fastload and OLEload to get the files uploaded.
Happy now, cheers
-
glad to hear it!
Viewing 5 posts - 1 through 4 (of 4 total)
You must be logged in to reply to this topic. Login to reply