April 5, 2013 at 8:10 am
Currently, we generate file in ANSI. Is there a setting we need to change to generate files in UNICODE? or how can we convert ANSI files to UNICODE?
April 5, 2013 at 8:16 am
Based on the little information you have provided, no.
How do you produce the ANSI file? SSIS? BCP? Copy and paste?
MM
select geometry::STGeomFromWKB(0x0106000000020000000103000000010000000B0000001000000000000840000000000000003DD8CCCCCCCCCC0840000000000000003DD8CCCCCCCCCC08408014AE47E17AFC3F040000000000104000CDCCCCCCCCEC3F9C999999999913408014AE47E17AFC3F9C99999999991340000000000000003D0000000000001440000000000000003D000000000000144000000000000000400400000000001040000000000000F03F100000000000084000000000000000401000000000000840000000000000003D0103000000010000000B000000000000000000143D000000000000003D009E99999999B93F000000000000003D009E99999999B93F8014AE47E17AFC3F400000000000F03F00CDCCCCCCCCEC3FA06666666666FE3F8014AE47E17AFC3FA06666666666FE3F000000000000003D1800000000000040000000000000003D18000000000000400000000000000040400000000000F03F000000000000F03F000000000000143D0000000000000040000000000000143D000000000000003D, 0);April 5, 2013 at 8:17 am
Sorry. Yes BCP.
April 5, 2013 at 8:23 am
Have you tried the "-w" switch?
MM
select geometry::STGeomFromWKB(0x0106000000020000000103000000010000000B0000001000000000000840000000000000003DD8CCCCCCCCCC0840000000000000003DD8CCCCCCCCCC08408014AE47E17AFC3F040000000000104000CDCCCCCCCCEC3F9C999999999913408014AE47E17AFC3F9C99999999991340000000000000003D0000000000001440000000000000003D000000000000144000000000000000400400000000001040000000000000F03F100000000000084000000000000000401000000000000840000000000000003D0103000000010000000B000000000000000000143D000000000000003D009E99999999B93F000000000000003D009E99999999B93F8014AE47E17AFC3F400000000000F03F00CDCCCCCCCCEC3FA06666666666FE3F8014AE47E17AFC3FA06666666666FE3F000000000000003D1800000000000040000000000000003D18000000000000400000000000000040400000000000F03F000000000000F03F000000000000143D0000000000000040000000000000143D000000000000003D, 0);April 5, 2013 at 8:45 am
-N will export char data as Unicode
April 5, 2013 at 8:47 am
so use both -W and -N switch? also, what would i see different in the file to confirm its in unicode?
April 5, 2013 at 8:54 am
The file size should double, for example, for a unicode file. (2 bytes per character.)
A text editor such as Ultraedit would confirm (Ctrl-H)
April 5, 2013 at 9:13 am
ok Thanks...So, do I use both -w and -n ?
April 5, 2013 at 9:26 am
SQL_Surfer (4/5/2013)
ok Thanks...So, do I use both -w and -n ?
Something like this will produce Unicode output.
bcp "select N'test' as test" queryout test.txt -w -T
You can check the format of the output file produced by opening it in Notepad.exe, then choose File...Save As... and at the bottom of the dialog window will be the file type Unicode.
MM
select geometry::STGeomFromWKB(0x0106000000020000000103000000010000000B0000001000000000000840000000000000003DD8CCCCCCCCCC0840000000000000003DD8CCCCCCCCCC08408014AE47E17AFC3F040000000000104000CDCCCCCCCCEC3F9C999999999913408014AE47E17AFC3F9C99999999991340000000000000003D0000000000001440000000000000003D000000000000144000000000000000400400000000001040000000000000F03F100000000000084000000000000000401000000000000840000000000000003D0103000000010000000B000000000000000000143D000000000000003D009E99999999B93F000000000000003D009E99999999B93F8014AE47E17AFC3F400000000000F03F00CDCCCCCCCCEC3FA06666666666FE3F8014AE47E17AFC3FA06666666666FE3F000000000000003D1800000000000040000000000000003D18000000000000400000000000000040400000000000F03F000000000000F03F000000000000143D0000000000000040000000000000143D000000000000003D, 0);April 5, 2013 at 9:55 am
I generated the file with w option and it does look different than the file without w option. But I need to make sure if it is in Unicode format. I tried to open it in notepad then save as, The default encoding type is ANSI.
April 5, 2013 at 10:02 am
Also opened in notepad++, it says ANSI.
April 5, 2013 at 10:06 am
Does your notepad++ have a hex editor?
In Ultraedit I can see the hex value of the bytes, and I can clearly see in a unicode file that there are 2 bytes for each character. (I click on a character and 2 bytes are highlighted.)
April 5, 2013 at 10:12 am
cast your column as unicode
MM
select geometry::STGeomFromWKB(0x0106000000020000000103000000010000000B0000001000000000000840000000000000003DD8CCCCCCCCCC0840000000000000003DD8CCCCCCCCCC08408014AE47E17AFC3F040000000000104000CDCCCCCCCCEC3F9C999999999913408014AE47E17AFC3F9C99999999991340000000000000003D0000000000001440000000000000003D000000000000144000000000000000400400000000001040000000000000F03F100000000000084000000000000000401000000000000840000000000000003D0103000000010000000B000000000000000000143D000000000000003D009E99999999B93F000000000000003D009E99999999B93F8014AE47E17AFC3F400000000000F03F00CDCCCCCCCCEC3FA06666666666FE3F8014AE47E17AFC3FA06666666666FE3F000000000000003D1800000000000040000000000000003D18000000000000400000000000000040400000000000F03F000000000000F03F000000000000143D0000000000000040000000000000143D000000000000003D, 0);April 5, 2013 at 10:27 am
David, I downloaded ultraedit. Is unicode file always shows in hexadecimal? I did what you suggested and when I click on 1 character, two bytes are highlighted. But when I opened a non-unicode file, it doesn't open up in hexadecimal.
April 5, 2013 at 2:05 pm
I am using the following swtich in BCP.
-w -T -t"|" -r"" -c -q
Seems like one switch is overiding the other. File looks different but enocoding hasn't changed to unicode.
Viewing 15 posts - 1 through 15 (of 27 total)
You must be logged in to reply to this topic. Login to reply