how to convert text file with unknown 16 bit encoding to 8 bit as cii

[Mogens Kjaer]

Lancashire, Pete wrote:
> how do I convert a file (or output to stdont) with an unknown 16 encoding
> into plain
> ol' ASCII aka 8 BIT ?
> 
> Example of files contents
> 
>  0 255 254
>  2  60   0
>  4  72   0
>  6  84   0
>  8  77   0
> 10  76   0
> 12  62   0
> 
> or ..
> 
> 0000000 377 376   <  \0   H  \0   T  \0   M  \0   L  \0   >  \0  \n  \0
> 0000020      \0      \0   <  \0   B  \0   O  \0   D  \0   Y  \0   >  \0
> 0000040  \n

Can you open the file in vim?

If I try a UTF-16 encoded file in vim, it shows the file correctly.

You can then set:

:set fileencoding=utf-8

and write out the file again (as a new file) to eliminate the NULL's.

Mogens


-- 
Mogens Kjaer, Carlsberg A/S, Computer Department
Gamle Carlsberg Vej 10, DK-2500 Valby, Denmark
Phone: +45 33 27 53 25, Fax: +45 33 27 47 08
Email: mk at crc.dk Homepage: http://www.crc.dk