[Fedora-i18n-bugs] [Bug 489222] New: unable to see/create non-ASCII utf-8 filenames in vfat USB stricks

Sun Mar 8 19:23:41 UTC 2009

Please do not reply directly to this email. All additional
comments should be made in the comments box of this bug.

Summary: unable to see/create non-ASCII utf-8 filenames in vfat USB stricks

https://bugzilla.redhat.com/show_bug.cgi?id=489222

           Summary: unable to see/create non-ASCII utf-8 filenames in vfat
                    USB stricks
           Product: Fedora
           Version: rawhide
          Platform: All
        OS/Version: Linux
            Status: NEW
          Severity: medium
          Priority: low
         Component: DeviceKit-disks
        AssignedTo: davidz at redhat.com
        ReportedBy: alsadi at ojuba.org
         QAContact: extras-qa at fedoraproject.org
                CC: petersen at redhat.com, yaneti at declera.com,
                    sangu.fedora at gmail.com, richard at hughsie.com,
                    wwoods at redhat.com, davidz at redhat.com,
                    hedayat at grad.com, fedora-i18n-bugs at redhat.com
   Estimated Hours: 0.0
    Classification: Fedora
          Clone Of: 470592

+++ This bug was initially created as a clone of Bug #470592 +++

Description of problem:
fedora has dropped a patch from kernel that forces IOCHARSET=utf-8
to make people with non-UTF-8 locales happy
https://www.redhat.com/archives/fedora-kernel-list/2008-October/msg00089.html

but it makes people with UTF-8 locales sad
when I put my USB stick and copy/paste files with non-ASCII charts
or when I chdir there, I got errors

if you really want to release fedora with such kerenl you should add a hal fdi
configuration file that pass utf8 to mount

just like what was done before that patch is introduced
https://bugzilla.redhat.com/show_bug.cgi?id=144600

as kernel docs (Documentation/filesystems/vfat.txt) there is a safe utf8
by using utf8 option instead of iocharset=utf8

http://git.kernel.org/?p=linux/kernel/git/torvalds/linux-2.6.git;a=blob;f=Documentation/filesystems/vfat.txt;h=3a5ddc96901a665e3801d8ebf80c817e2efb5fc2;hb=HEAD

Version-Release number of selected component (if applicable):
fedora 10
kernel-2.6.27.4-68.fc10.i686
hal-0.5.12-9.20081027git.fc10.i386

How reproducible:
always

Steps to Reproduce:
[alsadi at pc1 ALSADI]$ touch "سلام"
touch: setting times of `سلام': No such file or directory
[alsadi at pc1 ALSADI]$ touch peace
[alsadi at pc1 ALSADI]$ mkdir "الإسلام"
mkdir: cannot create directory `الإسلام': Invalid argument

Expected results:
no seeing the errors and having the files/dirs created with non-ASCII chars

Additional info:
having non-UTF-8 filesystem encoding could bug many poorly written GTK+
application
http://library.gnome.org/devel/gtk/2.14/GtkFileChooser.html#gtkfilechooser-encodings

--- Additional comment from wwoods at redhat.com on 2008-11-07 16:42:26 EDT ---

*** Bug 470086 has been marked as a duplicate of this bug. ***

--- Additional comment from wwoods at redhat.com on 2008-11-07 16:48:11 EDT ---

Forcing utf8 in the kernel was the wrong idea - see bug 454013 for an example
of the problems that caused. Further it made Fedora behave differently from all
other Linux distributions when mounting vfat volumes, which is bad.

So dropping that kernel patch was probably the right decision, but it seems
that we still need 'utf8' when mounting vfat for a lot of locales. So something
in userspace needs to enable utf8 when needed. Unfortunately figuring out
*when* it's needed is really hard. 

To maintain compatibility with older Fedora releases we could probably have HAL
suggest use that flag by default - as with bug 144600. In a future release we
might somehow decide that based on the current locale.

--- Additional comment from alsadi at ojuba.org on 2008-11-10 12:33:00 EDT ---

from bug 454013 
> ru_RU.cp1251 or ru_RU.koi8r
you should flag that bug as "non-BUG" becayse
the default locale in fedora for Russian locales is UTF-8 just look at this:

grep '^ru' /usr/share/system-config-language/locale-list
ru_RU.UTF-8 utf8 latarcyrheb-sun16 Russian  -  Русский
ru_UA.UTF-8 utf8 latarcyrheb-sun16 Russian (Ukraine)

so it's his own problem, he should edit his hal files to do his customizations

utf-8 is universal, forcing latin1 or whatever should not be done in an
international project as fedora

so if you want to go upstream, then you should move the patch as a hal
configuration

and those who want to use non-international encoding let them use some
/etc/hal/fdi/policy/ file

if you insist on not making utf8 the default on hal level at least make a
package having utf-8 fdi file for hal and make that package a default in the
comps file for each *-support group

be aware of the following facts
grep 'utf8' /usr/share/system-config-language/locale-list | wc -l
136
wc -l /usr/share/system-config-language/locale-list
143 /usr/share/system-config-language/locale-list

which mean you are breaking more than 95% of the locales by not making utf8
tobe the default

my suggestion is doing the opposite having the default to be the default as a
fdi hal file
and having 2 packages (8859-15 and 8859-2) for all the 7 non-utf-8 locales and
make that one a default or optional in the comps file

grep -v 'utf8' /usr/share/system-config-language/locale-list
af_ZA 8859-15 lat0-sun16 Afrikaans (South Africa)
bs_BA 8859-2 lat2-sun16 Bosnian (Bosnia and Herzegowina)
br_FR 8859-15 lat0-sun16 Breton (France)
oc_FR 8859-15 lat0-sun16 Occitan (France)
tl_PH 8859-15 lat0-sun16 Tagalog (Philippines)
uz_UZ 8859-15 lat0-sun16 Uzbek (Uzbekistan)
wa_BE at euro 8859-15 lat0-sun16 Walloon (Belgium)

--- Additional comment from wwoods at redhat.com on 2008-11-10 16:20:36 EDT ---

After much discussion we've decided to restore the kernel patch that enables
'utf8' by default on vfat, at least for F10 final:

* Mon Nov 10 2008 Dave Jones <davej at redhat.com> 2.6.27.5-93
- Make UTF-8 the default for FAT/VFAT filesystems again.

F11 will not include this patch, so this bug will need to be fixed in userspace
(HAL etc.) in Rawhide.

Moving to F11Blocker.

--- Additional comment from fedora-triage-list at redhat.com on 2008-11-26
00:00:44 EDT ---

This bug appears to have been reported against 'rawhide' during the Fedora 10
development cycle.
Changing version to '10'.

More information and reason for this action is here:
http://fedoraproject.org/wiki/BugZappers/HouseKeeping

--- Additional comment from alsadi at ojuba.org on 2008-11-26 17:35:32 EDT ---

I guess it won't be in hal only but also to DeviceKit which is planed for F11

-- 
Configure bugmail: https://bugzilla.redhat.com/userprefs.cgi?tab=email
------- You are receiving this mail because: -------
You are on the CC list for the bug.