For me the main argument is: Why should diskspace and time be spent on bootup to load gnome/gtk/glib libraries/font caches/icon caches, etc., if later on gnome/gtk is not used b/c gnome is not installed anyway (besides gdm and its deps)?