list-view: Drop selection click workaround

There was an issue selecting using ctrl+select which was fixed in
GTK. Our workaround is now making it break.

Related: https://gitlab.gnome.org/GNOME/gtk/-/issues/5669