Personally I don't find all the panels (media, frequent, favorites, downloads) useful. If you are on one, as soon as you click the END button, it will jump to the ALL section.
If you would like to remove them and keep just ALL or any ones you feel like selecting, from your home screen, press the BB button, select Manage Panels, Proceed to select which panels you would like visible.
