I think people who enjoy surround are active listeners... and by "active" I mean we listen to the individual instruments, and how they interact contributing to the whole; this is how I listened to stereo recordings (especially with headphones) before discovering surround, and surround has only enhanced the experience. Some people who don't "get" surround just don't actively listen in this way; others are annoyed or overloaded by the extra sounds coming at them.