What you're describing is the principle behind binaural recordings. They are astonishing in their realism and are created using a stationary dummy head with a microphone in each ear. So they are technically stereo recordings, but create a 3 dimensional soundstage played back over stereo headphones. There are lots of free binaural sound files on the internet for anyone to sample.
And there are a number of new albums in DSD binaural. Well worth a listen.
https://www.nativedsd.com/homepage/binaural_dsd_music