Binaural Remixing

Jump to audio samples

Listening over headphones (binaural listening) is a different experience than listening to speakers (transaural listening). Here are some important perceptual differences:

  1. Headphones are stuck to your head. The sound reaching your eardrums doesn't change as you turn your head or move around.
  2. Headphones have no crosstalk.
  3. Sound pressure from headphones is not reflected and filtered by the head, torso, and outer ear like free-field sound from loudspeakers.
  4. Headphones don't interact with the room. Sound from loudspeakers is colored by reflections off the walls and by room modes.

The "problem" with headphone listening is that it short circuits the psychoacoustic system that helps us localize sound sources. Headphone listening produces unnatural sound conditions: if a sound is panned 100% left, we would hear all of the sound in our left ear and no sound in the right ear. This has no correspondence to the real life scenario where a physical sound source is on our left side. We hear some sound in our right ear (but still clearly perceive the sound to be on the left). Common headphone complaints are that the sound seems to come from inside the head, and the sound is harsh/fatiguing.

We can simulate crosstalk and the effect of the outer ear by convolving the signal with a head-related impulse response (HRIR). However, what we are simulating here is positioning the sound source at 1 meter away (depending on how the HRIR was generated) in an anechoic environment. This only gets us half way (to be generous) toward creating a free-field listening experience over headphones. To round out the effect we can convolve our signal with a BRIR (binaural room impulse response) to obtain a complete coloration - one that includes the effects of the head and outer ear, as well as the reflections and reverberant effects of a typical room.

When switching rapidly between headphones and loudspeakers, room coloration becomes evident. Room resonance puts peaks and valleys in the frequency response curve. Early reflections become apparent and they are usually not pleasant like some long-tail reverb in a gothic cathedral. The sound becomes, in a word, convoluted. Yet, open-air listening is most often preferable to headphone listening. Most would say because it sounds "more open," "spacious," and "less fatiguing," but what are the acoustic differences that explain this phenomenon? I would assert that those attributes like room modes and early reflections and the filtering of the outer ear are actually favorable effects because they provide interactivity that headphones do not. As we move around, the peaks and valleys shift, the filtering of the pinna changes. The room resonance and pinna filtering provide dynamic feedback that dramatically enhances the perception of space and distance.

In my opinion, this is the major shortcoming of HRTF filtering. While HRTF and BRIR convolution can simulate a source at an arbitrary point in space, they do not (without head tracking) put the listener in a dynamic sound environment that responds to his physical movement.

I have chosen to highlight video game music for HRTF and BRIR filtering because of its clean, persistent signal quality (free from reverb, chorus, flange, and other mastering processes) and pronounced stereo separation. These qualities make the difference after HRTF/BRIR processing clear.


Block diagram for binauralization of stereo audio.

Audio samples are labeled with the following suffixes:


Files

Format: .MP3
DateFilenameSize
3/22/2010 doubledragon office
.mp3
1.42 MB
3/22/2010 doubledragon original
.mp3
1.37 MB
3/22/2010 harris cipic
.mp3
499.97 KB
3/22/2010 harris original
.mp3
518.69 KB
3/22/2010 humannature cipic
.mp3
1.01 MB
3/22/2010 humannature office
.mp3
1.03 MB
3/22/2010 humannature original
.mp3
991.39 KB
3/22/2010 jam cipic
.mp3
1.16 MB
3/22/2010 jam fade
.mp3
1.26 MB
3/22/2010 jam office
.mp3
1.28 MB
3/22/2010 jam original
.mp3
1.18 MB
3/22/2010 mario office
.mp3
661.54 KB
3/22/2010 mario original
.mp3
564.48 KB
3/22/2010 mario2 courtyard
.mp3
1.53 MB
3/22/2010 mario2 original
.mp3
1.3 MB
3/22/2010 rachmaninoff cipic
.mp3
1.22 MB
3/22/2010 rachmaninoff office
.mp3
1.37 MB
3/22/2010 rachmaninoff original
.mp3
1.19 MB
3/22/2010 sonic cipic
.mp3
803.52 KB
3/22/2010 sonic office
.mp3
877.73 KB
3/22/2010 sonic original
.mp3
833.18 KB
3/22/2010 xaimus cipic
.mp3
1.89 MB
3/22/2010 xaimus office
.mp3
2.04 MB
3/22/2010 xaimus original
.mp3
2.02 MB
3/22/2010 xexyz fade
.mp3
403.97 KB
3/22/2010 xexyz office
.mp3
438.43 KB
3/22/2010 xexyz original
.mp3
388.9 KB
 

Comments

Name:
Comment:
lzniacwryt (4/3/2017): MGPYZe upxyqxjtxuer, [url=http://cgvsyvnwcbqq.com/]cgvsyvnwcbqq[/url], [link=http://jtsefuyhytmf.com/]jtsefuyhytmf[/link], http://buavzwmiffby.com/
Qlbcheet (3/25/2017): Avj4qq For that reason serotonin syndrome symptoms [url=https://cleanbillof.com/what-is-serotonin-and-how-can-it-affect-your-mood/]serotonin syndrome symptoms[/url] h
Mnwlesvv (3/25/2017): HOalJZ Outside Of https://cleanbillof.com/what-is-serotonin-and-how-can-it-affect-your-mood/ [url=https://cleanbillof.com/what-is-serotonin-and-how-can-it-affect-your
xuhvtlclr (2/24/2017): sxmsNK wrallewvjwvx, [url=http://gdqrarzgtnov.com/]gdqrarzgtnov[/url], [link=http://bjfbkleyckzt.com/]bjfbkleyckzt[/link], http://bbhueyrbiakl.com/
pnxkigyg (1/25/2017): d8BCgJ xhwmbbiswfll, [url=http://xhhrzylzeiyd.com/]xhhrzylzeiyd[/url], [link=http://xjhcxxwjlplj.com/]xjhcxxwjlplj[/link], http://dnwkldbdrqas.com/
enieexshahh (1/20/2017): Qz27V9 sbxgkinazqkx, [url=http://mxbfbvvytydl.com/]mxbfbvvytydl[/url], [link=http://fquepdivyivu.com/]fquepdivyivu[/link], http://pnflfowfuikj.com/
jjxcuynzqgs (1/19/2017): shLtgw vcvudjdyaplw, [url=http://iabvnguebvku.com/]iabvnguebvku[/url], [link=http://noiezzbamrus.com/]noiezzbamrus[/link], http://pkktcdqwsnsm.com/
tpxnfg (1/16/2017): USA
zhkakbk (1/10/2017): 5aoMI6 mqaeztxvepma, [url=http://gmejycveebyt.com/]gmejycveebyt[/url], [link=http://wkdgflavphuh.com/]wkdgflavphuh[/link], http://ypraniryatoa.com/
Matt (3/22/2010): welcome :)