True spatial hearing MP3 inventor shows everyone how to do 3D audio properly
By Klaus WedekindJanuary 16, 2024, 5:38 p.mListen to article
Karlheinz Brandenburg wears Sennheiser headphones with an HTC Vive tracker on the headband.
(Photo: of)
3D audio is a nice thing, but not immersive enough, says Karlheinz Brandenburg. The co-inventor of MP3 and his team impressively demonstrate how you can create the perfect three-dimensional listening illusion with headphones.
Headphones used to only offer stereo sound, but now more and more headsets also offer three-dimensional sound, giving you the feeling of being right in the middle of the action. But no matter whether it's 3D audio, spatial audio, Dolby Atmos or 360 Reality Audio - it's always a static experience. That means you can't really move through a sound world. With further developed technology from Brandenburg Labs, this is now possible, as ntv.de was able to find out for itself at the Consumer Electronics Show (CES) in Las Vegas.
The company's founder is Karlheinz Brandenburg. The name is probably unknown to many people, even though they may use a technology every day that wouldn't exist without it. Brandenburg is considered the “father of MP3”. With his dissertation, which the now 69-year-old wrote in 1989 at the Technical Faculty of the Friedrich-Alexander University Erlangen-Nuremberg, he laid the foundations for the audio data compression process that he later developed with a team at the Fraunhofer Institute for Integrated Circuits IIS developed. He was recently
honored for this by the Society of Motion Picture and Television Engineers (SMPTE) in Hollywood.
Like Dolby Atmos, only better
Brandenburg's new process basically continues where Dolby Atmos etc. leave off. With Deep Dive Audio it is not only possible to hear in three dimensions, but also to perceive sound objects as if they were actually in space. This means you can approach them, move away from them or walk around them and it always sounds exactly as if they were really there.
So that media representatives could get an impression of the technology's possibilities, Brandenburg Labs set up a setting in a hotel suite with two speakers mounted on tripods. First you moved through the room while the speakers played music. After that, you put on high-resolution headphones and it was impossible to hear any difference. No matter how or where you moved, it still sounded like the speakers were active, even though the music was now playing through the headset.
So far still a “craft set”
To create the perfect acoustic illusion, Brandenburg Labs is still using technology from the
HTC Vive , which normally allows gamers to move through virtual reality (VR). The wearer's position and head movements are determined using base stations set up and a tracker attached to the headset's bracket.
The room must also be measured using an omnidirectional microphone. The reflections of each loudspeaker are recorded separately. In addition, the Brandenburg Labs team feeds the system with scanned room dimensions and the orientation of the speakers. Algorithms convert the information in real time.
The company is already offering the “craft set” demonstrated in Las Vegas for around 5,000 euros; according to Brandenburg, its current customers are primarily music studios. The goal, however, is to bring our own hardware onto the market, including headphones with an integrated tracker. The MP3 master and his team hope to find investors who will raise around 10 million euros.
Many possibilities
MORE ON THE SUBJECT
Collaboration with other companies is also an option, says Brandenburg. In addition to the immersive music experience, areas of application include VR and AR applications. Virtual conferences could also be enhanced with the technology. With it it is possible, for example, to whisper in the ear of a conversation partner, says Brandenburg.
The technology would certainly be a perfect addition to Apple's Vision Pro data glasses. But there have been no concrete discussions with any manufacturer yet, says Brandenburg. But perhaps he has found a backer in Las Vegas and we will literally hear a lot more about the company.
Source: ntv.de