Embodiments are described for an adaptive audio system that processes audio data comprising a number of independent monophonic audio streams. One or more of the streams has associated with it metadata that specifies whether the stream is a channel-based or object-based stream. Channel-based streams have rendering information encoded by means of channel name; and the object-based streams have location information encoded through location expressions encoded in the associated metadata. A codec packages the independent audio streams into a single serial bitstream that contains all of the audio data. This configuration allows for the sound to be rendered according to an allocentric frame of reference, in which the rendering location of a sound is based on the characteristics of the playback environment (e.g., room size, shape, etc.) to correspond to the mixer's intent. The object position metadata contains the appropriate allocentric frame of reference information required to play the sound correctly using the available speaker positions in a room that is set up to play the adaptive audio content.

System and method for adaptive audio signal generation, coding and rendering

Automatic classification of environmental sounds, such as dog barking and glass breaking, is becoming increasingly interesting, especially for mobile devices. Most mobile devices contain both camer ...

Classifying environmental sounds using image recognition networks

Thank you for reading psychophysics introduction to its perceptual neural and social prospects. As you may know, people have search numerous times for their favorite readings like this psychophysics introduction to its perceptual neural and social prospects, but end up in harmful downloads. Rather than reading a good book with a cup of tea in the afternoon, instead they cope with some infectious bugs inside their desktop computer.

Psychophysics Introduction To Its Perceptual Neural And Social Prospects

Provided are an audio encoding method and apparatus and an audio decoding method and apparatus in which audio signals can be encoded or decoded so that sound images can be localized at any desired position for each object audio signal. The audio decoding method generating a third downmix signal by combining a first downmix signal extracted from a first audio signal and a second downmix signal extracted from a second audio signal; generating third object-based side information by combining first object-based side information extracted from the first audio signal and second object-based side information extracted from the second audio signal; converting the third object-based side information into channel-based side information; and generating a multi-channel audio signal using the third downmix signal and the channel-based side information.

Methods and apparatuses for encoding and decoding object-based audio signals

Commonly used audio file formats relate directly to the audio channels, i.e. the audio information is stored like it is fed to the loudspeaker. However, for obtaining a general description of audio information, a paradigm shift is necessary. Instead of storing the loudspeaker channels, a new audio format may use the description of the spatial sound field. A method for encoding or transmitting an audio signal comprises the steps of providing one or more audio source signals (X src ), determining for each of said audio source signals a specific position to which it relates, generating data sets containing the determined positions (r src ) of the audio sources, and encoding or transmitting (62) the data sets together with said audio source signals. Advantageously, this allows conversion into Higher Order Ambisonics (HOA) format and subsequent re-conversion into conventional audio data that can be adapted to a given loudspeaker configuration.

Audio signal, method and apparatus for encoding or transmitting the same and method and apparatus for processing the same

Provided are an apparatus and method for coding and decoding a multi-object audio signal The apparatus includes a down-mixer for down-mixing the audio signals into one down-mixed audio signal and extracting supplementary information including header information and spatial cue information for each of the audio signals, a coder for coding the down-mixed audio signal, and a supplementary information coder for generating the supplementary information as a bit stream The header information includes identification information for each of the audio signals and channel information for the audio signals

Apparatus and method for coding and decoding multi-object audio signal with various channel

An object-based 3-D audio system. An audio input unit receives object-based sound sources. An audio editing/producing unit converts the sound sources into 3-D audio scene information. An audio encoding unit encodes 3-D information and object signals of the 3-D audio scene to transmit them through a medium. An audio decoding unit receives the encoded data through the medium, and decodes the same. An audio scene-synthesizing unit selectively synthesizes the object signals and 3-D information into a 3-D audio scene. A user control unit outputs a control signal according to the user's selection so as to selectively synthesize the audio scene by the audio scene synthesizing unit. An audio reproducing unit reproduces the audio scene synthesized by the audio scene-synthesizing unit.

Object-based three-dimensional audio system and method of controlling the same

The present research relates to controlling rendering of multi-object or multi-channel audio signals. The present research provides a method and apparatus for controlling rendering of multi-object or multi-channel audio signals based on spatial cues in a process of decoding the multi-object or multi-channel audio signals. To achieve the purpose, the method suggested in the research controls rendering in a spatial cue domain in the process of decoding the multi-object or multi-channel audio signals.

Method and apparatus for control of randering multiobject or multichannel audio signal using spatial cue

Provided is an apparatus and method for coding and decoding multi-object audio signals with various channels and providing backward compatibility with a conventional spatial audio coding (SAC) bitstream. The apparatus includes: an audio object coding unit for coding audio-object signals inputted to the coding apparatus based on a spatial cue and creating rendering information for the coded audio-object signals, where the rendering information provides a coding apparatus including spatial cue information for audio-object signals; channel information of the audio-object signals; and identification information of the audio-object signals, and used in coding and decoding of the audio signals.

Apparatus and method for coding and decoding multi-object audio signal with various channel including information bitstream conversion

Provided are an object-based three dimensional (3-D) audio service system using preset audio scenes and a method thereof. The system and the method are suggested for enabling a user to easily and conveniently watch and listen an object based 3-D audio service by eliminating inconvenience that requires a user to control each of object audio signals of sound sources. The system includes: audio input means for inputting an audio signal; preset audio scene generating means for extracting object audio signals from the audio signal inputted through the audio input means and generating more than one of 3-D audio scene information by arranging the extracted object audio signals in a 3-D space and editing features of each object; and encoding means for encoding and multiplexing the audio signal and the 3-D audio scene information for each object audio signal.

Taejin Lee

Papers

Apparatus and method for coding and decoding multi-object audio signal with various channel

Object-based three-dimensional audio system and method of controlling the same

Method and apparatus for control of randering multiobject or multichannel audio signal using spatial cue

Apparatus and method for coding and decoding multi-object audio signal with various channel including information bitstream conversion

Object-based 3-dimensional audio service system using preset audio scenes