This work revolves around the implementation of a neural implicit representation for spatial audio, specifically focusing on synthesizing impulse responses in a continuous space using a sparse dataset, and compressin the network to obtain a lightweight representation of the space. The proposed method, Neural Acoustic Fields (NAFs), models acoustic propagation as a linear time-invariant system and learns to map emitter and listener locations to a neural impulse response function. By optimizing and compressing the representation, NAFs enable the rendering of spatial acoustics at arbitrary locations with also being performant.

This work revolves around the implementation of a neural implicit representation for spatial audio, specifically focusing on synthesizing impulse responses in a continuous space using a sparse dataset, and compressin the network to obtain a lightweight representation of the space. The proposed method, Neural Acoustic Fields (NAFs), models acoustic propagation as a linear time-invariant system and learns to map emitter and listener locations to a neural impulse response function. By optimizing and compressing the representation, NAFs enable the rendering of spatial acoustics at arbitrary locations with also being performant.

Neural Implicit Representation for Spatial Audio Coding

NALE, DAVIDE
2022/2023

Abstract

This work revolves around the implementation of a neural implicit representation for spatial audio, specifically focusing on synthesizing impulse responses in a continuous space using a sparse dataset, and compressin the network to obtain a lightweight representation of the space. The proposed method, Neural Acoustic Fields (NAFs), models acoustic propagation as a linear time-invariant system and learns to map emitter and listener locations to a neural impulse response function. By optimizing and compressing the representation, NAFs enable the rendering of spatial acoustics at arbitrary locations with also being performant.
2022
Neural Implicit Representation for Spatial Audio Coding
This work revolves around the implementation of a neural implicit representation for spatial audio, specifically focusing on synthesizing impulse responses in a continuous space using a sparse dataset, and compressin the network to obtain a lightweight representation of the space. The proposed method, Neural Acoustic Fields (NAFs), models acoustic propagation as a linear time-invariant system and learns to map emitter and listener locations to a neural impulse response function. By optimizing and compressing the representation, NAFs enable the rendering of spatial acoustics at arbitrary locations with also being performant.
Neural Networks
Spatial Audio
Audio Compression
NIR
File in questo prodotto:
File Dimensione Formato  
main-pdfa.pdf

accesso riservato

Dimensione 19.8 MB
Formato Adobe PDF
19.8 MB Adobe PDF

The text of this website © Università degli studi di Padova. Full Text are published under a non-exclusive license. Metadata are under a CC0 License

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/20.500.12608/55806