Is Quality Enough? Integrating Energy Consumption in a Large-Scale Evaluation of Neural Audio Synthesis Models - Institut de Recherche et Coordination Acoustique/Musique
Communication Dans Un Congrès Année : 2023

Is Quality Enough? Integrating Energy Consumption in a Large-Scale Evaluation of Neural Audio Synthesis Models

Résumé

In most scientific domains, the deep learning community has largely focused on the quality of deep generative models, resulting in highly accurate and successful solutions. However, this race for quality comes at a tremendous computational cost, which incurs vast energy consumption and greenhouse gas emissions. At the heart of this problem are the measures that we use as a scientific community to evaluate our work. In this paper, we suggest relying on a multi-objective measure based on Pareto optimality, which takes into account both the quality of the model and its energy consumption. By applying our measure on the current state-of-the-art in generative audio models, we show that it can drastically change the significance of the results. We believe that this type of metric can be widely used by the community to evaluate their work, while putting computational cost – and in fine energy consumption – in the spotlight of deep learning research.
Fichier principal
Vignette du fichier
_ICASSP_23__Is_Quality_Enough__Integrating_Energy_Consumption_in_a_Large_Scale_Evaluation_of_Neural_Audio_Synthesis_Models.pdf (398.8 Ko) Télécharger le fichier
Origine Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-04043254 , version 1 (13-09-2024)

Licence

Identifiants

Citer

Constance Douwes, Giovanni Bindi, Antoine Caillon, Philippe Esling, Jean-Pierre Briot. Is Quality Enough? Integrating Energy Consumption in a Large-Scale Evaluation of Neural Audio Synthesis Models. 2023 IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP 2023), IEEE, Jun 2023, Ixia-Ialyssos (Rhodes), Greece. ⟨10.1109/ICASSP49357.2023.10096975⟩. ⟨hal-04043254⟩
105 Consultations
0 Téléchargements

Altmetric

Partager

More