VibraVox Dataset

Download

The dataset was released in July 2024 and is available on HuggingFace.

Complementary resources to reproduce experiments are also available on GitHub.

The scientific paper describing the Vibravox corpus and the results obtained for different speech processing tasks is available on arXiV (submitted to Speech Communication, under review).

A general purpose dataset of speech captured with body-conduction transducers

Vibravox is a dataset compliant with the General Data Protection Regulation (GDPR) containing audio recordings using five different body-conduction audio sensors : two in-ear microphones, two bone conduction vibration pickups and a laryngophone. The dataset also includes audio data from an airborne microphone used as a reference.

The Vibravox corpus contains 45.5 hours of speech samples and physiological sounds recorded by 188 participants under different acoustic conditions imposed by an high order ambisonics 3D spatializer. The corpus includes annotations on the recording conditions and linguistic transcriptions.

Image of vibravox sensors on subject Image of vibravox sensors on subject

Tasks

We conducted a series of experiments on various speech-related tasks, including speech recognition, speech enhancement and speaker verification. These experiments were carried out using state-of-the-art models to evaluate and compare their performances on signals captured by the different audio sensors offered by the Vibravox dataset, with the aim of gaining a better grasp of their individual characteristics.

Credits

If you use the Vibravox dataset for research, please cite this paper :

@article{jhauret-et-al-2024-vibravox,
     title={{Vibravox: A Dataset of French Speech Captured with Body-conduction Audio Sensors}},
     author={Hauret, Julien and Olivier, Malo and Joubaud, Thomas and Langrenne, Christophe and
       Poir{\'e}e, Sarah and Zimpfer, Véronique and Bavu, {\'E}ric},
     year={2024},
     eprint={2407.11828},
     archivePrefix={arXiv},
     primaryClass={eess.AS},
     url={https://arxiv.org/abs/2407.11828},
}

and this repository, which is linked to a DOI :

@misc{cnamlmssc2024vibravoxdataset,
   author={Hauret, Julien and Olivier, Malo and Langrenne, Christophe and
       Poir{\'e}e, Sarah and Bavu, {\'E}ric},
   title        = { {Vibravox} (Revision 7990b7d) },
   year         = 2024,
   url          = { https://huggingface.co/datasets/Cnam-LMSSC/vibravox },
   doi          = { 10.57967/hf/2727 },
   publisher    = { Hugging Face }
}