Unsupervised classification of graded animal vocalisations using fuzzy clustering

We present here an unsupervised procedure for the classification of graded animal vocalisations based on Mel frequency cepstral coefficients and fuzzy clustering. Cepstral coefficients compress information about the distribution of energy across the frequency spectrum into a reduced number of variables and are well-defined for signals of various acoustic characteristics (tonal, pulsed, or broadband). In addition, the Mel scale mimics the logarithmic perception of pitch by mammalian ears and is therefore well-suited to defined meaningful perceptual categories for mammals. Fuzzy clustering is a soft classification approach. It does not assign samples to a single category, but rather describes their position relative to overlapping categories. This method is capable of identifying stereotyped vocalisations – vocalisations located in a single category – and graded vocalisations – vocalisation which lie between categories – in a quantitative way. We evaluated the performance of this procedure on a set of long-finned pilot whale ( Globicephala melas ) calls. We compared our results with a call catalogue previously defined through audio-visual inspection of the calls by human experts. Our unsupervised classification achieved slightly lower precision than the catalogue approach: we described between two and ten fuzzy clusters compared to 11 call types in the catalogue. The fuzzy clustering did not replicate the manual classification. One-to-one correspondence between fuzzy clusters and catalogue call types were rare, however the same sets of call types were consistently grouped together within fuzzy clusters. There were also discrepancies between both classification approaches, with some catalogue call types being consistently spread over several fuzzy clusters. Compared to manual classification, the fuzzy clustering approach proved to be much less time-consuming (days vs. months) and provided additional quantitative information about the graded nature of the vocalisations. We discuss the scope of our unsupervised classifier and the need to investigate the functions of call gradation in future research. Author summary There is no consensus on how to describe the vocal repertoire of a species, an essential initial step to analyse how animals rely on different types of vocalisations according to social, ecological, and behavioural contexts. This task is even more challenging for species with graded vocal repertoires: their vocalisations do not fall into distinct categories but form a continuum which makes it difficult to draw strict boundaries between sound types. We present here a method to overcome this challenge using an unsupervised classification algorithm based on Mel frequency cepstral coefficients and fuzzy clustering. It is specifically designed to deal with the graded nature of animal vocalisations, as it can describe overlapping categories in a quantitative way. We tested our classification procedure on a particularly challenging set of long-finned pilot whale ( Globicephala melas ) calls. Indeed, this species can produce sounds of various acoustic natures (tonal, broadband, and pulsed) and their large vocal repertoire is a mix of stereotyped and highly graded sound types. We compared our results with an existing call catalogue established by human operators. We obtained promising results and recommend similar classification procedures in future studies to take a quantitative approach when studying the gradation of animals’ vocal repertoires.