Acceso abierto

A study of auditory-associative musical emotion based on multidimensional signal processing techniques

,  y   
17 mar 2025

Cite
Descargar portada

Figure 1.

Elements of music sentiment appreciation
Elements of music sentiment appreciation

Figure 2.

The relationship between the descending dimension
The relationship between the descending dimension

Figure 3.

Music’s emotional recognition accuracy
Music’s emotional recognition accuracy

Figure 4.

Variation curve of different characteristics
Variation curve of different characteristics

Database visual audio emotion recognition rate

Feature Pleasure Get angry Revulsion Sadness Surprise Fear Average
RML audio feature 58.24% 58.45% 61.2% 61.28% 60.28% 61.28% 60.12%
RML video features 75.2% 76.24% 74.25% 74.89% 78.02% 73.6% 75.37%
RML visual audio 78.21% 80.25% 80.28% 81.27% 78.85% 75.14% 79.00%
SAVEE audio feature 64.22% 63.58% 65.87% 67.23% 67.29% 65.74% 65.66%
SAVEE video features 83.47% 85.27% 86.77% 85.36% 82.67% 84.22% 84.63%
SAVEE visual audio 87.36% 87.52% 88.39% 87.57% 90.28% 87.28% 88.07%

RML audio library six emotional status recognition

RML
Feature Pleasure Get angry Revulsion Sadness Surprise Fear Average
Metrical feature 50.37% 51.27% 54.63% 50.14% 50.21% 53.84% 51.74%
MFCCs 55.96% 56.78% 60.28% 57.84% 58.42% 60.28% 58.26%
Fusion feature 58.03% 58.42% 60.8% 61.34% 60.24% 60.94% 59.96%
SAVEE
Feature Pleasure Get angry Revulsion Sadness Surprise Fear Average
Metrical feature 60.28% 60.94% 62.35% 64.32% 62.58% 62.54% 62.17%
MFCCs 61.75% 61.75% 65.38% 65.94% 65.37% 63.48% 63.95%
Fusion feature 65.23% 63.45% 66.28% 67.38% 67.3% 66.78% 66.07%

Physiological basis

External It works on the internal structure of the brain Information formation
Light wave→ Occipital lobe→ Visual information
Sound wave→ Temporal lobe→ Auditory information
Odour→ Medial temporal lobe→ Olfactory information
Something that can touch→ Parietal lobe→ Touch and kinesthetic