A study of auditory-associative musical emotion based on multidimensional signal processing techniques
, oraz
17 mar 2025
O artykule
Data publikacji: 17 mar 2025
Otrzymano: 10 lis 2024
Przyjęty: 18 lut 2025
DOI: https://doi.org/10.2478/amns-2025-0279
Słowa kluczowe
© 2025 Xiaohong Cui, published by Sciendo
This work is licensed under the Creative Commons Attribution 4.0 International License.
Figure 1.
Figure 2.
Figure 3.
Figure 4.
Database visual audio emotion recognition rate
| Feature | Pleasure | Get angry | Revulsion | Sadness | Surprise | Fear | Average |
|---|---|---|---|---|---|---|---|
| RML audio feature | 58.24% | 58.45% | 61.2% | 61.28% | 60.28% | 61.28% | 60.12% |
| RML video features | 75.2% | 76.24% | 74.25% | 74.89% | 78.02% | 73.6% | 75.37% |
| RML visual audio | 78.21% | 80.25% | 80.28% | 81.27% | 78.85% | 75.14% | 79.00% |
| SAVEE audio feature | 64.22% | 63.58% | 65.87% | 67.23% | 67.29% | 65.74% | 65.66% |
| SAVEE video features | 83.47% | 85.27% | 86.77% | 85.36% | 82.67% | 84.22% | 84.63% |
| SAVEE visual audio | 87.36% | 87.52% | 88.39% | 87.57% | 90.28% | 87.28% | 88.07% |
RML audio library six emotional status recognition
| RML | |||||||
|---|---|---|---|---|---|---|---|
| Feature | Pleasure | Get angry | Revulsion | Sadness | Surprise | Fear | Average |
| Metrical feature | 50.37% | 51.27% | 54.63% | 50.14% | 50.21% | 53.84% | 51.74% |
| MFCCs | 55.96% | 56.78% | 60.28% | 57.84% | 58.42% | 60.28% | 58.26% |
| Fusion feature | 58.03% | 58.42% | 60.8% | 61.34% | 60.24% | 60.94% | 59.96% |
| SAVEE | |||||||
| Feature | Pleasure | Get angry | Revulsion | Sadness | Surprise | Fear | Average |
| Metrical feature | 60.28% | 60.94% | 62.35% | 64.32% | 62.58% | 62.54% | 62.17% |
| MFCCs | 61.75% | 61.75% | 65.38% | 65.94% | 65.37% | 63.48% | 63.95% |
| Fusion feature | 65.23% | 63.45% | 66.28% | 67.38% | 67.3% | 66.78% | 66.07% |
Physiological basis
| External | It works on the internal structure of the brain | Information formation |
|---|---|---|
| Light wave→ | Occipital lobe→ | Visual information |
| Sound wave→ | Temporal lobe→ | Auditory information |
| Odour→ | Medial temporal lobe→ | Olfactory information |
| Something that can touch→ | Parietal lobe→ | Touch and kinesthetic |