A study of auditory-associative musical emotion based on multidimensional signal processing techniques
, and
Mar 17, 2025
About this article
Published Online: Mar 17, 2025
Received: Nov 10, 2024
Accepted: Feb 18, 2025
DOI: https://doi.org/10.2478/amns-2025-0279
Keywords
© 2025 Xiaohong Cui, published by Sciendo
This work is licensed under the Creative Commons Attribution 4.0 International License.
Figure 1.
Figure 2.
Figure 3.
Figure 4.
Database visual audio emotion recognition rate
| Feature | Pleasure | Get angry | Revulsion | Sadness | Surprise | Fear | Average |
|---|---|---|---|---|---|---|---|
| RML audio feature | 58.24% | 58.45% | 61.2% | 61.28% | 60.28% | 61.28% | 60.12% |
| RML video features | 75.2% | 76.24% | 74.25% | 74.89% | 78.02% | 73.6% | 75.37% |
| RML visual audio | 78.21% | 80.25% | 80.28% | 81.27% | 78.85% | 75.14% | 79.00% |
| SAVEE audio feature | 64.22% | 63.58% | 65.87% | 67.23% | 67.29% | 65.74% | 65.66% |
| SAVEE video features | 83.47% | 85.27% | 86.77% | 85.36% | 82.67% | 84.22% | 84.63% |
| SAVEE visual audio | 87.36% | 87.52% | 88.39% | 87.57% | 90.28% | 87.28% | 88.07% |
RML audio library six emotional status recognition
| RML | |||||||
|---|---|---|---|---|---|---|---|
| Feature | Pleasure | Get angry | Revulsion | Sadness | Surprise | Fear | Average |
| Metrical feature | 50.37% | 51.27% | 54.63% | 50.14% | 50.21% | 53.84% | 51.74% |
| MFCCs | 55.96% | 56.78% | 60.28% | 57.84% | 58.42% | 60.28% | 58.26% |
| Fusion feature | 58.03% | 58.42% | 60.8% | 61.34% | 60.24% | 60.94% | 59.96% |
| SAVEE | |||||||
| Feature | Pleasure | Get angry | Revulsion | Sadness | Surprise | Fear | Average |
| Metrical feature | 60.28% | 60.94% | 62.35% | 64.32% | 62.58% | 62.54% | 62.17% |
| MFCCs | 61.75% | 61.75% | 65.38% | 65.94% | 65.37% | 63.48% | 63.95% |
| Fusion feature | 65.23% | 63.45% | 66.28% | 67.38% | 67.3% | 66.78% | 66.07% |
Physiological basis
| External | It works on the internal structure of the brain | Information formation |
|---|---|---|
| Light wave→ | Occipital lobe→ | Visual information |
| Sound wave→ | Temporal lobe→ | Auditory information |
| Odour→ | Medial temporal lobe→ | Olfactory information |
| Something that can touch→ | Parietal lobe→ | Touch and kinesthetic |