A study of auditory-associative musical emotion based on multidimensional signal processing techniques

[1] Rudenko, S., & Cabral, J. P. (2019). Synaesthesia: How can it be used to enhance the audio-visual perception of music and multisensory design in digitally enhanced environments?. In Proceedings of SMM19, Workshop on Speech, Music and Mind 2019 (pp. 60-64). Rudenko S. Cabral J. P. ( 2019 ). Synaesthesia: How can it be used to enhance the audio-visual perception of music and multisensory design in digitally enhanced environments? . In Proceedings of SMM19, Workshop on Speech, Music and Mind 2019 (pp. 60 - 64 ). Search in Google Scholar

[2] Wang, W., Li, Q., Xie, J., Hu, N., Wang, Z., & Zhang, N. (2023). Research on emotional semantic retrieval of attention mechanism oriented to audio-visual synesthesia. Neurocomputing, 519, 194-204. Wang W. Li Q. Xie J. Hu N. Wang Z. Zhang N. ( 2023 ). Research on emotional semantic retrieval of attention mechanism oriented to audio-visual synesthesia . Neurocomputing , 519 , 194 - 204 . Search in Google Scholar

[3] Watkins, J. (2018). Composing Visual Music: visual music practice at the intersection of technology, audio-visual rhythms and human traces. Body, Space & Technology, 17(1), 51-75. Watkins J. ( 2018 ). Composing Visual Music: visual music practice at the intersection of technology, audio-visual rhythms and human traces . Body, Space & Technology , 17 ( 1 ), 51 - 75 . Search in Google Scholar

[4] Lebeau, C., & Richer, F. (2022). Emotions and consciousness alterations in music-color synesthesia. Auditory Perception & Cognition, 5(1-2), 76-85. Lebeau C. Richer F. ( 2022 ). Emotions and consciousness alterations in music-color synesthesia . Auditory Perception & Cognition , 5 ( 1-2 ), 76 - 85 . Search in Google Scholar

[5] Tsai, C. M., Chang, Y. T., & Tsai, W. C. (2022, June). A Pilot Study on Synesthesia Between Color Senses and Musical Scales in Chinese Musical Instrument “Guqin”. In International Conference on Human-Computer Interaction (pp. 127-135). Cham: Springer International Publishing. Tsai C. M. Chang Y. T. Tsai W. C. ( 2022 , June ). A Pilot Study on Synesthesia Between Color Senses and Musical Scales in Chinese Musical Instrument “Guqin” . In International Conference on Human-Computer Interaction (pp. 127 - 135 ). Cham: Springer International Publishing . Search in Google Scholar

[6] Li, Y. (2020). Psychological mechanism of audio-visual synaesthesia in the teaching of instrumental performance. Revista Argentina de Clínica Psicológica, 29(1), 1182. Li Y. ( 2020 ). Psychological mechanism of audio-visual synaesthesia in the teaching of instrumental performance . Revista Argentina de Clínica Psicológica , 29 ( 1 ), 1182 . Search in Google Scholar

[7] Li, J., & Frishman, J. (2023). Visual and Auditory Stimuli on Emotional Responses: The Relationship Between Art and Music on Human Emotion. Journal of Student Research, 12(3). Li J. Frishman J. ( 2023 ). Visual and Auditory Stimuli on Emotional Responses: The Relationship Between Art and Music on Human Emotion . Journal of Student Research , 12 ( 3 . Search in Google Scholar

[8] Taruffi, L., & Küssner, M. B. (2019). A review of music-evoked visual mental imagery: Conceptual issues, relation to emotion, and functional outcome. Psychomusicology: Music, Mind, and Brain, 29(2-3), 62. Taruffi L. Küssner M. B. ( 2019 ). A review of music-evoked visual mental imagery: Conceptual issues, relation to emotion, and functional outcome . Psychomusicology: Music, Mind, and Brain , 29 ( 2-3 ), 62 . Search in Google Scholar

[9] Giordano, G., & Casais, M. (2022). Lemon’s Pitch: An Attempt to Induce Audio-Visual Synesthesia in Live Music Performances. In Advances in Design and Digital Communication II: Proceedings of the 5th International Conference on Design and Digital Communication, Digicom 2021, November 4–6, 2021, Barcelos, Portugal (pp. 296-311). Springer International Publishing. Giordano G. Casais M. ( 2022 ). Lemon’s Pitch: An Attempt to Induce Audio-Visual Synesthesia in Live Music Performances . In Advances in Design and Digital Communication II: Proceedings of the 5th International Conference on Design and Digital Communication, Digicom 2021, November 4–6, 2021, Barcelos, Portugal (pp. 296 - 311 ). Springer International Publishing . Search in Google Scholar

[10] Gao, Y., Ma, X., & Xie, L. (2019, November). The visual synaesthesia analysis of Chinese traditional music aesthetics. In 2019 International Conference on Image and Video Processing, and Artificial Intelligence (Vol. 11321, pp. 524-529). SPIE. Gao Y. Ma X. Xie L. ( 2019 , November ). The visual synaesthesia analysis of Chinese traditional music aesthetics . In 2019 International Conference on Image and Video Processing, and Artificial Intelligence (Vol. 11321 , pp. 524 - 529 ). SPIE . Search in Google Scholar

[11] Hashim, S., Stewart, L., Küssner, M. B., & Omigie, D. (2023). Music listening evokes story-like visual imagery with both idiosyncratic and shared content. Plos one, 18(10), e0293412. Hashim S. Stewart L. Küssner M. B. Omigie D. ( 2023 ). Music listening evokes story-like visual imagery with both idiosyncratic and shared content . Plos one , 18 ( 10 ), e0293412 . Search in Google Scholar

[12] Sievers, B., Parkinson, C., Kohler, P. J., Hughes, J. M., Fogelson, S. V., & Wheatley, T. (2021). Visual and auditory brain areas share a representational structure that supports emotion perception. Current Biology, 31(23), 5192-5203. Sievers B. Parkinson C. Kohler P. J. Hughes J. M. Fogelson S. V. Wheatley T. ( 2021 ). Visual and auditory brain areas share a representational structure that supports emotion perception . Current Biology , 31 ( 23 ), 5192 - 5203 . Search in Google Scholar

[13] Fink, L., Fiehn, H., & Wald-Fuhrmann, M. (2024). The role of audiovisual congruence in aesthetic appreciation of contemporary music and visual art. Scientific Reports, 14(1), 20923. Fink L. Fiehn H. Wald-Fuhrmann M. ( 2024 ). The role of audiovisual congruence in aesthetic appreciation of contemporary music and visual art . Scientific Reports , 14 ( 1 ), 20923 . Search in Google Scholar

[14] Mao, X., Xu, J., Lang, J., & Zhang, S. (2023). Visualization of isomorphism-synesthesia of colour and music. Visual Informatics, 7(4), 110-114. Mao X. Xu J. Lang J. Zhang S. ( 2023 ). Visualization of isomorphism-synesthesia of colour and music . Visual Informatics , 7 ( 4 ), 110 - 114 . Search in Google Scholar

[15] Watkins, J., Street, S., & Row, P. (2018, July). Creating Affective Visual Music. In EVA. Watkins J. Street S. Row P. ( 2018 , July ). Creating Affective Visual Music . In EVA . Search in Google Scholar

[16] Hauck, P., von Castell, C., & Hecht, H. (2022). Crossmodal correspondence between music and ambient color is mediated by emotion. Multisensory Research, 35(5), 407-446. Hauck P. von Castell C. Hecht H. ( 2022 ). Crossmodal correspondence between music and ambient color is mediated by emotion . Multisensory Research , 35 ( 5 ), 407 - 446 . Search in Google Scholar

[17] Crnjanski, N., & Tomaš, D. (2019). Musical perception and visualization. In Music and Spatiality. 13th Biennale International Conference on Music Theory and Analysis. Crnjanski N. Tomaš D. ( 2019 ). Musical perception and visualization. In Music and Spatiality . 13th Biennale International Conference on Music Theory and Analysis . Search in Google Scholar

[18] Ng, K., Armitage, J., & McLean, A. (2014, July). The colour of music: Real-time music visualisation with synaesthetic sound-colour mapping. In Electronic Visualisation and the Arts (EVA 2014). BCS Learning & Development. Ng K. Armitage J. McLean A. ( 2014 , July ). The colour of music: Real-time music visualisation with synaesthetic sound-colour mapping. In Electronic Visualisation and the Arts (EVA 2014) . BCS Learning & Development . Search in Google Scholar

[19] O’Toole, P., Glowinski, D., Pitt, I., & Mancini, M. (2021, October). When emotions are triggered by single musical notes: Revealing the underlying factors of auditory-emotion associations. In Companion Publication of the 2021 International Conference on Multimodal Interaction (pp. 291-298). O’Toole P. Glowinski D. Pitt I. Mancini M. ( 2021 , October ). When emotions are triggered by single musical notes: Revealing the underlying factors of auditory-emotion associations . In Companion Publication of the 2021 International Conference on Multimodal Interaction (pp. 291 - 298 ). Search in Google Scholar

[20] Mesz, B., Tedesco, S., Reinoso-Carvalho, F., Ter Horst, E., Molina, G., Gunn, L. H., & Küssner, M. B. (2023). Marble melancholy: using crossmodal correspondences of shapes, materials, and music to predict music-induced emotions. Frontiers in Psychology, 14, 1168258. Mesz B. Tedesco S. Reinoso-Carvalho F. Ter Horst E. Molina G. Gunn L. H. Küssner M. B. ( 2023 ). Marble melancholy: using crossmodal correspondences of shapes, materials, and music to predict music-induced emotions . Frontiers in Psychology , 14 , 1168258 . Search in Google Scholar

[21] Disbergen, N. R., Valente, G., Formisano, E., & Zatorre, R. J. (2018). Assessing top-down and bottom-up contributions to auditory stream segregation and integration with polyphonic music. Frontiers in neuroscience, 12, 121. Disbergen N. R. Valente G. Formisano E. Zatorre R. J. ( 2018 ). Assessing top-down and bottom-up contributions to auditory stream segregation and integration with polyphonic music . Frontiers in neuroscience , 12 , 121 . Search in Google Scholar