Open Access

Construction of a Dynamic Interaction System for Digital Media Art Incorporating Affective Computing and Graph Neural Networks

Tianxing Chen

Tianxing Chen

College of Art and Design, Jinshen College of Nanjing Audit UniversityNanjing, China
Search for this author on
Sciendo|Google Scholar
Chen, Tianxing
  
Mar 19, 2025
Construction of a Dynamic Interaction System for Digital Media Art Incorporating Affective Computing and Graph Neural Networks's Cover Image
About this article
Previous Article
Next Article
Cite
Download Cover
Published Online: Mar 19, 2025
Received: Oct 12, 2024
Accepted: Jan 30, 2025
DOI: https://doi.org/10.2478/amns-2025-0472
Keywords
© 2025 Tianxing Chen, published by Sciendo
This work is licensed under the Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.

Figure 1.

Flow chart of multimodal sentiment analysis
Flow chart of multimodal sentiment analysis

Figure 2.

Emotion analysis model based on deep temporal modeling network
Emotion analysis model based on deep temporal modeling network

Figure 3.

System structure
System structure

Figure 4.

Basic information of the CMU-MOSEI dataset
Basic information of the CMU-MOSEI dataset

Figure 5.

Basic information of the CMU-MOSI dataset
Basic information of the CMU-MOSI dataset

Figure 6.

Emotional curves of different personalities in same sad video
Emotional curves of different personalities in same sad video

Figure 7.

Emotional curves of different personalities in same sad video
Emotional curves of different personalities in same sad video

Performance comparison results of each model on the CMU-MOSEI dataset

Model MAE Corr Acc-7 Acc-2 F1
TFN 0.645 0.746 47.7 77.8 78.2
LMF 0.661 0.684 48.4 79 80.1
MULT 0.614 0.731 50.3 82.6 83.4
MISA 0.565 0.768 51.9 83.8 83.5
ICCN 0.612 0.734 51.2 84 83.5
CMJRT 0.646 0.818 51.1 84.8 84.6
This model 0.526 0.872 54.4 86.7 87.2
Language:
English
Publication timeframe:
1 times per year
Journal Subjects:
Life Sciences, Life Sciences, other, Mathematics, Applied Mathematics, General Mathematics, Physics, Physics, other
Journal RSS Feed