Accès libre

Construction of a Dynamic Interaction System for Digital Media Art Incorporating Affective Computing and Graph Neural Networks

  
19 mars 2025
À propos de cet article

Citez
Télécharger la couverture

Figure 1.

Flow chart of multimodal sentiment analysis
Flow chart of multimodal sentiment analysis

Figure 2.

Emotion analysis model based on deep temporal modeling network
Emotion analysis model based on deep temporal modeling network

Figure 3.

System structure
System structure

Figure 4.

Basic information of the CMU-MOSEI dataset
Basic information of the CMU-MOSEI dataset

Figure 5.

Basic information of the CMU-MOSI dataset
Basic information of the CMU-MOSI dataset

Figure 6.

Emotional curves of different personalities in same sad video
Emotional curves of different personalities in same sad video

Figure 7.

Emotional curves of different personalities in same sad video
Emotional curves of different personalities in same sad video

Performance comparison results of each model on the CMU-MOSEI dataset

Model MAE Corr Acc-7 Acc-2 F1
TFN 0.645 0.746 47.7 77.8 78.2
LMF 0.661 0.684 48.4 79 80.1
MULT 0.614 0.731 50.3 82.6 83.4
MISA 0.565 0.768 51.9 83.8 83.5
ICCN 0.612 0.734 51.2 84 83.5
CMJRT 0.646 0.818 51.1 84.8 84.6
This model 0.526 0.872 54.4 86.7 87.2