Prototyping using a Pattern Technique and a Context-Based Bayesian Network in Multimodal Systems

1P. K. Atrey, M. A. Hossain, A. El Saddik, and M. S. Kankanhalli, “Multimodal fusion for multimedia analysis: a survey,” Multimedia Systems, vol. 16, pp. 345-379, 2010.10.1007/s00530-010-0182-0 Search in Google Scholar

2H. Djenidi, S. Benarif, A. Ramdane-Cherif, C. Tadj, and N. Levy, “Generic multimedia multimodal agents paradigms and their dynamic reconfiguration at the architectural level,” EURASIP J. Appl. Signal Process., vol. 2004, pp. 1688-1707, 2004. Search in Google Scholar

3R. Bolt, “Put-that-there,” Voice and gesture at the graphics interface ACMSIGGRAPH Computer Graphics, vol. 14, pp. 262-270, 1980.10.1145/965105.807503 Search in Google Scholar

5Turk, Matthew. “Multimodal interaction: A review.” Pattern Recognition Letters 36 (2014): 189-195.10.1016/j.patrec.2013.07.003 Search in Google Scholar

6T. D. C. Little, C. Y. R. Chen, C. S. Chang, and P. B. Berra, “Multimedia Synchronization,” EEE Data Eng. Bull., vol. 14, pp. 26-35, 1991. Search in Google Scholar

7S. Oviatt, P. Cohen, L. Wu, J. Vergo, L. Duncan, B. Suhm, J. Bers, T. Holzman, T. Winograd, J. Landay, J. Larson, and D. Ferro, “Designing the User Interface for Multimodal Speech and Pen-Based Gesture Applications: State-of-the-Art Systems and Future Research Directions,” in Human-Computer Interaction. vol. 15, ed: Lawrence Erlbaum Associates, 2000, pp. 263–322. Search in Google Scholar

8R. Raisamo, A. Hippula, S. Patomaki, E. Tuominen, V. Pasto, and M. Hasu, “Testing usability of multimodal applications with visually impaired children,” MultiMedia, IEEE, vol. 13, pp. 70-76, 2006.10.1109/MMUL.2006.68 Search in Google Scholar

9M. Debevc, P. Kosec, M. Rotovnik, and A. Holzinger, “Accessible Multimodal Web Pages with Sign Language Translations for Deaf and Hard of Hearing Users,” in Database and Expert Systems Application, 2009. DEXA ‘ 09. 20th International Workshop on, 2009, pp. 279283.10.1109/DEXA.2009.92 Search in Google Scholar

10J. Lai, S. Mitchell, and C. Pavlovski, “Examining modality usage in a conversational multimodal application for mobile e-mail access,” International Journal of Speech Technology, vol. 10, pp. 17-30, 2007/03/01 2007.10.1007/s10772-009-9017-9 Search in Google Scholar

11M. C. Caschera, A. D’Andrea, A. D’Ulizia, F. Ferri, P. Grifoni, and T. Guzzo, “ME: Multimodal Environment Based on Web Services Architecture,” presented at the OTM 2009 Workshops, Vilamoura, Portugal, 2009. pp 504-512.10.1007/978-3-642-05290-3_63 Search in Google Scholar

12A. Karpov, A. Ronzhin, I. Kipyatkova, and L. Akarun, “Multimodal Human Computer Interaction with MIDAS Intelligent Infokiosk,” in Pattern Recognition (ICPR), 2010 20th International Conference on, 2010, pp. 3862-3865.10.1109/ICPR.2010.941 Search in Google Scholar

13G. P. Laput, M. Dontcheva, G. Wilensky, W. Chang, A. Agarwala, J. Linder, and E. Adar, “PixelTone: a multimodal interface for image editing,” presented at the Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, Paris, France, 2013.10.1145/2470654.2481301 Search in Google Scholar

14A. Zaguia, M. D. Hina, C. Tadj, and A. Ramdane-Cherif, “Using Multimodal Fusion in Accessing Web Services,” Journal of Emerging Trends in Computing and Information Sciences, vol. 1, pp. 121-138, 2010. Search in Google Scholar

15D. Costa and C. Duarte, “Adapting Multimodal Fission to User’s Abilities,” in Universal Access in Human-Computer Interaction. Design for All and eInclusion. vol. 6765, C. Stephanidis, Ed., ed: Springer Berlin Heidelberg, 2011, pp. 347-356. Search in Google Scholar

16D. Perroud, L. Angelini, O. Abou Khaled, and E. Mugellini, “Context-Based Generation of Multimodal Feedbacks for Natural Interaction in Smart Environments,” in AMBIENT 2012, The Second International Conference on Ambient Computing, Applications, Services and Technologies, 2012, pp. 19-25. Search in Google Scholar

17Honold, Frank, Felix Schussel, and Michael Weber. “The Automated Interplay of Multimodal Fission and Fusion in Adaptive HCI.”Intelligent Environments (IE), 2014 International Conference on. IEEE, 2014.10.1109/IE.2014.32 Search in Google Scholar

18Schnelle-Walka, Dirk, Stefan Radomski, and Max Mühlhäuser. “Multimodal Fusion and Fission within W3C Standards for Nonverbal Communication with Blind Persons.”Computers Helping People with Special Needs. Springer International Publishing, 2014. 209-213.10.1007/978-3-319-08596-8_33 Search in Google Scholar

19A. Benoit, L. Bonnaud, A. Caplier, P. Ngo, L. Lawson, D. G. Trevisan, V. Levacic, C. Mancas, and G. Chanel, “Multimodal focus attention and stress detection and feedback in an augmented driver simulator,” Personal and Ubiquitous Computing, vol. 13, 2009. pp 33-41.10.1007/s00779-007-0173-0 Search in Google Scholar

20A. Zaguia, A. Wahbi, M. Miraoui, C. Tadj, and A. Ramdane-Cherif, “Modeling Rules Fission and Modality Selection Using Ontology,” Journal of Software Engineering and Applications, vol. 7, pp. 354-371, 2013.10.4236/jsea.2013.67045 Search in Google Scholar

21A. Zaguia, A. Wahbi, C. Tadj, and A. Ramdane-Cherif, “Multimodal Fission For Interaction Architecture,” Journal of Emerging Trends in Computing and Information Sciences, vol. 4, February 2013Search in Google Scholar

2013.pp. 152-166. Search in Google Scholar

22A. Zaguia, M. D. Hina, C. Tadj, and A. Ramdane-Cherif, “Interaction context-aware modalities and multimodal fusion for acessing web services,” Ubiquitous Computing and Communication Journal, vol. 5, N 4, pp.1-15, 2010. Search in Google Scholar

23Q. Ji, Z. Zhu, and P. Lan, “Real-time nonintrusive monitoring and prediction of driver fatigue,” Vehicular Technology, IEEE Transactions on, vol. 53, pp. 1052-1068, 2004. Search in Google Scholar

24Java. (2013). Java Socket. Available: docs.oracle.com/javase/tutorial/networking/sockets/definition.html Search in Google Scholar

25Zhang, Fei, Wuying Liu, and Yude Bi. “Review on Wordnet-based ontology construction in China.” International Journal on Smart Sensing and Intelligent Systems 6.2 (2013). pp.630647. Search in Google Scholar

26Guessoum, Djamel, Moeiz Miraoui, and Chakib Tadj. “SURVEY OF SEMANTIC SIMILARITY MEASURES IN PERVASIVE COMPUTING.” International Journal on Smart Sensing and Intelligent Systems 8.1 (2015). pp 125 – 158.10.21307/ijssis-2017-752 Search in Google Scholar

27Pavlakos, Georgios, Stavros Theodorakis, Vassilis Pitsikalis, S. Katsamanis, and Petros Maragos. “Kinect-based multimodal gesture recognition using a two-pass fusion scheme.” In Proc. Int’l Conf. on Image Processing. 2014. pp. 1495 – 1499.10.1109/ICIP.2014.7025299Search in Google Scholar