浏览全部资源
扫码关注微信
纸质出版日期： 2024-10-16 ，
移动端阅览
彭晓兰， 黄进， 田丰. 2024. 情感挑战研究进展及其在元宇宙中的应用前景. 中国图象图形学报， 29(10):2926-2936
Peng Xiaolan， Huang Jin， Tian Feng. 2024. Emotional challenge and its prospective applications in metaverse. Journal of Image and Graphics， 29(10):2926-2936
随着虚拟现实、元宇宙以及生成式人工智能等自然人机交互技术的发展，以交互式虚拟内容为主的人机界面正在给用户提供一种新型的任务挑战——情感挑战。情感挑战主要考察人对虚拟世界情感的理解、探索和处理能力，是元宇宙虚拟交互场景承载的核心内容，也是未来数字世界不可或缺的重要元素。情感挑战自2015年提出以来，一直受到人机交互领域高度关注。在此背景下，国内外研究者们围绕情感挑战的定义和特性、交互设计、评估量表和计算建模等方面开展了一系列研究工作，本文主要对这些工作进行系统化整理和介绍，并对情感挑战在元宇宙中的应用前景进行展望。首先，本文从传统数字游戏中的物理挑战和认知挑战出发，介绍情感挑战的发现、提出、完善和应用；其次，本文对虚拟现实中的情感挑战交互效应研究和情感挑战计算建模方法进行了介绍；然后，本文基于已有工作，从人机交互的角度给出了情感挑战的定义，介绍了情感挑战存在的主要媒介和设计方法；最后，本文总结了情感挑战在元宇宙中的研究意义，并对情感挑战在元宇宙中的应用前景进行了展望。
With the development of natural human-computer interaction technologies， such as virtual reality（VR）， metaverse， and artificial intelligence-generated content， human-computer interfaces based on interactive virtual contents are providing users with a new kind of task challenge——emotional challenge. Emotional challenge mainly examines the user’s ability to understand， explore， and deal with emotional issues in a virtual world. It is considered a core aspect of virtual interactive scenarios in the metaverse and an essential element in the future digital world. Moreover， users’ perceived emotional challenge has been proven to be a serious， profound， and reflective new type of user experience. Specifically， by resolving the tension within the narrative， identifying with virtual characters， and exploring emotional ambiguities， players encountering emotional challenge would be put in a more reflective state of mind and experience more diverse， impactful， and complex emotional experiences. Since the introduction of emotional challenge in 2015， it has attracted considerable attention in the field of human-computer interaction. With this background， researchers have conducted a series of research work on emotional challenge with respect to its definition， characteristics， interactive design， evaluation scales， and computational modeling. This study aims to systematically organize and introduce the related works of emotional challenge first and then elaborate its prospective applications in the metaverse. This paper starts by introducing the concept of challenge in digital games. Game challenge deals with the obstacles that players must overcome and the tasks that they must perform to make game progress. Game challenges generally have three different kinds. Physical challenge depends on players’ skills， such as speed， accuracy， endurance， dexterity， and strength， and cognitive challenge requires players to use their cognitive abilities， such as memory， observation， reasoning， planning， and problem solving. By contrast， emotional challenge deals with tension within the narrative or difficult material presented in the game and can only be overcome with a cognitive and affective effort from the player. Afterward， this paper introduces related works on emotional challenge， including how it differs from more traditional types of challenge， the diverse and relative negative emotional responses it evokes， the required game design characteristics， and the psychological theories relate to emotional challenge. This paper then introduces how emotional challenge affects player experience when separately from or jointly with traditional challenge in VR and PC conditions. Results showed that relatively exclusive emotional challenge induced a wider range of different emotions under VR and PC conditions， while the adding of emotional challenge broadened emotional responses only in VR condition. VR could also enhance players’ perceived experiences of emotional response， appreciation， immersion， and presence. This paper also reviewed the latest work on the potential of detecting perceived emotional challenge from physiological signals. Researchers collected physiological responses from a group of players who engaged in three typical game scenarios coving an entire spectrum of different game challenges. By collecting perceived challenge ratings from players and extracting basic physiological features， researchers applied multiple machine learning methods and metrics to detect challenge experiences. Results showed that most methods achieved a challenge detection accuracy of around 80%. Although emotional challenge has attracted considerable attention in the field of human-computer interaction， it has not been clearly defined at present. Additionally， current research on emotional challenge is primarily limited to the area of digital games. We believe that the concept of emotional challenge has the potential for application in various domains of human-computer interaction. Therefore， building upon previous works on emotional challenge， this paper provides a definition and description of emotional challenge from the perspective of human-computer interaction. Emotional challenge primarily examines users’ understanding， exploration， and processing abilities of emotions in virtual scenarios and the digital world. It often requires individuals to engage in meaningful choices and interactions within virtual interactive environments as they navigate emotional dilemmas and respond to the uncertainties arising from their interactions. For instance， in a virtual scenario， a sniper aims at an enemy soldier holding a rocket launcher， intending to destroy their own camp. However， the sniper suddenly realizes that the enemy soldier is a close friend with whom they have shared hardships. When faced with the decision of whether to pull the trigger， the sniper may experience an emotional challenge of “agonizing between friendship and protecting their own base”. With the proposed definition of emotional challenge， we also elaborate on how emotional challenge is understood from the perspectives of users and designers and highlight the main mediums through which emotional challenge exists. Finally， this paper summarizes the research importance of emotional challenge in the metaverse and provides an outlook on the application prospects of emotional challenge in the metaverse. The metaverse aims to create a comprehensive virtual digital living space that maps or transcends the real world. It includes a plethora of virtual content and virtual characters， with users being a part of it and interacting with these virtual characters or content. Through autonomous interactions with the virtual characters or content， users are likely to explore complex emotions and confront with emotional challenge. Hence， emotional challenge becomes the core content embedded in virtual interactive scenarios within the metaverse， making it an essential element in the future digital world. In the design of metaverse systems for application， the involvement of emotional challenge can equip the metaverse with the ability to evoke and generate complex but meaningful emotional experiences. It can assist in training users’ skills in understanding， exploring， and dealing with difficult emotional issues， promoting self-realization， self-expression， and self-management abilities and thus building correct life outlook and values.
情感挑战叙事性游戏虚拟现实（VR）元宇宙人机交互
emotional challengenarrative gamesvirtual reality（VR）metaversehuman-computer interaction
Adams E. 2014. Fundamentals of Game Design. 3rd ed. San Francisco， USA： Pearson Education
Alarcão S M and Fonseca M J. 2019. Emotions recognition using EEG signals： a survey. IEEE Transactions on Affective Computing， 10（3）： 374-393 ［DOI： 10.1109/TAFFC.2017.2714671http://dx.doi.org/10.1109/TAFFC.2017.2714671］
Ayata D， Yaslan Y and Kamaşak M. 2017. Emotion recognition via galvanic skin response： comparison of machine learning algorithms and feature extraction methods. Istanbul University-Journal of Electrical and Electronics Engineering， 17（1）： 3129-3136
Bian Y L， Yang C L， Gao F Q， Li H Y， Zhou S S， Li H C， Sun X W and Meng X C. 2016. A framework for physiological indicators of flow in VR games： construction and preliminary evaluation. Personal and Ubiquitous Computing， 20（5）： 821-832 ［DOI： 10.1007/s00779-016-0953-5http://dx.doi.org/10.1007/s00779-016-0953-5］
Bian Y L， Yang C L， Zhou C， Liu J， Gai W， Meng X X， Tian F and Shen C A. 2018. Exploring the weak association between flow experience and performance in virtual environments//Proceedings of 2018 CHI Conference on Human Factors in Computing Systems. Montreal， Canada： ACM： #401 ［DOI： 10.1145/3173574.3173975http://dx.doi.org/10.1145/3173574.3173975］
Bopp J A， Opwis K and Mekler E D. 2018. “An Odd Kind of Pleasure”： differentiating emotional challenge in digital games//Proceedings of 2018 CHI Conference on Human Factors in Computing Systems. Montreal， Canada： ACM： #41 ［DOI： 10.1145/3173574.3173615http://dx.doi.org/10.1145/3173574.3173615］
Bowman N D， Lin J T and Wu C. 2021. A Chinese-language validation of the video game demand scale （VGDS-C）： measuring the cognitive， emotional， physical， and social demands of video games//Proceedings of 2021 CHI Conference on Human Factors in Computing Systems. Yokohama， Japan： ACM： #117 ［DOI： 10.1145/3411764.3445348http://dx.doi.org/10.1145/3411764.3445348］
Bowman N D， Wasserman J and Banks J. 2018. Development of the video game demand scale//Video Games. New York： Routledge： 208-233
Cole T， Cairns P and Gillies M. 2015. Emotional and functional challenge in core and avant-garde games//Proceedings of 2015 Annual Symposium on Computer-Human Interaction in Play. London， United Kingdom： ACM： 121-126 ［DOI： 10.1145/2793107.2793147http://dx.doi.org/10.1145/2793107.2793147］
Cole T. 2021. “Moments to Talk About”： Designing for the Eudaimonic Gameplay Experience. Goldsmiths： University of London
Cole T and Gillies M. 2021. Thinking and doing： challenge， agency， and the eudaimonic experience in video games. Games and Culture， 16（2）： 187-207 ［DOI： 10.1177/1555412019881536http://dx.doi.org/10.1177/1555412019881536］
Cole T and Gillies M. 2022. Emotional exploration and the eudaimonic gameplay experience： a grounded theory//Proceedings of 2022 CHI Conference on Human Factors in Computing Systems. New Orleans， USA： ACM： #470 ［DOI： 10.1145/3491102.3502002http://dx.doi.org/10.1145/3491102.3502002］
Cox A， Cairns P， Shah P and Carroll M. 2012. Not doing but thinking： the role of challenge in the gaming experience//Proceedings of 2012 SIGCHI Conference on Human Factors in Computing Systems. Austin， USA： ACM： 79-88 ［DOI： 10.1145/2207676.2207689http://dx.doi.org/10.1145/2207676.2207689］
Denisova A， Cairns P， Guckelsberger C and Zendle D. 2020. Measuring perceived challenge in digital games： development and validation of the challenge originating from recent gameplay interaction scale （CORGIS）. International Journal of Human-Computer Studies， 137： #102383 ［DOI： 10.1016/j.ijhcs.2019.102383http://dx.doi.org/10.1016/j.ijhcs.2019.102383］
Denisova A， Guckelsberger C and Zendle D. 2017. Challenge in digital games： towards developing a measurement tool//Proceedings of 2017 Chi Conference Extended Abstracts on Human Factors in Computing Systems. Denver， USA： ACM： 2511-2519 ［DOI： 10.1145/3027063.3053209http://dx.doi.org/10.1145/3027063.3053209］
Diefenbach S， Kolb N and Hassenzahl M. 2014. The ‘hedonic’ in human-computer interaction： history， contributions， and future research directions//Proceedings of 2014 Conference on Designing Interactive Systems. Vancouver， Canada： ACM： 305-314 ［DOI： 10.1145/2598510.2598549http://dx.doi.org/10.1145/2598510.2598549］
Flint A， Denisova A and Bowman N. 2023. Comparing measures of perceived challenge and demand in video games： exploring the conceptual dimensions of CORGIS and VGDS//Proceedings of 2023 CHI Conference on Human Factors in Computing Systems. Hamburg， Germany： ACM： #571 ［DOI： 10.1145/3544548.3581409http://dx.doi.org/10.1145/3544548.3581409］
Gowler C P R and Iacovides I. 2019. “Horror， guilt and shame”——uncomfortable experiences in digital games//Proceedings of 2019 Annual Symposium on Computer-Human Interaction in Play. Barcelona， Spain： ACM： 325-337 ［DOI： 10.1145/3311350.3347179http://dx.doi.org/10.1145/3311350.3347179］
Kulke L， Feyerabend D and Schacht A. 2020. A comparison of the Affectiva iMotions facial expression analysis software with EMG for identifying facial expressions of emotion. Frontiers in Psychology， 11： #329 ［DOI： 10.3389/fpsyg.2020.00329http://dx.doi.org/10.3389/fpsyg.2020.00329］
Kumar A， Sharma K and Sharma A. 2021. Hierarchical deep neural network for mental stress state detection using IoT based biomarkers. Pattern Recognition Letters， 145： 81-87 ［DOI： 10.1016/j.patrec.2021.01.030http://dx.doi.org/10.1016/j.patrec.2021.01.030］
Mekler E D and Hornbæk K. 2016. Momentary pleasure or lasting meaning？ Distinguishing eudaimonic and hedonic user experiences//Proceedings of 2016 CHI Conference on Human Factors in Computing Systems. San Jose， USA： ACM： 4509-4520 ［DOI： 10.1145/2858036.2858225http://dx.doi.org/10.1145/2858036.2858225］
Mekler E D and Hornbæk K. 2019. A framework for the experience of meaning in human-computer interaction//Proceedings of 2019 CHI Conference on Human Factors in Computing Systems. Glasgow， UK： ACM： #225 ［DOI： 10.1145/3290605.3300455http://dx.doi.org/10.1145/3290605.3300455］
Norman D A. 2004. Emotional Design： Why We Love （or Hate） Everyday Things. New York： Basic Books
Peng X L， Huang J， Denisova A， Chen H， Tian F and Wang H A. 2020. A palette of deepened emotions： exploring emotional challenge in virtual reality games//Proceedings of 2020 CHI Conference on Human Factors in Computing Systems. Honolulu， USA： ACM： 1-13 ［DOI： 10.1145/3313831.3376221http://dx.doi.org/10.1145/3313831.3376221］
Peng X L， Huang J， Li L H， Gao C， Chen H， Tian F and Wang H A. 2019. Beyond horror and fear： exploring player experience invoked by emotional challenge in VR games//Proceedings of 2019 CHI Conference on Human Factors in Computing Systems. Glasgow， UK： ACM： #LBW1616 ［DOI： 10.1145/3290605.3300455］
Peng X L， Meng C Y， Xie X R， Huang J， Chen H and Wang H. 2022. Detecting challenge from physiological signals： a primary study with a typical game scenario//Proceedings of 2022 Extended Abstracts of CHI Conference on Human Factors in Computing Systems. New Orleans， USA： ACM： #424 ［DOI： 10.1145/3491101.3519806http://dx.doi.org/10.1145/3491101.3519806］
Peng X L， Xie X R， Huang J， Jiang C T， Wang H N， Denisova A， Chen H， Tian F and Wang H A. 2023. ChallengeDetect： investigating the potential of detecting in-game challenge experience from physiological measures//Proceedings of 2023 CHI Conference on Human Factors in Computing Systems. Hamburg， Germany： ACM： #587 ［DOI： 10.1145/3544548.3581232http://dx.doi.org/10.1145/3544548.3581232］
Quintana D S， Guastella A J， Outhred T， Hickie I B and Kemp A H. 2012. Heart rate variability is associated with emotion recognition： direct evidence for a relationship between the autonomic nervous system and social cognition. International Journal of Psychophysiology， 86（2）： 168-172 ［DOI： 10.1016/j.ijpsycho.2012.08.012http://dx.doi.org/10.1016/j.ijpsycho.2012.08.012］
Rim B， Sung N J， Min S D and Hong M. 2020. Deep learning in physiological signal data： a survey. Sensors， 20（4）： #969 ［DOI： doi.org/10.3390/s20040969http://dx.doi.org/doi.org/10.3390/s20040969］
Ryan R M and Deci E L. 2001. On happiness and human potentials： a review of research on hedonic and eudaimonic well-being. Annual Review of Psychology， 52（1）： 141-166 ［DOI： 10.1146/annurev.psych.52.1.141http://dx.doi.org/10.1146/annurev.psych.52.1.141］
Schell J. 2008. The Art of Game Design： A Book of Lenses. Boca Raton， USA： CRC Press ［DOI： 10.1201/9780080919171http://dx.doi.org/10.1201/9780080919171］
Vahlo J and Karhulahti V M. 2020. Challenge types in gaming validation of video game challenge inventory （CHA）. International Journal of Human-Computer Studies， 143： #102473 ［DOI： 10.1016/j.ijhcs.2020.102473http://dx.doi.org/10.1016/j.ijhcs.2020.102473］
Zhang Q， Chen X X， Zhan Q Y， Yang T and Xia S H. 2017. Respiration-based emotion recognition with deep learning. Computers in Industry， 92-93： 84-90 ［DOI： 10.1016/j.compind.2017.04.005http://dx.doi.org/10.1016/j.compind.2017.04.005］
相关作者
相关机构
京公网安备11010802024621