214
Abstracts from CT15
McCarthy, J.M., and Goffin, R.D., Measuring interview anxiety: Beyond weak knees and sweaty palms, Personnel Psychology 57 (2004), 607-637. –––––––––––––––––––––––––––––––––––––––––––––– neural mechanism of the interactive manner effect to social Cognition on interacting with Virtual other Hyeongrae Leea, Jeonghun Kua,1, Wonho Leea, Kang Jun Yoonb, In Young Kima and Sun I. Kima Department of Biomedical Engineering, Hanyang University, Seoul, Korea b St. Peter’s Hospital, Seoul, Korea
a
Corresponding author: Jeonghun Ku Department of Biomedical Engineering, Hanyang University 17 Haengdang-dong, Seongdong-gu Seoul, 133-791 Korea E-mail: kujh@bme.hanyang.ac.kr
introduction Social cognitive neuroscience benefits considerably by using animated virtual agents. With the development of an interactive technology, the user is able to experience virtual environments consisting of more lifelike environments. In previous studies, interactive manner affected the user’s feeling of presence. The different feelings of presence affected the user’s cognition, performance of tasks, immersion level, memory and other factors. However, it is unclear how the interactive manner affects social cognition on interacting with another. Therefore, in this study, we aimed to explore how the effect of interactive manner relates to social cognition using a handshake paradigm by a conventional interactive manner and a real interactive manner.
1
abstract In previous studies, interactive manner affects the user’s feeling of presence. The different feelings of presence influence the user’s cognition, performance of tasks, immersion level, memory and other factors. In this study, we aimed to investigate how interactive manner affects social cognition using a handshake paradigm by a conventional interactive manner using a button so that the subject’s hand motion synchronized with the avatar’s hand motion. In results, the subjects felt more presence and social presence in the real interactive manner condition. The main effect of the other avatar response was shown in the right superior temporal sulcus (STS), right inferior frontral gyrus (IFG) and left mid orbital gyrus. In both interactive manners, The STS was significantly more activated with the refused response, and the mid orbital gyrus was more activated with the acceptive response. However, the IFG was significantly more activated with the acceptive response in the real interactive manner, but was not differently activated in the conventional manner. The subjects felt more presence and social presence in the real interactive manner, and this different sense of presence affects a part of the mirror neuron system. Keywords: Social Cognition, Interactive Manner, Handshake
methods subjects Sixteen healthy participants were recruited for the fMRI experiment. experimental environments We conducted an fMRI study using an interactive handshake paradigm in which the user shook hands with a virtual other. There are two kinds of interactive manners to control my virtual avatar. In the conventional manner, the subject presses the left button to raise my avatar’s hand up, and presses the right button to lower my avatar’s hand. In the real manner, my virtual avatar’s hand motion is synchronized with the subject’s hand motion by calculating the position of marker on the subject's right hand. The other avatar responds by accepting or refusing the subject's offer. For the twelve pairs of avatars used in the virtual environment (VE), each pair of avatars wears different clothes for the acceptance action and the refusal action. After the fMRI experiment, subjects were asked to complete the questionnaire about the their feelings towards the virtual other’s response. The fMRI data were analyzed with AFNI. We conducted ANOVA with factorial model (interactive manner [real, button] by other avatar response [acceptance, refusal]) for group level analysis. results In questionnaire results the subjects felt more presence and social presence with the real interactive manner. Different brain activations affected by the interactive manner were in the left postcentral gyrus, left superior parietal lobule, left middle cingulate cortex and left paracentral lobule. The right superior temporal sulcus (STS), right in-
JCR