Current Issue

The Korean Journal of Cognitve & Biological Psychology - Vol. 34 , No. 2

[ Original Article ]
The Korean Journal of Cognitve & Biological Psychology - Vol. 34, No. 2, pp. 109-120
Abbreviation: KCBPA
ISSN: 1226-9654 (Print)
Print publication date 30 Apr 2022
Received 03 Feb 2022 Revised 04 Apr 2022 Accepted 06 Apr 2022
DOI: https://doi.org/10.22172/cogbio.2022.34.2.006

얼굴표정의 정서가 생물형운동의 처리에 미치는 맥락적 영향
김민희1 ; 김제중1,
1덕성여자대학교 심리학과

Contextual Influence of Emotional Facial Expressions on Processing Point-light Biological Motion
Minhee Kim1 ; Jejoong Kim1,
1Duksung Women’s University
Correspondence to : 김제중, 덕성여자대학교 심리학과, (01369) 서울시 도봉구 삼양로144길 33 E-mail: jejoong@duksung.ac.kr


ⓒ The Korean Society for Cognitive and Biological Psychology

초록

정서 재인에 있어서 맥락의 효과는 다양한 맥락자극을 사용한 연구들에서 입증되어 왔다. 그러나, 정서에 관한 대부분의 연구는 얼굴표정에 초점을 두고 수행되었다. 얼굴표정이 정서적 상호작용에서 매우 중요한 단서임은 틀림없으나, 신체표현 역시 정서 정보의 중요한 출처가 된다. 본 연구에서는 신체표현의 정서정보 처리에 작용하는 맥락의 효과를 살펴보고자 하였다. 특히, 신체표현은 얼굴표정과 분리해서 생각하기 어려운 만큼, 얼굴표정의 정서 정보가 신체표현에 미치는 맥락적 영향을 정서 점화 과제를 통해 알아보았다. 신체 움직임을 나타내는 자극으로는 점광생물형운동(BM)자극을 사용하였다. 첫 번째 과제에서는 분노, 중립 또는 행복정서를 나타내는 얼굴표정이 점화자극으로 짧게 주어진 후 정서중립 BM자극이 표적으로 제시되었고, 참가자들은 BM자극이 어떤 정서가를 가지는 것으로 보이는지를 판단하였다. 또한, 선행연구들이 얼굴표정의 처리에 초점을 맞추어 온 점을 고려하여, 동일한 과제에서 중립얼굴을 표적자극으로 사용한 과제를 실시하였다. 마지막으로, 정서가를 가진 BM에 대한 정서 평정 과제를 실시하여 그 결과를 첫 번째 과제와 비교하였다. 실험 결과, 정서를 가진 얼굴 점화자극은 얼굴 표적자극뿐만 아니라, BM자극의 정서가 판단에도 점화자극의 정서와 일치하는 방향으로 영향을 주는 것으로 나타났다. 그리고 이 효과는 분노 및 행복정서 모두 BM자극에서 얼굴 자극보다 더 크게 나타났다. 본 연구는 BM자극에 정서적 얼굴표정이 미치는 효과를 확인한 것과, 얼굴자극과의 비교를 통해 BM자극이 전달하는 정서가의 특성을 밝힌 점에서 의의가 있다.

Abstract

Contextual effects on emotion recognition have been well evidenced on various contextual stimuli. However, previous studies mostly focused on facial expressions. Although the facial expressions are important cue in emotional communication, bodily expressions are also one of the fundamental sources of emotional information especially when faces are hard to recognize. The present study examined contextual effects on emotional processing of the bodily expression. Given that the bodily expressions are inseparable from the facial expression, we aimed to examine contextual effects of faces on bodily expression. For bodily expression, we used point-light biological motion(BM) that depicts human movement and convey emotional information. In the affective priming paradigm, emotionally neutral BMs were presented as targets following the prime which was either happy, angry, or neutral face. To compare with the emotional processing of faces, the same experiment but with neutral face target was additionally conducted. Participants were told to rate emotional valence of the targets. The results showed that both the BM and face targets were affected by priming effects. Notably, the effects were much greater on BM than the face targets, indicating that BM was more influenced by contextual emotion. These suggest that BM perception may need greater integration of the emotional contextual information possibly due to insufficient its own emotional information compared to faces. To summarize, the present study newly revealed the affective contextual effect of facial expression on BM, and identified distinct property of emotional valence convey by BM compared with facial expressions.


Keywords: Biological motion, facial expressions, emotional contextual effect, emotional valence recognition
키워드: 생물형운동, 정서적 얼굴표정, 맥락 정서 효과, 정서 재인

References
1. Adams Jr., R. B., Nelson, A. J., Soto, J. A., Hess, U., & Kleck, R. E. (2012). Emotion in the neutral face: A mechanism for impression formation? Cognition and Emotion, 26(3), 431-441.
2. Atkinson, A. P., Dittrich, W. H., Gemmell, A. J., & Young, A. W. (2004). Emotion perception from dynamic and static body expressions in point-light and full-light displays. Perception, 33(6), 717-746.
3. Beauchamp, M. S., Lee, K. E., Haxby, J. V., & Martin, A. (2003). fMRI responses to video and point-light displays of moving humans and manipulable objects. Journal of Cognitive Neuroscience, 15, 991-1007.
4. Blake, R., & Shiffrar, M. (2007). Perception of human motion. Annual review of psychology, 58, 47-73
5. Brainard, D. H. (1997). The psychophysics toolbox. Spatial Vision, 10, 443-446.
6. Carroll, J. M., & Russell, J. A. (1996). Do facial expressions signal specific emotions? Judging emotion from the face in context. Journal of Personality and Social Psychology, 70, 205-18.
7. Chouchourelou, A., Matsuka, T., Harber, K., & Shiffrar, M. (2006). The visual analysis of emotional actions. Social Neuroscience, 1(1), 63-74.
8. De Gelder, B., & Van den Stock, J. (2011). The bodily expressive action stimulus test (BEAST). Contruction and validation of a stimulus basis for measuring perception of whole body expression of emotions. Frontiers in Psychology, 2, 181.
9. Grossman, E. D., Donnelly, M., Price, R., Morgan, V., Pickens, D., Neighbor, G., & Blake, R. (2000) Brain areas involved in perception of biological motion. Journal of Cognitive Neuroscience, 12, 711-720.
10. Hester, N. (2019). Perceived negative emotion in neutral faces: Gender-dependent effects on attractiveness and threat. Emotion, 19(8), 1490-1494.
11. Horstmann, G. (2003). What do facial expressions convey: Feeling states, behavioral intentions, or actions requests? Emotion, 3(2), 150-166.
12. Isernia, S., Sokolov, A. N., Fallgatter, A. J., & Pavlova, M. A. (2020). Untangling the ties between social cognition and body motion: gender impact. Frontiers in Psychology, 11, 128.
13. Johansson, G. (1973). Visual perception of biological motion and a model for its analysis. Perception & Psychophysics, 14(2), 201-211.
14. Kauschke, C., Bahn, D., Vesker, M., & Schwarzer, G. (2019). The role of emotional valence for the processing of facial and verbal stimuli-Positivity or negativity bias? Frontiers in Psychology, 10, 1654.
15. Kim, J. (2013). Perception of biological motion: Difference between the visual fields and comparison with non-biological motion. The Korean Journal of Cognitive and Biological Psychology. 25(1), 1-19.
16. Kim, J. (2019). Characteristics emotion discrimination from biological motion in trait-anxiety. The Korean Journal of Psychology: General, 38(4), 487-506.
17. Kim, J., Norton, D., McBain, R., Ongur, D., & Chen, Y. (2013). Deficient biological motion perception in schizophrenia: Results from a motion noise paradigm. Frontiers in Psychology, 4, 391.
18. Kim, J., Park, S., & Blake, R. (2011). Perception of biological motion in schizophrenia and healthy A behavioral and fMRI study. PLOS One, 6, e19971.
19. Kleinsmith, A., De Silva, P. R., & Bianch-Berthouze, N. (2006). Cross-cultural differences in recognizing affect from body posture. Interacting with Computers, 18(6), 1371-1389.
20. Koolagudi, S. G., & Rao, K. S. (2012). Emotion recognition from speech: a review. International Journal of Speech Technology, 15(2), 99-117.
21. Kosti, R., Alvarez, J. M., Recasens, A., & Lapedriza, A. (2017). Emotion recognition in context. In Proceedings of the IEEE conference on computer vision and pattern recognition, 1667-1675.
22. Kret, M. E., Roelofs, K., Stekelenburg, J. J., & de Gelder, B. (2013). Emotional signals from faces, bodies, and scenes influence observers’ face expression, fixations and pupil-size. Frontiers in Human Neuroscience, 13, 810.
23. Krüger, S., Sokolov, A. N., Enck, P., Krägeloh-Mann, I., & Pavlova, M. A. (2013). Emotion through locomotion: gender impact. PLOS One, 8(11), e81716.
24. Lee, E., Kang, J. I., Park, I. H., Kim, J. J., & An, S. K. (2008). Is a neutral face really evaluated as being emotionally neutral? Psychiatry Research, 157, 77-85.
25. Lee, H., & Kim, J. (2017). Facilitating effects of emotion on the perception of biological motion: evidence for a happiness superiority effect. Perception, 46(6), 679-697.
26. Lee, T. H., Choi, J. S., & Cho, Y. S. (2012). Context modulation of facial emotion perception differed by individual difference. PLOS One, 7(3), e32987.
27. Lewinski, P. (2015). Automated facial coding software outperforms people in recognizing neutral faces as neutral from standardized datasets. Frontiers in Psychology, 6, 1386.
28. Li, S., Li, P., Wang, W., Zhu, X., & Luo, W. (2018). The effect of emotionally valenced eye region images on visuocortical processing of surprised faces. Psychophysiology, 55(5), e13039.
29. Lopez, L. D., Reschke, P. J., Knothe, J. M., & Walle, E. A. (2017). Postural communication of emotion: Perception of distinct poses of five discrete emotions. Frontiers in Psychology, 8, 710.
30. Ma, Y., Paterson, H. M., & Pollick, F. E. (2006). A motion-capture library for the study of identity, gender, and emotion perception from biological motion. Behavior Research Methods, Instruments, & Computers, 38, 134-141.
31. Meeren, H. K. M., van Heijnsbergen, C. C. R. J., & de Gelder, B. (2005). Rapid perception integration of facial expression and emotional body language. PNAS, 102(45), 16518-16523.
32. Müller, V. I., Habel, U., Derntl, B., Schneider, F., Zilles, K., Thuetsky, B. I., & Eickhoff, S. B. (2011). Incongruence effects in crossmodal emotional integration. Neuroimage, 54(3), 2257-2266.
33. Mumenthaler, C., & Sander, D. (2015). Automatic integration of social information in emotion recognition. Journal of Experimental Psychology: General, 144(2), 392.
34. Nackaerts, E., Wagemans, J., Helsen, W., Swinnen, S. P., Wenderoth, N., & Alaerts, K. (2012). Recognizing biological motion and emotions from point-light displays in autism spectrum disorders. PLOS One, 7(9), e44473.
35. Neta, M., Davis, F. C., & Whalen, P. J., (2011). Valence resolution of ambiguous facial expressions using an emotional oddball task, Emotion, 11(6), 1425.
36. Neta, M., & Whalen, P. J. (2010). The primacy of negative interpretations when resolving the valence of ambiguous facial expressions. Psychological Science, 21(7), 901-907.
37. Noh, S. R. & Issacowitz, D. M. (2013). Emotional faces in context: age differences in recognition accuracy and scanning patterns. Emotion, 13(2), 238.
38. Okruszek, Ł. (2018). It is not just in faces! Processing of emotion and intention from biological motion in psychiatric disorders. Frontiers in Human Neuroscience, 12, 48.
39. Okruszek, Ł., Harman, M., Kalinowski, K., Talarowska, M., Becchio, C., & Manera, V. (2015). Impaired recognition of communicative interactions from biological motion in schizophrenia. PLOS One, 10(2):e0116793.
40. Parkinson, C., Walker, T. T., Memmi, S., & Wheatley, T. (2017). Emotions are understood from biological motion across remote cultures. Emotion, 17(3), 459.
41. Pelli, D. G. (1997). The video toolbox software for visual psychophysics: transforming numbers into movies. Spatial Vision, 10, 437-442.
42. Pelphrey, K. A., Morris, J. P., Michelich, C. R., Allison, T., & McCarthy, G. (2005). Functional anatomy of biological motion perception in posterior temporal cortex: An fMRI study of eye, mouth and hand movements. Cerebral Cortex, 15, 1866-1876.
43. Peterman, J. S., Bekele, E., Bian, D., Sarkar, N., & Park, S. (2015). Complexities of emotional responses to social and non-social affective stimuli in schizophrenia. Frontiers in Psychology, 6, 320.
44. Righart & de Gelder (2008). Rapid influence of emotional scenes on encoding of facial expressions. An ERP study. SCAN, 3, 270-278.
45. Santamaria-Garcia, H., Ibáñez, A., Montaño, S., Garcia, A. M., Patiño-Saenz, M., et al. (2019). Out of context, beyond the face: Neuroanatomical pathways of emotional face-body language integration in adolescent offenders. Frontiers in Behavioral Neuroscience, 13, 34.
46. Sokolov, A. A., Krüger, S., Enck, P., Krägeloh-Mann, I., & Pavlova, M. A. (2011). Gender affects body language reading. Frontiers in Psychology, 2, 16.
47. Suess, F., Rabovsky, M., & Rahman, R. A. (2015). Perceiving emotions in neutral facs: expression processing is biased by affective person knowledge. Social Cognitive and Affective Neuroscience, 10(4), 531-536.
48. Theurel, A., Witt, A., Malsert, J., Lejeune, F., Fiorentini, C., Barisnikov, K., & Gentaz, E. (2016). The integration of visual context information in facial emotion recognition in 5-to 15-year-olds. Journal of Experimental Child Psychology, 150, 252-271.
49. Van Boxtel, J. J. A., & Lu, H. (2013). A biological motion toolbox for reading, displaying, and manipulating motion capture data in research settings. Journal of Vision, 13, 7.
50. Van den Stock, J., & de Gelder, B. (2014). Face identity matching is influenced by emotions conveyed by face and body. Frontiers in Human Neuroscience, 8, 53.
51. Van den Stock, J., Righart, R., & de Gelder, B.(2007). Body expressions influence recognition of emotions in the face and voice. Emotion, 7(3), 487.
52. Wieser, M. J., & Brosch, T. (2012). Faces in context: a review and systematization of contextual influences on affective face processing. Frontiers in Psychology, 3, 471.
53. Wieser, M. J., Gerdes, A. B., Büngel, I., Schwarz, K. A., Mühlberger, A., & Pauli, P. (2014). Not so harmless anymore: how context impacts the perception and electrocortical processing of neutral faces. NeuroImage, 92, 74-82.
54. Zhang, M., Fu, Q., Chen, Y. H., & Fu, X. (2014). Emotional context influences micro-expression recognition. PLOS One, 9(4), e95018.
55. Zhang, M., Liu, T., Jin, Y., He, W., Huang, Y., & Luo, W. (2019). The asynchronous influence of facial expressions on bodily expressions. Acta Psychologica, 200, 102941.