Current Issue

The Korean Journal of Cognitve & Biological Psychology - Vol. 34 , No. 2

[ Original Article ]
The Korean Journal of Cognitve & Biological Psychology - Vol. 34, No. 2, pp. 135-148
Abbreviation: KCBPA
ISSN: 1226-9654 (Print)
Print publication date 30 Apr 2022
Received 01 Dec 2021 Revised 18 Apr 2022 Accepted 19 Apr 2022
DOI: https://doi.org/10.22172/cogbio.2022.34.2.008

얼굴표정 정서판단에 미치는 정서단어와 정서적 얼굴의 차별적 맥락조절효과
양현보1 ; 이정수1 ; 이동훈1,
1부산대학교 심리학과

Differential Context Modulation Effects of Emotion Words and Emotional Faces in Facial Emotion Judgment
Hyeonbo Yang1 ; Jeongsoo Lee1 ; Donghoon Lee1,
1Department of Psychology, Pusan National University
Correspondence to : 이동훈, 부산대학교 심리학과, (46241) 부산광역시 금정구 부산대학로 63번길 2, E-mail: dhlee@pusan.ac.kr


ⓒ The Korean Society for Cognitive and Biological Psychology
Funding Information ▼

초록

한 사람의 얼굴표정 이전에 제시되는 정서단어나 다른 사람의 얼굴표정은 그 사람의 정서를 파악하는 맥락정보로 사용될 수 있다. 본 연구는 정신물리학적 방법을 사용하여 사전에 제시한 정서단어와 얼굴표정이 표적 얼굴표정의 정서판단에 미치는 맥락조절효과를 비교하였다. 실험 참가자들은 맥락으로 정서단어(“기쁨”, “분노”) 또는 그에 대응하는 얼굴표정(전형적 기쁨 표정, 분노 표정)을 본 후, 뒤따르는 분노-기쁨 6단계 표적 얼굴표정의 정서범주를 판단하는 2안 강제선택과제(2 AFC; two alternative forced choice task)를 수행하였다. 맥락 제시시간을 달리하여 두 번의 실험을 진행한 결과(실험 1: 200ms, 실험 2: 1500ms), 정서단어 맥락은 제시시간과 상관없이 맥락 정서에 부합하는 방향으로 정서판단 역치를 이동시키는 동화성 맥락조절효과를 유발하였다. 이에 반해 얼굴표정 맥락은 맥락 정서와 반대 방향으로 판단 역치를 이동시키는 대조성 맥락조절효과를 유발하였다. 이때, 기쁨 표정 및 분노 표정의 맥락조절효과는 제시시간의 영향을 받았다. 맥락 제시시간이 짧은 경우에는(실험 1: 200ms) 기쁨 표정의 대조성 맥락조절효과만 관찰된 반면, 맥락 제시시간이 충분히 긴 경우에는(실험 2: 1500ms) 기쁨 표정과 분노 표정의 대조성 맥락조절효과가 모두 관찰되었다. 본 연구 결과는 정서판단 맥락으로서 정서단어는 정서개념을 활성화하는 반면 얼굴표정은 구조적 정보를 활성화함에 따라 뒤따르는 얼굴표정 정서지각에 상이한 맥락효과를 초래할 수 있음을 시사한다.

Abstract

Emotion words or emotional faces presented before a person's facial expressions can be used as contextual information to identify that person's emotion. Using a psychophysical method, we compared the context modulation effects of emotional words and faces on emotion judgment of the target faces. We presented emotion words (“happiness”, “anger”) or emotional faces (typical happy and angry face) as context, and then participants performed a two alternative forced choice task (2-AFC) to determine the emotion of the target face of which emotion was gradually morphed from happiness to anger. As a result of two experiments with different context presentation times (Experiment 1: 200 ms, Experiment 2: 1500 ms), the emotional word context induced an assimilation contextual modulation effect that shifts the emotion judgment threshold in a direction consistent with the context emotion regardless of the presentation time. On the other hand, the facial expression context induced a contrasting context-regulating effect that shifted the judgment threshold in the opposite direction to the contextual emotion. At this time, the context control modulation effect of joyhappy expression and anger expression was affected by the presentation time. When the context duration was short (200ms), only contrastive effect of happy face was observed, whereas when the context duration was long enough (1500ms), both contrastive effect of the happy and angry face were observed. The results of this study imply that emotional words as context activate emotional concepts, whereas facial expressions activate structural information, which can lead to different contextual effects on the emotional perception of subsequent facial expressions.


Keywords: Context modulation effect, emotion words, emotional faces, psychophysics, language-as-context hypothesis
키워드: 맥락조절효과, 얼굴표정, 정서단어, 정신물리학, 언어맥락가설

Acknowledgments

본 논문은 정부(교육부)의 재원으로 한국연구재단의 지원을 받아 연구되었음(NRF-2015S1A5A2A03049587).


References
1. Aviezer, H., Ensenberg, N., & Hassin, R. R. (2017). The inherently contextualized nature of facial emotion perception. Current Opinion in Psychology, 17, 47-54.
2. Barrett, L. F. (2009). Variety is the spice of life: A psychological construction approach to understanding variability in emotion. Cognition and Emotion, 23(7), 1284-1306.
3. Barrett, L. F. (2017a). How emotions are made: The secret life of the brain. New York, NY:  Houghton Mifflin Harcourt.
4. Barrett, L. F. (2017b). The theory of constructed emotion: An active inference account of interoception and categorization. Social Cognitive and Affective Neuroscience, 12(1), 1-23.
5. Barrett, L. F., Lindquist, K. A., & Gendron, M. (2007). Language as context for the perception of emotion. Trends in Cognitive Sciences, 11(8), 327-332.
6. Barrett, L. F., Mesquita, B., & Gendron, M. (2011). Context in emotion perception. Current Directions in Psychological Science, 20(5), 286-290.
7. Benda, J. (2021). Neural adaptation. Current Biology, 31(3), R110-R116.
8. Brown, S. B., van Steenbergen, H., Band, G. P., de Rover, M., & Nieuwenhuis, S. (2012). Functional significance of the emotion-related late positive potential. Frontiers in Human Neuroscience, 6, 33.
9. Carroll, J. M., & Russell, J. A. (1996). Do facial expressions signal specific emotions? judging emotion from the face in context. Journal of Personality and Social Psychology, 70(2), 205-218.
10. Carroll, N. C., & Young, A. W. (2005). Priming of emotion recognition. The Quarterly Journal of Experimental Psychology Section A, 58(7), 1173-1197.
11. D'Argembeau, A., & Van der Linden, M. (2007). Facial expressions of emotion influence memory for facial identity in an automatic way. Emotion, 7(3), 507-515.
12. Du, S., & Martinez, A. M. (2013). Wait, are you sad or angry? large exposure time differences required for the categorization of facial expressions of emotion. Journal of Vision, 13(4), 13.
13. Eimer, M. (2011). The face-sensitivity of the n170 component. Frontiers in Human Neuroscience, 5, 119.
14. Ekman, P. (1992). An argument for basic emotions. Cognition & Emotion, 6(3-4), 169-200.
15. Fugate, J. M., O'Hare, A. J., & Emmanuel, W. S. (2018). Emotion words: Facing change. Journal of Experimental Social Psychology, 79, 264-274.
16. Gendron, M., Lindquist, K. A., Barsalou, L., & Barrett, L. F. (2012). Emotion words shape emotion percepts. Emotion, 12(2), 314-325.
17. Gray, K. L., Barber, L., Murphy, J., & Cook, R. (2017). Social interaction contexts bias the perceived expressions of interactants. Emotion, 17(4), 567-571.
18. Han, S., Hu, J., Li, W., Zhao, S., Chen, M., Xu, P., & Luo, Y. (2021). From structure to concepts: The two stages of facial expression recognition. Neuropsychologia, 150, 107700.
19. Hietanen, J. K., & Astikainen, P. (2013). N170 response to facial expressions is modulated by the affective congruency between the emotional expression and preceding affective picture. Biological Psychology, 92(2), 114-124.
20. Hsu, S., & Wu, Z. (2020). The roles of preceding stimuli and preceding responses on assimilative and contrastive sequential effects during facial expression perception. Cognition and Emotion, 34(5), 890-905.
21. Hsu, S., & Yang, L. (2013). Sequential effects in facial expression categorization. Emotion, 13(3), 573-586.
22. Koji, S., & Fernandes, M. (2010). Does it matter where we meet? the role of emotional context in evaluative first impressions. Canadian Journal of Experimental Psychology/Revue Canadienne De Psychologie Expérimentale, 64(2), 107-116.
23. Korolkova, O. A. (2018). Adaptation or assimilation? sequential effects in the perception of dynamic and static facial expressions of emotion. The Russian Journal of Cognitive Science, 5(2), 18-34.
24. Lee, T., Choi, J., & Cho, Y. S. (2012). Context modulation of facial emotion perception differed by individual difference. PLOS One, 7(3), e32987.
25. Lee, S. Y., Kang, J. I., Lee, E., Namkoong, K., & An, S. K. (2011). Differential priming effect for subliminal fear and disgust facial expressions. Attention, Perception, & Psychophysics, 73(2), 473-481.
26. Lee, J. S., Yang, H. B., & Lee, D. H (2019). Context modulation effect by affective words influencing on the judgment of facial emotion. Korean Journal of the Science of Emotion & Sensibility, 22(2), 37-48.
27. Leppänen, J. M., & Hietanen, J. K. (2004). Positive facial expressions are recognized faster than negative facial expressions, but why? Psychological Research, 69(1), 22-29.
28. Li, W., Zinbarg, R. E., Boehm, S. G., & Paller, K. A. (2008). Neural and behavioral evidence for affective priming from unconsciously perceived emotional facial expressions and the influence of trait anxiety. Journal of Cognitive Neuroscience, 20(1), 95-107.
29. Lindquist, K. A., Barrett, L. F., Bliss-Moreau, E., & Russell, J. A. (2006). Language and the perception of emotion. Emotion, 6(1), 125-138.
30. Lu, Y., Zhang, W. N., Hu, W., & Luo, Y. J. (2011). Understanding the subliminal affective priming effect of facial stimuli: an ERP study. Neuroscience Letters, 502(3), 182-185.
31. Marian, D. E., & Shimamura, A. P. (2013). Contextual influences on dynamic facial expressions. The American Journal of Psychology, 126(1), 53-66.
32. Masuda, T., Ellsworth, P. C., Mesquita, B., Leu, J., Tanida, S., & Van de Veerdonk, E. (2008). Placing the face in context: Cultural differences in the perception of facial emotion. Journal of Personality and Social Psychology, 94(3), 365-381.
33. Masuda, T., Wang, H., Ishii, K., & Ito, K. (2012). Do surrounding figures' emotions affect judgment of the target figure's emotion? Comparing the eye-movement patterns of European Canadians, Asian Canadians, Asian international students, and Japanese. Frontiers in Integrative Neuroscience, 6, 72.
34. Meeren, H. K., van Heijnsbergen, C. C., & de Gelder, B. (2005). Rapid perceptual integration of facial expression and emotional body language. Proceedings of the National Academy of Sciences, 102(45), 16518-16523.
35. Morris, J. S., Frith, C. D., Perrett, D. I., Rowland, D., Young, A. W., Calder, A. J., & Dolan, R. J. (1996). A differential neural response in the human amygdala to fearful and happy facial expressions. Nature, 383(6603), 812-815.
36. Müller, V. I., Habel, U., Derntl, B., Schneider, F., Zilles, K., Turetsky, B. I., & Eickhoff, S. B. (2011). Incongruence effects in crossmodal emotional integration. NeuroImage, 54(3), 2257-2266.
37. Mumenthaler, C., & Sander, D. (2012). Social appraisal influences recognition of emotions. Journal of Personality and Social Psychology, 102(6), 1118-1135.
38. Otten, M., & Banaji, M. R. (2012). Social categories shape the neural representation of emotion: Evidence from a visual face adaptation task. Frontiers in Integrative Neuroscience, 6, 9.
39. Pessoa, L., Japee, S., Sturman, D., & Ungerleider, L. G. (2006). Target visibility and visual awareness modulate amygdala responses to fearful faces. Cerebral Cortex, 16(3), 366-375.
40. Rossion, B., & Jacques, C. (2008). Does physical interstimulus variance account for early electrophysiological face sensitive responses in the human brain? Ten lessons on the N170. Neuroimage, 39(4), 1959-1979.
41. Russell, J. A. (1991). The contempt expression and the relativity thesis. Motivation and Emotion, 15(2), 149-168.
42. Russell, J. A., & Fehr, B. (1987). Relativity in the perception of emotion in facial expressions. Journal of Experimental Psychology: General, 116(3), 223-237.
43. Rutherford, M. D., Chattha, H. M., & Krysko, K. M. (2008). The use of aftereffects in the study of relationships among emotion categories. Journal of Experimental Psychology: Human Perception and Performance, 34(1), 27-40.
44. Sherman, A., Sweeny, T. D., Grabowecky, M., & Suzuki, S. (2012). Laughter exaggerates happy and sad faces depending on visual context. Psychonomic Bulletin & Review, 19(2), 163-169.
45. Tanaka-Matsumi, J., Attivissimo, D., Nelson, S., & D'Urso, T. (1995). Context effects on the judgment of basic emotions in the face. Motivation and Emotion, 19(2), 139-155.
46. Thayer, S. (1980). The effect of expression sequence and expressor identity on judgments of the intensity of facial expression. Journal of Nonverbal Behavior, 5(2), 71-79.
47. Webster, M. A., Kaping, D., Mizokami, Y., & Duhamel, P. (2004). Adaptation to natural facial categories. Nature, 428(6982), 557-561.
48. Webster, M. A., & MacLeod, D. I. (2011). Visual adaptation and face perception. Philosophical Transactions of the Royal Society B: Biological Sciences, 366(1571), 1702-1725.
49. Werheid, K., Alpay, G., Jentzsch, I., & Sommer, W. (2005). Priming emotional facial expressions as evidenced by event-related brain potentials. International journal of psychophysiology, 55(2), 209-219.
50. Wieser, M. J., & Brosch, T. (2012). Faces in context: A review and systematization of contextual influences on affective face processing. Frontiers in Psychology, 3, 471.
51. Yang, H. B., & Lee, D. H. (2018). Influence of emotion labeling on the judgment of emotion category of facial emotion. The Korean Journal of Cognitive and Biological Psychology, 30(2), 203-210.
52. Yik, M., Widen, S. C., & Russell, J. A. (2013). The within-subjects design in the study of facial expressions. Cognition & Emotion, 27(6), 1062-1072.