视觉与多模态方法论的框架与应用:以视频内容分析为例-清华大学教育研究

文章信息/Info

Title:: Frameworks and Applications of Visual and Multimodal Methodologies: An Example of Multimodal Video Content Analysis

Author(s):: LUO Wen-wei¹; ² GAO Min-qi¹; ² HE Hui-hua¹; ²; 1.Institute of Early Childhood Education, Shanghai Normal University; 2.Lab for Educational Big Data and Policymaking, Ministry of Education

Keywords:: visual and multimodal; video content analysis; methodology; analytical frameworks

摘要:: 视觉与多模态是当代信息传播的重要特征之一,正逐渐成为教育科学研究者探索和分析教育现象的重点。本文解析了视觉与多模态方法论的核心概念,阐明如何通过社会符号学的理论框架理解多模态现象。详细介绍了视觉与多模态方法论的分析框架,探讨其在文本、对象、事件和空间等不同层面的应用。以视频内容分析为例,探讨视觉与多模态方法论的具体应用。深入分析视频从记录到数据处理,再到研究结果生成的全过程,并讨论这一过程中信效度的挑战及应对策略。最后,文章强调了视觉与多模态方法论在应对复杂教育现象和满足新兴研究需求中的适应性与创新性,展现了其在教育研究中的广阔发展性。

Abstract:: Vision and multimodality are key features of contemporary information dissemination and are increasingly becoming a focus for educational researchers exploring and analyzing educational phenomena. This article begins by examining the core concepts of visual and multimodal methodologies, illustrating how multimodal phenomena can be understood through the theoretical framework of social semiotics. It then introduces the analytical frameworks of visual and multimodal methodologies, exploring their applications across various dimensions, including texts, objects, events, and spaces. Using video content analysis as an example, the article delves into the practical applications of these methodologies, providing an in-depth exploration of the entire process, from video recording to data processing and the generation of research outcomes. Additionally, it addresses the challenges of reliability and validity inherent in this process and discusses strategies to overcome them. Finally, the article highlights the adaptability and innovativeness of visual and multimodal methodologies in addressing complex educational phenomena and meeting emerging research demands, showcasing their vast potential for development in educational research.