数字人文研究 ›› 2024, Vol. 4 ›› Issue (1): 74-85.

• 攻玉以石 • 上一篇    下一篇

沉浸式数字叙事中的视听联觉研究与构建——以宋庆龄与中国福利会相关档案开发实践为例

  

  1. 王美贤,中山大学信息管理学院硕士研究生;程宸,上海音乐学院音乐工程系本科生;陈涛,中山大学信息管理学院副教授;王心雨,中山大学信息管理学院硕士研究生;林纪元,中山大学计算机学院硕士研究生。
  • 出版日期:2024-03-28 发布日期:2024-12-16
  • 基金资助:
    国家社科基金一般项目“文化遗产多模态数据知识表示模型及智慧系统构建研究”(23BTQ088)阶段性研究成果

Sound Design in the Construction of Immersive Digital Narratives——Taking Song Qingling and China Welfare Institute's Related Archive as an Example

  • Online:2024-03-28 Published:2024-12-16

摘要:

在档案资源开发过程中应用沉浸式数字叙事,可使档案记忆立体化、具象化,实现从物理空间向记忆空间的演变。研究对数字人文视域下的档案资源开发利用实践现状进行回顾,分析目前针对档案资源所进行的沉浸式数字叙事构建的局限,论证基于精细声音设计的沉浸式叙事路径在档案资源开发利用中的可行性。并以宋庆龄与中国福利会的相关档案为对象,探索了基于VR、模拟人声、数字人等多种数字技术、强调声音设计的沉浸式叙事方法。当中虚拟展厅与全景色、无损音效的结合,使档案资源从平面延伸到丰满的立体空间,从而验证了音乐和图像多模态交叉交融的可能性,针对文本所进行的视听联觉研究与构建的尝试,拓展了数字人文研究新领域。

关键词: 沉浸式叙事 , 数字叙事 , 档案开发 , 数字人文 , 视听联觉

Abstract:

Immersive digital narrative of archival resources accelerates the three-dimensionalization and concreteness of archival memory, realizing the evolution from physical space to memory space. This study reviews the current status of the development and utilization of archival resources from the perspective of digital humanities, analyzes the limitations of the current construction of immersive digital narratives of archival resources, and demonstrates the feasibility of immersive narrative paths based on sophisticated sound design in the development and utilization of archival resources. Taking the relevant archives of Soong Ching Ling and the China Welfare Institute as an example, we synesthetically construct an audio-visual archival immersive narrative method based on multiple state-of-the-art technologies, such as VR, Meta Human and Mockingbird. It verifies the possibility of multi-modal cross-fertilization of music and image resources. By combining the virtual exhibition hall with panoramic views and lossless sound effects, archival resources and image resources can be extended from a flat space to an infinite three-dimensional space.

Key words: immersive storytelling  digital storytelling  archive development , digital humanities

中图分类号: