Prompt Engineering and Human-AI Collaboration Strategies with Large Language Models for the Analysis of Oral History Texts
Digital Humanities Research ›› 2025, Vol. 5 ›› Issue (3): 41-60.
Previous Articles Next Articles
Online:
Published:
Abstract:
Historical inquiry has long relied on official archives and elite writings, often marginalizing individual memories. Oral history offers a distinctive window onto overlooked social life and personal recollection; however, its non-standardized, highly context-dependent, and multi-layered textual characteristics pose challenges for structured information extraction and systematic analysis. Using oral history texts concerning ration coupons as a case study, this research explores and validates a human-AI collaboration methodology that “disciplines” large language models(LLMs) into scholarly assistants capable of strict instruction following. We design a progressive four-stage experiment—basic instructions, rule-based instructions, programmatic constraints, and few-shot learning—to iteratively optimize how to leverage LLMs, semantic understanding and instruction-following capabilities for efficient and precise structured information extraction. The findings show that the maturity of prompt engineering substantially affects output quality, and that carefully designed programmatic constraints can markedly improve the accuracy of LLM-based analyses. We further compare LLMs optimized for different tasks within a common technical framework, documenting variation in logical adherence, confirming the value of few-shot learning while identifying its point of diminishing returns, and revealing inherent limitations of LLMs in tasks requiring exact computation. The study distills an LLM “disciplining” framework for oral history text analysis that incorporates core strategies such as rule-based transduction/normalization and prudent task allocation between humans and models. The framework delivers efficient and accurate structured analysis of oral history texts and offers a reproducible, scalable intelligent research paradigm for digital humanities.
Key words: Large Language Models(LLMs) , oral history texts , information extraction , prompts , prompt engineering , digital humanities , DeepSeek , ration coupons
CLC Number:
G250.7
Ma Linqing, ShiJiaqi, Cao Xingyu.
Prompt Engineering and Human-AI Collaboration Strategies with Large Language Models for the Analysis of Oral History Texts [J]. Digital Humanities Research, 2025, 5(3): 41-60.
0 / / Recommend
Add to citation manager EndNote|Ris|BibTeX
URL: http://dhr.ruc.edu.cn/EN/
http://dhr.ruc.edu.cn/EN/Y2025/V5/I3/41
Summary of the International Symposium on “Cultural Diversity and Digital Humanities”
Digital Humanities and Digital Publishing: An Analytical Framework and Integration Mechanisms
From Manual to AI: Exploring History and Humanities in the Age of Artificial Intelligence-Workshop Summary
"Integration of Arts and Sciences: Digital Humanities in the Age of AGI”—A Review of the 6th China Digital Humanities Annual Conference (CDH2024)
Humanistic AI: Towards a New Field of Interdisciplinary Expertise and Research
From Still to Moving Images and Vice Versa: Analysing Technological Cycles and the Use of AI to Study Cinema History
Study on the Spatial and Temporal Distribution Structure of Evidence Chain in the Testimony Collection of Former Japanese Bacteriological Fighters from the Perspective of Knowledge Reorganization
The Scale of Time: Rereading and Rethinking A Companion to Digital Humanities
Quantitative Literary Research: Concepts, Traditions, and Paradigms
Digital Humanities in the Era of Digital Reproducibility Towards a Fairest and Post-computational Framework