Character is Destiny: Can Large Language Models Simulate Persona-Driven Decisions in Role-Playing?
arxiv(2024)
摘要
Can Large Language Models substitute humans in making important decisions?
Recent research has unveiled the potential of LLMs to role-play assigned
personas, mimicking their knowledge and linguistic habits. However, imitative
decision-making requires a more nuanced understanding of personas. In this
paper, we benchmark the ability of LLMs in persona-driven decision-making.
Specifically, we investigate whether LLMs can predict characters' decisions
provided with the preceding stories in high-quality novels. Leveraging
character analyses written by literary experts, we construct a dataset
LIFECHOICE comprising 1,401 character decision points from 395 books. Then, we
conduct comprehensive experiments on LIFECHOICE, with various LLMs and methods
for LLM role-playing. The results demonstrate that state-of-the-art LLMs
exhibit promising capabilities in this task, yet there is substantial room for
improvement. Hence, we further propose the CHARMAP method, which achieves a
6.01
datasets and code publicly available.
更多查看译文
AI 理解论文
溯源树
样例
生成溯源树,研究论文发展脉络
Chat Paper
正在生成论文摘要