Molecumentary: Scalable Narrated Documentaries Using Molecular Visualization
arxiv(2020)
摘要
We present a method for producing documentary-style content using real-time
scientific visualization. We produce molecumentaries, i.e., molecular
documentaries featuring structural models from molecular biology. We employ
scalable methods instead of the rigid traditional production pipeline. Our
method is motivated by the rapid evolution of interactive scientific
visualization, which shows great potential in science dissemination. Without
some form of explanation or guidance, however, novices and lay-persons often
find it difficult to gain insights from the visualization itself. We integrate
such knowledge using the verbal channel and provide it along an engaging visual
presentation. To realize the synthesis of a molecumentary, we provide technical
solutions along two major production steps: 1) preparing a story structure and
2) turning the story into a concrete narrative. In the first step, information
about the model from heterogeneous sources is compiled into a story graph.
Local knowledge is combined with remote sources to complete the story graph and
enrich the final result. In the second step, a narrative, i.e., story elements
presented in sequence, is synthesized using the story graph. We present a
method for traversing the story graph and generating a virtual tour, using
automated camera and visualization transitions. Texts written by domain experts
are turned into verbal representations using text-to-speech functionality and
provided as a commentary. Using the described framework we synthesize automatic
fly-throughs with descriptions that mimic a manually authored documentary.
Furthermore, we demonstrate a second scenario: guiding the documentary
narrative by a textual input.
更多查看译文
AI 理解论文
溯源树
样例
生成溯源树,研究论文发展脉络
Chat Paper
正在生成论文摘要