Expanding Virtual Production Frontiers: AI-Driven Workflows for Enhanced Cinematic Creation

Although virtual production (VP) offers cinematic and immersive storytelling by aligning a high-end camera with multiple LED screens through a central server, the creation of high-quality 3D scenery with real-time interactions remains complex and resource-intensive. This paper explores the potential of expanding cinematic virtual production scenes through three innovative AI-driven approaches: (1) AI-generated 360 degrees panoramas from text prompts to produce immersive backgrounds; (2) Direct text/AI-generated image-to-3D environment conversion using mesh generation; (3) An end-to-end AI pipeline for rapid stylized scene construction. We demonstrate each workflow through real-time avatar-interactive shooting scenarios. Our approach bridges technical and artistic domains and aims to show how these AI-driven workflows could accelerate scene creation, enable novel cinematic experiences, and reveal the future potential of visual content generation.