Bailando: 3D dance generation via Actor-Critic GPT with Choreographic Memory
Code for CVPR 2022 (oral) paper “Bailando: 3D dance generation via Actor-Critic GPT with Choreographic Memory”
[Paper] | [Project Page] | [Video Demo]
Driving 3D characters to dance following a piece of music is highly challenging due to the spatial constraints applied to poses by choreography norms. In addition, the generated dance sequence also needs to maintain temporal coherency with different music genres. To tackle these challenges, we propose a novel music-to-dance framework, Bailando, with two powerful components: 1) a choreographic memory that learns to summarize meaningful dancing units from 3D pose sequence to a quantized codebook, 2) an actor-critic Generative Pre-trained