ZooBuilder: 3D Animation Generation from Videos for Quadrupeds
Event Type
Key Events
Registration Categories
TimeSunday, 13 December 20209:00 - 10:00 SGT
LocationMain Room
DescriptionWith the objective of automating the creation of animations for wildlife, this project from Ubisoft China introduces a novel strategy for generating synthetic training data for 2D and 3D pose estimation of animals using keyframe animations. The machine learning models trained with this synthetic data are integrated into an end-to-end pipeline called ZooBuilder, that takes a video input of an animal in the wild and produces the corresponding 3D animation. With this approach, we produce motion capture-like data from videos that can be used to accelerate the workflow of animators.