- Published on
Researchers from Shanghai AI Lab and Stanford University have presented an approach that enables the extraction of camera trajectory and character motion from filmed content for replication in new 2D or 3D content.
The method enables the preservation of complex camera movements and character motion from the original shot and simulates new scenes with different characters, lighting, or environments.
The researchers have demonstrated the technology through a series of video examples showcasing 2D and 3D cinematic transfers of filmed content ranging from Hollywood movies to animated features, with accurate preservation of camera movements and character motions.
The team has made their code and datasets publicly available.