More broadly would like to be able to create draft video from a short description of the processand goal of the video This might be useful for advertising or marketing work to create a mockup, then further refine it.
New Algorithm Can Create Movies From Just a Few Snippets of Text
In CACM
Researchers at Katholieke University Leuven in Belgium have developed an algorithm that creates videos from text snippets.
The first stage of the process involves a "generator" neural network using text to produce a blurry image of the background with an unfocused blob where the main action occurs. The second stage derives a video from both this "gist" and the text, producing a short video.
A second network functions as a "discriminator" during training by watching the generated video alongside a real video of the action described in the text, and is taught to pick the real one. This network's critical ability improves over time, with its feedback setting a higher standard for the generator network.
The team trained the algorithm on 10 types of scenes, and a simple classification algorithm correctly guessed the intended action among six choices .... "
Subscribe to:
Post Comments (Atom)
No comments:
Post a Comment