/* ---- Google Analytics Code Below */

Sunday, March 04, 2018

Creating Video from Text Snippets

More broadly would like to be able to create draft video from a short description of the processand goal of the video  This might be useful for advertising or marketing work to create a mockup, then further refine it.

New Algorithm Can Create Movies From Just a Few Snippets of Text
In CACM

Researchers at Katholieke University Leuven in Belgium have developed an algorithm that creates videos from text snippets.

The first stage of the process involves a "generator" neural network using text to produce a blurry image of the background with an unfocused blob where the main action occurs. The second stage derives a video from both this "gist" and the text, producing a short video.

A second network functions as a "discriminator" during training by watching the generated video alongside a real video of the action described in the text, and is taught to pick the real one. This network's critical ability improves over time, with its feedback setting a higher standard for the generator network.

The team trained the algorithm on 10 types of scenes, and a simple classification algorithm correctly guessed the intended action among six choices  .... "

No comments: