Considering this ......
Simple Mathematical Trick Could Slash AI Development Time in Half
In New Scientist, Matthew Sparkes, March 10, 2022
Researchers at the U.K.'s University of Oxford have cut the two-stage back-propagation process used to train artificial intelligence (AI) models to one stage, saving time, energy, and computing power. Back-propagation involves passing data from one side of the neural network to the other through every link in the chain of artificial neurons, then working backwards to the beginning to calculate the gradient. The new method calculates an approximation of the gradient during the first pass that is close enough to be effective. Numerous tests comparing their approach with back-propagation showed the AI's performance was comparable, and that the new approach potentially could halve the amount of time needed to train AI models. .... '
No comments:
Post a Comment