Radical New Neural Network Design

Less definition of the architecture it seems and training adapts to results.

Radical New Neural Network Design Could Overcome Big Challenges in AI   in Technology Review

By Karen Hao     December 12, 2018

Researchers at the University of Toronto and the Vector Institute in Canada have redesigned neural networks without traditional stacked layers of simple computational nodes that work together to find patterns in data; the new design replaces the layers with calculus equations. The researchers, who dubbed this new design an ordinary differential equations (ODE) solver, said it can model continuous change, and changes certain aspects of training for neural networks. In a traditional neural network, the user has to specify the number of layers at the start of the training, then wait until training is done to find out how accurate the model is. The new method lets the user specify their desired accuracy first, and the network then will find the most efficient way to train itself within that margin of error. ... "