Benchmark Suite for Machine Learning

Worthwhile direction.

A new benchmark suite for machine learning
MLPerf is a new set of benchmarks compiled by a growing list of industry and academic contributors.     By Ben Lorica in O'Reilly

We are in an empirical era for machine learning, and it’s important to be able to identify tools that enable efficient experimentation with end-to-end machine learning pipelines. Organizations that are using and deploying machine learning are confronted with a plethora of options for training models and model inference, at the edge and on cloud services. To that end,MLPerf, a new set of benchmarks compiled by a growing list of industry and academic contributors,was recently announced at the recent Artificial Intelligence conference in NYC.  .... "  

List of problems include:  Image classification,  Object detection,  Speech to text,  Translation,  Recommendation,  Sentiment Analysis,  Reinforcement Learning ... 

See MLPerf.org