DeepMind Patent Shrinks Model Size Without Compromise

DeepMind Patent Shrinks Model Size Without Compromise

AI training data isn’t “one size fits all.” DeepMind wants to figure out exactly what’s right for each model. Google’s AI subsidiary filed a patent application for “determining training data sizes for training smaller neural networks using shrinking estimates.” To put it simply, the tech aims to figure out how much training data a smaller model needs in order to perform on par with a larger one.  DeepMind’s system does this with what the filing …