https://towardsdatascience.com/gato-the-latest-from-deepmind-towards-true-ai-1ac06e1d18cd
Moreover, and impressively, Gato is not even close to the largest neural networks we have seen! With “only” 1.2 billion weights, it’s comparable to OpenAI’s GPT-2 language model, i.e. over 2 orders of magnitude smaller than GPT-3 (with 175 billion weights) and other modern language processing networks.
Just 3 years ago, I absolutely wouldn’t have said any of this, especially not that AI could someday be real. Now, I’m not so sure, and the community sentiment is similar: they now approximate that we could have machine-based systems with the same general-purpose reasoning and problem-solving tasks of humans by 2030. The projected year was around 2200 just 2 years ago, and has been slowly decreasing
