Meta researchers believe that self-supervised learning is a necessary prerequisite for AI systems that can build “world models” and can therefore begin to gain human-like faculties such as reason, common sense, and the ability to transfer skills and knowledge from one context to another.
In the quest for human-level intelligent AI, Meta is betting on self-supervised learning.