When you return to school after summer break, it may feel like you
forgot everything you learned the year before, as Futurism reports.
But if you learned like
an AI system does, you actually would have — as you sat down for your
first day of class, your brain would take that as a cue to wipe the
slate clean and start from scratch.
AI systems’ tendency to forget the things it previously learned upon taking on new information is called catastrophic forgetting.
That’s a big problem. See, cutting-edge algorithms learn, so to
speak, after analyzing countless examples of what they’re expected to
do. A facial recognition AI system, for instance, will analyze thousands
of photos of people’s faces, likely photos that have been manually
annotated, so that it will be able to detect a face when it pops up in a
video feed. But because these AI systems don’t actually comprehend the
underlying logic of what they do, teaching them to do anything else,
even if it’s pretty similar — like, say, recognizing specific emotions — means training them all over again from scratch. Once an algorithm is trained, it’s done, we can’t update it anymore...
In fact, a number of AI experts who attended The Joint Multi-Conference on Human-Level Artificial Intelligence last
week in Prague said, in private interviews with Futurism or during
panels and presentations, that the problem of catastrophic forgetting is
one of the top reasons they don’t expect to see AGI or human-level AI
anytime soon.
But Irina Higgins,
a senior research scientist at Google DeepMind, used her presentation
during the conference to announce that her team had begun to crack the
code.
Read more...
Source: Futurism