This talk will be held in a hybrid format, both in person at AIP Open Space of RIKEN AIP (Nihonbashi office) and online by Zoom. AIP Open Space: *only available to AIP researchers.
DATE & TIME
Aug 19, 2024: 4:00 pm - 5:00 pm (JST)
TITLE
Memoria: Resolving Fateful Forgetting Problem through Human-Inspired Memory Architecture
SPEAKER
Dr. JinYeong Bak (Sungkyunkwan University)
ABSTRACT
Making neural networks remember over the long term has been a longstanding issue. Although several external memory techniques have been introduced, most focus on retaining recent information in the short term. Regardless of its importance, information tends to be fatefully forgotten over time. In this talk, I will present Memoria, a memory system for artificial neural networks, drawing inspiration from humans and applying various neuroscientific and psychological theories. The experimental results prove the effectiveness of Memoria in the diverse tasks of sorting, language modeling, and classification, surpassing conventional techniques. Engram analysis reveals that Memoria exhibits the primacy, recency, and temporal contiguity effects which are characteristics of human memory. I will also introduce recent research work in our lab that is overcoming the offsite-tuning problem.
BIOGRAPHY
JinYeong Bak is an assistant professor in the Colleague of Computing at Sungkyunkwan University. His research interests include analyzing human conversational behaviors and building machine learning models from the insights of the analysis. He worked at Microsoft Research Asia as a research intern and United Nations Global Pulse Lab Jakarta as a junior data scientist. He holds a Ph.D. and M.S. from the KAIST and a B.S. from Sungkyunkwan University. His research has been published in ACL, EMNLP, NAACL, ICML, CHI, and WWW. His personal homepage: https://nosyu.kr and lab homepage: https://hli.skku.edu
