CMSA Math Science Literature Lecture Series
CMSA EVENTS
Speaker:
Harry Shum - Tsinghua University
TITLE: From Deep Learning to Deep Understanding
ABSTRACT: In this talk I will discuss a couple of research directions for robust AI beyond deep neural networks. The first is the need to understand what we are learning, by shifting the focus from targeting effects to understanding causes. The second is the need for a hybrid neural/symbolic approach that leverages both commonsense knowledge and massive amount of data. Specifically, as an example, I will present some latest work at Microsoft Research on building a pre-trained grounded text generator for task-oriented dialog. It is a hybrid architecture that employs a large-scale Transformer-based deep learning model, and symbol manipulation modules such as business databases, knowledge graphs and commonsense rules. Unlike GPT or similar language models learnt from data, it is a multi-turn decision making system which takes user input, updates the belief state, retrieved from the database via symbolic reasoning, and decides how to complete the task with grounded response.
Written articles will accompany each lecture in this series and be available as part of the publication “History and Literature of Mathematical Science.”
For more information, please visit the event page.