Loading Events

Language modeling for Mathematical Reasoning

CMSA EVENTS: CMSA NEW TECHNOLOGIES IN MATHEMATICS

When: January 20, 2021
3:00 pm - 4:00 pm
Where: Virtually
Speaker: Christian Szegedy - Google Research

In this talk, I will summarize the current state of the art of transformer based language models and give examples on non-trivial reasoning task language models can solve in higher order logic reasoning. I will also discuss how to inject injective bias into transformer networks via pretraining on very simple synthetic tasks and representing graph structures for transformer networks.

Zoom: https://harvard.zoom.us/j/99018808011?pwd=SjRlbWFwVms5YVcwWURVN3R3S2tCUT09