CMSA New Technologies in Mathematics: A Mathematical Exploration of Why Language Models Help Solve Downstream Tasks
CMSA EVENTS
February 10, 2021 3:00 pmAutoregressive language models pretrained on large corpora have been successful at solving downstream tasks, even with zero-shot usage. However, there is little theoretical justification for their success. This paper considers...
Read more