CMSA New Technologies in Mathematics Seminar: The TinyStories Dataset: How Small Can Language Models Be And Still Speak Coherent English?
SEMINARS, CMSA EVENTS
September 20, 2023 - September 27, 2023 2:00 pmWhile generative language models exhibit powerful capabilities at large scale, when either the model or the number of training steps is too small, they struggle to produce coherent and fluent...
Read more