Jason Wei
AI Researcher
OpenAI
Presentation Title:
Some intuitions about large language models
Presentation Summary:
An open question these days is why large language models work so well.
In this talk I will discuss six basic intuitions about large language models. These intuitions are a lens to understanding why language models work and how they will continue to improve as we scale them in the future. Many of them are inspired by manually examining data, which is an exercise that I’ve found helpful and would recommend.
About | Jason Wei
Jason Wei is an AI researcher living in San Francisco, currently working at OpenAI. He was previously a research scientist at Google Brain, where he popularized key ideas in large language models such as chain-of-thought prompting, instruction tuning, and emergent phenomena.