🎯 Core Goals
- Understand that meaning (and distance) changes based on context.
- See how the same word can be “close” to different words in different situations.
- Learn why LLMs need “attention” to figure out which context applies.
The same word can mean different things depending on context. “Bank” is close to “river” in one sentence, but close to “money” in another.
👁️ Visuals & Interactives
🌊River
🚣Canoe
🏞️Bank
In this context, "bank" is pulled closer to Nature.
📝 Key Concepts
- Multiple Meanings: Words are ambiguous without surrounding text. “Apple” could be a fruit or a tech company.
- Shifting Distance: Surrounding words literally shift the “distance” of ambiguous words toward the correct meaning in the LLM’s “brain”.
What other words have multiple meanings? How does your brain know which meaning is intended? (Hint: You look at context - LLMs do the same thing!)