5 min
What it remembers
Learn what a context window is and what happens to what you type.
By the end of this lesson you can
- Explain how a chatbot remembers earlier messages in a chat
- Decide what's safe to type into a chatbot
From earlier lessons
Why does a chatbot sometimes make up facts?
Pick one answer.
Message 1: "My dog is called Biscuit." Message 20: "What should I name Biscuit's new toy?" It remembers. New chat, memory feature turned off: "What's my dog's name?" No idea. Same model, same day. What changed?
Take a guess
How does it remember Biscuit within one chat?
No pressure. Guess now, and the lesson will show you if you were right.

so it's not remembering, it's rereading the whole chat every time??
yep. every time you hit send, the app hands the model the conversation so far plus your new message
the model doesn't keep anything between replies?
nope. the chat text it's given is all it has to go on
what if the chat gets super long
there's a limit on how much it can read at once, the context window, measured in tokens. past that, the app drops or shortens older parts
and the memory feature some apps have?
the app saves notes about you, or looks through past chats, and adds what's relevant to new chats. still not the model learning

One more thing that does matter: what you type goes to the company running the chatbot. Depending on the app and your settings, chats may be stored, reviewed or used to train future models. Check the app's data settings, and don't paste passwords, ID numbers or anything you wouldn't want saved.
Predict, then reveal
Plot twist time. Everyone assumes that chatting with it all day trains it to know you. Does it?

You chat with a chatbot for an hour. What happens to the model itself?
Pick one answer.
In a very long chat, it forgets something you said at the start. Why?
Pick one answer.
Match
Match each thing to what it really is.
Pick an item on the left, then its match on the right.
FlashcardsIndex cardsFlashcards ⚡
Card 1 of 4Worth keeping
- The app resends the conversation so far with every message. The model itself doesn't change.
- Very long chats can outgrow the context window, and the oldest parts drop out.
- Memory features save notes or search past chats. Still not the model learning.
- What you type goes to the company running it, so keep passwords and ID numbers out.