QlearnAI

5 min

What it remembers

Learn what a context window is and what happens to what you type.

By the end of this lesson you can

  • Explain how a chatbot remembers earlier messages in a chat
  • Decide what's safe to type into a chatbot

From earlier lessons

Why does a chatbot sometimes make up facts?

Pick one answer.

Message 1: "My dog is called Biscuit." Message 20: "What should I name Biscuit's new toy?" It remembers. New chat, memory feature turned off: "What's my dog's name?" No idea. Same model, same day. What changed?

Take a guess

How does it remember Biscuit within one chat?

No pressure. Guess now, and the lesson will show you if you were right.

The chatbot before every single reply: let me just reread our entire conversation real quick Picture: A cartoon robot sitting at a desk scrolling through an extremely long paper scroll that unrolls across the floor and out the door, with tire
Zoe

so it's not remembering, it's rereading the whole chat every time??

Dev

yep. every time you hit send, the app hands the model the conversation so far plus your new message

Zoe

the model doesn't keep anything between replies?

Dev

nope. the chat text it's given is all it has to go on

Zoe

what if the chat gets super long

Dev

there's a limit on how much it can read at once, the context window, measured in tokens. past that, the app drops or shortens older parts

Zoe

and the memory feature some apps have?

Dev

the app saves notes about you, or looks through past chats, and adds what's relevant to new chats. still not the model learning

Chat so long the beginning no longer fits in the context window. The chatbot: Biscuit who? Picture: A cartoon robot reading a very long paper scroll whose top end has been snipped off by giant scissors, with a small drawing of a dog on the

One more thing that does matter: what you type goes to the company running the chatbot. Depending on the app and your settings, chats may be stored, reviewed or used to train future models. Check the app's data settings, and don't paste passwords, ID numbers or anything you wouldn't want saved.

Predict, then reveal

Plot twist time. Everyone assumes that chatting with it all day trains it to know you. Does it?

Me, after a three-hour chat: we've really bonded. The model: same parameters as this morning Picture: A cartoon person happily hugging a robot, while the robot calmly reads a long printed transcript of their conversation with a neutral expres

You chat with a chatbot for an hour. What happens to the model itself?

Pick one answer.

In a very long chat, it forgets something you said at the start. Why?

Pick one answer.

Match

Match each thing to what it really is.

Pick an item on the left, then its match on the right.

FlashcardsIndex cardsFlashcards ⚡

Card 1 of 4

Worth keeping

  1. The app resends the conversation so far with every message. The model itself doesn't change.
  2. Very long chats can outgrow the context window, and the oldest parts drop out.
  3. Memory features save notes or search past chats. Still not the model learning.
  4. What you type goes to the company running it, so keep passwords and ID numbers out.