From the course: Agentic AI: A Framework for Planning and Execution

Unlock this course with a free trial

Join today to access over 24,600 courses taught by industry experts.

What are memory and context management?

What are memory and context management?

- Two important features of an LLM or agentic system that you're going to hear a lot about are memory and context. And sometimes this is referred to as a context window. I do think it's important to understand what these are. So let's take a look at them in this video. I'll start with the context window. Think of it like the AI's working memory. It's the text that the AI can see at any given moment. I like to think of it as having a conversation with a person who only comes into existence at the moment the conversation begins. While they have a general understanding of information and content, the only stuff they know about this conversation is what you've discussed with them. And a limitation that after a certain amount of things you speak about, they'll forget about what came before. It's almost like working with a person who only remembers what you've spoken about over the last 10 or 15 minutes. And that's what a context window is in AI. Models are limited in how much they can…

Contents