0
$\begingroup$

I have a large document and I may need to introduce a large part of it to my llm for insight generation I know that that text can be chunked into parts and with the right prompt I can get what I want with the langchain memory feature but how long can my model remember past conversations?

$\endgroup$
0

1 Answer 1

2
$\begingroup$

Current LLMs don't have memory. You have to provide all the information at the prompt. See this answer.

The LangChain memory allows the model to "remember" by storing interactions in a database. At every new interaction, the conversation is retrieved from the database and written in the new prompt. However, the context window limit of the model still applies. Therefore, the maximum amount of information about past interactions your model can handle is constrained by that context size, which is specific for each model.

$\endgroup$

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service and acknowledge you have read our privacy policy.

Not the answer you're looking for? Browse other questions tagged or ask your own question.