Ai will crash if reached context size

[bmahabirbu]

After playing with the AI for a while it will crash after exceeding the context size. Should we increase the context size so this doesn't happen to the end user?

context size exceeded
llama_decode: failed to decode, ret = 1
failed to decode
failed to generate response
brian@DESKTOP-SB69448:~/ramalama$

[ericcurtin]

This is something that needs to be resolved in llama.cpp rather than RamaLama

[dylanmtaylor]

I'm also hitting this issue a bunch

[ericcurtin]

You can manually change it via "-c", but any kind of automatic change of context size changing would have to go to llama.cpp