👩💻 Join our community of thousands of amazing developers!
Original article AI Dungeon 2: Creating Infinitely Generated Text Adventures with Deep Learning Language Models - Perception, Control, Cognition For each action you type the model is fed the context sentence as well as the past N action- result pairs in its memory to generate the result. We found N=8 to be a good amount of memory to feed the model. Other times the model has difficulty keeping track of who is who, especially in dialogue....
"Language is everywhere. It permeates our thoughts mediates our relations with others, and even creeps into our dreams." -Ronald Wayne Langacker