Creating Infinitely Generated Text Adventures with DL LMs

1 · Shane Mulligan · Dec. 5, 2019, 4 p.m.
Original article AI Dungeon 2: Creating Infinitely Generated Text Adventures with Deep Learning Language Models - Perception, Control, Cognition For each action you type the model is fed the context sentence as well as the past N action- result pairs in its memory to generate the result. We found N=8 to be a good amount of memory to feed the model. Other times the model has difficulty keeping track of who is who, especially in dialogue....