Generative Large Language Models for Human-Like Behavior

This repository includes a working version of the type of model described in Generative Agents: Interactive Simulacra of Human Behavior.

Setup

The models are distributed as notebooks that are easy to run locally, or on Google Colab. We recommend the use of Jupyter Lab if running locally. The notebook(s) should work as-is on Google Colab.

Model

The current model is a simulation of the town of Phandalin from an introductory D&D 5e adventure. This setting is chosen as it is much more free form than the simple scenario described in the original paper.

Limitations

The model, as described in the paper, requires access to a very high quality instruction model such as GPT-3. However, the model also requires many high-context queries to work, making it expensive to run. As such, in this work we use low-parameter, locally runnable models instead.

We expect that with the advent of the next generation of instruction-tuned models, the model in this repo will perform better.

Future Steps

• Summarize agent decisions as emojis.
• Create a family of questions to compress agent contexts better.
• Check if the agent contexts are compressed well with an another layer of prompts.