Karpathy's LLM Wiki

LLM Wiki is an idea that an LLM maintains their own wiki as a base knowledge they have.

Usually, you drop a file to an LLM, LLM generates relevant chunks, then generate an answer.

Instead of doing that, LLM also writes a wiki so that when you add a new source, LLM extracts the key information and integrate it to the existing wiki.

LLM does all the grunt work, summarizing, cross-referencing, filing, and book-keeping while you are in charge of sourcing, exploring, and asking the right question.

https://gist.github.com/karpathy/442a6bf555914893e9891c11519de94f