A personal knowledge base, built with an LLM.
innops is developing a personal knowledge base inspired by Andrej Karpathy’s public work. Our version, with the choices we made on retrieval, chunking, and the daily-use loop. Plus what we'd carry into a client engagement (and what we wouldn't).
THE SHAPE
The basic shape Karpathy sketched: your own writing. Meeting notes, reading highlights, half-finished essays. Gets chunked, embedded, and stored. A retrieval layer surfaces the relevant chunks for any prompt. An LLM synthesizes across them. The result is a personal Claude / GPT that knows what you've already thought about, not just what the public internet thinks.
Most personal-KB attempts fail at one of three places: the ingest is too painful to be daily; the retrieval pulls too much noise; the daily-use loop has no actual habit attached to it. The full write-up will walk through the choices we made at each of those three points and which ones held up after three months of daily use.
WHAT WE'D BRING TO A CLIENT ENGAGEMENT
- Andrej Karpathy. Public posts on personal LLM tooling
- Jerry Liu / LlamaIndex. Retrieval patterns & chunking strategies
- Hamel Husain. Evaluation-driven development for RAG