Integration with Aider

[ian-reay]

Aider is a coding assistant ( https://github.com/paul-gauthier/aider ). It helps people write better code. But its built on a strategy where it takes universal c-tags and loads the tags ( your code's structure ) into the context window. As a result, it can only handle small applications. Applications with a few thousand lines of code ( which is many ) just cannot be handled by packing the system prompt with this much information.

I think there is huge opportunity for a solution like MemGPT to realistically help and nurture coding assistants to effectively work on large code bases.

[HaileyStorm]

I have a feeling some tweaked prompts might be needed. The things you need to keep in context, how you can and can't summarize things, etc. are pretty different from natural language. Sure would love to see this though.

[master-harvey]

Per the creator of Aider it is really difficult to get it to work with other LLMs and currently only works with gpt-3.5 due to consistency of responses. It seems improving memgpt support gpt-3.5 would be the most straightforward way to do this integration since Aider already has the tooling to use other APIs

Aider-AI/aider#172

[olafgeibig]

Actually, I have a different understanding of aider's requirements to LLMs. Aider works best with GPT-4, because of the quality of its responses. So, if you would use MemGPT that is backed by GPT-4, I don't see any reason why this shouldn't work. At least regarding the quality of the generated code.

IMHO, the real challenge is making aider utilising MemGPT's memory system.

[elifarley]

@ian-reay / @olafgeibig I intend to tackle bigger codebases differently. I think we can use CEDARScript's code analysis capabilities to allow the LLMs to choose which parts of the codebase they want to bring into context as if the LLM were talking to a kind of code librarian that searches and brings the needed excerpts for the LLM.

You can listen to a 7-minute audio that discusses these concepts: AI Coding Assistants & the Magical Librarian