[RFC] Lora Support

[sagiahrac]

This RFC proposes necessary changes to the llm-d kv cache manager to enable support for multiple LoRA adapters. The proposed solution involves ensuring the KV-Cache manager consistently uses the base model information for tokenization and incorporates the LoRA adapter name into block hashing for compatibility with the vLLM serving framework.

https://docs.google.com/document/d/1kAqPBqZctkXISoGfo6Z2E-vRKbBV4ifDvuP-2y1yTb8/edit?usp=sharing

[nirrozenbaum]

don't forget to add Author at the beginning of the doc, so if one wants to comment they know who is the address :)
additionally, I have no permission to add comments, only to view.
I assume this is true also for others. it's worth opening the access to add comments.