Skip to content

Commit 9932945

Browse files
authored
Supporting MultiModal Models: an example with LLaVA Notebook (#286)
* LMM notebook * Use "register_reply" instead. * Loop check LLaVA non-empty response * Run notebook * Make the llava_call function more flexible * Include API for LLaVA from Replicate * LLaVA data format update x2 1. prompt formater function 2. conversation format with SEP * Coding example added * Rename "ImageAgent" -> "LLaVAAgent" * Docstring and comments updates * Debug notebook: Remote LLaVA tested * Example 1: remove system message * MultimodalConversableAgent added * Add gpt4v_formatter * LLaVA: update example 1 * LLaVA: Add link to "Table of Content"
1 parent 9ed6c8e commit 9932945

File tree

1 file changed

+1363
-0
lines changed

1 file changed

+1363
-0
lines changed

0 commit comments

Comments
 (0)