New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Visual Model integration #774

Closed

pseudotensor opened this issue Aug 28, 2023 · 9 comments

Assignees

Collaborator

pseudotensor commented Aug 28, 2023

llama-2 w/ vision: https://github.com/haotian-liu/LLaVA https://www.youtube.com/watch?v=RxBSmbdJ1I8

https://minigpt-4.github.io/
https://huggingface.co/spaces/Vision-CAIR/minigpt4

pseudotensor self-assigned this

Collaborator Author

pseudotensor commented Aug 28, 2023

https://github.com/rom1504/img2dataset

https://arxiv.org/abs/2304.10592
https://minigpt-4.github.io/
https://github.com/Vision-CAIR/MiniGPT-4/blob/main/dataset/README_1_STAGE.md
https://github.com/Vision-CAIR/MiniGPT-4
https://www.youtube.com/watch?v=__tftoxpBAw
https://huggingface.co/datasets/Vision-CAIR/cc_sbu_align
https://huggingface.co/Vision-CAIR/MiniGPT-4
https://huggingface.co/spaces/Vision-CAIR/minigpt4

https://github.com/salesforce/LAVIS/tree/main/projects/blip2

Collaborator Author

pseudotensor commented Sep 7, 2023

https://github.com/turingmotors/heron/tree/main

Collaborator Author

pseudotensor commented Sep 26, 2023

https://github.com/NExT-GPT/NExT-GPT

Collaborator Author

pseudotensor commented Nov 9, 2023

https://github.com/voxel51/voxelgpt/tree/main

pseudotensor mentioned this issue

Feature request: LlaVa and advanced RAG integration #1079

Closed

Collaborator Author

pseudotensor commented Nov 11, 2023

https://github.com/langchain-ai/langchain/blob/master/cookbook/Semi_structured_multi_modal_RAG_LLaMA2.ipynb

Collaborator Author

pseudotensor commented Nov 11, 2023 •

edited

Loading

gradio-app/gradio#5055
https://llava.hliu.cc/

Collaborator Author

pseudotensor commented Dec 4, 2023

https://github.com/danny-avila/LibreChat

Collaborator Author

pseudotensor commented Dec 4, 2023

https://github.com/THUDM/CogVLM

Collaborator Author

pseudotensor commented Jan 10, 2024

done

pseudotensor closed this as completed

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment