A telegram bot to receive texts, images or pdfs and answer questions accordingly using LLMs.
Install dependencies through pip
pip install -r requirements.txt
On Telegram hit to @BotFather initiate your own bot and obtain BOT_TOKEN, BOT_USER
.
Example config/config.py
with necessary keys and values.
from typing import Final
BOT_TOKEN: Final = 'yourbottoken'
BOT_USER: Final = '@username'
APIURL: Final = 'llmapiendpoint'
VLLM: Final = 'mistral-nemo'
BEARER: Final = "Bearer bearertokenhere"
Run the backend of bot.
python main.py
Output
Bot started...
Bot polling...
Build and run the application on docker containers.
docker compose up --build
Once your bot is running as well as your API is serving properly. Start interacting with your bot.
MIT