Skip to content

QVAC-18440 Add support to LLMs #2162

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
BrunoCampana merged 7 commits into from
May 21, 2026
Merged

QVAC-18440 Add support to LLMs #2162

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
7 commits
Select commit Hold shift + click to select a range
398f89a
doc: add missing DevDependency for local http-server
BrunoCampana May 14, 2026
fd373e7
doc: fix bug in page index of nested links
BrunoCampana May 14, 2026
a3c1672
doc: improve support to LLMs: llms.txt, llms-full.txt and pages serve…
BrunoCampana May 14, 2026
9e2ac98
doc: implement page actions bar
BrunoCampana May 20, 2026
6bbbd22
doc: adjust page actions after cherry pick
BrunoCampana May 20, 2026
bf106a9
doc: bug - page action - button Ask AI
BrunoCampana May 20, 2026
d703afe
Merge branch 'main' into docs/support-llms
BrunoCampana May 21, 2026
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
10 changes: 5 additions & 5 deletions docs/website/content/docs/index.mdx
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -21,7 +21,7 @@ QVAC is Tether's answer to centralized AI by ensuring AI is not tied to massive

<Cards className="grid-cols-1 sm:grid-cols-2 lg:grid-cols-3">
<Card href="/ai-capabilities/text-generation" title={<span className="inline-flex items-center gap-2"><MessagesSquare className="size-4 text-[var(--color-fd-primary)]" />Text generation</span>}>
LLM inference for text generation and chat via [Fabric LLM](https://github.com/tetherto/qvac-fabric-llm.cpp).
LLM inference for text generation and chat via Fabric LLM.
</Card>
<Card href="/ai-capabilities/text-embeddings" title={<span className="inline-flex items-center gap-2"><Hash className="size-4 text-[var(--color-fd-primary)]" />Text embeddings</span>}>
Vector embedding generation for semantic search, clustering, and retrieval, via Fabric LLM.
Expand All @@ -36,19 +36,19 @@ QVAC is Tether's answer to centralized AI by ensuring AI is not tied to massive
LLM inference over text, images, and other media within a single conversation context.
</Card>
<Card href="/ai-capabilities/image-generation" title={<span className="inline-flex items-center gap-2"><ImageIcon className="size-4 text-[var(--color-fd-primary)]" />Image generation</span>}>
Text-to-image and image-to-image generation via a [customized Diffusion backend](https://github.com/tetherto/qvac-ext-stable-diffusion.cpp).
Text-to-image and image-to-image generation via a customized Diffusion backend.
</Card>
<Card href="/ai-capabilities/transcription" title={<span className="inline-flex items-center gap-2"><Speech className="size-4 text-[var(--color-fd-primary)]" />Transcription</span>}>
Automatic speech recognition (ASR) via a [customized Whisper backend](https://github.com/tetherto/qvac-ext-lib-whisper.cpp) or [NVIDIA Parakeet](https://huggingface.co/nvidia/parakeet-tdt-0.6b-v2).
Automatic speech recognition (ASR) via a customized Whisper backend or NVIDIA Parakeet.
</Card>
<Card href="/ai-capabilities/text-to-speech" title={<span className="inline-flex items-center gap-2"><Volume2 className="size-4 text-[var(--color-fd-primary)]" />Text-to-Speech</span>}>
Speech synthesis (TTS) via [ONNX Runtime](https://onnxruntime.ai).
Speech synthesis (TTS) via ONNX Runtime.
</Card>
<Card href="/ai-capabilities/voice-assistant" title={<span className="inline-flex items-center gap-2"><Mic className="size-4 text-[var(--color-fd-primary)]" />Voice assistant</span>}>
Real-time voice pipeline: transcription, text generation, and speech synthesis in one loop.
</Card>
<Card href="/ai-capabilities/translation" title={<span className="inline-flex items-center gap-2"><Languages className="size-4 text-[var(--color-fd-primary)]" />Translation</span>}>
Text-to-text neural machine translation (NMT), via Fabric LLM and [Bergamot](https://browser.mt).
Text-to-text neural machine translation (NMT), via Fabric LLM and Bergamot.
</Card>
<Card href="/ai-capabilities/ocr" title={<span className="inline-flex items-center gap-2"><ScanText className="size-4 text-[var(--color-fd-primary)]" />OCR</span>}>
Optical character recognition for extracting text from images via ONNX Runtime.
Expand Down
Loading