You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
<pclass="mb-2">LocalAI uses P2P technologies to enable distribution of work between peers. It is possible to share an instance with Federation and/or split the weights of a model across peers (only available with llama.cpp models).</p>
18
+
<pclass="mb-4">LocalAI uses P2P technologies to enable distribution of work between peers. It is possible to share an instance with Federation and/or split the weights of a model across peers (only available with llama.cpp models).</p>
<h3class="text-2xl font-semibold text-gray-100 mb-6">Start a new llama.cpp P2P worker</h3>
23
+
<pclass="mb-4">You can start llama.cpp workers to distribute weights between the workers and offload part of the computation. To start a new worker, you can use the CLI or Docker.</p>
@@ -40,37 +41,30 @@ <h3 class="text-2xl font-semibold text-gray-100 mb-4">Start a new llama.cpp P2P
40
41
local-ai worker p2p-llama-cpp-rpc
41
42
</code>
42
43
43
-
For all the options available please refer to the <ahref="https://localai.io/features/distribute/#starting-workers" target="_blank" class="text-yellow-300 hover:text-yellow-400">documentation</a>.
44
+
<pclass="mt-2">For all the options available, please refer to the <ahref="https://localai.io/features/distribute/#starting-workers" target="_blank" class="text-yellow-300 hover:text-yellow-400">documentation</a>.</p>
For all the options available and see what image to use, please refer to the <ahref="https://localai.io/basics/container/" target="_blank" class="text-yellow-300 hover:text-yellow-400">Container images documentation</a> and <ahref="https://localai.io/advanced/#cli-parameters" target="_blank" class="text-yellow-300 hover:text-yellow-400">CLI parameters documentation</a>
52
+
<pclass="mt-2">For all the options available and see what image to use, please refer to the <ahref="https://localai.io/basics/container/" target="_blank" class="text-yellow-300 hover:text-yellow-400">Container images documentation</a> and <ahref="https://localai.io/advanced/#cli-parameters" target="_blank" class="text-yellow-300 hover:text-yellow-400">CLI parameters documentation</a>.</p>
<h3class="text-2xl font-semibold text-gray-100 mb-4">Start a federated instance</h3>
73
-
<pclass="mb-2">You can start LocalAI in federated mode to share your instance, or start the federated server to balance requests between nodes of the federation.</p>
<h3class="text-2xl font-semibold text-gray-100 mb-6">Start a federated instance</h3>
66
+
<pclass="mb-4">You can start LocalAI in federated mode to share your instance, or start the federated server to balance requests between nodes of the federation.</p>
Note: Token is needed when starting the federated server.
95
+
<pclass="mt-2">Note: Token is needed when starting the federated server.</p>
102
96
103
-
For all the options available please refer to the <ahref="https://localai.io/features/distribute/#starting-workers" target="_blank" class="text-yellow-300 hover:text-yellow-400">documentation</a>.
97
+
<pclass="mt-2">For all the options available, please refer to the <ahref="https://localai.io/features/distribute/#starting-workers" target="_blank" class="text-yellow-300 hover:text-yellow-400">documentation</a>.</p>
For all the options available and see what image to use, please refer to the <ahref="https://localai.io/basics/container/" target="_blank" class="text-yellow-300 hover:text-yellow-400">Container images documentation</a> and <ahref="https://localai.io/advanced/#cli-parameters" target="_blank" class="text-yellow-300 hover:text-yellow-400">CLI parameters documentation</a>
110
+
<pclass="mt-2">For all the options available and see what image to use, please refer to the <ahref="https://localai.io/basics/container/" target="_blank" class="text-yellow-300 hover:text-yellow-400">Container images documentation</a> and <ahref="https://localai.io/advanced/#cli-parameters" target="_blank" class="text-yellow-300 hover:text-yellow-400">CLI parameters documentation</a>.</p>
0 commit comments