Skip to content

Commit 946c162

Browse files
committed
Snapshot.
1 parent 46dd328 commit 946c162

File tree

1 file changed

+19
-23
lines changed

1 file changed

+19
-23
lines changed

docs/models/models.md

Lines changed: 19 additions & 23 deletions
Original file line numberDiff line numberDiff line change
@@ -115,7 +115,7 @@ We want to create an application with two bricks with no models, one of them req
115115
require_devices: false
116116
mount_devices_into_container: false
117117
ports: []
118-
category: null
118+
category: [audio]
119119
variables:
120120
- name: ARDUINO_DEVICE_ID
121121
description: Arduino Cloud Device ID
@@ -135,8 +135,8 @@ We want to create an application with two bricks with no models, one of them req
135135
*Note:* Is the category keyword here connected to the model concept?
136136

137137
The brick contains some variables, visible to the user that should/could be configured by the user from the AppLab brick configuration.
138-
![Brick configuration_button](brick_conf_b.png)
139-
![Brick configuration_vars](brick_conf_v.png)
138+
![Brick configuration_button](images/brick_conf_b.png)
139+
![Brick configuration_vars](images/brick_conf_v.png)
140140

141141
### App.yaml definition
142142
The configured variables will be stored in the related brick section in the App.yaml file, as follow:
@@ -173,6 +173,7 @@ models/
173173
### hey_arduino_ei/conf.yaml
174174
```
175175
name : "Edge Impulse Hey Arduino model"
176+
model_category: [audio]
176177
model_labels:
177178
- "hey_arduino"
178179
- "other_labels_here"
@@ -192,18 +193,19 @@ source-model-url: "https://studio.edgeimpulse.com/studio/757509"
192193
```
193194
### hey_arduino_qlc/conf.yaml
194195
```
195-
source: "qualcomm-ai-hub"
196-
ei-gpu-mode: false
197-
source-model-id: "hey_arduino_spotting-lite"
198-
source-model-url: "https://aihub.qualcomm.com/models/hey_ardino_spotting_lite"
199-
```
200-
### hey_arduino_qlc/metadata.yaml
201-
```
202196
name : "Qualcomm Hey Arduino model"
197+
model_category: [audio]
203198
model_labels:
204199
- "hey_arduino"
205200
- "other_labels_here"
206201
```
202+
### hey_arduino_qlc/metadata.yaml
203+
```
204+
source: "qualcomm-ai-hub"
205+
ei-gpu-mode: false
206+
source-model-id: "hey_arduino_spotting-lite"
207+
source-model-url: "https://aihub.qualcomm.com/models/hey_ardino_spotting_lite"
208+
```
207209
### Brick definition (brick-list.yaml)
208210
```
209211
- id: arduino:keyword_spotting
@@ -214,7 +216,7 @@ model_labels:
214216
require_devices: false
215217
mount_devices_into_container: false
216218
ports: []
217-
category: audio
219+
model_category: [audio]
218220
required_devices:
219221
- microphone
220222
```
@@ -263,6 +265,7 @@ models/
263265
```
264266
### yolo_x_nano/conf.yaml
265267
name : Lightweight-Face-Detection
268+
model_category: [video]
266269
model_labels:
267270
- "face"
268271
- "other_labels_here"
@@ -283,7 +286,7 @@ source-model-url: "https://github.com/Megvii-BaseDetection/YOLOX"
283286
require_devices: false
284287
mount_devices_into_container: false
285288
ports: []
286-
category: video
289+
model_category: [video]
287290
- id: arduino:fast_runner_object_detection
288291
name: Object Detection
289292
description: "Brick for faster object detection"
@@ -292,7 +295,7 @@ source-model-url: "https://github.com/Megvii-BaseDetection/YOLOX"
292295
require_devices: false
293296
mount_devices_into_container: false
294297
ports: []
295-
category: video
298+
model_category: [video]
296299
```
297300
### App.yaml definition
298301
```
@@ -333,7 +336,7 @@ models/
333336
```
334337
The conf and metadata YAML files are the same as in Case #2. This custom model scenario, however, changes the way we handle model lifecycle management and model provision to the container. (Could a filesystem overlay be an option?)
335338

336-
*NOTE:* There is another case here: the container could decide to autonomously download the model from a remote site using its metadata. In this case, we just need to expose the metadata.
339+
*NOTE:* There is another case here: the container could decide to autonomously download the model from a remote site using its metadata. If this happens, we only need to expose the metadata.
337340

338341
### Brick definition (brick-list.yaml)
339342
```
@@ -345,7 +348,7 @@ The conf and metadata YAML files are the same as in Case #2. This custom model s
345348
require_devices: false
346349
mount_devices_into_container: false
347350
ports: []
348-
category: audio
351+
model_category: [video]
349352
required_devices:
350353
- microphone
351354
variables:
@@ -370,8 +373,6 @@ bricks:
370373
EI_KEYWORD_SPOTTING_MODEL: "/models/hei_arduino_qlc/builds/qualcomm_impulse_hey_arduino.model"
371374
```
372375

373-
# end
374-
375376
The following section explores whether this model is suitable for specific use cases.
376377

377378
## The user chooses a model for a brick (link Figma here)
@@ -435,9 +436,4 @@ This section details the proposed changes to the current implementation.
435436
A Model definition contains a list of categories.
436437

437438
A Brick definition containes a list of supported categories supported and a default_mode_name.
438-
439-
440-
![Model](model.png)
441-
![Brick](brick.png)
442-
![App](app.png)
443-
439+

0 commit comments

Comments
 (0)