@@ -115,7 +115,7 @@ We want to create an application with two bricks with no models, one of them req
115115 require_devices: false
116116 mount_devices_into_container: false
117117 ports: []
118- category: null
118+ category: [audio]
119119 variables:
120120 - name: ARDUINO_DEVICE_ID
121121 description: Arduino Cloud Device ID
@@ -135,8 +135,8 @@ We want to create an application with two bricks with no models, one of them req
135135* Note:* Is the category keyword here connected to the model concept?
136136
137137The brick contains some variables, visible to the user that should/could be configured by the user from the AppLab brick configuration.
138- ![ Brick configuration_button] ( brick_conf_b.png )
139- ![ Brick configuration_vars] ( brick_conf_v.png )
138+ ![ Brick configuration_button] ( images/ brick_conf_b.png)
139+ ![ Brick configuration_vars] ( images/ brick_conf_v.png)
140140
141141### App.yaml definition
142142The configured variables will be stored in the related brick section in the App.yaml file, as follow:
@@ -173,6 +173,7 @@ models/
173173### hey_arduino_ei/conf.yaml
174174```
175175name : "Edge Impulse Hey Arduino model"
176+ model_category: [audio]
176177model_labels:
177178 - "hey_arduino"
178179 - "other_labels_here"
@@ -192,18 +193,19 @@ source-model-url: "https://studio.edgeimpulse.com/studio/757509"
192193```
193194### hey_arduino_qlc/conf.yaml
194195```
195- source: "qualcomm-ai-hub"
196- ei-gpu-mode: false
197- source-model-id: "hey_arduino_spotting-lite"
198- source-model-url: "https://aihub.qualcomm.com/models/hey_ardino_spotting_lite"
199- ```
200- ### hey_arduino_qlc/metadata.yaml
201- ```
202196name : "Qualcomm Hey Arduino model"
197+ model_category: [audio]
203198model_labels:
204199 - "hey_arduino"
205200 - "other_labels_here"
206201```
202+ ### hey_arduino_qlc/metadata.yaml
203+ ```
204+ source: "qualcomm-ai-hub"
205+ ei-gpu-mode: false
206+ source-model-id: "hey_arduino_spotting-lite"
207+ source-model-url: "https://aihub.qualcomm.com/models/hey_ardino_spotting_lite"
208+ ```
207209### Brick definition (brick-list.yaml)
208210```
209211- id: arduino:keyword_spotting
@@ -214,7 +216,7 @@ model_labels:
214216 require_devices: false
215217 mount_devices_into_container: false
216218 ports: []
217- category: audio
219+ model_category: [ audio]
218220 required_devices:
219221 - microphone
220222```
@@ -263,6 +265,7 @@ models/
263265```
264266### yolo_x_nano/conf.yaml
265267name : Lightweight-Face-Detection
268+ model_category: [ video]
266269model_labels:
267270 - "face"
268271 - "other_labels_here"
@@ -283,7 +286,7 @@ source-model-url: "https://github.com/Megvii-BaseDetection/YOLOX"
283286 require_devices: false
284287 mount_devices_into_container: false
285288 ports: []
286- category: video
289+ model_category: [ video]
287290- id: arduino:fast_runner_object_detection
288291 name: Object Detection
289292 description: "Brick for faster object detection"
@@ -292,7 +295,7 @@ source-model-url: "https://github.com/Megvii-BaseDetection/YOLOX"
292295 require_devices: false
293296 mount_devices_into_container: false
294297 ports: []
295- category: video
298+ model_category: [ video]
296299```
297300### App.yaml definition
298301```
@@ -333,7 +336,7 @@ models/
333336```
334337The conf and metadata YAML files are the same as in Case #2 . This custom model scenario, however, changes the way we handle model lifecycle management and model provision to the container. (Could a filesystem overlay be an option?)
335338
336- * NOTE:* There is another case here: the container could decide to autonomously download the model from a remote site using its metadata. In this case , we just need to expose the metadata.
339+ * NOTE:* There is another case here: the container could decide to autonomously download the model from a remote site using its metadata. If this happens , we only need to expose the metadata.
337340
338341### Brick definition (brick-list.yaml)
339342```
@@ -345,7 +348,7 @@ The conf and metadata YAML files are the same as in Case #2. This custom model s
345348 require_devices: false
346349 mount_devices_into_container: false
347350 ports: []
348- category: audio
351+ model_category: [video]
349352 required_devices:
350353 - microphone
351354 variables:
@@ -370,8 +373,6 @@ bricks:
370373EI_KEYWORD_SPOTTING_MODEL: "/models/hei_arduino_qlc/builds/qualcomm_impulse_hey_arduino.model"
371374```
372375
373- # end
374-
375376The following section explores whether this model is suitable for specific use cases.
376377
377378## The user chooses a model for a brick (link Figma here)
@@ -435,9 +436,4 @@ This section details the proposed changes to the current implementation.
435436A Model definition contains a list of categories.
436437
437438A Brick definition containes a list of supported categories supported and a default_mode_name.
438-
439-
440- ![ Model] ( model.png )
441- ![ Brick] ( brick.png )
442- ![ App] ( app.png )
443-
439+
0 commit comments