-
Notifications
You must be signed in to change notification settings - Fork 5
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
[DEVX-217] Cleanup Repo #211
Conversation
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Looks good. A few minor comments and questions.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Looks good. A few minor comments.
@@ -28,24 +28,24 @@ class App(Lister, BaseClient): | |||
"""App is a class that provides access to Clarifai API endpoints related to App information.""" | |||
|
|||
def __init__(self, | |||
url_init: str = "", | |||
url: str = "", | |||
app_id: str = "", | |||
base_url: str = "https://api.clarifai.com", |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
nit: Put this url into constants
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
I assume you're referring to base_url?
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Yes
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Will change this in a later PR
| | Segmentation | `coco_segmentation` | | ||
| | Captions | `coco_captions` | | ||
|[xVIEW](http://xviewdataset.org/) | Detection | `xview_detection` | | ||
| [ImageNet](https://www.image-net.org/) | Classification | `imagenet_classification` | | ||
## Contributing Modules |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Suggestion: To avoid confusion with Clarifai's Modules, maybe we could use the name of the directory.
## Contributing Modules | |
## Contributing To Loaders |
# note1: concept_name can be human readable | ||
# note2: concept_id can only be alphanumeric, up to 32 characters, with no special chars except `-` and `_` |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Nit: No need to enumerate notes.
#convert mask to polygons and add to annots | ||
contours, _ = cv2.findContours(mask, cv2.RETR_TREE, cv2.CHAIN_APPROX_SIMPLE) |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Just found this, and is out of scope of this PR. Annotations support masks as base64 images: Annotation -> Data -> Image. How come we are converting them into polygons?
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
For segmentation, only polygons are supported in dataloader
https://github.com/Clarifai/clarifai-python/blob/master/clarifai/datasets/upload/features.py
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Why is that, when we support seg masks?
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
This is in todo planning, Need to extend the support for mask uploads.
What
Delete
clarifai.auth
as now langchain is updatedExamples
andLoaders
which is available in clarifai-examples reposplit
arg inupload_dataset()
task
arg inupload_dataset()
module_dir
inupload_dataset
Refactor
chunk_size
tobatch_size
in dataset/inputsurl_init
arg name to urlClarifaiDataLoader
to includetask
propertyclasses
tolabels
in all features to be consistentDATASET_UPLOAD_TYPES
in constantsdataset_loader
to more usabledataloader
inupload_dataset
batch_size
to 32 from 128text_cls
task name to fulltext_classification
loaders