Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

I do not find images with bikes, riders, motos or trains #1

Open
RobertoAlcoverCouso opened this issue Jun 1, 2023 · 2 comments
Open

Comments

@RobertoAlcoverCouso
Copy link

I have downloaded the dataset and i find 3 missing classes: riders, motos and trains. Furthermore, the class bike is only in around 30 images and those 30 images contain around 40 pixels of class bike.
Is there a mistake with the published dataset?

@giannifranchi
Copy link

Hi Roberto, I wanted to bring to your attention that the training set does not include the classes riders, motos, and trains. These three classes represent out-of-distribution (OOD) classes, and the challenge aims to evaluate how well your DNN performs when it encounters these unseen classes. Furthermore, there are additional peculiar OOD classes such as cow, rock, deer, and so on. I hope this clarifies the objective. We strive to adhere to normal statistics, and it is indeed challenging to handle the bike class.

@farhadi76m
Copy link

Hi Roberto, I wanted to bring to your attention that the training set does not include the classes riders, motos, and trains. These three classes represent out-of-distribution (OOD) classes, and the challenge aims to evaluate how well your DNN performs when it encounters these unseen classes. Furthermore, there are additional peculiar OOD classes such as cow, rock, deer, and so on. I hope this clarifies the objective. We strive to adhere to normal statistics, and it is indeed challenging to handle the bike class.

Hello, I have to say, we need a grand truth for ood data, since I don't know how to evaluate them .

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants