-
Notifications
You must be signed in to change notification settings - Fork 440
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
[feature] Support NAS #24
Comments
I agree supporting NAS is great. NAS is so important for architecture search. |
I'm going to implement POC code for architecture search with NAS. |
SGTM! Thanks! |
/assign @YujiOshima |
@gaocegege Why is this P1? For P1 I'd like to use everything that's needed in order to have an initial release of Katib. I don't think NAS is required for our initial release. So I'd suggest making this P2. As @YujiOshima implementing NAS is actually quite difficult and in practice I'm not sure how many people will benefit from it because it requires huge amounts of compute resources which is probably too expensive. (The NAS paper used hundreds of GPUs for weeks). |
OK, we can set it to p2/p3 since it is hard to implement 🤔 WDYT @YujiOshima |
Yes. In the initial release, I think that support of random, grid, BO, HyperBand and CMA-ES is sufficient. |
As discussed, we hope we could implement the experimental feature before kubeflow 1.0. |
dup with #257 |
We support some parameter search algorithms such as random search as grid search. Personally, I think it is better if we could support neural architecture search based on our system. I am not sure if it is feasible.
@YujiOshima We have some discussion on slack and I am glad to move it here.
/cc @weiweijiuzaizhe
The text was updated successfully, but these errors were encountered: