Skip to content

[WIP/not-for-merge] Initial resnet implementation#1613

Closed
danpovey wants to merge 14 commits intokaldi-asr:kaldi_52from
danpovey:kaldi_52_resnet
Closed

[WIP/not-for-merge] Initial resnet implementation#1613
danpovey wants to merge 14 commits intokaldi-asr:kaldi_52from
danpovey:kaldi_52_resnet

Conversation

@danpovey
Copy link
Contributor

@danpovey danpovey commented May 7, 2017

This is an implementation of ResNets. They do seem helpful for CIFAR, e.g. we're getting 91% accuracy, although based on the papers we're referring to we should be getting better accuracy, around 95%.

I made it a bit more general than it needed to be, with some features that I now realize are not helpful, so I'm going to modify and simplify the implementation before this is ready for check in. I am putting up this PR here just in case collorabors like @hhadian want to have a look.

This PR also contains some stuff that didn't really work regarding image augmentation in RGB space.

@freewym, you probably shouldn't use this, I'm working today on a more definitive implementation.

@danpovey
Copy link
Contributor Author

danpovey commented May 8, 2017

@freewym, actually maybe you can start from this point.
Before I merge this I want to clean this up and get rid of most of the resnet experiments from the repo, and some of the image augmentation stuff that didn't help; but if you look at local/nnet3/run_resnet_1b24.sh, that should be the best starting point. Later I'll rename it to something more normal.

I'm running it in /home/dpovey/kaldi-chain/egs/cifar/v1; it's not finished running yet, but it's the cleanest version of ResNet (i.e. the closest to published setups).

@danpovey danpovey added the stopped development On backburner. Please comment if you think it should not be. label May 24, 2017
@danpovey danpovey closed this Jun 7, 2017
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

stopped development On backburner. Please comment if you think it should not be.

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant