Does anyone try to apply this project to BERT?

[guotong1988]

https://github.com/google-research/bert
Thank you very much!

[raziel]

Not that we know of. I don't believe the open source bert trainer uses Keras. It would beb nice to see somebody trying it out though.

[alanchiao]

@haozha111 is trying this out

[Jasperty]

@haozha111

how to apply this api to bert? do you train bert by keras? can we use bert trained by tensorflow?

[haozha111]

The pruning API only supports keras model right now. I'm just starting to trying it out, and don't have any code examples now. Will post here once I get some good results. Thanks!

[teijeong]

Hi @haozha111, is there some updates?

[lan2720]

The pruning API only supports keras model right now. I'm just starting to trying it out, and don't have any code examples now. Will post here once I get some good results. Thanks!

Hi @haozha111, is there some updates?

[haozha111]

no, I haven't tried it recently. if you are interested, please follow docs in https://www.tensorflow.org/model_optimization to apply it to BERT, also cc'ing Jaesung who is currently working on MOT.