Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Train a real smaller teacher to be used in CTranslate2 #970

Open
gregtatum opened this issue Dec 20, 2024 · 0 comments
Open

Train a real smaller teacher to be used in CTranslate2 #970

gregtatum opened this issue Dec 20, 2024 · 0 comments
Labels
cost & perf Speeding up and lowering cost for the pipeline

Comments

@gregtatum
Copy link
Member

In #922 I'm introducing a CTranslate2 test that runs a real teacher. The teacher is ~700MB, and takes 40 seconds to run. It would be nice to have a smaller teacher that can be used for testing, but that will produce real results so that we have confidence the setup is working.

The work here would be to define a smaller teacher model, and train it on a real run. This could be done as a small run while doing a bigger training.

@gregtatum gregtatum added the cost & perf Speeding up and lowering cost for the pipeline label Dec 20, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
cost & perf Speeding up and lowering cost for the pipeline
Projects
None yet
Development

No branches or pull requests

1 participant