Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Allow switching between accurate vs probabilistic model in pipeline #1875

Closed
2 tasks
chubei opened this issue Aug 21, 2023 · 0 comments · Fixed by #1912
Closed
2 tasks

Allow switching between accurate vs probabilistic model in pipeline #1875

chubei opened this issue Aug 21, 2023 · 0 comments · Fixed by #1912
Assignees
Labels

Comments

@chubei
Copy link
Contributor

chubei commented Aug 21, 2023

We're using probabilistic models in the pipeline to improve performance. There are two patterns:

We'd like to enable the users to choose between accuracy and performance. This can be a runtime flag the the whole pipeline level. The individual processors will respect this flag and use corresponding implementation.

This requires:

  • Implement "accurate" model for relevant processors.
  • Add the flag to the configuration file.

Implementation note: We should probably clean up join processor before implementing the change. There are quite some duplicated code.

This issue was closed.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

Successfully merging a pull request may close this issue.

2 participants