Added search quality testing pipeline #1774
Conversation
|
The latest updates on your projects. Learn more about Vercel for Git ↗︎
|
backend/tests/regression/answer_quality/search_test_config.yaml
Outdated
Show resolved
Hide resolved
backend/tests/regression/answer_quality/search_test_config.yaml
Outdated
Show resolved
Hide resolved
backend/tests/regression/answer_quality/search_test_config.yaml
Outdated
Show resolved
Hide resolved
| @@ -0,0 +1,406 @@ | |||
| version: '3' | |||
There was a problem hiding this comment.
I'm quite against having yet another docker compose yaml. Every time we add a new env based config we have to currently copy it to 3 docker compose yamls, kubernetes deployment, helm deployment. Let's see if we can just use the existing yamls
| ports: | ||
| - "8080" | ||
| environment: | ||
| # Auth Settings |
There was a problem hiding this comment.
this can rely on an .env file explicitly. The goal is to not have to duplicate the env vars so that when we introduce a new one it has to be changed in 20 places
| o: bind | ||
| device: ${DANSWER_VESPA_DATA_DIR:-./vespa_data} | ||
| model_cache_huggingface: | ||
| # driver: local |
There was a problem hiding this comment.
general cleanup here (also other commented things around the PR). Be sure to give the PR a read on GitHub before the final review <3 thanks!
| # driver_opts: | ||
| # type: none | ||
| # o: bind | ||
| # device: ${DANSWER_MODEL_CACHE_DIR:-./model_cache} |
| - LANGUAGE_CHAT_NAMING_HINT=${LANGUAGE_CHAT_NAMING_HINT:-} | ||
| - QA_PROMPT_OVERRIDE=${QA_PROMPT_OVERRIDE:-} | ||
| # Other Services | ||
| - POSTGRES_HOST=relational_db |
There was a problem hiding this comment.
Some of the env things do still need to stay as it points to a service in the docker compose deployment which is not default
No description provided.