Replies: 1 comment
-
Sure. You should pin dependencies you need in your requirements.txt file if you want reproducibility. This is standard expectation any time you use requirement file - pinning dependencies you want to have installed in your venv is on you |
Beta Was this translation helpful? Give feedback.
0 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
Airflow is installing different versions of pip installer for different task attempts and also the virtual env is getting built differently for each attempt which is causing the DAG to fail for some attempts and then succeed only on the reruns.
dag_id=poa-de-paa-hrp-prepay-batch-hrp-prepay-batch-239_run_id=scheduled__2024-06-18T14_30_00 00_00_task_id=send_to_bot_piab_py_attempt=7.log
dag_id=poa-de-paa-hrp-prepay-batch-hrp-prepay-batch-239_run_id=scheduled__2024-06-18T14_30_00+00_00_task_id=send_to_bot_piab_py_attempt=4.log
Beta Was this translation helpful? Give feedback.
All reactions