Process lock for pipen to prevent multiple runs at the same time
pip install -U pipen-lock
The plugin is enabled by default. To disable it, either uninstall it or:
from pipen import Proc, Pipen
# process definition
class MyPipeline(Pipen):
plugins = ["-lock"]
lock_soft
: Whether to use soft lock. Default:False
non-soft lock is platform dependent while soft lock only watches the existence of the lock file. See more details https://py-filelock.readthedocs.io/en/latest/index.html#filelock-vs-softfilelock for the difference betweenFileLock
andSoftFileLock