I have been using DVC to manage ML pipeline for several last days and I had a pretty good experience. Especially, I like the way the outputs are cached and the dependencies are managed.
However, I have been trying to run multiple pipelines simultaneously. This is useful, for example, to test several different parameter values and make use of multiple CPUs/GPUs available. The runs are completely independent (both deps and outs are different) so there is no risk of overwriting results.
However, dvc repro, does not allow to run more than a single pipeline at time. I managed to get around this by removing the .dvc/lock file, but this causes the error in the pipeline:
ERROR: cannot perform the command because another DVC process seems to be running on this project. If that is not the case, manually remove
.dvc/lock and try again.
Is there a better way to go around this limitation?