I am reading about experiment management https://dvc.org/doc/user-guide/experiment-management and I am interested in exploring the directories organisation pattern where you can keep all your experiments that you have run recorded at the same time and not through git history.
What is not clear to me is how to implement that pattern though? Anyone has a better idea of how this works?
Hi @nsorros,
Developing workflows for experiment management is still a work in progress for DVC. The most natural way to organize experiments now is to use dvc exp run and compare them with dvc exp show.
If it’s important for you to have each experiment in its own directory, you could instead look into using foreach stages to define a separate stage for each experiment: https://dvc.org/doc/user-guide/project-structure/pipelines-files#foreach-stages. With this approach, keep in mind that each experiment’s metrics will be written to a different file, making it harder to compare them with commands like dvc exp show.
As I said, these workflows are still a work in progress, so feel free to provide more context for why you want to use separate directories or open a feature request in Discussions · iterative/dvc · GitHub.