Hi, I 400 GB of images and videos inside a self-hosted minIO s3 that I use as a DVC repository. I also have the git repo with all the data in my local. when I add a few images to the data in my local and run dvc add, it takes a long time and also running dvc status takes a long time to run. before this when I used git lfs to track my data both git add and git status ran almost instantly. is it normal or am I doing something wrong? this is the process I go through when I modify some data in my git repo which is integrated with DVC:
When using DVC with a large amount of data in a self-hosted for a website MinIO S3, the slowdown in dvc add and dvc status may be normal due to network and storage considerations. Optimize MinIO setup, network speed, and DVC configuration for better performance.