# Maximum data size
**URL:** https://discuss.dvc.org/t/maximum-data-size/1857
**Category:** Questions
**Created:** [November 28, 2023, 3:36pm UTC](https://discuss.dvc.org/t/maximum-data-size/1857 "2023-11-28T15:36:20Z")
**Posts on this page:** 5
**Page:** 1
### Author:  [@gregstarr](https://discuss.dvc.org/u/gregstarr)
#### Post date: [November 28, 2023, 3:36pm UTC](https://discuss.dvc.org/t/maximum-data-size/1857/1 "2023-11-28T15:36:20Z")
Hello,
What is intended to be the maximum dataset size? At some point hashing a large dataset becomes infeasible, right?
---
### Author:  [@kupruser](https://discuss.dvc.org/u/kupruser)
#### Post date: [November 28, 2023, 9:07pm UTC](https://discuss.dvc.org/t/maximum-data-size/1857/2 "2023-11-28T21:07:48Z")
There is no strict limit anywhere in dvc. All depends on your setup and how long it is acceptable for you to wait for operations to finish 🙂
---
### Author:  [@gregstarr](https://discuss.dvc.org/u/gregstarr)
#### Post date: [November 28, 2023, 9:42pm UTC](https://discuss.dvc.org/t/maximum-data-size/1857/3 "2023-11-28T21:42:12Z")
what is the largest dataset you would consider practical to use DVC with?
---
### Author:  [@skshetry](https://discuss.dvc.org/u/skshetry)
#### Post date: [November 29, 2023, 7:03am UTC](https://discuss.dvc.org/t/maximum-data-size/1857/4 "2023-11-29T07:03:39Z")
We have users tracking TBs of data and datasets to a million files with DVC. It depends on how frequently your dataset changes. If it’s mostly static, you can usually wait for operations to finish, as it’s a one time thing.
DVC supports pulling partial datasets and operating (adding/removing) from the partial datasets that you can later push. See [Modifying Large Datasets](https://dvc.org/doc/user-guide/data-management/modifying-large-datasets#modifying-remote-datasets).
So you don’t have to hash the whole dataset. Even then, dvc caches hash of the files, so it’s not computed again (unless the mtime of the file changes).
If the files are tiny, but you have hundreds of thousands of files, then `dvc push/pull` will be slower as transferring large number of files are slow.
Also note most users keep their large datasets in shared S3/NFS, etc and use smaller dvc repositories as dataset registries and model registries and import part of the dataset from their shared storages.
---
### Author:  [@gregstarr](https://discuss.dvc.org/u/gregstarr)
#### Post date: [November 29, 2023, 4:43pm UTC](https://discuss.dvc.org/t/maximum-data-size/1857/5 "2023-11-29T16:43:01Z")
Ok thanks for the detailed answer! very interesting