# Zero byte files created in Artifactory remote (http based)

**URL:** <https://discuss.dvc.org/t/zero-byte-files-created-in-artifactory-remote-http-based/1271>\
**Category:** Bug Reports\
**Created:** [July 28, 2022, 9:40am UTC](https://discuss.dvc.org/t/zero-byte-files-created-in-artifactory-remote-http-based/1271 "2022-07-28T09:40:20Z")\
**Posts on this page:** 3\
**Page:** 1

<div class="post-metadata">

**Author:** ![jorue](https://avatars.discourse-cdn.com/v4/letter/j/bc79bd/32.png) [@jorue](https://discuss.dvc.org/u/jorue)\
**Post date:** [July 28, 2022, 9:40am UTC](https://discuss.dvc.org/t/zero-byte-files-created-in-artifactory-remote-http-based/1271/1 "2022-07-28T09:40:20Z")

</div>

Hi,

I am facing the problem that dvc silently uploaded corrupted files (zero-byte files) to my Artifactory remote (http-based remote). This happened not only to me but also other colleagues. [This issue](https://github.com/iterative/dvc/issues/7268#issuecomment-1013200373) mentions zero-byte files caused by VPN issues but I think it might be another underlying problem.

To fix the 500 zero-byte files created for a example.dvc file, I had to iterate 4 times over the following steps:

1. dvc push example.dvc
2. crosscheck that the size stated in examples.dvc matches the summation of artifacts uploaded to Artifactory.
3. Since step 2) showed a discrepancy between both sizes, I searched and deleted all zero-byte artifacts (referenced by example.dvc) in Artifactory incl. the .dir file.

Looping over steps 1-3) 4 times brought me down from 500 corrupted files, to 170, to 50, to 0 corrupted files. I find this behavior very disturbing because it shines an unstable light on DVC - eventhough I really like the tool and the idea.

Unfortunately, reproducing this issue is hard, there seems to be some randomness involved.  
My (amature) guesses here are a false handling of http connection disruptions, or unhandled connection timeout?  
I verified that all those zero-byte files are non-zero in the local cache (just to make sure that the original uploaded file was not empty in the first place).

Here is my dvc doctor output:

```auto
DVC version: 2.15.0 (pip)                                                                                                                                                                          
---------------------------------                                                                                                                                                                  
Platform: Python 3.8.10 on Linux-5.13.0-37-generic-x86_64-with-glibc2.29                                                                                                                          
Supports:                                                                                                                                                                                          
        hdfs (fsspec = 2022.5.0, pyarrow = 7.0.0),                                                                                                                                                
        webhdfs (fsspec = 2022.5.0),                                                                                                                                                              
        http (aiohttp = 3.7.4.post0, aiohttp-retry = 2.4.6),                                                                                                                                      
        https (aiohttp = 3.7.4.post0, aiohttp-retry = 2.4.6)                                                                                                                                      
Cache types: hardlink, symlink                                                                                                                                                                    
Cache directory: ext4 on /dev/sda3                                                                                                                                                                
Caches: local                                                                                                                                                                                      
Remotes: https      
Workspace directory: ext4 on /dev/sda3
Repo: dvc, git

```

Thank you very much for any input or debugging help. In general, I am really amazed by DVC and your work and effort you put in this great tool!

Best,  
Jo

---

<div class="post-metadata">

**Author:** ![skshetry](https://avatars.discourse-cdn.com/v4/letter/s/eb8c5e/32.png) [@skshetry](https://discuss.dvc.org/u/skshetry)\
**Post date:** [July 29, 2022, 10:48am UTC](https://discuss.dvc.org/t/zero-byte-files-created-in-artifactory-remote-http-based/1271/2 "2022-07-29T10:48:19Z")

</div>

Hi, Jo. We try to upload files atomically to the remote where we can (eg: ssh/s3, etc). Unfortunately, http does not provide us ways to do atomic upload (i.e. we cannot move files after we upload to a temporary location). We however could try deleting the files in case of any error.

Btw, do you remember any errors that happen when DVC uploads corrupted files?  
Also, would you be able to create an issue for this so we can track it?

> **[Build software better, together](https://github.com/iterative/dvc-objects/issues/new)**
>
> GitHub is where people build software. More than 83 million people use GitHub to discover, fork, and contribute to over 200 million projects.

Thanks.

---

<div class="post-metadata">

**Author:** ![jorue](https://avatars.discourse-cdn.com/v4/letter/j/bc79bd/32.png) [@jorue](https://discuss.dvc.org/u/jorue)\
**Post date:** [August 17, 2022, 6:58pm UTC](https://discuss.dvc.org/t/zero-byte-files-created-in-artifactory-remote-http-based/1271/3 "2022-08-17T18:58:45Z")

</div>

I think the issue I was describing related to the [Issue #8100](https://github.com/iterative/dvc/issues/8100) and [this issue](https://github.com/iterative/dvc-objects/pull/117). For me, it was removed with DVC 2.18.1 where `dvc-data` was updated to 0.1.16.