S3 bucket on minio
is ok with mc
dvc push -vv -r minio --all-commits --all-tags --all-branches
2023-02-21 13:45:39,387 DEBUG: Collecting status from ‘dvc’
0% Querying remote cache| |0/2 [00:00<?, ?files/s]2023-02-21 13:45:39,387 DEBUG: Querying 2 oids via object_exists
2023-02-21 13:45:39,903 ERROR: unexpected error - Forbidden: An error occurred (403) when calling the HeadObject operation: Forbidden
Traceback (most recent call last):
File “C:\Users\JB6407\Anaconda3\envs\dvc-venv\lib\site-packages\s3fs\core.py”, line 112, in _error_wrapper
return await func(*args, **kwargs)
File “C:\Users\JB6407\Anaconda3\envs\dvc-venv\lib\site-packages\aiobotocore\client.py”, line 358, in _make_api_call
raise error_class(parsed_response, operation_name)
botocore.exceptions.ClientError: An error occurred (403) when calling the HeadObject operation: Forbidden
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File “C:\Users\JB6407\Anaconda3\envs\dvc-venv\lib\site-packages\dvc\cli_init_.py”, line 185, in main
ret = cmd.do_run()
File “C:\Users\JB6407\Anaconda3\envs\dvc-venv\lib\site-packages\dvc\cli\command.py”, line 22, in do_run
return self.run()
File “C:\Users\JB6407\Anaconda3\envs\dvc-venv\lib\site-packages\dvc\commands\data_sync.py”, line 59, in run
processed_files_count = self.repo.push(
File “C:\Users\JB6407\Anaconda3\envs\dvc-venv\lib\site-packages\dvc\repo_init_.py”, line 48, in wrapper
return f(repo, *args, **kwargs)
File “C:\Users\JB6407\Anaconda3\envs\dvc-venv\lib\site-packages\dvc\repo\push.py”, line 91, in push
result = self.cloud.push(
File “C:\Users\JB6407\Anaconda3\envs\dvc-venv\lib\site-packages\dvc\data_cloud.py”, line 143, in push
return self.transfer(
File “C:\Users\JB6407\Anaconda3\envs\dvc-venv\lib\site-packages\dvc\data_cloud.py”, line 124, in transfer
return transfer(src_odb, dest_odb, objs, **kwargs)
File “C:\Users\JB6407\Anaconda3\envs\dvc-venv\lib\site-packages\dvc_data\hashfile\transfer.py”, line 190, in transfer
status = compare_status(
File “C:\Users\JB6407\Anaconda3\envs\dvc-venv\lib\site-packages\dvc_data\hashfile\status.py”, line 179, in compare_status
dest_exists, dest_missing = status(
File “C:\Users\JB6407\Anaconda3\envs\dvc-venv\lib\site-packages\dvc_data\hashfile\status.py”, line 136, in status
exists = hashes.intersection(
File “C:\Users\JB6407\Anaconda3\envs\dvc-venv\lib\site-packages\dvc_data\hashfile\status.py”, line 56, in _indexed_dir_hashes
dir_exists.update(
File “C:\Users\JB6407\Anaconda3\envs\dvc-venv\lib\site-packages\tqdm\std.py”, line 1195, in iter
for obj in iterable:
File “C:\Users\JB6407\Anaconda3\envs\dvc-venv\lib\site-packages\dvc_objects\db.py”, line 308, in list_oids_exists
yield from itertools.compress(oids, in_remote)
File “C:\Users\JB6407\Anaconda3\envs\dvc-venv\lib\concurrent\futures_base.py”, line 621, in result_iterator
yield _result_or_cancel(fs.pop())
File “C:\Users\JB6407\Anaconda3\envs\dvc-venv\lib\concurrent\futures_base.py”, line 319, in _result_or_cancel
return fut.result(timeout)
File “C:\Users\JB6407\Anaconda3\envs\dvc-venv\lib\concurrent\futures_base.py”, line 458, in result
return self.__get_result()
File “C:\Users\JB6407\Anaconda3\envs\dvc-venv\lib\concurrent\futures_base.py”, line 403, in __get_result
raise self._exception
File “C:\Users\JB6407\Anaconda3\envs\dvc-venv\lib\concurrent\futures\thread.py”, line 58, in run
result = self.fn(*self.args, **self.kwargs)
File “C:\Users\JB6407\Anaconda3\envs\dvc-venv\lib\site-packages\dvc_objects\fs\base.py”, line 308, in exists
return self.fs.exists(path)
File “C:\Users\JB6407\Anaconda3\envs\dvc-venv\lib\site-packages\fsspec\asyn.py”, line 113, in wrapper
return sync(self.loop, func, *args, **kwargs)
File “C:\Users\JB6407\Anaconda3\envs\dvc-venv\lib\site-packages\fsspec\asyn.py”, line 98, in sync
raise return_result
File “C:\Users\JB6407\Anaconda3\envs\dvc-venv\lib\site-packages\fsspec\asyn.py”, line 53, in _runner
result[0] = await coro
File “C:\Users\JB6407\Anaconda3\envs\dvc-venv\lib\site-packages\s3fs\core.py”, line 974, in _exists
await self._info(path, bucket, key, version_id=version_id)
File “C:\Users\JB6407\Anaconda3\envs\dvc-venv\lib\site-packages\s3fs\core.py”, line 1238, in _info
out = await self._call_s3(
File “C:\Users\JB6407\Anaconda3\envs\dvc-venv\lib\site-packages\s3fs\core.py”, line 339, in _call_s3
return await _error_wrapper(
File “C:\Users\JB6407\Anaconda3\envs\dvc-venv\lib\site-packages\s3fs\core.py”, line 139, in _error_wrapper
raise err
PermissionError: Forbidden
2023-02-21 13:45:40,066 DEBUG: link type reflink is not available ([Errno 129] no more link types left to try out)
2023-02-21 13:45:40,066 DEBUG: Removing ‘C:\Users\JB6407\Documents\Mooc-DVC.YMA3oz9UX849yiH3y3Ja4j.tmp’
2023-02-21 13:45:40,066 DEBUG: Removing ‘C:\Users\JB6407\Documents\Mooc-DVC.YMA3oz9UX849yiH3y3Ja4j.tmp’
2023-02-21 13:45:40,066 DEBUG: link type symlink is not available ([WinError 1314] Le client ne dispose pas d’un privilège nécessaire: ‘C:/Users/JB6407/Documents/Mooc-DVC/example-versioning/.dvc/cache/.S6ufwuNo7wpqkQVoaaoF37.tmp’ → ‘C:/Users/JB6407/Documents/Mooc-DVC/.YMA3oz9UX849yiH3y3Ja4j.tmp’)
2023-02-21 13:45:40,066 DEBUG: Removing ‘C:\Users\JB6407\Documents\Mooc-DVC.YMA3oz9UX849yiH3y3Ja4j.tmp’
2023-02-21 13:45:40,066 DEBUG: Removing ‘C:\Users\JB6407\Documents\Mooc-DVC\example-versioning.dvc\cache.S6ufwuNo7wpqkQVoaaoF37.tmp’
2023-02-21 13:45:41,407 DEBUG: Version info for developers:
DVC version: 2.38.1 (conda)
Platform: Python 3.10.8 on Windows-10-10.0.19044-SP0
Subprojects:
dvc_data = 0.28.4
dvc_objects = 0.14.0
dvc_render = 0.0.15
dvc_task = 0.1.8
dvclive = 1.2.2
scmrepo = 0.1.4
Supports:
http (aiohttp = 3.8.3, aiohttp-retry = 2.8.3),
https (aiohttp = 3.8.3, aiohttp-retry = 2.8.3),
s3 (s3fs = 2023.1.0, boto3 = 1.26.70)
Cache types: hardlink
Cache directory: NTFS on C:
Caches: local
Remotes: local, s3, s3
Workspace directory: NTFS on C:
Repo: dvc, git
Having any troubles? Hit us up at Support, we are always happy to help!
2023-02-21 13:45:41,422 DEBUG: Analytics is enabled.
2023-02-21 13:45:41,656 DEBUG: Trying to spawn ‘[‘daemon’, ‘-q’, ‘analytics’, ‘C:\Users\JB6407\AppData\Local\Temp\tmp9h1ybzep’]’
2023-02-21 13:45:41,656 DEBUG: Spawned ‘[‘daemon’, ‘-q’, ‘analytics’, ‘C:\Users\JB6407\AppData\Local\Temp\tmp9h1ybzep’]’