Dvc-gs library not found despite seemingly successful pip install 'dvc[gs]'

Questions
1

I am trying to setup dvc within a git project, using Google Cloud Storage as our cloud storage location. We have set up the remote, and we have assigned credentials that have Storage Admin permissions to our GCP project. After launching the venv, we ran `pip install ‘dvc[gs]’, although it appears the install is not completing correctly?

(.venv) nicholas@Nicks-MacBook-Pro cbb-tracking % pip list
Package                  Version
------------------------ -----------
...
dvc                      3.49.0
dvc-data                 3.15.1
dvc-gs                   3.0.1
dvc-http                 2.32.0
dvc-objects              5.1.0
dvc-render               1.0.1
dvc-studio-client        0.20.0
dvc-task                 0.4.0
...

(.venv) nicholas@Nicks-MacBook-Pro cbb-tracking % dvc push
ERROR: unexpected error - gs is supported, but requires 'dvc-gs' to be installed: No module named 'dvc_gs'

Having any troubles? Hit us up at https://dvc.org/support, we are always happy to help!
(.venv) nicholas@Nicks-MacBook-Pro cbb-tracking % dvc-gs --version
zsh: command not found: dvc-gs
(.venv) nicholas@Nicks-MacBook-Pro cbb-tracking % dvc --version
3.49.0

It shows dvc-gs in our list of libraries when we run pip list, however gvc-gs --version returns command not found: dvc-gs error, and dvc push is not working. What could be the issue here? Feel like I am missing something obvious but I am not sure?

1 Like
2

Uninstalling a globally installed version of dvc fixed the issue. I had dvc installed globally but not dvc-gs. Not sure why the virtual environment was operating incorrectly, but this resolved the issue for me.

3

I have same problem.
How did you resolve it?
I tried pip uninstall dvc and reinstall.
However, this problem wasn’t fixed.

(py311) shou10254@LAPTOP-K1G46D1T:~/signate/skert_bord/signate_skertbord$ pip list
Package Version

vc 3.58.0
dvc-data 3.16.7
dvc-gs 3.0.1
dvc-http 2.32.0
dvc-objects 5.1.0
dvc-render 1.0.2
dvc-studio-client 0.21.0
dvc-task 0.40.2

(py311) shou10254@LAPTOP-K1G46D1T:~/signate/skert_bord/signate_skertbord$ dvc push
ERROR: unexpected error - gs is supported, but requires ‘dvc-gs’ to be installed: No module named ‘dvc_gs’

Having any troubles? Hit us up at Support | Platinum Services For MLOps, we are always happy to help!

4

could you try run dvc version and share the result?

also which dvc?

5

Thank you for the reply.


(py311) shou10254@LAPTOP-K1G46D1T:~/signate/skert_bord/signate_skertbord$ dvc version
ERROR: unexpected error - gs is supported, but requires 'dvc-gs' to be installed: No module named 'dvc_gs'

Having any troubles? Hit us up at https://dvc.org/support, we are always happy to help!
(py311) shou10254@LAPTOP-K1G46D1T:~/signate/skert_bord/signate_skertbord$ which dvc
/home/shou10254/.local/bin/dvc
6

So, it seems it is picking up DVC from a user environment (not a virtual env). How did you install it? What is py311 and how you initialized it?

Overall it seems it is something with the envs and the way they configured.

7

py311 means conda environment which install python 3.11.
I installed dvc by pip install dvc on “py311”.
And I initialized dvc by pip uninstall dvc on “py311”.

(py311) shou10254@LAPTOP-K1G46D1T:~/signate/skert_bord/signate_skertbord$ conda info -e

conda environments:

base /home/shou10254/miniconda3
py311 * /home/shou10254/miniconda3/envs/py311

8

I deleted conda environment and tried venv environment.
However, the same problem occurred.

$python3.11 -m venv py311
$source py311/bin/activate
$pip install dvc-gs

(py311) shou10254@LAPTOP-K1G46D1T:~/signate/skert_bord/signate_skertbord$ which dvc
/home/shou10254/signate/skert_bord/signate_skertbord/py311/bin/dvc

(py311) shou10254@LAPTOP-K1G46D1T:~/signate/skert_bord/signate_skertbord$ dvc push
ERROR: unexpected error - gs is supported, but requires 'dvc-gs' to be installed: No module named 'dvc_gs'

Having any troubles? Hit us up at https://dvc.org/support, we are always happy to help!
9

I resolved it by using “pip install dvc[gs]”.
thank you

1 Like