git clone error git+https://github.com/Snowflake-Labs/vllm@artic

[vsesha]

Hello,
I am trying to play around with snowflake’s artic llm in google co-lab and using Hugging face version. I tried following the instructions on snowflake-artic github and got the errors mentioned below:

1. !pip install git+git://github.com/Snowflake-Labs/vllm@artic - threw error saying [git clone --filter=blob:none --quiet git://github.com/Snowflake-Labs/vllm.git /tmp/pip-req-build-07so961n did not run successfully.]
2. changed it to !pip install git+https://github.com/Snowflake-Labs/vllm@artic - threw error saying [error: pathspec 'artic' did not match any file(s) known to git]
3. Finally I removed the branch option !pip install git+https://github.com/Snowflake-Labs/vllm, starts to clone and towards the end throws the error:
   _Building wheels for collected packages: vllm
   error: subprocess-exited-with-error

× Building wheel for vllm (pyproject.toml) did not run successfully.
│ exit code: 1
╰─> See above for output.

note: This error originates from a subprocess, and is likely not a problem with pip.
Building wheel for vllm (pyproject.toml) … error
ERROR: Failed building wheel for vllm
Failed to build vllm
ERROR: Could not build wheels for vllm, which is required to install pyproject.toml-based projects_

I am referring to an incorrect branch ? could someone help me here pls?

[sfc-gh-jrasley]

@vsesha, i think there's a small typo in the branch name. It should be arctic instead of artic. Can you try again with this command?

 !pip install git+https://github.com/Snowflake-Labs/vllm@arctic

Another question though, what type of GPUs are you trying to use in colab? You will need roughly 8xA100-80GB or 8xH100-80GBs to run Arctic.