Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Evaluate google/gemma-2b/7b-it #163

Closed
the-crypt-keeper opened this issue Feb 21, 2024 · 2 comments
Closed

Evaluate google/gemma-2b/7b-it #163

the-crypt-keeper opened this issue Feb 21, 2024 · 2 comments
Labels
quant request Evaluate impact of quantizing a model

Comments

@the-crypt-keeper
Copy link
Owner

New open source instruction tune from Google.

GGUF support just merged ggml-org/llama.cpp#5631
@the-crypt-keeper the-crypt-keeper added the quant request Evaluate impact of quantizing a model label Feb 21, 2024
@the-crypt-keeper the-crypt-keeper changed the title Evaluate https://huggingface.co/google/gemma-2b/7b-it Evaluate google/gemma-2b/7b-it Feb 21, 2024
@the-crypt-keeper
Copy link
Owner Author

the-crypt-keeper commented Feb 21, 2024 •
edited
Loading

vLLM 0.3.2 adds Gemma and OLMo (what is this?) models: https://github.com/vllm-project/vllm/releases/tag/v0.3.2

the-crypt-keeper pushed a commit that referenced this issue Feb 22, 2024
#163 evaluate google gemma IT family
8645948
@the-crypt-keeper
Copy link
Owner Author

Completed with much disappointment.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
quant request Evaluate impact of quantizing a model
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
1 participant
@the-crypt-keeper