Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

支持 BelleGroup/BELLE-LLAMA-7B-2M-gptq #12

Merged
merged 8 commits into from
Apr 1, 2023
+2,005 −10
Merged

支持 BelleGroup/BELLE-LLAMA-7B-2M-gptq #12

Changes from 1 commit
Commits
Show all changes
8 commits
Select commit Hold shift + click to select a range
4f17b27
Update chatglm.py
Apr 1, 2023
268d2e3
Update llama.py
Apr 1, 2023
bff0677
Update app.py
Apr 1, 2023
6834e13
gptq
Apr 1, 2023
7cca0ee
gptq
Apr 1, 2023
6b28cb7
Create llama_gptq.py
Apr 1, 2023
03eb62a
Update app.py
Apr 1, 2023
a7c93fd
Update llama_gptq.py
Apr 1, 2023
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
Update app.py
ypw committed Apr 1, 2023
commit 03eb62a78ec0f89b90380b463b7c3a94f85b8241
7 changes: 5 additions & 2 deletions app.py
View file
Original file line number Diff line number Diff line change
@@ -9,13 +9,16 @@

# 加载模型
# model_name = 'THUDM/chatglm-6b'
model_name = 'BelleGroup/BELLE-LLAMA-7B-2M'
# model_name = 'BelleGroup/BELLE-LLAMA-7B-2M'
# model_name = 'silver/chatglm-6b-int4-slim'
# model_name = 'BelleGroup/BELLE-LLAMA-7B-2M-gptq'
model_name = 'BelleGroup/BELLE-LLAMA-7B-2M-gptq'

if 'chatglm' in model_name.lower():
from predictors.chatglm import ChatGLM
predictor = ChatGLM(model_name)
elif 'gptq' in model_name.lower():
from predictors.llama_gptq import LLaMaGPTQ
predictor = LLaMaGPTQ(model_name)
elif 'llama' in model_name.lower():
from predictors.llama import LLaMa
predictor = LLaMa(model_name)