Files

 5a1fed6

/

datasets

/

Copy path

Directory actions

More options

Directory actions

More options

Latest commit

tonysy

[Update] Update Fullbench (#1712)

Nov 26, 2024

f97c4ea · Nov 26, 2024

History

History

/

datasets

/

Top

Folders and files

Name		Name	Last commit message	Last commit date
parent directory ..
ARC_c		ARC_c	[Feature] Dataset prompts update for ARC, BoolQ, Race (#1527)	Sep 13, 2024
ARC_e		ARC_e	[Feature] Support ModelScope datasets (#1289)	Jul 29, 2024
CHARM		CHARM	[Feature] Update CHARM Memeorziation (#1230)	Jul 26, 2024
CIBench		CIBench	[Format] Add config lints (#892)	May 14, 2024
CLUE_C3		CLUE_C3	[Format] Add config lints (#892)	May 14, 2024
CLUE_CMRC		CLUE_CMRC	[Feature] Support ModelScope datasets (#1289)	Jul 29, 2024
CLUE_DRCD		CLUE_DRCD	[Feature] Support ModelScope datasets (#1289)	Jul 29, 2024
CLUE_afqmc		CLUE_afqmc	[Feature] Support ModelScope datasets (#1289)	Jul 29, 2024
CLUE_cmnli		CLUE_cmnli	[Feature] Support ModelScope datasets (#1289)	Jul 29, 2024
CLUE_ocnli		CLUE_ocnli	[Feature] Support ModelScope datasets (#1289)	Jul 29, 2024
ChemBench		ChemBench	[Feature] Support ModelScope datasets (#1289)	Jul 29, 2024
FewCLUE_bustm		FewCLUE_bustm	[Feature] Support ModelScope datasets (#1289)	Jul 29, 2024
FewCLUE_chid		FewCLUE_chid	[Feature] Support ModelScope datasets (#1289)	Jul 29, 2024
FewCLUE_cluewsc		FewCLUE_cluewsc	[Feature] Support ModelScope datasets (#1289)	Jul 29, 2024
FewCLUE_csl		FewCLUE_csl	[Feature] Support ModelScope datasets (#1289)	Jul 29, 2024
FewCLUE_eprstmt		FewCLUE_eprstmt	[Feature] Support ModelScope datasets (#1289)	Jul 29, 2024
FewCLUE_ocnli_fc		FewCLUE_ocnli_fc	[Feature] Support ModelScope datasets (#1289)	Jul 29, 2024
FewCLUE_tnews		FewCLUE_tnews	[Feature] Support ModelScope datasets (#1289)	Jul 29, 2024
FinanceIQ		FinanceIQ	[Format] Add config lints (#892)	May 14, 2024
GLUE_CoLA		GLUE_CoLA	[Format] Add config lints (#892)	May 14, 2024
GLUE_MRPC		GLUE_MRPC	[Format] Add config lints (#892)	May 14, 2024
GLUE_QQP		GLUE_QQP	[Format] Add config lints (#892)	May 14, 2024
GaokaoBench		GaokaoBench	[Fix] the automatically download for several datasets (#1652)	Nov 1, 2024
IFEval		IFEval	[Doc] Update running command in README (#1206)	May 29, 2024
LCBench		LCBench	[Feature] Support import configs/models/summarizers from whl (#1376)	Jul 31, 2024
MMLUArabic		MMLUArabic	[Format] Add config lints (#892)	May 14, 2024
MathBench		MathBench	[Feature] Update MathBench & Math base model config (#1550)	Sep 23, 2024
MedBench		MedBench	[Format] Add config lints (#892)	May 14, 2024
NPHardEval		NPHardEval	[Feature] Support ModelScope datasets (#1289)	Jul 29, 2024
OpenFinData		OpenFinData	[Feature] Support ModelScope datasets (#1289)	Jul 29, 2024
PJExam		PJExam	[Format] Add config lints (#892)	May 14, 2024
QuALITY		QuALITY	[Format] Add config lints (#892)	May 14, 2024
SVAMP		SVAMP	[Format] Add config lints (#892)	May 14, 2024
SuperGLUE_AX_b		SuperGLUE_AX_b	[Feature] Support ModelScope datasets (#1289)	Jul 29, 2024
SuperGLUE_AX_g		SuperGLUE_AX_g	[Feature] Support ModelScope datasets (#1289)	Jul 29, 2024
SuperGLUE_BoolQ		SuperGLUE_BoolQ	[Feature] Dataset prompts update for ARC, BoolQ, Race (#1527)	Sep 13, 2024
SuperGLUE_CB		SuperGLUE_CB	[Feature] Support ModelScope datasets (#1289)	Jul 29, 2024
SuperGLUE_COPA		SuperGLUE_COPA	[Feature] Support ModelScope datasets (#1289)	Jul 29, 2024
SuperGLUE_MultiRC		SuperGLUE_MultiRC	[Feature] Support ModelScope datasets (#1289)	Jul 29, 2024
SuperGLUE_RTE		SuperGLUE_RTE	[Feature] Support ModelScope datasets (#1289)	Jul 29, 2024
SuperGLUE_ReCoRD		SuperGLUE_ReCoRD	[Feature] Support ModelScope datasets (#1289)	Jul 29, 2024
SuperGLUE_WSC		SuperGLUE_WSC	[Feature] Support ModelScope datasets (#1289)	Jul 29, 2024
SuperGLUE_WiC		SuperGLUE_WiC	[Feature] Support ModelScope datasets (#1289)	Jul 29, 2024
TabMWP		TabMWP	[Format] Add config lints (#892)	May 14, 2024
TheoremQA		TheoremQA	[Doc] Update running command in README (#1206)	May 29, 2024
XCOPA		XCOPA	[Format] Add config lints (#892)	May 14, 2024
XLSum		XLSum	Update configs (#9)	Jul 6, 2023
Xsum		Xsum	[Feature] Support ModelScope datasets (#1289)	Jul 29, 2024
adv_glue		adv_glue	[Feature] Support ModelScope datasets (#1289)	Jul 29, 2024
agieval		agieval	[Feature] Support ModelScope datasets (#1289)	Jul 29, 2024
anli		anli	[Format] Add config lints (#892)	May 14, 2024
anthropics_evals		anthropics_evals	[Format] Add config lints (#892)	May 14, 2024
apps		apps	[Sync] Sync with internal codes 2024.06.28 (#1279)	Jun 28, 2024
bbh		bbh	[Feature] Support import configs/models/summarizers from whl (#1376)	Jul 31, 2024
calm		calm	Calm dataset (#1385)	Aug 1, 2024
ceval		ceval	[Feature] Support import configs/models/summarizers from whl (#1376)	Jul 31, 2024
civilcomments		civilcomments	[Format] Add config lints (#892)	May 14, 2024
clozeTest_maxmin		clozeTest_maxmin	[Feature] Support ModelScope datasets (#1289)	Jul 29, 2024
cmb		cmb	[Format] Add config lints (#892)	May 14, 2024
cmmlu		cmmlu	[Feature] Support import configs/models/summarizers from whl (#1376)	Jul 31, 2024
collections		collections	[Sync] Sync with internal codes 2024.06.28 (#1279)	Jun 28, 2024
commonsenseqa		commonsenseqa	[Bug] Commonsenseqa dataset fix (#1425)	Aug 16, 2024
commonsenseqa_cn		commonsenseqa_cn	[Format] Add config lints (#892)	May 14, 2024
compassbench_20_v1_1		compassbench_20_v1_1	[Feature] Support ModelScope datasets (#1289)	Jul 29, 2024
compassbench_20_v1_1_public		compassbench_20_v1_1_public	[Feature] Support ModelScope datasets (#1289)	Jul 29, 2024
compassbench_v1_3		compassbench_v1_3	[Fix] Compatible with old versions (#1616)	Oct 21, 2024
contamination		contamination	[Feature] Support ModelScope datasets (#1289)	Jul 29, 2024
crowspairs		crowspairs	[Feature] Support ModelScope datasets (#1289)	Jul 29, 2024
crowspairs_cn		crowspairs_cn	[Feature] Support ModelScope datasets (#1289)	Jul 29, 2024
cvalues		cvalues	[Format] Add config lints (#892)	May 14, 2024
demo		demo	[Doc] quick start swap tabs (#1263)	Jul 5, 2024
dingo		dingo	[Feature] Add dingo test (#1529)	Sep 29, 2024
drop		drop	[Sync] Sync with internal codes 2024.06.28 (#1279)	Jun 28, 2024
ds1000		ds1000	[Format] Add config lints (#892)	May 14, 2024
flores		flores	[Feature] Support ModelScope datasets (#1289)	Jul 29, 2024
game24		game24	[Format] Add config lints (#892)	May 14, 2024
gaokao_math		gaokao_math	[Feature] Add GaoKaoMath Dataset for Evaluation & MATH Model Eval Con…	Oct 12, 2024
govrepcrs		govrepcrs	[Format] Add config lints (#892)	May 14, 2024
gpqa		gpqa	[Fix] gpqa_few_shot_ppl prompt bug (#1627)	Oct 21, 2024
gsm8k		gsm8k	[Feature] Add custom model postprocess function (#1519)	Sep 18, 2024
gsm8k_contamination		gsm8k_contamination	[Format] Add config lints (#892)	May 14, 2024
gsm_hard		gsm_hard	[Format] Add config lints (#892)	May 14, 2024
hellaswag		hellaswag	[Feature] Support ModelScope datasets (#1289)	Jul 29, 2024
humaneval		humaneval	[Feature] Support ModelScope datasets (#1289)	Jul 29, 2024
humaneval_cn		humaneval_cn	[Feature] Support ModelScope datasets (#1289)	Jul 29, 2024
humaneval_multi		humaneval_multi	[feat] support multipl-e (#846)	Feb 6, 2024
humaneval_plus		humaneval_plus	[Feature] Support ModelScope datasets (#1289)	Jul 29, 2024
humanevalx		humanevalx	[Format] Add config lints (#892)	May 14, 2024
hungarian_exam		hungarian_exam	[Format] Add config lints (#892)	May 14, 2024
inference_ppl		inference_ppl	[Feature] Support inference ppl datasets (#1315)	Jul 22, 2024
infinitebench		infinitebench	[Format] Add config lints (#892)	May 14, 2024
iwslt2017		iwslt2017	[Format] Add config lints (#892)	May 14, 2024
jigsawmultilingual		jigsawmultilingual	[Format] Add config lints (#892)	May 14, 2024
kaoshi		kaoshi	[Format] Add config lints (#892)	May 14, 2024
lambada		lambada	[Feature] Support ModelScope datasets (#1289)	Jul 29, 2024
lawbench		lawbench	[Format] Add config lints (#892)	May 14, 2024
lcsts		lcsts	[Feature] Support ModelScope datasets (#1289)	Jul 29, 2024
leval		leval	[Format] Add config lints (#892)	May 14, 2024
livecodebench		livecodebench	[Update] Update configurations (#1704)	Nov 21, 2024
llm_compression		llm_compression	[Format] Add config lints (#892)	May 14, 2024
longbench		longbench	[Feature] Longbench dataset update	Sep 6, 2024
lveval		lveval	[Format] Add config lints (#892)	May 14, 2024
mastermath2024v1		mastermath2024v1	[Format] Add config lints (#892)	May 14, 2024
math		math	[Feature] Add GaoKaoMath Dataset for Evaluation & MATH Model Eval Con…	Oct 12, 2024
math401		math401	[Format] Add config lints (#892)	May 14, 2024
mbpp		mbpp	[Feature] Support ModelScope datasets (#1289)	Jul 29, 2024
mbpp_cn		mbpp_cn	[Feature] Support ModelScope datasets (#1289)	Jul 29, 2024
mbpp_plus		mbpp_plus	[Format] Add config lints (#892)	May 14, 2024
mgsm		mgsm	[Format] Add config lints (#892)	May 14, 2024
mmlu		mmlu	[Feature] Add custom model postprocess function (#1519)	Sep 18, 2024
mmlu_pro		mmlu_pro	[Fix] Compatible with old versions (#1616)	Oct 21, 2024
narrativeqa		narrativeqa	[Format] Add config lints (#892)	May 14, 2024
needlebench		needlebench	[Feature] Needlebench auto-download update (#1480)	Sep 5, 2024
nq		nq	[Fix] the automatically download for several datasets (#1652)	Nov 1, 2024
nq_cn		nq_cn	[Feature] Support ModelScope datasets (#1289)	Jul 29, 2024
obqa		obqa	[Feature] Support ModelScope datasets (#1289)	Jul 29, 2024
piqa		piqa	[Feature] Support ModelScope datasets (#1289)	Jul 29, 2024
promptbench		promptbench	[Feature] Support ModelScope datasets (#1289)	Jul 29, 2024
py150		py150	[Feature] Support ModelScope datasets (#1289)	Jul 29, 2024
qabench		qabench	[Format] Add config lints (#892)	May 14, 2024
qasper		qasper	[Format] Add config lints (#892)	May 14, 2024
qaspercut		qaspercut	[Format] Add config lints (#892)	May 14, 2024
race		race	[Feature] Dataset prompts update for ARC, BoolQ, Race (#1527)	Sep 13, 2024
realtoxicprompts		realtoxicprompts	[Format] Add config lints (#892)	May 14, 2024
rolebench		rolebench	[Feature] Add abbr for rolebench dataset (#1431)	Aug 20, 2024
ruler		ruler	[Update] Add RULER 64k config (#1709)	Nov 25, 2024
s3eval		s3eval	[Feature] Support ModelScope datasets (#1289)	Jul 29, 2024
safety		safety	Align prompt files with their hash (#1)	Jul 5, 2023
scibench		scibench	[Format] Add config lints (#892)	May 14, 2024
scicode		scicode	[Feature] Add SciCode summarizer config (#1514)	Sep 10, 2024
siqa		siqa	[Feature] Support ModelScope datasets (#1289)	Jul 29, 2024
squad20		squad20	[Feature] Add Xiezhi SQuAD2.0 ANLI (#101)	Aug 10, 2023
storycloze		storycloze	[Feature] Support ModelScope datasets (#1289)	Jul 29, 2024
strategyqa		strategyqa	[Feature] Support ModelScope datasets (#1289)	Jul 29, 2024
subjective		subjective	[Update] Update Fullbench (#1712)	Nov 26, 2024
summedits		summedits	[Feature] Support ModelScope datasets (#1289)	Jul 29, 2024
summscreen		summscreen	[Format] Add config lints (#892)	May 14, 2024
taco		taco	[Sync] Sync with internal codes 2024.06.28 (#1279)	Jun 28, 2024
teval		teval	[Format] Add config lints (#892)	May 14, 2024
triviaqa		triviaqa	[Feature] Support ModelScope datasets (#1289)	Jul 29, 2024
triviaqarc		triviaqarc	[Format] Add config lints (#892)	May 14, 2024
truthfulqa		truthfulqa	[Fix] Update SciCode and Gemma model (#1449)	Aug 23, 2024
tydiqa		tydiqa	[Feature] Support ModelScope datasets (#1289)	Jul 29, 2024
wikibench		wikibench	[Fix] the automatically download for several datasets (#1652)	Nov 1, 2024
wikitext		wikitext	[Format] Add config lints (#892)	May 14, 2024
winograd		winograd	[Feature] Support import configs/models/summarizers from whl (#1376)	Jul 31, 2024
winogrande		winogrande	[Feature] Support ModelScope datasets (#1289)	Jul 29, 2024
xiezhi		xiezhi	[Format] Add config lints (#892)	May 14, 2024
View all files