Files

 cfbd308

/

configs

/

Copy path

Directory actions

More options

Directory actions

More options

Latest commit

MaiziXiao

[Feature] Dataset prompts update for ARC, BoolQ, Race (#1527)

Sep 13, 2024

90279b6 · Sep 13, 2024

History

History

/

configs

/

Top

Folders and files

Name		Name	Last commit message	Last commit date
parent directory ..
api_examples		api_examples	[Feature] Add support for Rendu API (#1468)	Sep 5, 2024
dataset_collections		dataset_collections	[Doc] Update Readme (#1439)	Aug 22, 2024
datasets		datasets	[Feature] Dataset prompts update for ARC, BoolQ, Race (#1527)	Sep 13, 2024
models		models	[Feature] Update Models (#1518)	Sep 12, 2024
summarizers		summarizers	[Feature] Update Models (#1518)	Sep 12, 2024
eval_TheoremQA.py		eval_TheoremQA.py	[Doc] Update Readme (#1439)	Aug 22, 2024
eval_academic_leaderboard_202407.py		eval_academic_leaderboard_202407.py	[Feature] Update Lint and Leaderboard (#1458)	Aug 28, 2024
eval_alaya.py		eval_alaya.py	[Doc] Update Readme (#1439)	Aug 22, 2024
eval_api_demo.py		eval_api_demo.py	[Doc] Update Readme (#1439)	Aug 22, 2024
eval_attack.py		eval_attack.py	[Doc] Update Readme (#1439)	Aug 22, 2024
eval_base_demo.py		eval_base_demo.py	[Doc] Update Readme (#1439)	Aug 22, 2024
eval_bluelm_32k_lveval.py		eval_bluelm_32k_lveval.py	[Doc] Update Readme (#1439)	Aug 22, 2024
eval_charm_mem.py		eval_charm_mem.py	[Doc] Update Readme (#1439)	Aug 22, 2024
eval_charm_rea.py		eval_charm_rea.py	[Doc] Update Readme (#1439)	Aug 22, 2024
eval_chat_agent.py		eval_chat_agent.py	[Doc] Update Readme (#1439)	Aug 22, 2024
eval_chat_agent_baseline.py		eval_chat_agent_baseline.py	[Doc] Update Readme (#1439)	Aug 22, 2024
eval_chat_demo.py		eval_chat_demo.py	[Doc] Update Readme (#1439)	Aug 22, 2024
eval_chat_last.py		eval_chat_last.py	[Doc] Update Readme (#1439)	Aug 22, 2024
eval_chembench.py		eval_chembench.py	[Doc] Update Readme (#1439)	Aug 22, 2024
eval_cibench.py		eval_cibench.py	[Doc] Update Readme (#1439)	Aug 22, 2024
eval_cibench_api.py		eval_cibench_api.py	[Doc] Update Readme (#1439)	Aug 22, 2024
eval_circular.py		eval_circular.py	[Doc] Update Readme (#1439)	Aug 22, 2024
eval_claude.py		eval_claude.py	[Doc] Update Readme (#1439)	Aug 22, 2024
eval_code_passk.py		eval_code_passk.py	[Doc] Update Readme (#1439)	Aug 22, 2024
eval_code_passk_repeat_dataset.py		eval_code_passk_repeat_dataset.py	[Doc] Update Readme (#1439)	Aug 22, 2024
eval_codeagent.py		eval_codeagent.py	[Doc] Update Readme (#1439)	Aug 22, 2024
eval_codegeex2.py		eval_codegeex2.py	[Doc] Update Readme (#1439)	Aug 22, 2024
eval_contamination.py		eval_contamination.py	[Doc] Update Readme (#1439)	Aug 22, 2024
eval_ds1000_interpreter.py		eval_ds1000_interpreter.py	[Doc] Update Readme (#1439)	Aug 22, 2024
eval_edgellm_demo.py		eval_edgellm_demo.py	[Doc] Update Readme (#1439)	Aug 22, 2024
eval_gpt3.5.py		eval_gpt3.5.py	[Doc] Update Readme (#1439)	Aug 22, 2024
eval_gpt4.py		eval_gpt4.py	[Doc] Update Readme (#1439)	Aug 22, 2024
eval_hf_llama2.py		eval_hf_llama2.py	[Doc] Update Readme (#1439)	Aug 22, 2024
eval_hf_llama_7b.py		eval_hf_llama_7b.py	[Doc] Update Readme (#1439)	Aug 22, 2024
eval_inference_ppl.py		eval_inference_ppl.py	[Doc] Update Readme (#1439)	Aug 22, 2024
eval_internLM.py		eval_internLM.py	[Doc] Update Readme (#1439)	Aug 22, 2024
eval_internlm2_chat_keyset.py		eval_internlm2_chat_keyset.py	[Doc] Update Readme (#1439)	Aug 22, 2024
eval_internlm2_keyset.py		eval_internlm2_keyset.py	[Doc] Update Readme (#1439)	Aug 22, 2024
eval_internlm_7b.py		eval_internlm_7b.py	[Doc] Update Readme (#1439)	Aug 22, 2024
eval_internlm_chat_lmdeploy_apiserver.py		eval_internlm_chat_lmdeploy_apiserver.py	[Feature] Add an attribute api_key into TurboMindAPIModel default None (	Sep 5, 2024
eval_internlm_chat_lmdeploy_pytorch.py		eval_internlm_chat_lmdeploy_pytorch.py	[Doc] Update Readme (#1439)	Aug 22, 2024
eval_internlm_chat_lmdeploy_tis.py		eval_internlm_chat_lmdeploy_tis.py	[Doc] Update Readme (#1439)	Aug 22, 2024
eval_internlm_chat_turbomind.py		eval_internlm_chat_turbomind.py	[Doc] Update Readme (#1439)	Aug 22, 2024
eval_internlm_chat_turbomind_tis.py		eval_internlm_chat_turbomind_tis.py	[Doc] Update Readme (#1439)	Aug 22, 2024
eval_internlm_flames_chat.py		eval_internlm_flames_chat.py	[Doc] Update Readme (#1439)	Aug 22, 2024
eval_internlm_lmdeploy_apiserver.py		eval_internlm_lmdeploy_apiserver.py	[Doc] Update Readme (#1439)	Aug 22, 2024
eval_internlm_math_chat.py		eval_internlm_math_chat.py	[Doc] Update Readme (#1439)	Aug 22, 2024
eval_internlm_turbomind.py		eval_internlm_turbomind.py	[Doc] Update Readme (#1439)	Aug 22, 2024
eval_internlm_turbomind_tis.py		eval_internlm_turbomind_tis.py	[Doc] Update Readme (#1439)	Aug 22, 2024
eval_lightllm.py		eval_lightllm.py	[Doc] Update Readme (#1439)	Aug 22, 2024
eval_llama2_7b.py		eval_llama2_7b.py	[Doc] Update Readme (#1439)	Aug 22, 2024
eval_llama2_7b_lveval.py		eval_llama2_7b_lveval.py	[Doc] Update Readme (#1439)	Aug 22, 2024
eval_llama3_instruct.py		eval_llama3_instruct.py	[Doc] Update Readme (#1439)	Aug 22, 2024
eval_llm_compression.py		eval_llm_compression.py	[Doc] Update Readme (#1439)	Aug 22, 2024
eval_lmdeploy_demo.py		eval_lmdeploy_demo.py	[Doc] Update Readme (#1439)	Aug 22, 2024
eval_math_llm_judge.py		eval_math_llm_judge.py	[Doc] Update Readme (#1439)	Aug 22, 2024
eval_mathbench.py		eval_mathbench.py	[Doc] Update Readme (#1439)	Aug 22, 2024
eval_mmlu_pro.py		eval_mmlu_pro.py	[Doc] Update Readme (#1439)	Aug 22, 2024
eval_mmlu_with_zero_retriever_overwritten.py		eval_mmlu_with_zero_retriever_overwritten.py	[Doc] Update Readme (#1439)	Aug 22, 2024
eval_modelscope_datasets.py		eval_modelscope_datasets.py	[Doc] Update Readme (#1439)	Aug 22, 2024
eval_multi_prompt_demo.py		eval_multi_prompt_demo.py	[Doc] Update Readme (#1439)	Aug 22, 2024
eval_needlebench.py		eval_needlebench.py	[Doc] Update Readme (#1439)	Aug 22, 2024
eval_qwen_7b.py		eval_qwen_7b.py	[Doc] Update Readme (#1439)	Aug 22, 2024
eval_qwen_7b_chat.py		eval_qwen_7b_chat.py	[Doc] Update Readme (#1439)	Aug 22, 2024
eval_qwen_7b_chat_lawbench.py		eval_qwen_7b_chat_lawbench.py	[Doc] Update Readme (#1439)	Aug 22, 2024
eval_ruler.py		eval_ruler.py	[Doc] Update Readme (#1439)	Aug 22, 2024
eval_ruler_fix_tokenizer.py		eval_ruler_fix_tokenizer.py	[Doc] Update Readme (#1439)	Aug 22, 2024
eval_rwkv5_3b.py		eval_rwkv5_3b.py	[Doc] Update Readme (#1439)	Aug 22, 2024
eval_subjective.py		eval_subjective.py	[Doc] Update Readme (#1439)	Aug 22, 2024
eval_subjective_alpacaeval_official.py		eval_subjective_alpacaeval_official.py	[Doc] Update Readme (#1439)	Aug 22, 2024
eval_teval.py		eval_teval.py	[Doc] Update Readme (#1439)	Aug 22, 2024
eval_with_model_dataset_combinations.py		eval_with_model_dataset_combinations.py	[Doc] Update Readme (#1439)	Aug 22, 2024
View all files