C-Eval | GPTtopic

C-Eval is a multi-level and multidisciplinary Chinese assessment kit suitable for large language models, jointly launched by researchers from Shanghai Jiao Tong University, Tsinghua University, and the University of Edinburgh in May 2023. It includes 13948 multiple-choice questions, covering 52 different disciplines and four difficulty levels, to evaluate the Chinese understanding ability of large language models.

data statistics

Relevant Navigation

HELM

HELM, also known as Holistic Evaluation of Language Models, is a large-scale model evaluation system developed by Stanford University.

H2O EvalGPT

H2O EvalGPT is an open tool used by H2O.ai to evaluate and compare LLM large models, providing a platform to understand the performance of models in a large number of tasks and benchmark tests.

CMMLU

CMMLU is a comprehensive Chinese language assessment benchmark specifically designed to evaluate the knowledge and reasoning ability of language models in Chinese contexts,

OpenCompass

OpenCompass is a large-scale open evaluation system officially launched by Shanghai Artificial Intelligence Laboratory (Shanghai AI Laboratory) in August 2023

SuperCLUE

SuperCLUE is a comprehensive evaluation benchmark for Chinese general large models, which evaluates the capabilities of models from three different dimensions: basic ability, professional ability, and Chinese characteristic ability.

MMBench

MMBench is a multimodal benchmark test developed by researchers from Shanghai Artificial Intelligence Laboratory, Nanyang Technological University,

No comments

No comments...