The Open LLM Leaderboard is the largest open source big model ranking released by the HuggingFace community, based on the Eleuther AI Language Model Evaluation Harnesspackage.

C-Eval is a multi-level and multidisciplinary Chinese assessment kit suitable for large language models

FlagEval, jointly developed by Zhiyuan Research Institute and multiple university teams

SuperCLUE is a comprehensive evaluation benchmark for Chinese general large models, which evaluates the capabilities of models from three different dimensions: basic ability, professional ability, and Chinese characteristic ability.

OpenCompass is a large-scale open evaluation system officially launched by Shanghai Artificial Intelligence Laboratory (Shanghai AI Laboratory) in August 2023

CMMLU is a comprehensive Chinese language assessment benchmark specifically designed to evaluate the knowledge and reasoning ability of language models in Chinese contexts,

MMBench is a multimodal benchmark test developed by researchers from Shanghai Artificial Intelligence Laboratory, Nanyang Technological University,

HELM, also known as Holistic Evaluation of Language Models, is a large-scale model evaluation system developed by Stanford University.

Chatbot Arena is a benchmark platform for Large Language Modeling (LLM), which conducts anonymous random battles through crowdsourcing. The project is led by LMSYS Org, a research organization co founded by the University of California, Berkeley, the University of California, San Diego, and Carnegie Mellon University.

LLMEval is a large-scale model evaluation benchmark launched by the NLP Laboratory of Fudan University.

H2O EvalGPT is an open tool used by H2O.ai to evaluate and compare LLM large models, providing a platform to understand the performance of models in a large number of tasks and benchmark tests.

PubMedQA is a biomedical research question and answer dataset that includes 1K expert annotated, 61.2K unlabeled, and 211.3K manually generated QA instances. The ranking currently includes medical test scores for 18 models.

Large scale multitasking language comprehension benchmark