LLMEval3 | GPTtopic

LLMEval is a large-scale model evaluation benchmark launched by the NLP Laboratory of Fudan University. The latest LLMEval-3 focuses on professional knowledge and ability evaluation, covering 13 subject categories and more than 50 secondary disciplines designated by the Ministry of Education, including philosophy, economics, law, education, literature, history, science, engineering, agriculture, medicine, military science, management, art, etc., with a total of about 200000 standard generative question answering questions.

data statistics

Relevant Navigation

MMLU

Large scale multitasking language comprehension benchmark

CMMLU

CMMLU is a comprehensive Chinese language assessment benchmark specifically designed to evaluate the knowledge and reasoning ability of language models in Chinese contexts,

OpenCompass

OpenCompass is a large-scale open evaluation system officially launched by Shanghai Artificial Intelligence Laboratory (Shanghai AI Laboratory) in August 2023

Open LLM Leaderboard

The Open LLM Leaderboard is the largest open source big model ranking released by the HuggingFace community, based on the Eleuther AI Language Model Evaluation Harnesspackage.

SuperCLUE

SuperCLUE is a comprehensive evaluation benchmark for Chinese general large models, which evaluates the capabilities of models from three different dimensions: basic ability, professional ability, and Chinese characteristic ability.

MMBench

MMBench is a multimodal benchmark test developed by researchers from Shanghai Artificial Intelligence Laboratory, Nanyang Technological University,

No comments

No comments...