LLMEval3 | GPTtopic

LLMEval is a large-scale model evaluation benchmark launched by the NLP Laboratory of Fudan University. The latest LLMEval-3 focuses on professional knowledge and ability evaluation, covering 13 subject categories and more than 50 secondary disciplines designated by the Ministry of Education, including philosophy, economics, law, education, literature, history, science, engineering, agriculture, medicine, military science, management, art, etc., with a total of about 200000 standard generative question answering questions.

data statistics

Relevant Navigation

C-Eval

C-Eval is a multi-level and multidisciplinary Chinese assessment kit suitable for large language models

FlagEval

FlagEval, jointly developed by Zhiyuan Research Institute and multiple university teams

CMMLU

CMMLU is a comprehensive Chinese language assessment benchmark specifically designed to evaluate the knowledge and reasoning ability of language models in Chinese contexts,

SuperCLUE

SuperCLUE is a comprehensive evaluation benchmark for Chinese general large models, which evaluates the capabilities of models from three different dimensions: basic ability, professional ability, and Chinese characteristic ability.

H2O EvalGPT

H2O EvalGPT is an open tool used by H2O.ai to evaluate and compare LLM large models, providing a platform to understand the performance of models in a large number of tasks and benchmark tests.

OpenCompass

OpenCompass is a large-scale open evaluation system officially launched by Shanghai Artificial Intelligence Laboratory (Shanghai AI Laboratory) in August 2023

No comments

No comments...