CMMLU
CMMLU is a comprehensive Chinese language assessment benchmark specifically designed to evaluate the knowledge and reasoning ability of language models in Chinese cont...
Tags:AI Model EvaluationAI Test AI TipCMMLU is a comprehensive Chinese language assessment benchmark specifically designed to evaluate the knowledge and reasoning ability of language models in Chinese contexts, covering 67 topics from basic disciplines to advanced professional levels. It includes natural sciences that require computation and reasoning, humanities and social sciences that require knowledge, and Chinese driving rules that require common sense of life. In addition, many tasks in CMMLU have Chinese specific answers and may not be universally applicable in other regions or languages. Therefore, it is a completely Chinese language testing benchmark.
data statistics
Relevant Navigation
Word Soul is an AIGC boutique prompt word library where you can find various prompt words and spells for AI painting, helping you better use AI tools, quickly achieve desired effects, and improve work efficiency. If you are an excellent prompt word creator, you can also sell your own prompt words here.