01 / OVERVIEW
What is CMMLU?
CMMLU: Measuring massive multitask language understanding in Chinese - haonan-li/CMMLU
CMMLU IS A COMPREHENSIVE ASSESSMENT BENCHMARK IN CHINESE, DEDICATED TO ASSESSING THE KNOWLEDGE AND REASONING OF LANGUAGE MODELS IN THE CHINESE LANGUAGE CONTEXT, COVERING 67 TOPICS RANGING FROM BASIC DISCIPLINES TO ADVANCED PROFESSIONAL LEVELS. INCLUDING NATURAL SCIENCES REQUIRING COMPUTATION AND REASONING, HUMANITIES AND SOCIETIES REQUIRING KNOWLEDGE
简体中文 | English
02 / CAPABILITIES
Key features
Highlight
Dataset
Preprocessing code
Assessment tool
03 / AUDIENCE & USE CASES
Use cases and audience
To be edited for verification
- Language model performance assessment
- Smart counselling in the field of education
- Smart client service optimization
- Cultural knowledge dissemination
Input
To be edited for verification
Output
To be edited for verification
GETTING STARTED
How to use
- 01
Access to data sets
- 02
Download from GitHub
- 03
Get it through Hugging Face
- 04
Prepare for testing environment
SOURCES
Official website & sources
Updated on 2026-10-20
RELATED COLLECTIONS
Related topics
NEWS REPORTS
