AI Model Assessment

OpenCompass, launched by Shanghai Artificial Intelligence Laboratory, is an open-source large model evaluation system offering comprehensive and efficient assessment services. It covers multiple dimensions such as knowledge, language, understanding, and reasoning, supporting various models and datasets to assist AI researchers and developers in gaining deep insights into model performance.

FlagEval (Libra) is a large model evaluation platform developed by BAAI in collaboration with multiple university teams. It employs a 'Capability-Task-Metric' three-dimensional evaluation framework to provide comprehensive and detailed assessment results, aiding researchers and developers in gaining deep insights into model performance.

MMLU (Massive Multitask Language Understanding) is a benchmark test launched by the University of California, Berkeley in September 2020, aiming to comprehensively evaluate large language models' multitask understanding across 57 different domains.