Issues

• 最新7月榜为啥没有“文本理解与创作”这一项了？

  CLUEbenchmark/SuperCLUE#52 · Filter by author Ebola-Chan-bot opened on Aug 1, 2025

• www.langyb.com 不能访问了

  CLUEbenchmark/SuperCLUE#51 · Filter by author guotong1988 opened on Mar 28, 2025

• tobedelete

  CLUEbenchmark/SuperCLUE#50 · Filter by author Wangwentao1 opened on Feb 13, 2025

• 断更了？？？

  CLUEbenchmark/SuperCLUE#48 · Filter by author yiliangfang opened on Nov 9, 2024
  3

• 请问评测的原理是什么呀，是人工打分的吗，如果是客观题是直接比较返回的答案的字符串，主观题是人工评判答案吗

  CLUEbenchmark/SuperCLUE#47 · Filter by author starplatinum3 opened on Jul 26, 2024
  2

• 工具的评测是什么含义？ 是Function calling么，如果没有请添加此能力的评测。

  CLUEbenchmark/SuperCLUE#46 · Filter by author goqw opened on Apr 11, 2024
  1

• Claude3有评测吗？

  CLUEbenchmark/SuperCLUE#45 · Filter by author Pancat007 opened on Mar 28, 2024

• 请问如何对自己做的大模型使用该指标进行测评呢？

  CLUEbenchmark/SuperCLUE#44 · Filter by author deo651 opened on Mar 11, 2024
  6

• 请问一月榜单呢

  CLUEbenchmark/SuperCLUE#42 · Filter by author kindle939393 opened on Feb 3, 2024
  2

• 咨询一下，从测评报告来看，SuperCLUE是采用自动化方式的客观评估，是否可提供针对某一模型的可实际运行的自动化评测的python样例代码(api调用或者web)？

  CLUEbenchmark/SuperCLUE#40 · Filter by author Romanzhang2024 opened on Jan 4, 2024

• Where to download the benchmark dataset?

  CLUEbenchmark/SuperCLUE#38 · Filter by author zhimin-z opened on Nov 30, 2023

• How to calculate the metrics from the table in the paper to the leaderboard?

  CLUEbenchmark/SuperCLUE#37 · Filter by author zhimin-z opened on Nov 30, 2023
  1

• 大模型升级方式

  CLUEbenchmark/SuperCLUE#36 · Filter by author lukeup opened on Nov 27, 2023

• Where to locate the SuperCLUE-LYB leaderboards?

  CLUEbenchmark/SuperCLUE#34 · Filter by author zhimin-z opened on Nov 18, 2023

• 能否增加翻译的评估排名

  CLUEbenchmark/SuperCLUE#33 · Filter by author lx0126z opened on Oct 12, 2023

• 任务规划和工具使用的评价标准是什么样的？

  CLUEbenchmark/SuperCLUE#32 · Filter by author heibaidaolx123 opened on Sep 26, 2023
  1

• c-eval是真的离谱，希望superclue能更新的稍微快一点，比如1-2周更新一次

  CLUEbenchmark/SuperCLUE#31 · Filter by author iammeizu opened on Sep 8, 2023
  2

• anthropic拼错了

  CLUEbenchmark/SuperCLUE#30 · Filter by author JerryJiang12923 opened on Aug 8, 2023

• 求教一下 逻辑与推理 具体指哪方面？ 比如 "郭德纲2岁会看报,xxxx" ，请问郭德纲3岁会看书吗？ 这个属于推理还是语义理解能力？？

  CLUEbenchmark/SuperCLUE#29 · Filter by author ArtificialZeng opened on Aug 7, 2023

• 请问可以把vicuna-33B模型加入评测吗？

  CLUEbenchmark/SuperCLUE#28 · Filter by author Mr-wang2016 opened on Aug 3, 2023

• 测评时如何与标准答案进行匹配

  CLUEbenchmark/SuperCLUE#27 · Filter by author Starry-Hu opened on Jul 2, 2023

• 数据集开源吗？可以在哪里下载呢

  CLUEbenchmark/SuperCLUE#26 · Filter by author vanshaw2017 opened on Jun 26, 2023
  3

• 关于prompt设计的问题

  CLUEbenchmark/SuperCLUE#25 · Filter by author lrs1353281004 opened on Jun 24, 2023
  1

• 排名变化的原因是什么？

  CLUEbenchmark/SuperCLUE#24 · Filter by author zhaojiawen-coding opened on Jun 20, 2023
  1

• test the 智源大模型吧

  CLUEbenchmark/SuperCLUE#23 · Filter by author forkyguo opened on Jun 13, 2023
  3