文件历史

提交图

4 次代码提交

作者 SHA1 备注 提交日期
Andrej Karpathy 8d55c4a6ac fix a bug, we have to be careful to make sure we evaluate loss at the token just before the first completion token, because that is the prediction for the first token, and its accuracy 2024-05-19 15:45:28 +00:00
Andrej Karpathy 4e14b52285 report both acc and acc_norm 2024-05-19 15:18:04 +00:00
Andrej Karpathy 7bd2389c1f add mmlu as well and refine both a bit 2024-05-19 14:23:51 +00:00
Andrej Karpathy aec9ce5d0a move hellaswag file to dev 2024-05-19 12:18:02 +00:00