Andrej Karpathy
|
8d55c4a6ac
|
fix a bug, we have to be careful to make sure we evaluate loss at the token just before the first completion token, because that is the prediction for the first token, and its accuracy
|
2024-05-19 15:45:28 +00:00 |
|
Andrej Karpathy
|
4e14b52285
|
report both acc and acc_norm
|
2024-05-19 15:18:04 +00:00 |
|
Andrej Karpathy
|
7bd2389c1f
|
add mmlu as well and refine both a bit
|
2024-05-19 14:23:51 +00:00 |
|
Andrej Karpathy
|
aec9ce5d0a
|
move hellaswag file to dev
|
2024-05-19 12:18:02 +00:00 |
|