 Andrej Karpathy
|
72698a5ba3
|
update gpt3 125M script to be better. should exactly reproduce gpt-3 125M, except we don't use banded attention and we use fineweb
|
2024-07-18 16:43:14 +00:00 |
|
|
Andrej Karpathy
|
528b1b0e31
|
fix fat fingers
|
2024-07-15 17:56:41 +00:00 |
|
|
Andrej Karpathy
|
039904ee9f
|
revert legacy behavior in .sh scripts for -e option
|
2024-07-15 17:55:26 +00:00 |
|
|
Erik Schultheis
|
b5d5ed7f68
|
updated example scripts
|
2024-07-12 14:46:09 +02:00 |
|
|
Andrej Karpathy
|
c6efd90a86
|
upload good 1558M sh script
|
2024-07-02 16:49:09 +00:00 |
|
|
Aleksa Gordic
|
a259eeabe5
|
Fix CI errors
|
2024-06-24 16:26:12 +02:00 |
|
|
Aleksa Gordic
|
3abdf9a3e4
|
Add gpus per node arg
|
2024-06-24 16:26:12 +02:00 |
|
|
Aleksa Gordic
|
bfdea887eb
|
Add launch scripts - tested
|
2024-06-24 16:26:12 +02:00 |
|
|
Andrej Karpathy
|
fd564f7b8a
|
add the gpt2 1558M repro script too
|
2024-06-19 02:26:39 +00:00 |
|
|
Andrej Karpathy
|
42dff87939
|
clarification we trained with 150B tokens
|
2024-06-12 15:51:14 +00:00 |
|
|
Andrej Karpathy
|
963aa6828e
|
add gpt-2 774M repro script
|
2024-06-12 15:33:19 +00:00 |
|
|
Andrej Karpathy
|
0fddf06043
|
more docs on scripts
|
2024-05-30 21:06:36 +00:00 |
|
|
Andrej Karpathy
|
fe36e40f2c
|
also move pyrun script to scripts/
|
2024-05-30 20:17:16 +00:00 |
|
|
Andrej Karpathy
|
a0d5dbbda6
|
scripts folder
|
2024-05-30 20:00:07 +00:00 |
|