 Andrej Karpathy
|
bd8c6045be
|
change default params: use tinyshakespeare and decrease LR
|
2024-09-13 19:04:08 +00:00 |
|
|
Andrej
|
ebc28b9563
|
Merge pull request #735 from gordicaleksa/minor_refactor3
Minor LLaMA 3 refactor
|
2024-08-27 04:24:22 +09:00 |
|
|
Aleksa Gordic
|
b018b0c85c
|
Change default dataset path to tiny stories
|
2024-08-10 21:50:39 +02:00 |
|
|
Aleksa Gordic
|
d3151c4ace
|
Add llama 3 tokenization and data loader
|
2024-08-10 21:25:57 +02:00 |
|
|
Aleksa Gordic
|
b0bc864320
|
Refactor flash logic
|
2024-08-10 18:51:56 +02:00 |
|
|
Aleksa Gordic
|
a0c666bfbb
|
Remove logprobs - like andrej in nano llama 3
|
2024-08-10 18:24:51 +02:00 |
|
|
Aleksa Gordic
|
92cc4ebf36
|
Add msg to asserts
|
2024-08-10 18:04:59 +02:00 |
|
|
Aleksa Gordic
|
a1278731a3
|
Minor refactor
|
2024-08-10 17:43:50 +02:00 |
|
|
Aleksa Gordic
|
d773c88e49
|
Remove unnecessary comment
|
2024-08-08 21:06:01 +02:00 |
|
|
Aleksa Gordic
|
c5c87fc4e7
|
Add comments, fix stop tokens
|
2024-08-08 20:54:17 +02:00 |
|
|
Aleksa Gordic
|
8b672ffcb9
|
Add data loader not implemented exception
|
2024-08-08 18:55:17 +02:00 |
|
|
Aleksa Gordic
|
f1c91f8ae3
|
Address Andrej's PR comments
|
2024-08-08 18:45:04 +02:00 |
|
|
Aleksa Gordic
|
dfd459bfc4
|
Remove prompts.json
|
2024-08-08 18:19:40 +02:00 |
|
|
Aleksa Gordic
|
624ed3ce30
|
Rename the new file to train llama3
|
2024-08-08 18:15:37 +02:00 |
|