 Aleksa Gordic
|
b018b0c85c
|
Change default dataset path to tiny stories
|
2024-08-10 21:50:39 +02:00 |
|
|
Aleksa Gordic
|
d3151c4ace
|
Add llama 3 tokenization and data loader
|
2024-08-10 21:25:57 +02:00 |
|
|
Aleksa Gordic
|
d773c88e49
|
Remove unnecessary comment
|
2024-08-08 21:06:01 +02:00 |
|
|
Aleksa Gordic
|
c5c87fc4e7
|
Add comments, fix stop tokens
|
2024-08-08 20:54:17 +02:00 |
|
|
Aleksa Gordic
|
8b672ffcb9
|
Add data loader not implemented exception
|
2024-08-08 18:55:17 +02:00 |
|
|
Aleksa Gordic
|
f1c91f8ae3
|
Address Andrej's PR comments
|
2024-08-08 18:45:04 +02:00 |
|
|
Aleksa Gordic
|
dfd459bfc4
|
Remove prompts.json
|
2024-08-08 18:19:40 +02:00 |
|
|
Aleksa Gordic
|
624ed3ce30
|
Rename the new file to train llama3
|
2024-08-08 18:15:37 +02:00 |
|