 Andrej Karpathy
|
835bb2e6d7
|
delete segmentation fault when B < 4 atm
|
2024-07-16 01:20:16 +00:00 |
|
|
Ross Wheeler
|
5b95bff118
|
Dataloader test and ptx/sass file generator
Setup new test infrastructure
|
2024-06-21 17:23:03 -07:00 |
|
|
Aleksa Gordic
|
1120fa4465
|
Remove -1, point at current sample
|
2024-06-18 13:35:17 +02:00 |
|
|
Aleksa Gordic
|
077f9bdd59
|
Fix dataloader & determinism testing
|
2024-06-18 13:23:13 +02:00 |
|
|
Andrej Karpathy
|
efbbdc8f46
|
Merge branch 'master' of github.com:karpathy/llm.c
|
2024-06-18 03:03:37 +00:00 |
|
|
Andrej Karpathy
|
75b844898d
|
delete warning using an explicit cast to size_t
|
2024-06-18 03:01:06 +00:00 |
|
|
Erik Schultheis
|
19a34d8cdd
|
fix dataloader
|
2024-06-18 00:25:41 +03:00 |
|
|
Aleksa Gordic
|
7b5ee07e18
|
Minor refactor of dataloader
|
2024-06-17 21:53:18 +02:00 |
|
|
Andrej Karpathy
|
93d1450bdd
|
malloc -> mallocCheck in dataloader.h
|
2024-06-17 18:56:24 +00:00 |
|
|
Aleksa Gordic
|
328641f728
|
Minor refactor
|
2024-06-14 09:57:19 +02:00 |
|
|
Aleksa Gordic
|
ef3afcb1d6
|
Fix num samples bug
|
2024-06-14 09:37:38 +02:00 |
|
|
Aleksa Gordic
|
efd9df4c1b
|
Remove bool, add permutation on every shard advance
|
2024-06-13 23:36:24 +02:00 |
|
|
Aleksa Gordic
|
7e9328f724
|
Remove redundant headers, refactor
|
2024-06-13 23:15:39 +02:00 |
|
|
Aleksa Gordic
|
1329a2c80c
|
Change type from size_t to int to save space
|
2024-06-13 23:04:15 +02:00 |
|
|
Aleksa Gordic
|
814b83bbf1
|
Refactor
|
2024-06-13 22:43:57 +02:00 |
|
|
Aleksa Gordic
|
b7933ef62c
|
Modify state save/load
|
2024-06-13 21:22:16 +02:00 |
|
|
Aleksa Gordic
|
8f61f48cba
|
Add random inter/intra shard data shuffling
|
2024-06-13 20:21:49 +02:00 |
|
|
Aleksa Gordic
|
d57a52408e
|
Make C compiler happy - no default args
|
2024-06-13 20:21:49 +02:00 |
|
|
Aleksa Gordic
|
c3db1bb112
|
Set default seed value to null
|
2024-06-13 20:21:49 +02:00 |
|
|
Aleksa Gordic
|
af0b2f51c0
|
Start from a random position in a random shard
|
2024-06-13 20:21:49 +02:00 |
|
|
Aleksa Gordic
|
d9e867678e
|
Remove file size - not used
|
2024-06-03 12:14:58 +02:00 |
|
|
Aleksa Gordic
|
e86bd62374
|
Refactor eval loader - remove 2 unnecessary malloc calls per iteration
|
2024-06-03 11:43:33 +02:00 |
|
|
Andrej Karpathy
|
0bc24c36e6
|
fix bug in resumption of dataloader, have to reload shard
|
2024-05-31 22:19:37 +00:00 |
|
|
Andrej Karpathy
|
35aa110244
|
more refactor
|
2024-05-30 19:39:29 +00:00 |
|
|
Andrej Karpathy
|
eed242702a
|
experiment with adding the llmc lib directory
|
2024-05-27 21:10:28 +00:00 |
|