 Andrej Karpathy
|
90a7bfecf1
|
move fused classifier
|
2024-06-03 22:35:20 +00:00 |
|
|
Andrej Karpathy
|
2186cd6fe7
|
move attention
|
2024-06-03 22:19:47 +00:00 |
|
|
Andrej Karpathy
|
d8d55e0a08
|
move gelu to llmc
|
2024-06-03 21:57:02 +00:00 |
|
|
Andrej Karpathy
|
49b9776e50
|
also move the launchers
|
2024-06-03 21:37:18 +00:00 |
|
|
Andrej Karpathy
|
93546aed01
|
move encoder, kernel 1/N
|
2024-06-03 21:21:28 +00:00 |
|
|
Andrej
|
3392671826
|
Merge pull request #535 from ngc92/speed-up-compile
moved device utilities into a separate file, and follow-up cleanup
|
2024-06-03 14:11:10 -07:00 |
|
|
Erik Schultheis
|
67502c7f8e
|
moved device utilities into a separate file, and follow-up cleanup
|
2024-06-03 23:58:47 +03:00 |
|
|
Andrej
|
8cc39a794b
|
Merge pull request #528 from gordicaleksa/refactor_evalloader
Refactor eval loader - remove 2 unnecessary malloc calls per iteration
|
2024-06-03 13:54:52 -07:00 |
|
|
Andrej Karpathy
|
001ad78fe1
|
resolve deviceProp and cudaCheck dupes
|
2024-06-03 19:54:32 +00:00 |
|
|
Andrej Karpathy
|
020b15ad77
|
small more fixes
|
2024-06-03 19:32:32 +00:00 |
|
|
Andrej Karpathy
|
5d9403479c
|
some fixes, still not done
|
2024-06-03 18:50:41 +00:00 |
|
|
Andrej Karpathy
|
804d0693c8
|
refactor part 2, moving stuff into common files so that we can later nicely separate out all the kernels as well
|
2024-06-03 18:10:33 +00:00 |
|
|
Aleksa Gordic
|
d9e867678e
|
Remove file size - not used
|
2024-06-03 12:14:58 +02:00 |
|
|
Aleksa Gordic
|
e86bd62374
|
Refactor eval loader - remove 2 unnecessary malloc calls per iteration
|
2024-06-03 11:43:33 +02:00 |
|
|
Andrej Karpathy
|
41dc65a0ef
|
attempt to move cudnn attention to the llmc directory
|
2024-06-03 03:23:04 +00:00 |
|
|
Andrej Karpathy
|
1ac30591f2
|
add new file llmc/mfu.h for MFU calculations for different GPUs
|
2024-06-03 01:41:18 +00:00 |
|
|
Aleksa Gordic
|
ae9c957273
|
Add clarification on Box-Muller
|
2024-06-02 15:04:45 +02:00 |
|
|
Andrej Karpathy
|
0bc24c36e6
|
fix bug in resumption of dataloader, have to reload shard
|
2024-05-31 22:19:37 +00:00 |
|
|
Andrej Karpathy
|
35aa110244
|
more refactor
|
2024-05-30 19:39:29 +00:00 |
|
|
Andrej Karpathy
|
eed242702a
|
experiment with adding the llmc lib directory
|
2024-05-27 21:10:28 +00:00 |
|