 Andrej Karpathy
|
e6856bc566
|
fallback to memory allocation of m,v,master_weights on host automatically in case of OOM. will run slower but won't OOM
|
2024-08-16 17:23:42 +00:00 |
|
|
Erik Schultheis
|
0d52d2a3d7
|
fall back to cudaMallocManaged for optimizer states if we're out of memory
|
2024-08-16 01:42:30 +03:00 |
|
|
Erik Schultheis
|
09503dea4f
|
make windows happy
|
2024-06-25 21:28:52 +03:00 |
|
|
Erik Schultheis
|
4745f53589
|
boolean_constant utilities
|
2024-06-25 21:28:52 +03:00 |
|
|
Andrej Karpathy
|
98e928f1d8
|
minor fixes for disk device io
|
2024-06-23 01:14:42 +00:00 |
|
|
Erik Schultheis
|
d95313d0a9
|
explicit sync
|
2024-06-18 20:02:07 +03:00 |
|
|
Erik Schultheis
|
04234d0c24
|
utility functions for device <-> disk IO
|
2024-06-18 13:23:56 +03:00 |
|
|
Erik Schultheis
|
4d35bac1ae
|
added a determinism check
|
2024-06-17 23:47:29 +03:00 |
|
|
Andrej Karpathy
|
8940dcdcb1
|
Merge branch 'stream-2' of https://github.com/ngc92/llm.c into ngc92-stream-2
|
2024-06-04 22:52:26 +00:00 |
|
|
Erik Schultheis
|
bc35d3438e
|
naming the stream
|
2024-06-05 01:50:16 +03:00 |
|
|
Erik Schultheis
|
b02aab1f16
|
made implicit includes of standard headers explicit
|
2024-06-04 13:22:16 +03:00 |
|
|
Andrej Karpathy
|
094988738b
|
adjust the comment on extern deviceProp to be more descriptive
|
2024-06-03 22:57:00 +00:00 |
|
|
Andrej Karpathy
|
645feac1e7
|
move matmul
|
2024-06-03 22:54:07 +00:00 |
|
|
Erik Schultheis
|
67502c7f8e
|
moved device utilities into a separate file, and follow-up cleanup
|
2024-06-03 23:58:47 +03:00 |
|
|
Andrej Karpathy
|
001ad78fe1
|
resolve deviceProp and cudaCheck dupes
|
2024-06-03 19:54:32 +00:00 |
|
|
Andrej Karpathy
|
020b15ad77
|
small more fixes
|
2024-06-03 19:32:32 +00:00 |
|
|
Andrej Karpathy
|
5d9403479c
|
some fixes, still not done
|
2024-06-03 18:50:41 +00:00 |
|
|
Andrej Karpathy
|
804d0693c8
|
refactor part 2, moving stuff into common files so that we can later nicely separate out all the kernels as well
|
2024-06-03 18:10:33 +00:00 |
|