 Andrej Karpathy
|
e6856bc566
|
fallback to memory allocation of m,v,master_weights on host automatically in case of OOM. will run slower but won't OOM
|
2024-08-16 17:23:42 +00:00 |
|
|
Erik Schultheis
|
f72c1f2c64
|
hint to host
|
2024-08-16 01:44:08 +03:00 |
|
|
Erik Schultheis
|
c8457572fa
|
just try to allocate on device; fallback if that fails
|
2024-08-16 01:43:56 +03:00 |
|
|
Erik Schultheis
|
0d52d2a3d7
|
fall back to cudaMallocManaged for optimizer states if we're out of memory
|
2024-08-16 01:42:30 +03:00 |
|
|
Erik Schultheis
|
cbe04c3f92
|
moved dtype utilities to cuda_utils
|
2024-07-18 17:13:38 +02:00 |
|
|
Erik Schultheis
|
8d994782cf
|
moved loss calculation to backward
|
2024-06-25 21:28:52 +03:00 |
|
|
Aleksa Gordic
|
bb9eab8736
|
Change positionX to uint
|
2024-06-19 21:05:28 +02:00 |
|
|
Aleksa Gordic
|
66950f3790
|
Cast computation to uint
|
2024-06-19 17:45:34 +02:00 |
|
|
Aleksa Gordic
|
ff14b0819f
|
Make sure each parameter was rounded with a unique seed
|
2024-06-15 12:02:39 +00:00 |
|
|
Erik Schultheis
|
f071efd94f
|
stride-based adam and copy-and-cast
|
2024-06-13 02:01:26 +03:00 |
|
|
Andrej Karpathy
|
45b0d1b378
|
copy and cast kernel move to cuda_utils, good general util
|
2024-06-03 23:14:59 +00:00 |
|
|
Erik Schultheis
|
67502c7f8e
|
moved device utilities into a separate file, and follow-up cleanup
|
2024-06-03 23:58:47 +03:00 |
|