 Ross Wheeler
|
b203820232
|
Including unistd.h in cudnn_att.cpp for latest MSVC compiler
|
2024-07-20 11:57:10 -07:00 |
|
|
ademeure
|
29a067f916
|
Make cuDNN deterministic for Flash Attention backward (requires frontend >=1.5)
|
2024-06-27 13:33:02 +00:00 |
|
|
Erik Schultheis
|
ca7caac5c5
|
move all kernels into a main_stream in preparation for future parallelism
|
2024-06-04 22:35:12 +03:00 |
|
|
Ross Wheeler
|
4bfb23948d
|
Make clean fix and Windows cuDNN build fix
|
2024-06-03 20:26:52 -07:00 |
|
|
Erik Schultheis
|
67502c7f8e
|
moved device utilities into a separate file, and follow-up cleanup
|
2024-06-03 23:58:47 +03:00 |
|
|
Andrej Karpathy
|
020b15ad77
|
small more fixes
|
2024-06-03 19:32:32 +00:00 |
|
|
Andrej Karpathy
|
5d9403479c
|
some fixes, still not done
|
2024-06-03 18:50:41 +00:00 |
|
|
Andrej Karpathy
|
41dc65a0ef
|
attempt to move cudnn attention to the llmc directory
|
2024-06-03 03:23:04 +00:00 |
|