 lancer
|
2b0667aee1
|
update the utils function and assert
|
2024-05-20 08:00:39 -07:00 |
|
|
lancer
|
6348d4196d
|
fix the unsupported block_size
|
2024-05-19 17:39:25 -07:00 |
|
|
Erik Schultheis
|
858c6e6dae
|
deterministic kernel
|
2024-05-16 01:04:10 +03:00 |
|
|
Erik Schultheis
|
2ccdfb70e0
|
general cleanup
|
2024-05-16 01:04:10 +03:00 |
|
|
Erik Schultheis
|
c66e48c06c
|
fixup comment
|
2024-05-13 20:58:07 +03:00 |
|
|
Erik Schultheis
|
65727d5a4d
|
fix CI compile by disabling kernel 5
|
2024-05-13 19:20:03 +03:00 |
|
|
Erik Schultheis
|
49ee3c8307
|
fix non-atomic version:
* accumulate instead of assign
* need dedicated argument to correctly handle the floatX == float case
|
2024-05-13 18:27:56 +03:00 |
|
|
Erik Schultheis
|
081d224b21
|
automatically switch to buffer-less version if that can fill up the GPU
|
2024-05-13 17:39:32 +03:00 |
|
|
Erik Schultheis
|
c0329ebdba
|
new kernel version with fewer atomics
|
2024-05-13 17:18:27 +03:00 |
|
|
Erik Schultheis
|
2287da0120
|
enable bf16
|
2024-05-12 19:42:32 +03:00 |
|
|
Erik Schultheis
|
ec92368f8b
|
added current backward bias kernel to dev cuda
|
2024-05-12 19:24:43 +03:00 |
|
|
lancer
|
5c90845f7a
|
update the -lcublas -lcublasLt flag in the comment
|
2024-05-09 22:04:02 -07:00 |
|
|
Andrej Karpathy
|
937fbd8e36
|
small doc fixes
|
2024-05-02 22:17:22 +00:00 |
|
|
Erik Schultheis
|
6e48501d60
|
bias backward kernel that will use all available threads
|
2024-05-03 01:05:47 +03:00 |
|
|
Andrej Karpathy
|
988489519c
|
nice new kernel for bias reduce, we are down by ~1ms/iter, to 76.13ms/iter on average
|
2024-04-22 17:51:06 +00:00 |
|
|
cip19aac
|
35393b4442
|
add more comments to explain the philosophy behind the kernel
|
2024-04-22 17:29:11 +01:00 |
|
|
cip19aac
|
b82ec201be
|
add comment
|
2024-04-22 17:05:05 +01:00 |
|
|
cip19aac
|
55fbd7e6ad
|
add a faster matmul backward bias kernel that uses coalesced reads and shared memory
|
2024-04-22 16:35:21 +01:00 |
|
|
Andrej Karpathy
|
9fb9c9185a
|
change baseline kernel to float, for now, for fair comparison too
|
2024-04-20 22:57:18 +00:00 |
|
|
Andrej Karpathy
|
8488669d25
|
speed up the backward bias kernel by 45% and speed up the full running time by 1%
|
2024-04-20 22:46:19 +00:00 |
|