mirrors / karpathy--llm.c

项目文件夹

karpathy--llm.c
文件
feature/permuted_dataloader
T
文件历史
Andrej Karpathy 14d9cd671e resolve merge conflict in staate file between use_master_weights and DataLoader should_shuffle
2024-06-17 19:16:42 +00:00
..
adamw.cuh
Make sure each parameter was rounded with a unique seed
2024-06-15 12:02:39 +00:00
attention.cuh
consolidate memory by deleting the grad activation struct, move some of the last pieces of memory to the forward pass
2024-06-14 00:54:58 +00:00
cublas_common.h
made implicit includes of standard headers explicit
2024-06-04 13:22:16 +03:00
cuda_common.h
Merge branch 'stream-2' of https://github.com/ngc92/llm.c into ngc92-stream-2
2024-06-04 22:52:26 +00:00
cuda_utils.cuh
Make sure each parameter was rounded with a unique seed
2024-06-15 12:02:39 +00:00
cudnn_att.cpp
move all kernels into a main_stream in preparation for future parallelism
2024-06-04 22:35:12 +03:00
cudnn_att.h
move all kernels into a main_stream in preparation for future parallelism
2024-06-04 22:35:12 +03:00
dataloader.h
malloc -> mallocCheck in dataloader.h
2024-06-17 18:56:24 +00:00
encoder.cuh
Merge branch 'stream-2' of https://github.com/ngc92/llm.c into ngc92-stream-2
2024-06-04 22:52:26 +00:00
fused_classifier.cuh
Support 100% determinism, fix race condition, update global norm
2024-06-14 11:57:07 +02:00
gelu.cuh
Fix guarding logic, refactor
2024-06-17 14:12:05 +02:00
global_norm.cuh
Add a minor note that code is coupled
2024-06-16 23:54:09 +02:00
layernorm.cuh
Fix guarding logic, refactor
2024-06-17 14:12:05 +02:00
logger.h
Add learning rate and grad norm logging
2024-06-07 17:34:42 +02:00
matmul.cuh
Merge branch 'stream-2' of https://github.com/ngc92/llm.c into ngc92-stream-2
2024-06-04 22:52:26 +00:00
mfu.h
Add H100 PCIe
2024-06-14 09:23:55 +02:00
rand.h
Minor refactor
2024-06-14 09:57:19 +02:00
sampler.h
refactor part 2, moving stuff into common files so that we can later nicely separate out all the kernels as well
2024-06-03 18:10:33 +00:00
tokenizer.h
made implicit includes of standard headers explicit
2024-06-04 13:22:16 +03:00
utils.h
made implicit includes of standard headers explicit
2024-06-04 13:22:16 +03:00
zero.cuh
revert old printf0, minor touchups and comments, add assert
2024-06-13 23:18:22 +00:00