mirrors / karpathy--llm.c

项目文件夹

karpathy--llm.c
文件
feature/streams
T
文件历史
Andrej Karpathy d5f7458e03 Merge branch 'stream-2' of https://github.com/ngc92/llm.c into ngc92-stream-2
2024-06-05 00:23:19 +00:00
..
adamw.cuh
move all kernels into a main_stream in preparation for future parallelism
2024-06-04 22:35:12 +03:00
attention.cuh
move all kernels into a main_stream in preparation for future parallelism
2024-06-04 22:35:12 +03:00
cublas_common.h
made implicit includes of standard headers explicit
2024-06-04 13:22:16 +03:00
cuda_common.h
Merge branch 'stream-2' of https://github.com/ngc92/llm.c into ngc92-stream-2
2024-06-04 22:52:26 +00:00
cuda_utils.cuh
copy and cast kernel move to cuda_utils, good general util
2024-06-03 23:14:59 +00:00
cudnn_att.cpp
move all kernels into a main_stream in preparation for future parallelism
2024-06-04 22:35:12 +03:00
cudnn_att.h
move all kernels into a main_stream in preparation for future parallelism
2024-06-04 22:35:12 +03:00
dataloader.h
Remove file size - not used
2024-06-03 12:14:58 +02:00
encoder.cuh
Merge branch 'stream-2' of https://github.com/ngc92/llm.c into ngc92-stream-2
2024-06-04 22:52:26 +00:00
fused_classifier.cuh
move all kernels into a main_stream in preparation for future parallelism
2024-06-04 22:35:12 +03:00
gelu.cuh
move all kernels into a main_stream in preparation for future parallelism
2024-06-04 22:35:12 +03:00
global_norm.cuh
moved remaining memcpy/memset in the training loop to main_stream
2024-06-05 02:06:32 +03:00
layernorm.cuh
moved remaining memcpy/memset in the training loop to main_stream
2024-06-05 02:06:32 +03:00
logger.h
made implicit includes of standard headers explicit
2024-06-04 13:22:16 +03:00
matmul.cuh
Merge branch 'stream-2' of https://github.com/ngc92/llm.c into ngc92-stream-2
2024-06-04 22:52:26 +00:00
mfu.h
add new file llmc/mfu.h for MFU calculations for different GPUs
2024-06-03 01:41:18 +00:00
rand.h
Add clarification on Box-Muller
2024-06-02 15:04:45 +02:00
sampler.h
refactor part 2, moving stuff into common files so that we can later nicely separate out all the kernels as well
2024-06-03 18:10:33 +00:00
tokenizer.h
made implicit includes of standard headers explicit
2024-06-04 13:22:16 +03:00
utils.h
made implicit includes of standard headers explicit
2024-06-04 13:22:16 +03:00