mirrors / karpathy--llm.c

文件历史

1,536 提交 53 分支 0 Git 标签
master
提交图

22 次代码提交

作者 SHA1 备注 提交日期
Erik Schultheis 39a41fa701 move cpu float reduction to zero 2024-07-12 11:12:58 +02:00
Erik Schultheis 4d1ec6832a rename parameters to avoid name clashes with global variable 2024-07-11 19:04:02 +02:00
Erik Schultheis 09b78bc902 move set_zero_configs into zero.cuh 2024-07-11 09:55:31 +02:00
Aleksa Gordic d27331cced Move socket header to utils.h 2024-07-02 21:17:28 +02:00
Aleksa Gordic 1ae3243185 Add check versions of socket close 2024-07-02 21:17:28 +02:00
Aleksa Gordic 2667aa1e3e Fix windows include issue 2024-06-24 23:18:38 +02:00
Aleksa Gordic ac1e37b659 Remove linux socket funcs when windows 2024-06-24 18:56:48 +00:00
Aleksa Gordic f9d0e8b67a Add socket logic for Windows 2024-06-24 18:26:53 +00:00
Aleksa Gordic fbf4f59c8f Add MPI under multi gpu guard 2024-06-24 16:26:12 +02:00
Aleksa Gordic 3abdf9a3e4 Add gpus per node arg 2024-06-24 16:26:12 +02:00
Aleksa Gordic bfdea887eb Add launch scripts - tested 2024-06-24 16:26:12 +02:00
Aleksa Gordic 1bc3a5ef6e Add all 3 init methods 2024-06-24 16:26:12 +02:00
Aleksa Gordic 1c6c5ff0b7 TCP working 2024-06-24 16:26:12 +02:00
Aleksa Gordic 5500b61da5 fs working 2024-06-24 16:26:12 +02:00
Aleksa Gordic 08c055cd72 Free up unified buffer mem 2024-06-24 16:26:12 +02:00
Aleksa Gordic 1bd737546c Mini refactor 2024-06-24 16:26:12 +02:00
Aleksa Gordic 52db158367 Can not call set device after NCCL init 2024-06-24 16:26:12 +02:00
Aleksa Gordic 0addb503ef Use NCCL where possible 2024-06-24 16:26:12 +02:00
Andrej Karpathy 43a903e1b4 revert old printf0, minor touchups and comments, add assert 2024-06-13 23:18:22 +00:00
Erik Schultheis 8cba9ba0c0 cleanup 2024-06-12 13:16:19 +03:00
Erik Schultheis ecca976132 re-enable reduce-scatter operation 2024-06-12 13:16:19 +03:00
Erik Schultheis ecdb0ca86e refactored code 2024-06-12 13:16:19 +03:00