 Aleksa Gordic
|
2667aa1e3e
|
Fix windows include issue
|
2024-06-24 23:18:38 +02:00 |
|
|
Aleksa Gordic
|
ac1e37b659
|
Remove linux socket funcs when windows
|
2024-06-24 18:56:48 +00:00 |
|
|
Aleksa Gordic
|
f9d0e8b67a
|
Add socket logic for Windows
|
2024-06-24 18:26:53 +00:00 |
|
|
Aleksa Gordic
|
fbf4f59c8f
|
Add MPI under multi gpu guard
|
2024-06-24 16:26:12 +02:00 |
|
|
Aleksa Gordic
|
3abdf9a3e4
|
Add gpus per node arg
|
2024-06-24 16:26:12 +02:00 |
|
|
Aleksa Gordic
|
bfdea887eb
|
Add launch scripts - tested
|
2024-06-24 16:26:12 +02:00 |
|
|
Aleksa Gordic
|
1bc3a5ef6e
|
Add all 3 init methods
|
2024-06-24 16:26:12 +02:00 |
|
|
Aleksa Gordic
|
1c6c5ff0b7
|
TCP working
|
2024-06-24 16:26:12 +02:00 |
|
|
Aleksa Gordic
|
5500b61da5
|
fs working
|
2024-06-24 16:26:12 +02:00 |
|
|
Aleksa Gordic
|
08c055cd72
|
Free up unified buffer mem
|
2024-06-24 16:26:12 +02:00 |
|
|
Aleksa Gordic
|
1bd737546c
|
Mini refactor
|
2024-06-24 16:26:12 +02:00 |
|
|
Aleksa Gordic
|
52db158367
|
Can not call set device after NCCL init
|
2024-06-24 16:26:12 +02:00 |
|
|
Aleksa Gordic
|
0addb503ef
|
Use NCCL where possible
|
2024-06-24 16:26:12 +02:00 |
|
|
Andrej Karpathy
|
43a903e1b4
|
revert old printf0, minor touchups and comments, add assert
|
2024-06-13 23:18:22 +00:00 |
|
|
Erik Schultheis
|
8cba9ba0c0
|
cleanup
|
2024-06-12 13:16:19 +03:00 |
|
|
Erik Schultheis
|
ecca976132
|
re-enable reduce-scatter operation
|
2024-06-12 13:16:19 +03:00 |
|
|
Erik Schultheis
|
ecdb0ca86e
|
refactored code
|
2024-06-12 13:16:19 +03:00 |
|