099b173f6f
[DistPart] expose timeout config for process group ( #4532 )
...
* [DistPart] expose timeout config for process group
* refine code
* Update tools/distpartitioning/data_proc_pipeline.py
Co-authored-by: Minjie Wang <wmjlyjemaine@gmail.com >
Co-authored-by: Minjie Wang <wmjlyjemaine@gmail.com >
2022-09-15 15:28:36 +08:00
7a41c126f6
[Doc] Change random.py to random_partition.py in guide on distributed partition pipeline ( #4438 )
...
* Update distributed-preprocessing.rst
* Update
Co-authored-by: Ubuntu <ubuntu@ip-172-31-9-26.ap-northeast-1.compute.internal >
2022-08-22 18:12:55 +08:00
2e8ae9f980
[Dist][CI] Unit test for the new distributed partitioning pipeline ( #4394 )
...
* chunked graph data format
* Update
* Update
* Update task_distributed_test.sh
* Update
* Update
* Revert "Update"
This reverts commit 03c461870f19375fb03125b061fc853ab555577f.
* Update
* Update
* ssh-keygen
* CI
* install openssh
* openssh
* Update
* CI
* Update
* Update
Co-authored-by: Ubuntu <ubuntu@ip-172-31-53-142.us-west-2.compute.internal >
Co-authored-by: Ubuntu <ubuntu@ip-172-31-16-87.us-west-2.compute.internal >
Co-authored-by: Ubuntu <ubuntu@ip-172-31-20-21.us-west-2.compute.internal >
Co-authored-by: Ubuntu <ubuntu@ip-172-31-9-26.ap-northeast-1.compute.internal >
2022-08-19 14:20:56 +08:00
9501ed6a07
[Dist] master port should be fixed for all trainers ( #4108 )
...
* [Dist] master port should be fixed for all trainers
* add tests for tools/launch.py
2022-06-14 11:22:22 +08:00
ac01e88082
[Tools] In tools/launch.py, correctly pass all DGL client/server env vars if udf is a multi-command ( #3245 )
...
* Correctly pass all DGL client/server env vars if udf is a multi-command
* Refactor to use wrap_cmd_with_local_envvars() helper fn
2021-08-16 18:54:48 -07:00
c40bbf4f33
[Tools] Refactor tools/launch.py to handle more python binary names ( #3205 )
...
* Refactors torch dist launcher udf-wrap code to handle more python versions
* minor changes
2021-08-02 17:31:02 +08:00
Rhett Ying