 Da Zheng
|
e36c5db614
|
[Distributed] Simplify distributed API (#2775)
* remove num_workers.
* remove num_workers.
* remove num_workers.
* remove num-servers.
* update error message.
* update docstring.
* fix docs.
* fix tests.
* fix test.
* fix.
* print messages in test.
* fix.
* fix test.
* fix.
Co-authored-by: Ubuntu <ubuntu@ip-172-31-9-132.us-west-1.compute.internal>
|
2021-03-29 19:19:23 -07:00 |
|
|
Da Zheng
|
bb54206620
|
remove pyinstrument. (#2772)
Co-authored-by: xiang song(charlie.song) <classicxsong@gmail.com>
|
2021-03-21 20:27:12 -07:00 |
|
|
Da Zheng
|
d0638b1ea9
|
[Example] Update the example of distributed GNN training of RGCN (#2709)
* support gpu training.
* remove unnecessary arguments.
* update README.
* update time measurement.
* add zero_grad.
Co-authored-by: Ubuntu <ubuntu@ip-172-31-9-132.us-west-1.compute.internal>
Co-authored-by: Jinjing Zhou <VoVAllen@users.noreply.github.com>
|
2021-03-01 12:00:15 -08:00 |
|
|
Da Zheng
|
28b0a76618
|
[Example] Provide instructions of setting up passwordless SSH login. (#2707)
|
2021-02-27 18:34:46 -08:00 |
|
|
Ligeng Zhu
|
6568d0aaf6
|
[Example] Recommend NFS over copy files (#2689)
* Update README to use NFS, rather than copying files
* Update README.md
* Update README.md
* Update README.md
* Add ParMetis
* Update README.md
* fix directory.
* fix
* redo.
* fix.
* update.
* add more descriptions
Co-authored-by: Da Zheng <zhengda1936@gmail.com>
Co-authored-by: Quan Gan <coin2028@hotmail.com>
|
2021-02-25 20:20:52 +08:00 |
|
|
Da Zheng
|
0526b885ee
|
[Distributed] Fix the path for distributed partitioning. (#2700)
Co-authored-by: Ubuntu <ubuntu@ip-172-31-9-132.us-west-1.compute.internal>
|
2021-02-24 20:41:41 -08:00 |
|
|
Da Zheng
|
ff64bd0de8
|
add warning for a bug in README (#2665)
|
2021-02-16 00:16:40 -08:00 |
|
|
Da Zheng
|
e4ff484494
|
[Distributed] Distributed METIS partition (#2576)
* add convert.
* fix.
* add write_mag.
* fix convert_partition.py
* write data.
* use pyarrow to read.
* update write_mag.py
* fix convert_partition.py.
* load node/edge features when necessary.
* reshuffle nodes.
* write mag correctly.
* fix a bug: inner nodes in a partition might be empty.
* fix bugs.
* add verify code.
* insert reverse edges.
* fix a bug.
* add get node/edge data.
* add instructions.
* remove unnecessary argument.
* update distributed preprocessing.
* fix readme.
* fix.
* fix.
* fix.
* fix readme.
* fix doc.
* fix.
* update readme
* update doc.
* update readme.
Co-authored-by: Ubuntu <ubuntu@ip-172-31-9-132.us-west-1.compute.internal>
Co-authored-by: Ubuntu <ubuntu@ip-172-31-2-202.us-west-1.compute.internal>
|
2021-02-08 17:19:18 -08:00 |
|
|
Da Zheng
|
25ac334403
|
[Distributed] Heterogeneous graph support (#2457)
* Distributed heterograph (#3)
* heterogeneous graph partition.
* fix graph partition book for heterograph.
* load heterograph partitions.
* update DistGraphServer to support heterograph.
* make DistGraph runnable for heterograph.
* partition a graph and store parts with homogeneous graph structure.
* update DistGraph server&client to use homogeneous graph.
* shuffle node Ids based on node types.
* load mag in heterograph.
* fix per-node-type mapping.
* balance node types.
* fix for homogeneous graph
* store etype for now.
* fix data name.
* fix a bug in example.
* add profiler in rgcn.
* heterogeneous RGCN.
* map homogeneous node ids to hetero node ids.
* fix graph partition book.
* fix DistGraph.
* shuffle eids.
* verify eids and their mappings when loading a partition.
* Id map from homogneous Ids to per-type Ids.
* verify partitioned results.
* add test for distributed sampler.
* add mapping from per-type Ids to homogeneous Ids.
* update example.
* fix DistGraph.
* Revert "add profiler in rgcn."
This reverts commit 36daaed8b660933dac8f61a39faec3da2467d676.
* add tests for homogeneous graphs.
* fix a bug.
* fix test.
* fix for one partition.
* fix for standalone training and evaluation.
* small fix.
* fix two bugs.
* initialize projection matrix.
* small fix on RGCN.
* Fix rgcn performance (#17)
Co-authored-by: Ubuntu <ubuntu@ip-172-31-62-171.ec2.internal>
* fix lint.
* fix lint.
* fix lint.
* fix lint.
* fix lint.
* fix lint.
* fix.
* fix test.
* fix lint.
* test partitions.
* remove redundant test for partitioning.
* remove commented code.
* fix partition.
* fix tests.
* fix RGCN.
* fix test.
* fix test.
* fix test.
* fix.
* fix a bug.
* update dmlc-core.
* fix.
* fix rgcn.
* update readme.
* add comments.
Co-authored-by: Ubuntu <ubuntu@ip-172-31-2-202.us-west-1.compute.internal>
Co-authored-by: Ubuntu <ubuntu@ip-172-31-9-132.us-west-1.compute.internal>
Co-authored-by: xiang song(charlie.song) <classicxsong@gmail.com>
Co-authored-by: Ubuntu <ubuntu@ip-172-31-62-171.ec2.internal>
* fix.
* fix.
* add div_int.
* fix.
* fix.
* fix lint.
* fix.
* fix.
* fix.
* adjust.
* move code.
* handle heterograph.
* return pytorch tensor in GPB.
* remove some tests in example.
* add to_block for distributed training.
* use distributed to_block.
* remove unnecessary function in DistGraph.
* remove distributed to_block.
* use pytorch tensor.
* fix a bug in ntypes and etypes.
* enable norm.
* make the data loader compatible with the old format.
* fix.
* add comments.
* fix a bug.
* add test for heterograph.
* support partition without reshuffle.
* add test.
* support partition without reshuffle.
* fix.
* add test.
* fix bugs.
* fix lint.
* fix dataset.
* fix for mxnet.
* update docstring.
* rename to floor_div
* avoid exposing NodePartitionPolicy and EdgePartitionPolicy.
* fix docstring.
* fix error.
* fixes.
* fix comments.
* rename.
* rename.
* explain IdMap.
* fix docstring.
* fix docstring.
* update docstring.
* remove the code of returning heterograph.
* remove argument.
* fix example.
* make GraphPartitionBook an abstract class.
* fix.
* fix.
* fix a bug.
* fix a bug in example
* fix a bug
* reverse heterograph sampling.
* temp fix.
* fix lint.
* Revert "temp fix."
This reverts commit c450717b9f578b8c48769c675f2a19d6c1e64381.
* compute norm.
* Revert "reverse heterograph sampling."
This reverts commit bd6deb7f52998de76508f800441ff518e2fadcb9.
* fix.
* move id_map.py
* remove check
* add more comments.
* update docstring.
Co-authored-by: Ubuntu <ubuntu@ip-172-31-2-202.us-west-1.compute.internal>
Co-authored-by: Ubuntu <ubuntu@ip-172-31-9-132.us-west-1.compute.internal>
Co-authored-by: xiang song(charlie.song) <classicxsong@gmail.com>
Co-authored-by: Ubuntu <ubuntu@ip-172-31-62-171.ec2.internal>
|
2021-01-24 19:18:00 -08:00 |
|
|
xiang song(charlie.song)
|
782527d481
|
Fix partition for 0.5.1 (#2187)
Co-authored-by: Ubuntu <ubuntu@ip-172-31-24-210.ec2.internal>
|
2020-09-13 16:25:51 +08:00 |
|
|
Chao Ma
|
e8273a8510
|
update README.md (#2138)
|
2020-09-02 15:42:28 +08:00 |
|
|
xiang song(charlie.song)
|
0052f1212b
|
[Example] Rgcn distributed training (#1999)
* add entity_classify_dist
* upd
* update
* Fix
* Fix
* upd
* upd
* upd
* upd
* global eval
* Fix
* Fix
* Fix
* Fix
* FIx
* upd
* upd
* update
* support pytorch sparse embedding
* Fix
* Fix
* update Readme
* update with new API
* Fix
* update Readme
* add fanout for validation neighbor sampling
Co-authored-by: Ubuntu <ubuntu@ip-172-31-51-214.ec2.internal>
Co-authored-by: Ubuntu <ubuntu@ip-172-31-24-210.ec2.internal>
Co-authored-by: Chao Ma <mctt90@gmail.com>
Co-authored-by: Da Zheng <zhengda1936@gmail.com>
|
2020-08-18 12:12:21 -07:00 |
|