Da Zheng
2dd114ed24
[Distributed] Measure peak memory size in graph partitioning ( #3633 )
...
* measure peak memory size.
* fix lint.
Co-authored-by: Ubuntu <ubuntu@ip-172-31-30-164.us-west-2.compute.internal >
2022-01-13 15:41:53 -08:00
Rhett Ying
37467e2589
[Feature][Dist] change TP::Receiver/TP::Sender for multiple connections ( #3574 )
...
* [Feature] enable TP::Receiver wait for any numbers of senders
* fix random unit test failure
* avoid endless future wait
* fix unit test failure
* fix seg fault when finalize wait in receiver
* [Feature] refactor sender connect logic and remove unnecessary sleeps in unit tests
* fix lint
* release RPCContext resources before process exits
* [Debug] TPReceiver wait start log
* [Debug] add log in get port
* [Debug] add log
* [ReDebug] revert time sleep in unit tests
* [Debug] remove sleep for test_distri,test_mp
* [debug] add more log
* [debug] add listen_booted_ flag
* [debug] restore commented code for queue
* [debug] sleep more in rpc_client
* restore change in tests
* Revert "restore change in tests"
This reverts commit 41a18926d181ec2517069389bfc41de2cc949280.
* Revert "[debug] sleep more in rpc_client"
This reverts commit a908e758eabca0a6ce62eb2e59baea02a840ac67.
* Revert "[debug] restore commented code for queue"
This reverts commit d3f993b3746e6bb6e2cc2f90204dd7e9461c6301.
* Revert "[debug] add listen_booted_ flag"
This reverts commit 244b2167d94942ff2a0acec8823b974975e52580.
* Revert "[debug] add more log"
This reverts commit 4b78447b0a575a824821dc7e25cca2246e6e30e2.
* Revert "[Debug] remove sleep for test_distri,test_mp"
This reverts commit e1df1aadcc8b1c2a0013ed77322ac391a8807612.
* remove debug code
* revert unnecessary change
* revert unnecessary changes
* always reset RPCContext when get started and reset all data
* remove time.sleep in dist tests
* fix lint
* reset envs before each dist test
* reset env properly
* add time sleep when start each server
* sleep for a while when boot server
* replace wait_thread with callback
* fix lint
* add dglconnect handshake check
Co-authored-by: Jinjing Zhou <VoVAllen@users.noreply.github.com >
2022-01-11 08:55:36 +08:00
Jinjing Zhou
a3ce780d29
[RPC] Use tensorpipe for rpc communication ( #3335 )
...
* doesn't know whether works
* add change
* fix
* fix
* fix
* remove
* revert
* lint
* lint
* fix
* revert
* lint
* fix
* only build rpc on linux
* lint
* lint
* fix build on windows
* fix windows
* remove old test
* fix cmake
* Revert "remove old test"
This reverts commit f1ea75c777c34cdc1f08c0589676ba6aee1feb29.
* fix windows
* fix
* fix
* fix indent
* fix indent
* address comment
* fix
* fix
* fix
* fix
* fix
* lint
* fix indent
* fix lint
* add introduction
* fix
* lint
* lint
* add more logs
* fix
* update xbyak for C++14 with gcc5
* Remove channels
* fix
* add test script
* fix
* remove unused file
* fix lint
* add timeout
2021-12-06 20:03:33 +08:00
Quan (Andy) Gan
eb08ef3831
[Distributed] Edge-type-specific fanouts for heterogeneous graphs ( #3558 )
...
* first commit
* second commit
* spaghetti unit tests
* rewrite test
2021-12-06 13:59:29 +08:00
xiang song(charlie.song)
156c17f3a6
[BugFix] Fix a bug of distributed SparseAdam optimizer. ( #3561 )
...
* Fix dist user embed bug
* Add some comments
* trigger
Co-authored-by: xiangsx <xiangsx@ip-10-3-83-86.eu-west-1.compute.internal >
2021-12-03 21:29:25 -08:00
Rhett Ying
7c7b60be18
[BugFix] add count_nonzero() into SA_Client ( #3417 )
2021-10-12 06:17:30 -07:00
Jingcheng Yu
5cf48fc69c
[Feature] Implement one thread multiple socket ( #3200 )
...
Co-authored-by: JingchengYu94 <jingchengyu94@gmail.com >
2021-09-27 21:45:52 -07:00
xiang song(charlie.song)
f4fe518ff7
[Feature] Add a HINT for the per edge type sampler of heterogeneous DistGraph that highlighting the etypes are sorted already. ( #3260 )
...
* pass cpp test
* distgraph use sorted edge flag.
* lint
* triger
* update test
Co-authored-by: Ubuntu <ubuntu@ip-172-31-2-66.ec2.internal >
2021-09-01 15:36:01 +08:00
Da Zheng
e5ed7adc12
[Distributed] Fix a bug in sampling an empty frontier ( #3298 )
...
* handle empty frontiers.
* fix lint.
* fix
Co-authored-by: Ubuntu <ubuntu@ip-172-31-2-202.us-west-1.compute.internal >
Co-authored-by: xiang song(charlie.song) <classicxsong@gmail.com >
2021-08-29 10:54:46 -07:00
nv-dlasalle
7f9279397a
[Feature][DistDGL] Add NCCL support for range based partitions ( #3213 )
...
* Implement range based NDArrayPartition
* Finish implement range based partition support
* Add unit test
* Fix whitepace
* Add Kernel suffix
* Fix argument passing
* Add doxygen docs and improve variable naming
* Add unit test
* Add function for converting a partition book
* Add example to partition_op docs
* Fix dtype conversion for mxnet and tensorflow
2021-08-19 21:17:55 -07:00
xiang song(charlie.song)
6f36dd6366
Cleanup some code in graph_services.py ( #3238 )
...
* Fix bug
* Fix
* Fix
* upd
* Merge some code
* lint
2021-08-15 11:58:37 -07:00
xiang song(charlie.song)
cd2cf606db
[Bugfix] Fix bug introduced by https://github.com/dmlc/dgl/pull/3131 ( #3234 )
...
* Fix bug
* Fix
* Fix
* upd
* trigger
2021-08-10 11:36:57 +08:00
xiang song(charlie.song)
bcf92f6c21
[Bugfix] Distributed training can not work with dgl.dataloading.negative_sampler ( #3215 )
...
* Fix dist negative data loader bug
* upd
* Fix
Co-authored-by: Da Zheng <zhengda1936@gmail.com >
2021-08-06 20:41:20 +08:00
freeliuzc
45858d6803
[feature] add count_nonzero function for DistTensor ( #3203 )
...
* add count_nonzero function for DistTensor
* change the load method of local data
Co-authored-by: liuzichang04 <liuzichang04@meituan.com >
Co-authored-by: Jinjing Zhou <VoVAllen@users.noreply.github.com >
Co-authored-by: Da Zheng <zhengda1936@gmail.com >
2021-08-05 10:47:50 -07:00
Jinjing Zhou
8bc91414e9
[Distributed] Fix distributed training hang with multiple samplers ( #3169 )
...
Rewrite the multiprocessing worker pool
2021-08-01 21:31:04 +08:00
Da Zheng
cb4a83a233
[Distributed] Enable distributed EdgeDataLoader ( #3192 )
...
* make heterogeneous find_edges
* add distributed EdgeDataLoader.
* fix.
* fix a bug.
* fix bugs.
* add tests on distributed heterogeneous graph sampling.
* fix.
Co-authored-by: Zheng <dzzhen@3c22fba32af5.ant.amazon.com >
2021-07-28 15:28:27 +08:00
xiang song(charlie.song)
ba7e7cf931
[New Feature] Per edge type sampler for to_homogeneous graphs. ( #3131 )
...
* fix.
* fix.
* fix.
* fix.
* Fix test
* Deprecate old DistEmbedding impl, use synchronized embedding impl
* Basic imple of heterogeneous on homogenenous sampling
* make pass
* Pass C++ test
* Add python test code
* lint
* lint
* Add MultiLayerEtypeNeighborSampler
* Add unitest for single machine dataloader
* Add dist dataloader test for edge type sampler
* Fix lint
* fix
* support for per etype sample
* Fix some bug and enable distributed training with per edge sample
* fix
* Now distributed training works
* turn off some mxnet
* turn off mxnet for some dist test
* fix
* upd
* upd according to the comments
* Fix
* Fix test and now distributed works.
* upd
* upd
* Fix
* Fix bug
* remove dead code.
* upd
* Fix
* upd
* Fix
Co-authored-by: Ubuntu <ubuntu@ip-172-31-71-112.ec2.internal >
Co-authored-by: Ubuntu <ubuntu@ip-172-31-2-66.ec2.internal >
Co-authored-by: Da Zheng <zhengda1936@gmail.com >
2021-07-28 11:51:32 +08:00
Da Zheng
34426a98e9
[Distributed] Distributed heterograph training ( #3069 )
...
* support hetero RGCN.
* fix.
* simplify code.
* sample_neighbors return heterograph directly.
* avoid using to_heterogeneous.
* compute canonical etypes in advance.
* fix tests.
* fix.
* fix distributed data loader for heterograph.
* use NodeDataLoader.
* fix bugs in partitioning on heterogeneous graphs.
* fix lint.
* fix tests.
* fix.
* fix.
* fix bugs.
* fix tests.
* fix.
* enable coo for distributed.
* fix.
* fix.
* fix.
* fix.
* fix.
Co-authored-by: Ubuntu <ubuntu@ip-172-31-71-112.ec2.internal >
Co-authored-by: Zheng <dzzhen@3c22fba32af5.ant.amazon.com >
2021-07-17 10:57:00 +08:00
Jingcheng Yu
b379dbd6c8
Optimize dist_graph/_split_even_to_part memory usage ( #3132 )
...
Co-authored-by: yujingcheng02 <yujingcheng02@meituan.com >
Co-authored-by: Quan (Andy) Gan <coin2028@hotmail.com >
2021-07-15 11:51:56 +08:00
xiang song(charlie.song)
d7390763f0
[Distributed] Deprecate old DistEmbedding impl, use synchronized embedding impl ( #3111 )
...
* fix.
* fix.
* fix.
* fix.
* Fix test
* Deprecate old DistEmbedding impl, use synchronized embedding impl
* update doc
Co-authored-by: Ubuntu <ubuntu@ip-172-31-71-112.ec2.internal >
Co-authored-by: Ubuntu <ubuntu@ip-172-31-2-66.ec2.internal >
Co-authored-by: Da Zheng <zhengda1936@gmail.com >
Co-authored-by: Jinjing Zhou <VoVAllen@users.noreply.github.com >
2021-07-14 00:15:53 +08:00
Jinjing Zhou
4556fab8e6
[Fix] Use logging to print warning message in socket creation ( #3098 )
...
* fix
* fix
* lint
* fix
Co-authored-by: Quan (Andy) Gan <coin2028@hotmail.com >
2021-07-06 15:33:43 +08:00
Da Zheng
485c04cff6
[Distributed] Fix a few bugs in distributed API ( #3094 )
...
* fix.
* fix.
* fix.
* fix.
* Fix test
Co-authored-by: Ubuntu <ubuntu@ip-172-31-71-112.ec2.internal >
Co-authored-by: Ubuntu <ubuntu@ip-172-31-2-66.ec2.internal >
2021-07-05 15:12:02 +08:00
Da Zheng
0884d02465
[Distributed] Fix bugs in partitioning on heterogeneous graphs. ( #3085 )
...
* fix bugs in partitioning on heterogeneous graphs.
* fix.
* fix.
* fix example.
* fix.
* fix test.
* fix.
* fix.
* fix.
* fix tests.
Co-authored-by: Ubuntu <ubuntu@ip-172-31-71-112.ec2.internal >
Co-authored-by: Zheng <dzzhen@3c22fba32af5.ant.amazon.com >
2021-07-02 21:16:14 +08:00
Da Zheng
aaec3d8a0b
[Distributed] Support hierarchical partitioning ( #3000 )
...
* add.
* fix.
* fix.
* fix.
* fix.
* add tests.
* support node split and edge split.
* support 1 partition.
* add tests.
* fix.
* fix test.
* use hierarchical partition.
* add check.
Co-authored-by: Zheng <dzzhen@3c22fba32af5.ant.amazon.com >
Co-authored-by: Ubuntu <ubuntu@ip-172-31-22-57.us-west-2.compute.internal >
Co-authored-by: Ubuntu <ubuntu@ip-172-31-71-112.ec2.internal >
2021-06-16 16:58:23 +08:00
Da Zheng
7a816f4743
[Doc] Minor fix on the distributed training doc. ( #2968 )
...
Co-authored-by: Zheng <dzzhen@3c22fba32af5.ant.amazon.com >
2021-06-02 18:46:52 +08:00
Da Zheng
18dbaebebc
[Distributed] Specify the graph format for distributed training ( #2948 )
...
* explicitly set the graph format.
* fix.
* fix.
* fix launch script.
* fix readme.
Co-authored-by: Zheng <dzzhen@3c22fba32af5.ant.amazon.com >
Co-authored-by: xiang song(charlie.song) <classicxsong@gmail.com >
Co-authored-by: Ubuntu <ubuntu@ip-172-31-71-112.ec2.internal >
2021-05-26 18:09:30 +08:00
Da Zheng
6e7f19f27b
[Distributed] add distributed in-degree and out-degree. ( #2918 )
...
* add distributed in-degree and out-degree.
* update comments.
* fix a bug.
* add tests.
* add tests.
* fix a bug.
* fix docstring.
* update doc.
* fix
* fix.
Co-authored-by: Zheng <dzzhen@3c22fba32af5.ant.amazon.com >
Co-authored-by: xiang song(charlie.song) <classicxsong@gmail.com >
2021-05-18 19:46:09 +08:00
chwan-rice
e156331b0e
return a list of ntypes/etypes ( #2742 )
...
Co-authored-by: Da Zheng <zhengda1936@gmail.com >
2021-05-13 10:42:50 +08:00
xiang song(charlie.song)
975eb8fc5d
[Distributed] Distributed node embedding and sparse optimizer ( #2733 )
...
* Draft for sparse emb
* add some notes
* Fix
* Add sparse optim for dist pytorch
* Update test
* Fix
* upd
* upd
* Fix
* Fix
* Fix bug
* add transductive exmpale
* Fix example
* Some fix
* Upd
* Fix lint
* lint
* lint
* lint
* upd
* Fix lint
* lint
* upd
* remove dead import
* update
* lint
* update unitest
* update example
* Add adam optimizer
* Add unitest and update data
* upd
* upd
* upd
* Fix docstring and fix some bug in example code
* Update rgcn readme
Co-authored-by: Ubuntu <ubuntu@ip-172-31-57-25.ec2.internal >
Co-authored-by: Ubuntu <ubuntu@ip-172-31-24-210.ec2.internal >
Co-authored-by: Ubuntu <ubuntu@ip-172-31-2-66.ec2.internal >
2021-05-03 08:37:40 +08:00
Da Zheng
d76af4d4c1
[Distributed] Return the ID mapping in graph partitioning. ( #2857 )
...
* return mapping.
* support heterogeneous graph.
* more test.
* fix lint.
* fix for diff backends.
* fix.
* fix.
Co-authored-by: Zheng <dzzhen@3c22fba32af5.ant.amazon.com >
Co-authored-by: xiang song(charlie.song) <classicxsong@gmail.com >
2021-04-22 17:51:42 +08:00
Da Zheng
de5e8e2392
[Distributed] Fix a bug for graphs without node/edge data. ( #2838 )
...
* fix.
* test distributed graph without node/edge data.
* remove some tests.
* fix lint
2021-04-12 22:35:01 -07:00
Tonny-Gu
0fce09074d
[Distributed] Bind to the correct NIC ( #2798 )
...
Co-authored-by: Da Zheng <zhengda1936@gmail.com >
2021-04-08 17:56:30 -07:00
Da Zheng
bfbbefa793
[Distributed] Fix a bug in multiprocessing sampling. ( #2826 )
...
Co-authored-by: Ubuntu <ubuntu@ip-172-31-73-81.ec2.internal >
Co-authored-by: Jinjing Zhou <VoVAllen@users.noreply.github.com >
2021-04-08 01:29:33 -07:00
Da Zheng
e36c5db614
[Distributed] Simplify distributed API ( #2775 )
...
* remove num_workers.
* remove num_workers.
* remove num_workers.
* remove num-servers.
* update error message.
* update docstring.
* fix docs.
* fix tests.
* fix test.
* fix.
* print messages in test.
* fix.
* fix test.
* fix.
Co-authored-by: Ubuntu <ubuntu@ip-172-31-9-132.us-west-1.compute.internal >
2021-03-29 19:19:23 -07:00
Da Zheng
97863ab85b
[Distributed] Cleanup the process pool correctly when the process exits. ( #2781 )
...
Co-authored-by: xiang song(charlie.song) <classicxsong@gmail.com >
2021-03-29 14:53:51 -07:00
Da Zheng
d0638b1ea9
[Example] Update the example of distributed GNN training of RGCN ( #2709 )
...
* support gpu training.
* remove unnecessary arguments.
* update README.
* update time measurement.
* add zero_grad.
Co-authored-by: Ubuntu <ubuntu@ip-172-31-9-132.us-west-1.compute.internal >
Co-authored-by: Jinjing Zhou <VoVAllen@users.noreply.github.com >
2021-03-01 12:00:15 -08:00
Ligeng Zhu
7ab3d993a4
Change the absolute path to relative one in part_config.json ( #2690 )
...
* Update partition.py
* fix lint.
Co-authored-by: Da Zheng <zhengda1936@gmail.com >
2021-02-24 16:12:19 -08:00
Minjie Wang
8a07ab7737
[Doc] Tutorials re-organization ( #2683 )
...
* reorg
* change titles
* rm some stale API doc; minor fix
* fix docs
* add warning
* rm new-tutorial run in ci
* lint
2021-02-20 17:42:45 +08:00
Da Zheng
0fc649523b
[Doc] Distributed heterogeneous graph training ( #2654 )
...
* update DistGraph docstrings.
* add user guide.
* add doc string.
* fix.
* fix.
* fix.
Co-authored-by: Jinjing Zhou <VoVAllen@users.noreply.github.com >
2021-02-19 10:48:05 -08:00
Da Zheng
25ac334403
[Distributed] Heterogeneous graph support ( #2457 )
...
* Distributed heterograph (#3 )
* heterogeneous graph partition.
* fix graph partition book for heterograph.
* load heterograph partitions.
* update DistGraphServer to support heterograph.
* make DistGraph runnable for heterograph.
* partition a graph and store parts with homogeneous graph structure.
* update DistGraph server&client to use homogeneous graph.
* shuffle node Ids based on node types.
* load mag in heterograph.
* fix per-node-type mapping.
* balance node types.
* fix for homogeneous graph
* store etype for now.
* fix data name.
* fix a bug in example.
* add profiler in rgcn.
* heterogeneous RGCN.
* map homogeneous node ids to hetero node ids.
* fix graph partition book.
* fix DistGraph.
* shuffle eids.
* verify eids and their mappings when loading a partition.
* Id map from homogneous Ids to per-type Ids.
* verify partitioned results.
* add test for distributed sampler.
* add mapping from per-type Ids to homogeneous Ids.
* update example.
* fix DistGraph.
* Revert "add profiler in rgcn."
This reverts commit 36daaed8b660933dac8f61a39faec3da2467d676.
* add tests for homogeneous graphs.
* fix a bug.
* fix test.
* fix for one partition.
* fix for standalone training and evaluation.
* small fix.
* fix two bugs.
* initialize projection matrix.
* small fix on RGCN.
* Fix rgcn performance (#17 )
Co-authored-by: Ubuntu <ubuntu@ip-172-31-62-171.ec2.internal >
* fix lint.
* fix lint.
* fix lint.
* fix lint.
* fix lint.
* fix lint.
* fix.
* fix test.
* fix lint.
* test partitions.
* remove redundant test for partitioning.
* remove commented code.
* fix partition.
* fix tests.
* fix RGCN.
* fix test.
* fix test.
* fix test.
* fix.
* fix a bug.
* update dmlc-core.
* fix.
* fix rgcn.
* update readme.
* add comments.
Co-authored-by: Ubuntu <ubuntu@ip-172-31-2-202.us-west-1.compute.internal >
Co-authored-by: Ubuntu <ubuntu@ip-172-31-9-132.us-west-1.compute.internal >
Co-authored-by: xiang song(charlie.song) <classicxsong@gmail.com >
Co-authored-by: Ubuntu <ubuntu@ip-172-31-62-171.ec2.internal >
* fix.
* fix.
* add div_int.
* fix.
* fix.
* fix lint.
* fix.
* fix.
* fix.
* adjust.
* move code.
* handle heterograph.
* return pytorch tensor in GPB.
* remove some tests in example.
* add to_block for distributed training.
* use distributed to_block.
* remove unnecessary function in DistGraph.
* remove distributed to_block.
* use pytorch tensor.
* fix a bug in ntypes and etypes.
* enable norm.
* make the data loader compatible with the old format.
* fix.
* add comments.
* fix a bug.
* add test for heterograph.
* support partition without reshuffle.
* add test.
* support partition without reshuffle.
* fix.
* add test.
* fix bugs.
* fix lint.
* fix dataset.
* fix for mxnet.
* update docstring.
* rename to floor_div
* avoid exposing NodePartitionPolicy and EdgePartitionPolicy.
* fix docstring.
* fix error.
* fixes.
* fix comments.
* rename.
* rename.
* explain IdMap.
* fix docstring.
* fix docstring.
* update docstring.
* remove the code of returning heterograph.
* remove argument.
* fix example.
* make GraphPartitionBook an abstract class.
* fix.
* fix.
* fix a bug.
* fix a bug in example
* fix a bug
* reverse heterograph sampling.
* temp fix.
* fix lint.
* Revert "temp fix."
This reverts commit c450717b9f578b8c48769c675f2a19d6c1e64381.
* compute norm.
* Revert "reverse heterograph sampling."
This reverts commit bd6deb7f52998de76508f800441ff518e2fadcb9.
* fix.
* move id_map.py
* remove check
* add more comments.
* update docstring.
Co-authored-by: Ubuntu <ubuntu@ip-172-31-2-202.us-west-1.compute.internal >
Co-authored-by: Ubuntu <ubuntu@ip-172-31-9-132.us-west-1.compute.internal >
Co-authored-by: xiang song(charlie.song) <classicxsong@gmail.com >
Co-authored-by: Ubuntu <ubuntu@ip-172-31-62-171.ec2.internal >
2021-01-24 19:18:00 -08:00
Quan (Andy) Gan
bdb88df576
[Performance] Allow DataLoaders to return indices of the seed array ( #2495 )
...
* return indices from dataloader
* fixes
* fix
* fix distgraph and added some todos
* Update dataloader.py
* Update dataloader.py
Co-authored-by: xiang song(charlie.song) <classicxsong@gmail.com >
2021-01-08 14:30:52 +08:00
Da Zheng
3d1f2e870a
delete shared memory when receiving signals. ( #2419 )
...
* delete shared memory when receive signal.
* rename.
* fix lint.
* fix lint.
* fix compile.
* Fix.
* we need to report error if the shared memory exist.
* disable tensorflow test for shared memory.
* revert.
Co-authored-by: Ubuntu <ubuntu@ip-172-31-2-202.us-west-1.compute.internal >
Co-authored-by: Jinjing Zhou <VoVAllen@users.noreply.github.com >
2020-12-26 10:41:10 -08:00
Jinjing Zhou
cd204a4ac9
[Distributed] Use barrier instead of sleep in DistDataloader ( #2086 )
...
* use barrier instead of sleep
* lint
2020-08-21 18:01:09 +08:00
Chao Ma
a4a7e02f5f
[BugFix] Fix a small bug on kvstore ( #2058 )
...
* small fix
* update
2020-08-19 14:57:45 +08:00
Da Zheng
9da1629c9d
[Distributed] Some small fixes on doc ( #2049 )
...
* quick fix.
* update sparse optimizer.
* fix.
* fix
2020-08-18 21:13:19 -07:00
Da Zheng
75ffc31f76
[Doc] Update the docstring of distributed APIs. ( #2025 )
...
* add doc.
* update DistGraph.
* add DistTensor.
* update DistEmbedding.
* add partition.py
* add sampling.
* fix.
* add graph partition book and create a base class.
* fix test.
* add rst.
* update doc rst.
* update.
* fix.
* fix docs
* update distributed tensor and embeddings.
* add checks.
* update DistGraph.
* update initialization.
* fix graph partition book.
* update graph partition book.
* update partition.
* update partition.
* fix.
* add example code.
* update DistGraph
* Update python/dgl/distributed/dist_context.py
Co-authored-by: Quan (Andy) Gan <coin2028@hotmail.com >
* Update python/dgl/distributed/dist_context.py
Co-authored-by: Quan (Andy) Gan <coin2028@hotmail.com >
* Update python/dgl/distributed/dist_dataloader.py
Co-authored-by: Quan (Andy) Gan <coin2028@hotmail.com >
* Update python/dgl/distributed/dist_dataloader.py
Co-authored-by: Quan (Andy) Gan <coin2028@hotmail.com >
* Update python/dgl/distributed/dist_dataloader.py
Co-authored-by: Quan (Andy) Gan <coin2028@hotmail.com >
* update initialize.
* update dataloader.
* update distgraph.
* update DistGraph.
* update DistTensor.
* update.
* more updates.
* fix lint.
* add num_nodes and num_edges
Co-authored-by: Chao Ma <mctt90@gmail.com >
Co-authored-by: Quan (Andy) Gan <coin2028@hotmail.com >
Co-authored-by: xiang song(charlie.song) <classicxsong@gmail.com >
2020-08-18 11:53:45 -07:00
Quan (Andy) Gan
edfbee2ca8
[Feature] Make sample_neighbors copy features on demand ( #2042 )
...
* fix
* fix
* lint
* fix
* test
* fix
* fix
2020-08-18 22:25:19 +08:00
Da Zheng
efa95d8673
[Distributed] Fix bugs ( #2009 )
...
* fix.
* add tests.
* fix.
* fix.
2020-08-13 23:51:11 -07:00
Da Zheng
1ad46fd015
[Distributed] support distributed sampling in NodeDataLoader ( #2012 )
...
* fix.
* doesn't support EdgeDataLoader
* add test.
* fix.
* fix test.
* catch errors in the test.
* fix.
* fix error message
* add print.
* join the server processes.
* update test.
* fix test.
2020-08-13 22:49:21 -07:00
Chao Ma
15e3ff878c
[Distributed] Fix memory leak in kvstore ( #2016 )
...
* Fix memory leak
* update
* update
* update
* update
* update
* update
* update
2020-08-13 17:17:24 +08:00