17d604b5c7
[Feature] Allow using NCCL for communication in dgl.NodeEmbedding and dgl.SparseOptimizer ( #2824 )
...
* Split from NCCL PR
* Fix type in comment
* Expand documentation for sparse_all_to_all_push
* Restore previous behavior in example
* Re-work optimizer to use NCCL based on gradient location
* Allow for running with embedding on CPU but using NCCL for gradient exchange
* Optimize single partition case
* Fix pylint errors
* Add missing include
* fix gradient indexing
* Fix line continuation
* Migrate 'first_step'
* Skip tests without enough GPUs to run NCCL
* Improve empty tensor handling for pytorch 1.5
* Fix indentation
* Allow multiple NCCL communicator to coexist
* Improve handling of empty message
* Update python/dgl/nn/pytorch/sparse_emb.py
Co-authored-by: xiang song(charlie.song) <classicxsong@gmail.com >
* Update python/dgl/nn/pytorch/sparse_emb.py
Co-authored-by: xiang song(charlie.song) <classicxsong@gmail.com >
* Keepy empty tensor dimensionaless
* th.empty -> th.tensor
* Preserve shape for empty non-zero dimension tensors
* Use shared state, when embedding is shared
* Add support for gathering an embedding
* Fix typo
* Fix more typos
* Fix backend call
* Use NodeDataLoader to take advantage of ddp
* Update training script to share memory
* Only squeeze last dimension
* Better handle empty message
* Keep embedding on the target device GPU if dgl_sparse if false in RGCN example
* Fix typo in comment
* Add asserts
* Improve documentation in example
Co-authored-by: xiang song(charlie.song) <classicxsong@gmail.com >
2021-06-10 21:19:00 -07:00
caa6d6072c
[Feature] Replacing thread_wrapped_func with minimal mp.Process wrapper ( #2905 )
...
* standardizing thread_wrapped_func
* lints
* Update __init__.py
2021-05-14 11:34:49 +08:00
48d357b8f6
Fix numbers ( #2641 )
...
Co-authored-by: Ubuntu <ubuntu@ip-172-31-56-220.ec2.internal >
2021-02-08 14:05:30 +08:00
23afe911b2
[Bug Fix] Fix several sparse optimizer bugs ( #2596 )
...
* Fix pytorch TCP kvstore bug
* lint
* Fix
* upd
* Fix lint
* Fix
* trigger
* fix
Co-authored-by: Ubuntu <ubuntu@ip-172-31-56-220.ec2.internal >
2021-02-05 11:49:41 +08:00
a7e941c379
[Feature] Add support for sparse embedding ( #2451 )
...
* Add sparse embedding for dgl and update rgcn example
* upd
* Fix
* Revert "Fix"
This reverts commit 4da87cdfb8b8c3506b7fc7376cd2385ba8045c2a.
* Fix
* upd
* upd
* Fix
* Add unitest and update impl
* fix
* Clean up rgcn example code
* upd
* upd
* update
* Fix
* update score
* sparse for sage
* remove model sparse
* upd
* upd
* remove global norm
* revert delete model_sparse.py
* update according to comments
* Fix doc
* upd
* Fix test
* upd
* lint
* lint
* lint
* upd
* upd
* clean up
Co-authored-by: Ubuntu <ubuntu@ip-172-31-56-220.ec2.internal >
2021-01-28 00:26:49 +08:00
492ad9be81
[Fix] Avoid Overloading Nonzero for PyTorch Backend ( #2434 )
...
* Update gatedgraphconv.py
* Update entity_classify.py
* Update data-process.rst
* Update reading_data.py
* Update data-process.rst
* Update utils.py
* Update knowledge_graph.py
* Update entity_classify.py
* Update rdf.py
* Update entity_classify_mb.py
* Update test_classify.py
* Update tensor.py
* Update sparse.py
* Update entity_classify_mp.py
* Update 6_line_graph.py
2020-12-20 13:12:17 +08:00
62b4bbb494
[Fix] Enable mini-batch rgcn for CPU ( #2345 )
2020-11-16 17:27:54 +08:00
1e3fcc7c53
update comments ( #2132 )
...
Co-authored-by: Ubuntu <ubuntu@ip-172-31-51-214.ec2.internal >
2020-08-31 13:23:43 +08:00
0435b74c48
[Hotfix] Fix layer norm ( #2119 )
...
* hotfix
* Fix Layer Norm
Co-authored-by: Ubuntu <ubuntu@ip-172-31-87-240.ec2.internal >
2020-08-28 11:20:33 +08:00
be444e52d9
[Doc/Feature] Refactor, doc update and behavior fix for graphs ( #1983 )
...
* Update graph
* Fix for dgl.graph
* from_scipy
* Replace canonical_etypes with relations
* from_networkx
* Update for hetero_from_relations
* Roll back the change of canonical_etypes to relations
* heterograph
* bipartite
* Update doc
* Fix lint
* Fix lint
* Fix test cases
* Fix
* Fix
* Fix
* Fix
* Fix
* Fix
* Update
* Fix test
* Fix
* Update
* Use DGLError
* Update
* Update
* Update
* Update
* Fix
* Fix
* Fix
* Fix
* Fix
* Fix
* Fix
* Fix
* Update
* Fix
* Update
* Fix
* Fix
* Fix
* Update
* Fix
* Update
* Fix
* Update
* Update
* Update
* Update
* Update
* Update
* Update
* Fix
* Fix
* Update
* Update
* Update
* Update
* Update
* Update
* rewrite sanity checks
* delete unnecessary checks
* Update
* Update
* Update
* Update
* Update
* Update
* Update
* Update
* Fix
* Update
* Update
* Update
* Fix
* Fix
* Fix
* Update
* Fix
* Update
* Fix
* Fix
* Update
* Fix
* Update
* Fix
Co-authored-by: xiang song(charlie.song) <classicxsong@gmail.com >
Co-authored-by: Minjie Wang <wmjlyjemaine@gmail.com >
Co-authored-by: Quan Gan <coin2028@hotmail.com >
2020-08-18 04:26:29 +08:00
4ef01dbb05
[Example] Rgcn support ogbn-mag dataset. ( #1812 )
...
* rgcn support ogbn-mag dataset
* upd
* multi-gpu val and test
* Fix
* fix
* Add support for ogbn-mag
* Fix
* Fix
* Fix
* Fix
* Add layer_norm
* update
* Fix merge
* Clean some code
* update Readme
* upd
Co-authored-by: Ubuntu <ubuntu@ip-172-31-68-185.ec2.internal >
Co-authored-by: Ubuntu <ubuntu@ip-172-31-87-240.ec2.internal >
Co-authored-by: Ubuntu <ubuntu@ip-172-31-51-214.ec2.internal >
2020-08-09 15:56:15 +08:00
aee1067941
[Dataset] RDF dataset with DGL-Dataset template ( #1869 )
...
* update rdf builtin dataset
* Fix
* use new dataset
* fix
* rdf dataset using new framework
* tf work
* Fix mxnet
* Fix tensorflow
* Fix mxnet
* Update
* upd
* update some docstring
* clean some dead code
Co-authored-by: Ubuntu <ubuntu@ip-172-31-51-214.ec2.internal >
2020-07-30 09:12:00 +08:00
d6b4e286b6
RGCN minibatch using homogeneous graph. ( #1745 )
...
* minibatch rgcn
* minibatch based rgcn
* remove ogb
* lint
* Add sparse emb
* Fix
* Fix
Co-authored-by: Ubuntu <ubuntu@ip-172-31-51-214.ec2.internal >
Co-authored-by: Ubuntu <ubuntu@ip-172-31-68-185.ec2.internal >
Co-authored-by: Ubuntu <ubuntu@ip-172-31-87-240.ec2.internal >
2020-07-07 00:26:10 +08:00
nv-dlasalle