* add unit test
* Extend NDArrayPartition object
* Add method for setting embedding, and improve documentation
* Sync before returning
* Use name unique to sparse embedding class to avoid delete
Co-authored-by: xiang song(charlie.song) <classicxsong@gmail.com>
* add bruteforce impl
* add nn descent implementation
* change doc-string
* remove redundant func
* use local rng for cuda
* fix lint
* fix lint
* fix bug
* fix bug
* wrap nndescent_knn_graph into knn
* fix lint
* change function names
* add comment for dist funcs
* let the compiler do the unrolling
* use better blocksize setting
* remove redundant line
* check the return of the cub calls
Co-authored-by: Tong He <hetong007@gmail.com>
* Split from NCCL PR
* Fix type in comment
* Expand documentation for sparse_all_to_all_push
* Restore previous behavior in example
* Re-work optimizer to use NCCL based on gradient location
* Allow for running with embedding on CPU but using NCCL for gradient exchange
* Optimize single partition case
* Fix pylint errors
* Add missing include
* fix gradient indexing
* Fix line continuation
* Migrate 'first_step'
* Skip tests without enough GPUs to run NCCL
* Improve empty tensor handling for pytorch 1.5
* Fix indentation
* Allow multiple NCCL communicator to coexist
* Improve handling of empty message
* Update python/dgl/nn/pytorch/sparse_emb.py
Co-authored-by: xiang song(charlie.song) <classicxsong@gmail.com>
* Update python/dgl/nn/pytorch/sparse_emb.py
Co-authored-by: xiang song(charlie.song) <classicxsong@gmail.com>
* Keepy empty tensor dimensionaless
* th.empty -> th.tensor
* Preserve shape for empty non-zero dimension tensors
* Use shared state, when embedding is shared
* Add support for gathering an embedding
* Fix typo
* Fix more typos
* Fix backend call
* Use NodeDataLoader to take advantage of ddp
* Update training script to share memory
* Only squeeze last dimension
* Better handle empty message
* Keep embedding on the target device GPU if dgl_sparse if false in RGCN example
* Fix typo in comment
* Add asserts
* Improve documentation in example
Co-authored-by: xiang song(charlie.song) <classicxsong@gmail.com>
* add bruteforce impl
* add support for bruteforce-sharemem
* modify python API
* add tests
* change file path
* change python API
* fix lint
* fix test
* also check worst_dist in the last few dim
* use heap and early-stop on CPU
* fix lint
* fix lint
* add device check
* use cuda function to determine max shared mem
* use cuda to determine block info
* add memory free for tmp var
* update doc-string and add dist option
* fix lint
* add more tests
Co-authored-by: Quan (Andy) Gan <coin2028@hotmail.com>
Co-authored-by: Minjie Wang <wmjlyjemaine@gmail.com>
* Auto stash before rebase of "origin/pytorch-nn-working"
GCNII model added
* linting
* linting
* lint
* Frequency Adaptive gcn init comit
* Revert "Frequency Adaptive gcn init comit"
This reverts commit 86a80586ac0040497c1edfa0e80df719992dcc4a.
* Update python/dgl/nn/pytorch/conv/gcn2conv.py
modified docstring
Co-authored-by: Quan (Andy) Gan <coin2028@hotmail.com>
* added beta formula and changed param name
* fix docstring
* lint
* white space lint
* update docstring
Co-authored-by: Quan (Andy) Gan <coin2028@hotmail.com>
* docstring formula update
* added gcn2
* added GCN2Conv
* Update nn.pytorch.rst
Co-authored-by: Quan (Andy) Gan <coin2028@hotmail.com>
* add implementation of twirls
* format the code
* fix some format error, and ignore others
* fix format errors
* fix format errors
* expose unfolding & attention
* Update nn.pytorch.rst
Co-authored-by: Quan (Andy) Gan <coin2028@hotmail.com>
* tf nn for edgeConv
* Auto stash before merge of "tf_working" and "origin/tf_working"
* clean up
* added test for edge_conv
* fix
* fix
* fix
Co-authored-by: Jinjing Zhou <VoVAllen@users.noreply.github.com>
Co-authored-by: Quan Gan <coin2028@hotmail.com>
* add multihead in DotGatConv
* Fix spacing issue
* Add Unit test for dotgat
* Modified Unit test for dotgat
* Add transformer like divisor
* Update dotgatconv.py
Co-authored-by: Chen <chesirui@3c22fbe5458c.ant.amazon.com>
Co-authored-by: Zihao Ye <expye@outlook.com>
Rhett Ying