mirrors / dmlc--dgl

提交

3,215 提交 34 分支 42 Git 标签
fix-gpu-sampling-doc
提交图

3215 次代码提交

此分支
此分支
所有分支
作者 SHA1 备注 提交日期
Minjie Wang d3e4460b98 [Doc] Add docstring for missing APIs (#3088) 
* add docstring for missing API; fix some docstring

* rename apis; address comments
 2021-07-05 18:40:07 +08:00
Da Zheng 485c04cff6 [Distributed] Fix a few bugs in distributed API (#3094) 
* fix.

* fix.

* fix.

* fix.

* Fix test

Co-authored-by: Ubuntu <ubuntu@ip-172-31-71-112.ec2.internal>
Co-authored-by: Ubuntu <ubuntu@ip-172-31-2-66.ec2.internal>
 2021-07-05 15:12:02 +08:00
Tianjun Xiao 595d4e3415 add SLAPS and Haystacks in awesome papers (#3097) 2021-07-05 14:16:10 +08:00
Quan (Andy) Gan ced0e443c2 [Doc] Add user guide for GPU-based sampling (#3070) 
* add user guide for gpu sampling

* Update minibatch-gpu-sampling.rst

Co-authored-by: Minjie Wang <wmjlyjemaine@gmail.com>
 2021-07-05 12:07:43 +08:00
WangYQ 0851b4df5d Sageconv doc (#3093) 
* revise the doc of forward function in SAGEConv

* remove trailing space
 2021-07-05 09:25:56 +08:00
Tong He 9c41c22d7b [Model] Official implementation for HiLANDER model. (#3087) 
* add hilander model implementation draft

* use focal loss

* fix

* change data root

* add necessary scripts

* update download links

* update

* update example table

* fix

* update readme with numbers

* add empty folder

* only eval at the end

* set up hilander

* inform results may fluctuate

* address comments

Co-authored-by: sneakerkg <xiaotj1990327@gmail.com>
Co-authored-by: Ubuntu <ubuntu@ip-172-31-19-212.us-east-2.compute.internal>
 2021-07-04 20:08:58 +08:00
唐宇謙 66ad774f9e [Tutorial] update typo in line 175 (#3092) 2021-07-03 18:14:30 +08:00
Da Zheng 0884d02465 [Distributed] Fix bugs in partitioning on heterogeneous graphs. (#3085) 
* fix bugs in partitioning on heterogeneous graphs.

* fix.

* fix.

* fix example.

* fix.

* fix test.

* fix.

* fix.

* fix.

* fix tests.

Co-authored-by: Ubuntu <ubuntu@ip-172-31-71-112.ec2.internal>
Co-authored-by: Zheng <dzzhen@3c22fba32af5.ant.amazon.com>
 2021-07-02 21:16:14 +08:00
Rhett-Ying 04dce1e630 [Doc] refine doc and optimize metis part for dgl.reorder() (#3090) 
Co-authored-by: Tong He <hetong007@gmail.com>
 2021-07-02 20:14:47 +08:00
Jinjing Zhou 0b3a6216f5 [Test] Enable kvstore test (#3079) 
* try enable kvstore test

* fix

* fix

* seperate out kvstore test

* add comment
 2021-07-02 14:54:38 +08:00
ankit-garg 35ffceb409 Added code for Rectifying (TypeError: unhashable type: 'slice') when copying file (#3049) 
Co-authored-by: Ankit Garg <gaank@amazon.com>
Co-authored-by: Da Zheng <zhengda1936@gmail.com>
 2021-07-02 14:22:08 +08:00
Quan (Andy) Gan 4e74dc86af fix curand (#3077) 
Co-authored-by: Minjie Wang <wmjlyjemaine@gmail.com>
 2021-07-02 13:37:06 +08:00
nv-dlasalle a0390dde93 [Feature] Add dgl.utils.is_sorted_srcdst() (#2685) 
* Add dgl.utils.is_sorted_srcdst

* Fix linting issues

* delete blank line

* Specify datatype to index tensor in test

* Force integer conversion

Co-authored-by: Minjie Wang <wmjlyjemaine@gmail.com>
Co-authored-by: Quan (Andy) Gan <coin2028@hotmail.com>
 2021-07-02 11:29:24 +08:00
Rhett-Ying 95f8ec83b5 [Doc] fix docstring in to_block() (#3081) 2021-07-02 09:45:45 +08:00
Tong He 1bfc3118e4 [Benchmark] Benchmark script for KNN Graph (#3080) 
* add knn benchmark result

* update

* update knn benchmark to test on multiple algorithms

* update benchmark script

* update
 2021-07-01 16:12:50 +08:00
Quan (Andy) Gan a97aaa4903 fix (#3076) 2021-06-30 18:27:05 +08:00
Quan (Andy) Gan 7823ae2dbb add TUDataset notice (#3075) 
Co-authored-by: Jinjing Zhou <VoVAllen@users.noreply.github.com>
 2021-06-30 14:22:45 +08:00
Rhett-Ying 4307fe8895 [Feature] Add dgl.reorder() to re-order graph according to specified … (#3063) 
* [Feature] Add dgl.reorder() to re-order graph according to specified strategy

* fix unit test failure for metis reorder

* fix unit test failure on mxnet_cpu

* refine unit test for dgl.reorder

* fix unit test failure on mxnet

* fix array_equal error for mxnet unit test

* fix unit test failure for mxnet

* convert metis output to numpy array explicitly

Co-authored-by: Tong He <hetong007@gmail.com>
 2021-06-30 13:29:08 +08:00
Quan (Andy) Gan 61fba9da0f [Doc] Add Node2Vec docstrings to documentation server (#3068) 
Co-authored-by: Jinjing Zhou <VoVAllen@users.noreply.github.com>
 2021-06-29 22:29:10 +08:00
Quan (Andy) Gan dad8751d29 [Doc] Add instructions for Windows users to install VC2015 redistributable (#3071) 
* add instructions for VC2015 redist install

* fix typo
 2021-06-29 13:10:48 +08:00
nv-dlasalle 02e5d47d2a [Example][Bugfix] Fix RGCN example datasplitting (#3037) 
* Fix example datasplitting

* Remove left-over split parameter

* Remove unused parameter

* Set epoch when using multiple GPUs

Co-authored-by: xiang song(charlie.song) <classicxsong@gmail.com>
 2021-06-29 10:16:28 +08:00
Jinjing Zhou 2295c2186a [Benchmark] Add benchmark for GraphConv and HeteroGraphConv (#2999) 
* fix

* lint

* Revert "lint"

This reverts commit 263f913f02a9ece8491e9a9f812e50892da899ba.

Co-authored-by: Minjie Wang <wmjlyjemaine@gmail.com>
 2021-06-28 17:16:18 +08:00
Tong He 789b03f433 [Doc] Add KNN Benchmark Results (#3055) 
* add knn benchmark result

* update
 2021-06-28 16:13:56 +08:00
Kay Liu 81456af8c5 [Doc] fix inconsistent variable names (#3065) 
Co-authored-by: Quan (Andy) Gan <coin2028@hotmail.com>
 2021-06-28 13:30:08 +08:00
Tomohiro Endo 7f4086da7a cuda() to to(device) (#3064) 
Co-authored-by: Quan (Andy) Gan <coin2028@hotmail.com>
 2021-06-28 11:56:24 +08:00
WangYQ 2f43cdb3c8 deal with situation where num_layers equals 1 (#3066) 2021-06-28 10:17:16 +08:00
Jinjing Zhou 9664cdffd3 [Build] Make nccl optional (#3056) 
* fix

* remove nvidiasmi

* fix

* fix docs

* fix

* fix

* 1

* fix

* remove

* skip deprecated kernel

* fix

* Revert "skip deprecated kernel"

This reverts commit c5ceb7f60dbbaf065b81cc3680757fd611d90ad3.

* fix
 2021-06-27 22:36:01 +08:00
Jinjing Zhou 115ac0b9a3 [Benchmark] Enable sample neighbors gpu benchmark (#3060) 
* skip deprecated kernels

* Revert "skip deprecated kernels"

This reverts commit 2ee7f212d11d0858a0f863349a5e02ad04e4bc3c.

* fix
 2021-06-25 14:24:01 +08:00
Quan (Andy) Gan 427a5a96e0 [Doc] Update NodeDataLoader and EdgeDataLoader for GPU-based neighbor sampling (#3046) 
* update docstrings and tidy code

* add docs

* address comments

* Update __init__.py

* address comments
 2021-06-25 10:46:21 +08:00
Quan (Andy) Gan acd21a6d60 [Feature] Support direct creation from CSR and CSC (#3045) 
* csr and csc creation

* fix

* fix

* fixes to adj transpose

* fine

* raise error if indptr did not match number of nodes

* fix

* huh?

* oh

Co-authored-by: Minjie Wang <wmjlyjemaine@gmail.com>
 2021-06-25 10:05:47 +08:00
xiang song(charlie.song) 2f7ca41459 [Bug fix] Use shared memory for grad sync when NCCL is not avaliable as PyTorch distributed backend. (#3034) 
* Use shared memory for grad sync when NCCL is not avaliable as PyTorch distributed backend.

Fix small bugs and update unitests

* Fix bug

* update test

* update test

* Fix unitest

* Fix unitest

* Fix test

* Fix

* simple update

Co-authored-by: Ubuntu <ubuntu@ip-172-31-24-212.ec2.internal>
 2021-06-24 12:06:54 +08:00
maqy 31f4483af7 add HAN sampling demo (#3005) 
Co-authored-by: maqy1995 <maqingyun0718>
Co-authored-by: Quan (Andy) Gan <coin2028@hotmail.com>
 2021-06-23 20:27:18 +08:00
Qidong Su e56bbafd25 [Feature] Biased Neighbor Sampling (#2987) 
* update

* update

* update

* update

* lint

* lint

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* lint

* update

* clone

* update

* update

* update

* update

* replace idarray with ndarray

* refactor cpp part

* refactor python part

* debug

* refactor interface

* test and doc

* lint and test

* lint

* fix

* fix

* fix

* const

* doc

* fix

* fix

* fix

* fix

* fix & doc

* fix

* fix

* update

* update

* update

* merge

* doc

* doc

* lint

* fix

* more tests

* doc

* fix

* fix

* update

* update

* update

* fix

* fix

Co-authored-by: Minjie Wang <wmjlyjemaine@gmail.com>
 2021-06-23 17:44:51 +08:00
nv-dlasalle 7415eaa5fa [Bugfix] Handle case where process has no elements to update, in NCCL communicator (#3035) 
Co-authored-by: Minjie Wang <wmjlyjemaine@gmail.com>
 2021-06-23 16:31:29 +08:00
Tomohiro Endo cb2327d4a9 [Example] Fix error in gcn train due to missing argument (#3040) 
* Fix example

* Remove register_data_args and revert  to dataset

Co-authored-by: Minjie Wang <wmjlyjemaine@gmail.com>
 2021-06-23 15:50:07 +08:00
Tomohiro Endo 5961c14026 [Doc] EdgeWeightNorm Fix doc (#3051) 
Co-authored-by: Jinjing Zhou <VoVAllen@users.noreply.github.com>
 2021-06-23 15:49:31 +08:00
Quan (Andy) Gan e667545da5 [Feature] Node2vec (#2992) 
* add seal example

* 1. add paper infomation in examples/README
2. adjust codes
3. option test

* use latest `to_simple` to replace coalesce graph function

* remove outdated codes

* remove useless comment

* Node2vec
1.implement node2vec random walk c++ op
2.implement node2vec model
3.implement node2vec example

* add CMakeLists file modify

* refine c++ codes

* refine c++ codes

* add missing whitespace

* refine python codes

* add codes

* add node2vec_impl.h

* fix codes

* fix code style problem

* fixes

* remove

* lots of changes

* add benchmark

* fixes

Co-authored-by: smilexuhc <smile.xuhc@gmail.com>
Co-authored-by: Minjie Wang <wmjlyjemaine@gmail.com>
 2021-06-23 14:47:56 +08:00
nv-dlasalle 7359481497 [Feature][GPU] Add function for setting weights of a sparse embedding on multiple GPUs. (#3047) 
* add unit test

* Extend NDArrayPartition object

* Add method for setting embedding, and improve documentation

* Sync before returning

* Use name unique to sparse embedding class to avoid delete

Co-authored-by: xiang song(charlie.song) <classicxsong@gmail.com>
 2021-06-22 08:48:12 -07:00
Xiangkun Hu 70af1945da [Doc] Add one paper to Awesome paper list (#3041) 
Co-authored-by: Minjie Wang <wmjlyjemaine@gmail.com>
 2021-06-22 18:43:55 +08:00
Israt Nisa 1113f67422 [Kernel] Add heterograph support in CUDA kernels (SpMM, SDDMM) (#2925) 
* Added heterograph support SpMM, SDDMM

* bug fix cuda stream

* add cudaStrm destroy and fix whitespace

* Added heterograph support SpMM, SDDMM

* bug fix cuda stream

* add cudaStrm destroy and fix whitespace

* changed max stream = 1

* Fixed ctx

* using default stream

* Added heterograph support SpMM, SDDMM

* bug fix cuda stream

* add cudaStrm destroy and fix whitespace

* changed max stream = 1

* Fixed ctx

* using default stream

* fix bug in copy_rhs

* changed by mistake

* minor datatype change

* added datatype check

Co-authored-by: Israt Nisa <nisisrat@amazon.com>
 2021-06-22 09:34:37 +08:00
Mufei Li ff519f98c3 [API] Standardize Subgraph APIs (#2929) 
* Update

* Update

* Update

* Update

* Update

* Update

* Update

* Fix

* Update

* Fix subgraph tests

* Capture stdout for distributed test

* Capture stdout for distributed test

* Update

* Update

* Update

* Update subgraph.cc

Co-authored-by: Ubuntu <ubuntu@ip-172-31-28-17.us-west-2.compute.internal>
Co-authored-by: Jinjing Zhou <VoVAllen@users.noreply.github.com>
 2021-06-21 19:53:37 +08:00
Tianjun Xiao fc69f6ceca update two papers in awesome list (#3043) 2021-06-21 13:14:25 +08:00
Kay Liu 9706eaa895 [Feature] add permission information and fix import problems (#3036) 
* [Feature] add positive negative statistics

* [Feature] add permission information and fix import problem

* fix backend incompatible problem

* modify random split to remove sklearn usage

* modify file read to remove pandas usage

* add datasets into doc

* add random seed in data splitting

* add dataset unit test

* usage permission information update

Co-authored-by: zhjwy9343 <6593865@qq.com>
 2021-06-21 11:55:15 +08:00
Jinjing Zhou e57c6e3506 [Fix] Fix lint resource usage & Fix Docs (#3032) 
* fix

* remove nvidiasmi

* fix

* fix docs

* fix

* fix
 2021-06-18 18:33:52 +08:00
zhjwy9343 55e7796ac5 Revert "[Feature] add permission information and fix import problems (#2998)" (#3029) 
This reverts commit cba5b188b5.

Co-authored-by: Jinjing Zhou <VoVAllen@users.noreply.github.com>
 2021-06-17 13:58:38 +08:00
nv-dlasalle 7d069d62eb Add Ampere support to cmake files (#3031) 
* Update cmake to build Ampere

* Fix version check
 2021-06-16 12:57:28 -07:00
Jinjing Zhou 7176f5f25f [Regression] Multigpu regression test (#2923) 
* add multigpu sage

* Fix #2808

* multigpu test

* try

* fix remote url

* fix

* Revert "Fix #2808"

This reverts commit 19741f7d546df34b33759d8d0c9a85992ebc6118.

* add back thread_wrapped_func for backward compatibility

* fix

* fix multigpu

* print nvidia-smi

* use new docker image

* fix

* fix

* add ogb mag
 2021-06-16 18:37:59 +08:00
Kay Liu cba5b188b5 [Feature] add permission information and fix import problems (#2998) 
* [Feature] add positive negative statistics

* [Feature] add permission information and fix import problem

* fix backend incompatible problem

* modify random split to remove sklearn usage

* modify file read to remove pandas usage

* add datasets into doc

Co-authored-by: zhjwy9343 <6593865@qq.com>
 2021-06-16 18:24:17 +08:00
Da Zheng aaec3d8a0b [Distributed] Support hierarchical partitioning (#3000) 
* add.

* fix.

* fix.

* fix.

* fix.

* add tests.

* support node split and edge split.

* support 1 partition.

* add tests.

* fix.

* fix test.

* use hierarchical partition.

* add check.

Co-authored-by: Zheng <dzzhen@3c22fba32af5.ant.amazon.com>
Co-authored-by: Ubuntu <ubuntu@ip-172-31-22-57.us-west-2.compute.internal>
Co-authored-by: Ubuntu <ubuntu@ip-172-31-71-112.ec2.internal>
 2021-06-16 16:58:23 +08:00
Hengrui Zhang 18eaad17cc fix bugs (#3008) 
Co-authored-by: zhjwy9343 <6593865@qq.com>
 2021-06-16 15:27:47 +08:00