mirrors / dmlc--dgl

提交

2,937 提交 34 分支 42 Git 标签
test_sparse_compile
提交图

2937 次代码提交

此分支
此分支
所有分支
作者 SHA1 备注 提交日期
David Min b78acd67ce [Doc] Add an official documentation of UnifiedTensor (#3194) 
* Add pytorch-direct version

* remove

* add documentation for UnifiedTensor

* Revert "add documentation for UnifiedTensor"

This reverts commit 63ba42644d4aba197c1cb4ea4b85fa1bc43b8849.

* add UnifiedTensor documentation

* Update python/dgl/contrib/unified_tensor.py

Co-authored-by: xiang song(charlie.song) <classicxsong@gmail.com>

Co-authored-by: shhssdm <shhssdm@gmail.com>
Co-authored-by: xiang song(charlie.song) <classicxsong@gmail.com>
 2021-08-02 22:40:51 +08:00
nv-dlasalle f7ce267164 [bugfix] Fix curand_init() calls in rowwise sampling (#3196) 
* Split out separate generators for each thread

* Amortize cost of curand_init

* Improve readability

Co-authored-by: Jinjing Zhou <VoVAllen@users.noreply.github.com>
Co-authored-by: Quan (Andy) Gan <coin2028@hotmail.com>
 2021-08-02 19:08:11 +08:00
Eric Kim c40bbf4f33 [Tools] Refactor tools/launch.py to handle more python binary names (#3205) 
* Refactors torch dist launcher udf-wrap code to handle more python versions

* minor changes
 2021-08-02 17:31:02 +08:00
Quan (Andy) Gan 213e27f05c Bump nightly version (#3146) 2021-08-02 17:24:18 +08:00
Tianjun Xiao ddeb657f0d Add four dgl papers (#3212) 2021-08-02 17:10:36 +08:00
Quan (Andy) Gan 100eb57c45 [Doc] Fix random_walk documentation inconsistency (#3188) 
* Update randomwalks.py

* Update randomwalks.py

FIx lint

Co-authored-by: Jinjing Zhou <VoVAllen@users.noreply.github.com>
 2021-08-02 16:16:29 +08:00
xiang song(charlie.song) 0e90d04566 [Readme] Add pytorch direct to Awesome Papers Using DGL (#3211) 
* Add pytorch direct to Awesome Papers Using DGL

* update
 2021-08-02 15:24:52 +08:00
nv-dlasalle 6001001fed Improve usage of pinned memory in sparse_optimizer (#3207) 
Co-authored-by: xiang song(charlie.song) <classicxsong@gmail.com>
 2021-08-02 14:16:23 +08:00
David Min c793593577 [Feature] Add multi-GPU UnifiedTensor unit test (#3184) 
* Add pytorch-direct version

* remove

* Add multi-gpu unified tensor test for pytorch

* relocate verification step to each process

* reduce number of workers

* add parameter

Co-authored-by: shhssdm <shhssdm@gmail.com>
Co-authored-by: xiang song(charlie.song) <classicxsong@gmail.com>
Co-authored-by: Jinjing Zhou <VoVAllen@users.noreply.github.com>
 2021-08-02 12:41:03 +08:00
Xiangkun Hu 50a62c19b6 [Doc] Add two papers to Awesome Paper List (#3208) 
* PPIDataset

* Revert "PPIDataset"

This reverts commit 264bd0c960cfa698a7bb946dad132bf52c2d0c8a.

* data pipeline user guide

* remove chapter numbers

* Update data.rst

* image in dataset userguide

* update links using ref

* modify the link of save_graphs and load_graphs in dataset user guide

* move image to s3 server.

* fix links and ref

* Hide implementations that may cause confusions to the user

* add papers

* fix number of classes in Amazon Cobuy datasets

* add two papers to Awesome paper list

* Update README.md

* add four papers

* add two papers

* Add awesome papers

* Fix index in paper list

* Add paper to paperlist

* add two papers

* add two papers

* Update README.md

Co-authored-by: Minjie Wang <wmjlyjemaine@gmail.com>
 2021-08-02 11:57:01 +08:00
Jinjing Zhou 8bc91414e9 [Distributed] Fix distributed training hang with multiple samplers (#3169) 
Rewrite the multiprocessing worker pool
 2021-08-01 21:31:04 +08:00
Mufei Li 2ec0493df4 Update README.md (#3209) 2021-08-01 18:11:55 +08:00
Eric Kim efd0fc6cde [Tools] Adds --ssh_username to the dist launcher (tools/launch.py) (#3202) 2021-07-30 23:34:26 +08:00
Lu Lu 7ab659e257 Remove DGL_LOADALL=true (#3150) 
DGL_LOADALL=true is not used in the code anymore.
 2021-07-30 18:17:18 +08:00
Kay Liu 39764da491 [model] add model example GeniePath (#3199) 
* [model] add model example GeniePath

* improvements based on feedback

* improvements based on feedback

Co-authored-by: zhjwy9343 <6593865@qq.com>
 2021-07-30 18:09:42 +08:00
Jinjing Zhou a5dc230af9 Fix shared memory in unit test (#3204) 2021-07-30 15:02:09 +08:00
KounianhuaDu 6f93c6aa74 fix (#3167) 
Co-authored-by: xiang song(charlie.song) <classicxsong@gmail.com>
Co-authored-by: zhjwy9343 <6593865@qq.com>
 2021-07-30 13:07:22 +08:00
Kay Liu a107993f10 [Model] add model example CARE-GNN (#3187) 
* [Model] add model example CARE-GNN

* update README

* improvements based on the review feedback

* fix missing item()

Co-authored-by: zhjwy9343 <6593865@qq.com>
 2021-07-29 15:24:15 +08:00
Rhett Ying c4791fd46e [bugfix] fix default ntypes/etypes consistency between dgl.DGLGraph and dgl.graph (#3198) 2021-07-29 14:05:28 +08:00
Jinjing Zhou 2583ec5934 [Doc] Fix WeightBasis documentation (#3189) 
* fix

* fix type

Co-authored-by: Minjie Wang <wmjlyjemaine@gmail.com>
 2021-07-28 18:56:10 +08:00
Da Zheng cb4a83a233 [Distributed] Enable distributed EdgeDataLoader (#3192) 
* make heterogeneous find_edges

* add distributed EdgeDataLoader.

* fix.

* fix a bug.

* fix bugs.

* add tests on distributed heterogeneous graph sampling.

* fix.

Co-authored-by: Zheng <dzzhen@3c22fba32af5.ant.amazon.com>
 2021-07-28 15:28:27 +08:00
Minjie Wang c3921599c8 Update README.md 2021-07-28 12:37:31 +08:00
Minjie Wang 8355a47e45 Update README.md 2021-07-28 12:28:02 +08:00
xiang song(charlie.song) ba7e7cf931 [New Feature] Per edge type sampler for to_homogeneous graphs. (#3131) 
* fix.

* fix.

* fix.

* fix.

* Fix test

* Deprecate old DistEmbedding impl, use synchronized embedding impl

* Basic imple of heterogeneous on homogenenous sampling

* make pass

* Pass C++ test

* Add python test code

* lint

* lint

* Add MultiLayerEtypeNeighborSampler

* Add unitest for single machine dataloader

* Add dist dataloader test for edge type sampler

* Fix lint

* fix

* support for per etype sample

* Fix some bug and enable distributed training with per edge sample

* fix

* Now distributed training works

* turn off some mxnet

* turn off mxnet for some dist test

* fix

* upd

* upd according to the comments

* Fix

* Fix test and now distributed works.

* upd

* upd

* Fix

* Fix bug

* remove dead code.

* upd

* Fix

* upd

* Fix

Co-authored-by: Ubuntu <ubuntu@ip-172-31-71-112.ec2.internal>
Co-authored-by: Ubuntu <ubuntu@ip-172-31-2-66.ec2.internal>
Co-authored-by: Da Zheng <zhengda1936@gmail.com>
 2021-07-28 11:51:32 +08:00
Lu Lu d70beba762 Bug fix: change th to tf (#3182) 
Co-authored-by: Jinjing Zhou <VoVAllen@users.noreply.github.com>
 2021-07-27 17:23:21 +08:00
Jingcheng Yu c8d4d6fbf8 [Bugfix] fix potential starving in socket receiver (#3176) 
Co-authored-by: JingchengYu94 <jingchengyu94@gmail.com>
Co-authored-by: xiang song(charlie.song) <classicxsong@gmail.com>
 2021-07-25 10:25:35 +08:00
Kay Liu 59a7d0d1c0 [Model] add model example GCN-based Anti-Spam (#3145) 
* add model example GCN-based Anti-Spam

* update example index

* add usage info

* improvements as per comments

* fix image invisiable problem

* add image file

Co-authored-by: zhjwy9343 <6593865@qq.com>
 2021-07-24 23:33:25 +08:00
Tianjun Xiao c0719ec574 train test on face use concat bce (#3180) 2021-07-24 20:49:09 +08:00
Minjie Wang 0f257733ad [Doc] New README (#3178) 
New readme structure
 2021-07-23 18:58:00 +08:00
Minjie Wang 73c85b984b [Doc] Fix perf doc (#3177) 2021-07-23 18:07:42 +08:00
Tianjun Xiao 65ecbb9492 change numbers to concat bce (#3175) 2021-07-23 12:54:28 +08:00
Quan (Andy) Gan 460e784b3b Update README.md (#3170) 2021-07-22 15:48:51 +08:00
Jinjing Zhou de174adac4 Remove redundant fill in SPMM kernel (#3166) 
* remove redundant fill

* trigger ci
 2021-07-21 18:47:54 +08:00
Xiangkun Hu bbb6d4eed0 [Dataset] Fix the edge numbers in the GNNBenchmarkDataset doc string (#3163) 
* PPIDataset

* Revert "PPIDataset"

This reverts commit 264bd0c960cfa698a7bb946dad132bf52c2d0c8a.

* Hide implementations that may cause confusions to the user

* fix number of classes in Amazon Cobuy datasets

* add four papers

* Fix doc string

* fix readme

* fix readme

Co-authored-by: Quan (Andy) Gan <coin2028@hotmail.com>
 2021-07-21 17:31:32 +08:00
Minjie Wang 9d56d386c8 [Doc] Update the example folder README 2021-07-20 19:12:06 +08:00
Quan (Andy) Gan ddc92f8d5b speed up random walks (#3158) 
Co-authored-by: Jinjing Zhou <VoVAllen@users.noreply.github.com>
 2021-07-20 18:15:50 +08:00
Minjie Wang d1cc096956 [Doc] Note for performance benchmarks (#3152) 
Co-authored-by: Tong He <hetong007@gmail.com>
 2021-07-20 13:33:32 +08:00
Xiangkun Hu ee1c1a82fa [Doc] Add two papers to Awesome Paper List (#3155) 
* PPIDataset

* Revert "PPIDataset"

This reverts commit 264bd0c960cfa698a7bb946dad132bf52c2d0c8a.

* data pipeline user guide

* remove chapter numbers

* Update data.rst

* image in dataset userguide

* update links using ref

* modify the link of save_graphs and load_graphs in dataset user guide

* move image to s3 server.

* fix links and ref

* Hide implementations that may cause confusions to the user

* add papers

* fix number of classes in Amazon Cobuy datasets

* add two papers to Awesome paper list

* Update README.md

* add four papers

* add two papers

* Add awesome papers

* Fix index in paper list

* Add paper to paperlist

* add two papers

Co-authored-by: Minjie Wang <wmjlyjemaine@gmail.com>
 2021-07-19 15:53:36 +08:00
Mufei Li 13017ed4b2 Update README.md (#3154) 2021-07-19 14:16:47 +08:00
Da Zheng 34426a98e9 [Distributed] Distributed heterograph training (#3069) 
* support hetero RGCN.

* fix.

* simplify code.

* sample_neighbors return heterograph directly.

* avoid using to_heterogeneous.

* compute canonical etypes in advance.

* fix tests.

* fix.

* fix distributed data loader for heterograph.

* use NodeDataLoader.

* fix bugs in partitioning on heterogeneous graphs.

* fix lint.

* fix tests.

* fix.

* fix.

* fix bugs.

* fix tests.

* fix.

* enable coo for distributed.

* fix.

* fix.

* fix.

* fix.

* fix.

Co-authored-by: Ubuntu <ubuntu@ip-172-31-71-112.ec2.internal>
Co-authored-by: Zheng <dzzhen@3c22fba32af5.ant.amazon.com>
 2021-07-17 10:57:00 +08:00
David Min 905c0aa578 [Feature][Performance][GPU] Introducing UnifiedTensor for efficient zero-copy host memory access from GPU (#3086) 
* Add pytorch-direct version

* Initial commit of unified tensor

* Merge branch 'master' of https://github.com/davidmin7/dgl

* Remove unnecessary things

* Fix error message

* Fix/Add descriptions

* whitespace fix

* add unpin

* disable IndexSelectCPUFromGPU with no CUDA

* add a newline for unified_tensor.py

* Apply changes based on feedback

* add 'os' module

* skip unified tensor unit test for cpu only

* Update tests/pytorch/test_unified_tensor.py

Co-authored-by: xiang song(charlie.song) <classicxsong@gmail.com>

* reflect feedback

Co-authored-by: shhssdm <shhssdm@gmail.com>
Co-authored-by: Jinjing Zhou <VoVAllen@users.noreply.github.com>
Co-authored-by: xiang song(charlie.song) <classicxsong@gmail.com>
 2021-07-17 00:06:20 +08:00
Quan (Andy) Gan 7e923180c1 [Doc] Add thumbnails to multi-GPU tutorials (#3141) 2021-07-16 14:27:43 +08:00
Jingcheng Yu b379dbd6c8 Optimize dist_graph/_split_even_to_part memory usage (#3132) 
Co-authored-by: yujingcheng02 <yujingcheng02@meituan.com>
Co-authored-by: Quan (Andy) Gan <coin2028@hotmail.com>
 2021-07-15 11:51:56 +08:00
Jinjing Zhou 88f20eec4e fix tags (#3140) 
Co-authored-by: Quan (Andy) Gan <coin2028@hotmail.com>
 2021-07-15 11:02:44 +08:00
Rhett Ying 5cdf7cfa98 [Doc] refine metis part of dgl.reorder_graph() (#3136) 
Co-authored-by: Mufei Li <mufeili1996@gmail.com>
 2021-07-15 10:14:39 +08:00
Mufei Li 3f6f694159 [Bug fix] Various fix from bug bash (#3133) 
* Update

* Update

* Update dependencies

* Update

* Update

* Fix ogbn-products gat

* Update

* Update

* Reformat

* Fix typo in node2vec_random_walk

* Specify file encoding

* Working for 6.7

* Update

* Fix subgraph

* Fix doc for sample_neighbors_biased

* Fix hyperlink

* Add example for udf cross reducer

* Fix

* Add example for slice_batch

* Replace dgl.bipartite

* Fix GATConv

* Fix math rendering

* Fix doc

Co-authored-by: Ubuntu <ubuntu@ip-172-31-28-17.us-west-2.compute.internal>
Co-authored-by: Jinjing Zhou <VoVAllen@users.noreply.github.com>
Co-authored-by: Ubuntu <ubuntu@ip-172-31-22-156.us-west-2.compute.internal>
 2021-07-15 09:17:15 +08:00
Jinjing Zhou 5f2639e230 [Regression] Fix Reddit dataset in regression test (#3106) 
* fix

* fix

* Update run.sh

Co-authored-by: Minjie Wang <wmjlyjemaine@gmail.com>
 2021-07-14 17:22:19 +08:00
Quan (Andy) Gan 066bef21f0 [Doc] Fix CoraFull number of edges inconsistency in doc (#3139) 2021-07-14 15:06:57 +08:00
xiang song(charlie.song) d7390763f0 [Distributed] Deprecate old DistEmbedding impl, use synchronized embedding impl (#3111) 
* fix.

* fix.

* fix.

* fix.

* Fix test

* Deprecate old DistEmbedding impl, use synchronized embedding impl

* update doc

Co-authored-by: Ubuntu <ubuntu@ip-172-31-71-112.ec2.internal>
Co-authored-by: Ubuntu <ubuntu@ip-172-31-2-66.ec2.internal>
Co-authored-by: Da Zheng <zhengda1936@gmail.com>
Co-authored-by: Jinjing Zhou <VoVAllen@users.noreply.github.com>
 2021-07-14 00:15:53 +08:00
Wilfried L. Bounsi ee6bc95175 Update a comment in pytorch HGT example (#3101) 
Co-authored-by: Quan (Andy) Gan <coin2028@hotmail.com>
Co-authored-by: Jinjing Zhou <VoVAllen@users.noreply.github.com>
 2021-07-13 19:09:17 +08:00