9e630101a1
fix and lots of tests ( #2650 )
2021-02-12 11:40:05 +08:00
cf8a3fb305
[hotfix] Address the performance issue of topk. ( #2628 )
...
* upd
* fix
* upd
* upd
* udp
* upd
* upd
* upd
* upd
* upd
* upd
Co-authored-by: Jinjing Zhou <VoVAllen@users.noreply.github.com >
2021-02-11 00:00:39 +08:00
8ccb8206bf
[Doc] Update docs to motivate the use of set_batch_num_nodes and set_batch_num_edges ( #2630 )
...
* fix doc
* update docstring for transformation on batch graph
* update cn guide
* fix format
* update rst
2021-02-08 14:43:24 +08:00
bc3a532f5e
[Sampling] Implement dgl.to_block() for the GPU ( #2339 )
...
* Add start of to_block gpu implementation
* Pull in more changes from 0.4.2 cuda_to_block
* Move more code to IdArray
* Refactor DeviceNodeMapMaker
* Updates
* get compiling
* Integrate to_block
* Fix ID allocation
* Minor fixes
* Cleanup cuda calls to use cuda_common
* Reduce kernel calls
* Lint cleanup
* Expand documentation
* Remove unused function
* Rename variables for consistency
* Add doxygen comments
* Fix file extension
* Remove raw asynccopy for deviceapi
* Remove unused function
* Fix block/tile configuration
* Add cuda_device_common.cuh
* Add basic hashtable
* Migrate part of hashtable
* Refactor to use external hashtable
* Make functions members
* Format hash table functions
* Migrate duplicate filling
* Move last function over
* Refactor with cu file
* lint c++ code
* Move context check to C++ code
* Use macro switch
* Add missing files
* Update docstring
* update docs
* Move atomic functions
* Refactor hashtable
* Fix linting
* Expand docs
* Fix mismatched argument names
* Switch doxygen comments from using @param to \param
Co-authored-by: Jinjing Zhou <VoVAllen@users.noreply.github.com >
Co-authored-by: Minjie Wang <wmjlyjemaine@gmail.com >
2021-02-08 13:00:43 +08:00
98ac391ed9
[Doc] Large graph training tutorials ( #2595 )
...
* large graph training tutorials
* add full graph link prediction update
* fix
* fix
* fix
* addressed comments
2021-02-07 17:55:49 +08:00
0346b0aa80
[Test] Add test for Cython and force rebuild when run setup.py ( #2635 )
2021-02-05 22:38:46 +08:00
3ca52b1e59
[Fix] Various Fix after Bug Bash ( #2620 )
...
* update
* Misc fix
* Update
2021-02-05 17:34:16 +08:00
23afe911b2
[Bug Fix] Fix several sparse optimizer bugs ( #2596 )
...
* Fix pytorch TCP kvstore bug
* lint
* Fix
* upd
* Fix lint
* Fix
* trigger
* fix
Co-authored-by: Ubuntu <ubuntu@ip-172-31-56-220.ec2.internal >
2021-02-05 11:49:41 +08:00
b1840f49fa
[Dataset] Change the Data Type of the Node Features in GINDataset/TUDataset from Float64 to Float32 ( #2592 )
...
* Update
* Update
* Update
* update
Co-authored-by: Jinjing Zhou <VoVAllen@users.noreply.github.com >
Co-authored-by: Tong He <hetong007@gmail.com >
2021-02-03 21:00:45 +08:00
fb4a0508c6
[bugfix] Solve the boundary issue in backward function of segment sum ( #2610 )
...
* upd
* trigger
* upd
2021-02-03 18:50:07 +08:00
47c9380555
[Performance] Fix Cython not being imported after switching to RTLD_LOCAL ( #2608 )
...
* fix
* ?
Co-authored-by: Jinjing Zhou <VoVAllen@users.noreply.github.com >
2021-02-02 16:23:54 +08:00
20d49771df
[Feature] Add reverse edges in CitationGraphDataset ( #2588 )
...
* [Feature] Add reverse edges in CitationGraphDataset
* fix bug
* fix bug
* fix bug
* Update python/dgl/data/citation_graph.py
Co-authored-by: Xiangkun Hu <huxk_hit@qq.com >
* fix notes
* fix notes
* fix bugs
* solve requested changes
* fix bug
* fix bug
Co-authored-by: Xiangkun Hu <huxk_hit@qq.com >
2021-02-02 15:52:43 +08:00
3a19bbc508
fix doc ( #2604 )
2021-02-02 11:04:43 +08:00
db57809da1
[hotfix] Add data type check for kernels. ( #2598 )
...
* upd
* upd
2021-01-31 13:08:05 +08:00
1f6eba9ed3
[Bug] Heterogeneous graph convolution bugfix ( #2578 )
...
* fix heterograph conv
* remove test cases
* fix test
* fix test
* fix test
Co-authored-by: Minjie Wang <wmjlyjemaine@gmail.com >
2021-01-29 09:30:19 +08:00
e4ddafe951
[NN] add multihead in DotGatConv ( #2549 )
...
* add multihead in DotGatConv
* Fix spacing issue
* Add Unit test for dotgat
* Modified Unit test for dotgat
* Add transformer like divisor
* Update dotgatconv.py
Co-authored-by: Chen <chesirui@3c22fbe5458c.ant.amazon.com >
Co-authored-by: Zihao Ye <expye@outlook.com >
2021-01-28 21:05:10 +08:00
fb3c07094f
Revert part of #2563 ( #2584 )
2021-01-28 14:53:55 +08:00
878acdb0fc
Revert "Refactor code for retaining formats in message-passing. ( #2570 )" ( #2583 )
...
This reverts commit a613ad8806
2021-01-28 14:04:07 +08:00
7bab1365e2
[feature] Supporting half precision floating data type (fp16). ( #2552 )
...
* add tvm as submodule
* compilation is ok but calling fails
* can call now
* pack multiple modules, change names
* upd
* upd
* upd
* fix cmake
* upd
* upd
* upd
* upd
* fix
* relative path
* upd
* upd
* upd
* singleton
* upd
* trigger
* fix
* upd
* count reducible
* upd
* upd
* upd
* upd
* upd
* upd
* upd
* upd
* upd
* only keep related files
* upd
* upd
* upd
* upd
* lint
* lint
* lint
* lint
* pylint
* upd
* upd
* compilation
* fix
* upd
* upd
* upd
* upd
* upd
* upd
* upd doc
* refactor
* fix
* upd number
Co-authored-by: Zhi Lin <linzhilynn@gmail.com >
Co-authored-by: Ubuntu <ubuntu@ip-172-31-42-78.us-east-2.compute.internal >
Co-authored-by: Ubuntu <ubuntu@ip-172-31-21-156.us-east-2.compute.internal >
Co-authored-by: Jinjing Zhou <VoVAllen@users.noreply.github.com >
2021-01-28 11:21:58 +08:00
a7e941c379
[Feature] Add support for sparse embedding ( #2451 )
...
* Add sparse embedding for dgl and update rgcn example
* upd
* Fix
* Revert "Fix"
This reverts commit 4da87cdfb8b8c3506b7fc7376cd2385ba8045c2a.
* Fix
* upd
* upd
* Fix
* Add unitest and update impl
* fix
* Clean up rgcn example code
* upd
* upd
* update
* Fix
* update score
* sparse for sage
* remove model sparse
* upd
* upd
* remove global norm
* revert delete model_sparse.py
* update according to comments
* Fix doc
* upd
* Fix test
* upd
* lint
* lint
* lint
* upd
* upd
* clean up
Co-authored-by: Ubuntu <ubuntu@ip-172-31-56-220.ec2.internal >
2021-01-28 00:26:49 +08:00
12f6429616
remove hash_func from dataset object ( #2572 )
...
Co-authored-by: Minjie Wang <wmjlyjemaine@gmail.com >
2021-01-27 18:49:40 +08:00
0855d25501
[NN] Support scalar edge weight for GraphConv, SAGEConv and GINConv ( #2557 )
...
* add edge weight in forward
* fix lint
* fix
* fix
* address comments
* add utils
* add util to normalize in gcn way
* fix lint
* add unittest
* fix lint
* fix docstring
* fix docstring
* address comments
* improve notation consistence
* use preferred fn
2021-01-26 23:34:12 +08:00
c45f6eb575
[Bugfix] Fix duplicate edges in Coauthor Dataset #2553 ( #2569 )
...
* fix
* address comment
2021-01-26 15:30:27 +08:00
6c23fba8fa
[Doc][Org] move edge_softmax to functional ( #2442 )
...
* move edge_softmax to functional
* change examples
* fixes
* revert
* fix
* fix
* remove
* fix
* test
* add init
Co-authored-by: Minjie Wang <wmjlyjemaine@gmail.com >
2021-01-26 12:46:37 +08:00
a613ad8806
Refactor code for retaining formats in message-passing. ( #2570 )
2021-01-25 16:55:16 +08:00
25ac334403
[Distributed] Heterogeneous graph support ( #2457 )
...
* Distributed heterograph (#3 )
* heterogeneous graph partition.
* fix graph partition book for heterograph.
* load heterograph partitions.
* update DistGraphServer to support heterograph.
* make DistGraph runnable for heterograph.
* partition a graph and store parts with homogeneous graph structure.
* update DistGraph server&client to use homogeneous graph.
* shuffle node Ids based on node types.
* load mag in heterograph.
* fix per-node-type mapping.
* balance node types.
* fix for homogeneous graph
* store etype for now.
* fix data name.
* fix a bug in example.
* add profiler in rgcn.
* heterogeneous RGCN.
* map homogeneous node ids to hetero node ids.
* fix graph partition book.
* fix DistGraph.
* shuffle eids.
* verify eids and their mappings when loading a partition.
* Id map from homogneous Ids to per-type Ids.
* verify partitioned results.
* add test for distributed sampler.
* add mapping from per-type Ids to homogeneous Ids.
* update example.
* fix DistGraph.
* Revert "add profiler in rgcn."
This reverts commit 36daaed8b660933dac8f61a39faec3da2467d676.
* add tests for homogeneous graphs.
* fix a bug.
* fix test.
* fix for one partition.
* fix for standalone training and evaluation.
* small fix.
* fix two bugs.
* initialize projection matrix.
* small fix on RGCN.
* Fix rgcn performance (#17 )
Co-authored-by: Ubuntu <ubuntu@ip-172-31-62-171.ec2.internal >
* fix lint.
* fix lint.
* fix lint.
* fix lint.
* fix lint.
* fix lint.
* fix.
* fix test.
* fix lint.
* test partitions.
* remove redundant test for partitioning.
* remove commented code.
* fix partition.
* fix tests.
* fix RGCN.
* fix test.
* fix test.
* fix test.
* fix.
* fix a bug.
* update dmlc-core.
* fix.
* fix rgcn.
* update readme.
* add comments.
Co-authored-by: Ubuntu <ubuntu@ip-172-31-2-202.us-west-1.compute.internal >
Co-authored-by: Ubuntu <ubuntu@ip-172-31-9-132.us-west-1.compute.internal >
Co-authored-by: xiang song(charlie.song) <classicxsong@gmail.com >
Co-authored-by: Ubuntu <ubuntu@ip-172-31-62-171.ec2.internal >
* fix.
* fix.
* add div_int.
* fix.
* fix.
* fix lint.
* fix.
* fix.
* fix.
* adjust.
* move code.
* handle heterograph.
* return pytorch tensor in GPB.
* remove some tests in example.
* add to_block for distributed training.
* use distributed to_block.
* remove unnecessary function in DistGraph.
* remove distributed to_block.
* use pytorch tensor.
* fix a bug in ntypes and etypes.
* enable norm.
* make the data loader compatible with the old format.
* fix.
* add comments.
* fix a bug.
* add test for heterograph.
* support partition without reshuffle.
* add test.
* support partition without reshuffle.
* fix.
* add test.
* fix bugs.
* fix lint.
* fix dataset.
* fix for mxnet.
* update docstring.
* rename to floor_div
* avoid exposing NodePartitionPolicy and EdgePartitionPolicy.
* fix docstring.
* fix error.
* fixes.
* fix comments.
* rename.
* rename.
* explain IdMap.
* fix docstring.
* fix docstring.
* update docstring.
* remove the code of returning heterograph.
* remove argument.
* fix example.
* make GraphPartitionBook an abstract class.
* fix.
* fix.
* fix a bug.
* fix a bug in example
* fix a bug
* reverse heterograph sampling.
* temp fix.
* fix lint.
* Revert "temp fix."
This reverts commit c450717b9f578b8c48769c675f2a19d6c1e64381.
* compute norm.
* Revert "reverse heterograph sampling."
This reverts commit bd6deb7f52998de76508f800441ff518e2fadcb9.
* fix.
* move id_map.py
* remove check
* add more comments.
* update docstring.
Co-authored-by: Ubuntu <ubuntu@ip-172-31-2-202.us-west-1.compute.internal >
Co-authored-by: Ubuntu <ubuntu@ip-172-31-9-132.us-west-1.compute.internal >
Co-authored-by: xiang song(charlie.song) <classicxsong@gmail.com >
Co-authored-by: Ubuntu <ubuntu@ip-172-31-62-171.ec2.internal >
2021-01-24 19:18:00 -08:00
aa884d43b6
[doc][fix] Improve the docstring and fix its behavior in DGL's kernel ( #2563 )
...
* upd
* fix
* lint
* fix
* upd
2021-01-25 00:18:57 +08:00
a6abffe303
[Fix] Don't create extra formats in dataloader ( #2551 )
...
Co-authored-by: Minjie Wang <wmjlyjemaine@gmail.com >
2021-01-24 20:59:24 +08:00
2288098ba6
[Feature] Converting a block to a graph and allow block construction ( #2555 )
...
* first commit
* more commit
* fix and docstring
* add to api reference
* address comments
* Update convert.py
2021-01-24 12:44:54 +08:00
7ff2662b88
[Fix] Better Error Message for node_type_subgraph ( #2554 )
...
* Update
* Update
* Update
2021-01-21 15:12:05 +08:00
2c6d071617
[Feature] QM9 Dataset Support ( #2521 )
...
* [Model] MixHop for Node Classification task
* [docs] update
* [docs] update
* [fix] remove seed option
* [fix] update readme
* [feature] support qm9 dataset
* [style] update
* [docs] fix the details
* [fix] indexing only support int
* [style] update
* [fix] multiple backends support
* [docs] add qm9
* [fix] Z type: float32 -> int32
* [fix] Z type: int32 -> long
* [docs] add ref
* [docs] fix
* [docs] update
* [docs] update
* [fix] test eval
* [docs] fix example
Co-authored-by: xnuohz@126.com <ubuntu@ip-172-31-44-184.us-east-2.compute.internal >
Co-authored-by: Mufei Li <mufeili1996@gmail.com >
Co-authored-by: Jinjing Zhou <VoVAllen@users.noreply.github.com >
2021-01-21 01:33:30 +08:00
917a755291
[Fix] fix version check ( #2544 )
2021-01-19 19:35:43 +08:00
9a9a06eb2f
[Bug Fix] Fix undefined var bug in LegacyTUDataset ( #2543 )
...
* [Bug Fix] Fix undefined var bug in LegacyTUDataset
* upt
* [Bug Fix] Fix cache file name bug in TUDataset
Co-authored-by: Tong He <hetong007@gmail.com >
2021-01-19 13:58:01 +08:00
8c8c5b1dc1
[Bug fix] Stop erasing schemas of frames with no data rows ( #2529 )
...
* added option for batching empty data, fixes #2526
* added option for batching empty data, fixes #2526
* decreased line lengths
* removed trailing whitespace
* fixed wrong feature name
* [Bugfix] stop erasing schema of frames w/ no cols (fixes #2528 )
* removed arg doc
Co-authored-by: Quan (Andy) Gan <coin2028@hotmail.com >
Co-authored-by: Minjie Wang <wmjlyjemaine@gmail.com >
2021-01-17 10:32:47 +08:00
5da3439c16
[Feature] Add Device Flag in Data Loaders ( #2450 )
...
* Update
* Update
* Update
* Update
* Update
* Update
* Update
* Update
* Update
* Update
* Update
* Update
* Update
Co-authored-by: Minjie Wang <wmjlyjemaine@gmail.com >
2021-01-15 07:39:26 +08:00
0778766411
[Bug fix] [Feature] added option for batching empty data ( #2527 )
...
* added option for batching empty data, fixes #2526
* added option for batching empty data, fixes #2526
* decreased line lengths
* removed trailing whitespace
* fixed wrong feature name
* now default behavior when all graphs are empty
Co-authored-by: Minjie Wang <wmjlyjemaine@gmail.com >
2021-01-14 15:25:13 +08:00
bedccc2392
fix 2532 ( #2533 )
2021-01-14 13:40:25 +08:00
54f186bba0
Fix ( #2524 )
...
Co-authored-by: Ubuntu <ubuntu@ip-172-31-59-204.ec2.internal >
Co-authored-by: Minjie Wang <wmjlyjemaine@gmail.com >
2021-01-13 15:09:21 +08:00
498505bafb
[Doc] fix docserver build for tutorials ( #2518 )
...
* fix doc build
* hide GPU code
2021-01-12 17:55:58 +08:00
a9f8f2589c
[Doc] Update GraphDataLoader in our docs ( #2504 )
...
* update graphdataloader in docs
* fix
* update examples
* fix sagpool
Co-authored-by: Quan (Andy) Gan <coin2028@hotmail.com >
2021-01-11 13:11:19 +08:00
bdb88df576
[Performance] Allow DataLoaders to return indices of the seed array ( #2495 )
...
* return indices from dataloader
* fixes
* fix
* fix distgraph and added some todos
* Update dataloader.py
* Update dataloader.py
Co-authored-by: xiang song(charlie.song) <classicxsong@gmail.com >
2021-01-08 14:30:52 +08:00
e2e524df41
[Feature] Add GraphDataLoader implementation ( #2496 )
...
* add graph dataloader
* add to doc
* fix
* fix
* fix docstring
* update according to torch default_collate
* add unittest
* fix
* fix lint
* fix
2021-01-07 13:38:21 +08:00
fa5f4d6aa7
[Doc] Hotfix on docstring of set_batch_num_edges ( #2498 )
2021-01-06 21:45:04 +08:00
2caac086c2
[Bug] send_and_recv and pull may write to wrong places ( #2497 )
...
* fix
* fix test
2021-01-06 17:18:37 +08:00
0c2a2ea1e2
[Bugfix] Handle a Corner Case of Batching after Removing Nodes/Edges ( #2465 )
...
* Update
* Update
* Update
Co-authored-by: Quan (Andy) Gan <coin2028@hotmail.com >
2021-01-05 22:22:03 +08:00
21e90cbf48
[Doc] Fix number of classes in Amazon Cobuy datasets ( #2488 )
...
* PPIDataset
* Revert "PPIDataset"
This reverts commit 264bd0c960cfa698a7bb946dad132bf52c2d0c8a.
* Update gnn_benckmark.py
* Hide implementations that may cause confusions to the user
* fix number of classes in Amazon Cobuy datasets
2021-01-05 13:08:05 +08:00
f960468f50
[feature] APIs for manually set batch_num_nodes and batch_num_edges ( #2430 )
...
* wip
* udp
* upd
* fix typo
* lint
* lint
* upd
* upd
* lint
* lint
* upd
* upd
* tftest
* fix
* fallback numpy
* fix tf
* docstring
Co-authored-by: Mufei Li <mufeili1996@gmail.com >
2021-01-04 23:43:58 +08:00
d3c1645550
[Performance][Test] New low memory implementation for RGCN and related regression tests ( #2468 )
...
* WIP
* finish lowmem impl; benchmarking
* wip
* wip
* fix benchmarks
* fix bug in searchsorted
* update readme
* update
* lint and ogb dependency
* add flags to to_homogeneous
* fix docstring
* address comments
2021-01-04 22:23:59 +08:00
9fabc9b8c5
[Doc] fix simple typo, tranfer -> transfer ( #2464 )
...
There is a small typo in python/dgl/dataloading/async_transferer.py.
Should read `transfer` rather than `tranfer`.
Co-authored-by: Minjie Wang <wmjlyjemaine@gmail.com >
2021-01-02 19:26:09 +08:00
4464b9734c
Fix kg dataset len() ( #2475 )
...
Co-authored-by: Ubuntu <ubuntu@ip-172-31-59-204.ec2.internal >
2020-12-31 23:33:21 +08:00
Quan (Andy) Gan