文件历史

提交图

1563 次代码提交

作者 SHA1 备注 提交日期
Israt Nisa cb0e1103ed [Feature] Add Min/max reducer in heterogeneous API for unary message functions (#3514)
* min/max support for forward CPU heterograph

* Added etype with each argU values

* scatter_add needs fix

* added scatter_add_hetero. Grads dont match for max reducer

* storing ntype in argX

* fixing scatter_add_hetero

* hetero matches with torch's scatter add

* works copy_e forward+cpu

* added backward for copy_rhs

* Computes gradient for all node types in one kernel

* bug fix

* unnitest for max/min on CPU

* renamed scatter_add_hetero to update_grad_minmax_hetero

* lint check and comment out cuda call for max. Code is for CPU only

* lint check

* replace inf with zero

* minor

* lint check

* removed LIBXSMM code from hetro code

* fixing backward operator of UpdateGradMinMaxHetero

* removed backward from update_grad_minmax_hetero

* docstring

* improved docstring and coding style

* Added pass by pointer for output

* typos and pass by references

* Support for copy_rhs

* Added header <string>

* fix bug in copy_u_max

* Added comments and dimension check of all etypes

* skip mxnet check

* pass by pointer output arrays

* updated docstring

Co-authored-by: Israt Nisa <nisisrat@amazon.com>
Co-authored-by: Quan (Andy) Gan <coin2028@hotmail.com>
2021-12-04 00:39:30 +08:00
Mufei Li d2ef24335c [NN] EdgePredictor (#3518)
* Update

* Update

* Fix

* Update

* Update

* update

* Fix test

* CI

* CI
2021-12-02 14:25:31 +08:00
lixiaobai 44f0b5fe40 [PinSAGE samper] Adjust the APIs for PinSAGESamper (#3529)
* Feat: support API "randomwalk_topk" in library

* Feat: use the new API "randomwalk_topk" for PinSAGESampler

* Minor

* Minor

* Refactor: modified codes as checker required

* Minor

* Minor

* Minor

* Minor

* Fix: checking errors in RandomWalkTopk

* Refactor: modified the docstring for randomwalk_topk

* change randomwalk_topk to internal

* fix

* rename

* Minor for pinsage.py

Co-authored-by: Quan Gan <coin2028@hotmail.com>
2021-11-30 01:19:57 +08:00
esang a7b5085a5d Add a note about the order of TUDataset (#3549) 2021-11-28 00:12:29 +08:00
Krzysztof Sadowski 8dbf3a4716 [NN] Fix GATv2Conv residual for mini-batch (#3535) 2021-11-22 23:44:34 +08:00
VoVAllen ea8b5d7933 fix #2278 2021-11-22 10:53:27 +00:00
Jinjing Zhou 7b4b8129e3 Add edge_weight parameters to nn modules (#3455)
* add

* fix optional docing

* fix

* lint

* add normalized by edge weight

* add test

* fix

* lint

* fix docs

* fix

* fix docs
2021-11-21 14:59:46 +08:00
Mufei Li 9e7fbf9567 [NN] JumpingKnowledge (#3512)
* Update

* Fix
2021-11-19 16:37:25 +08:00
Israt Nisa 2150fcaf23 [Feature] Added heterograph support to SDDMM_COO and clean up SpMM and SDDMM hetero kernels (#3449)
* Added SDDMMCOO_hetero support

* removed redundant CUDA kernels

* added benchmark for regression test

* fix

* fixed bug for single src node type

Co-authored-by: Israt Nisa <nisisrat@amazon.com>
Co-authored-by: Quan (Andy) Gan <coin2028@hotmail.com>
2021-11-17 15:29:27 +08:00
Rhett Ying e053df7965 [Feature] enable async transfer in NodeDataLoader for homograph (#3407)
* [Feature] enable async transfer in NodeDataLoader for homograph

* fix lint issues

* fix device choose when creating stream

* fix test on cpu only machine

* fix pin_memory config

* support homo only

* avoid creating stream in each step and sync via event

* fix lint

* enable graph copy on non-default stream

* fix lint

* refine arg description

* fix conflicts
2021-11-17 10:06:48 +08:00
Xin Yao 65fdfad67b [Doc] Fix the example code of negative sampler (#3501)
Co-authored-by: Jinjing Zhou <VoVAllen@users.noreply.github.com>
2021-11-16 17:49:34 +08:00
Quan (Andy) Gan b8ce0f41a3 [Sampling] Cluster-GCN and ShaDow-GNN DataLoader (#3487)
* first commit

* next commit

* third commit

* add ShaDow-GNN sampler and unit tests

* fixes

* lint

* cr*p

* lint

* fix lint

* fixes and more unit tests

* more tests

* fix docs

* lint

* fix

* fix

* fix

* fixes

* fix doc
2021-11-16 13:16:25 +08:00
Mufei Li dfa32ae092 [NN] GNNExplainer (#3490)
* Update

* Update

* Update

* Fix

* Update

* Update

* Update

* Update

* Update

* Update

* Fix

* Fix

* Update

* Update

* Update

* Update

* Update

* Update

* lint fix

* lint fix

* Fix lint

* Update

* Fix CI

* Fix CI

* Fix

* CI

* Fix

* Update

* Fix

* Fix

* Fix CI

* Fix CI
2021-11-11 02:22:22 +08:00
Mufei Li 55f2e87292 [Doc] Fix Doc for GATv2Conv (#3491)
* Fix

* CI

Co-authored-by: Ubuntu <ubuntu@ip-172-31-31-136.us-west-2.compute.internal>
Co-authored-by: Jinjing Zhou <VoVAllen@users.noreply.github.com>
2021-11-10 17:28:18 +08:00
Yuchen 7c771d0d6c [BugFix] fix #3429 and update results of caregnn (#3441)
* squeeze node labels in FraudDataset

* fix RLModule

* update results in README.md

* fix KeyError in full graph training

Co-authored-by: Jinjing Zhou <VoVAllen@users.noreply.github.com>
2021-11-10 16:00:12 +08:00
Shaked Brody db78fac5df Update gatv2conv.py doc (#3486) 2021-11-09 11:08:04 +08:00
Xin Yao b717c8bf0d [BugFix] Fix bugs in GPU sampling and enable unit tests for dataloaders on the GPU (#3474)
* enable unit tests for dataloader on the GPU

* fix compatibility

* copyright

* fix linting

Co-authored-by: nv-dlasalle <63612878+nv-dlasalle@users.noreply.github.com>
2021-11-04 10:34:56 -07:00
Mufei Li f46080a4d1 [Feature] k-hop Subgraph Extraction (#3458)
* Update

* Fix

* Fix

* Update

* Update

* Update

* Fix CI

* Fix

* Fix

* Fix

* Update

* Update

* Update

* Fix

* Fix

* Fix for TF
2021-11-04 15:47:35 +08:00
Shaked Brody e2f33fd5cc [NN][Model] GATv2 (#3473)
* [Model][Core] GATv2

* lint

* gatv2conv.py

* lint

* lint

* style and docs

* lint

* gatv2conv fix

Co-authored-by: Shaked Brody shakedbr@campus.technion.ac.il <shakedbr@tangerine.cslcs.technion.ac.il>
Co-authored-by: Mufei Li <mufeili1996@gmail.com>
2021-11-03 21:55:56 +08:00
Quan (Andy) Gan cac25f636f fix compatibility with PyTorch 1.10 (#3454) 2021-10-29 09:33:08 +08:00
Kamil Kamiński 51c6509704 [NN] Add EGATConv nn.module (#3425)
* added nn pytorch egatconv

* aligned with test build

* aligned with test build

* fixed wihite spaces

* fixed wihite spaces

* fixed wihite spaces

* added missing egatconv in imports

* added indentation in forward

* GATConv based implementation

* removed **kw_args

* added dgl relative imports

* PR corrections

* added DGL Error to EGATConv imports

* Update test_nn.py

Co-authored-by: Argusmocny <k.kaminski@cent.uw.edu.pl>
Co-authored-by: Mufei Li <mufeili1996@gmail.com>
2021-10-28 00:38:08 +08:00
Jinjing Zhou a9c83bce15 Fix #3437 (#3440) 2021-10-26 17:56:48 +08:00
Xin Yao a8c81018c5 [Sampling] Implement dgl.compact_graphs() for the GPU (#3423)
* gpu compact graph template

* cuda compact graph draft

* fix typo

* compact graphs

* pass unit test but fail in training

* example using EdgeDataLoader on the GPU

* refactor cuda_compact_graph and cuda_to_block

* update training scripts

* fix linting

* fix linting

* fix exclude_edges for the GPU

* add --data-cpu & fix copyright
2021-10-20 22:07:35 -07:00
Cheng Wan ff94ee80b1 [BugFix] Avoid Memory Leak Issue in PyTorch Backend (#3386)
* try to avoid memory leak

* try to avoid memory leak

* avoid memory leak with no hope

* Revert "avoid memory leak with no hope"

This reverts commit c77befe9479f46758e744642f66dd209b50eef7d.

* no message

* Update sparse.py

* Update tensor.py

Co-authored-by: Jinjing Zhou <VoVAllen@users.noreply.github.com>
2021-10-18 17:24:54 +08:00
Quan (Andy) Gan b81bb91465 [Bug] Fix edge exclusion still not working for full neighbor sampling (#3424) 2021-10-15 17:51:56 +08:00
nv-dlasalle b81efb2b2d [PyTorch][Bugfix] Use uint8 instead of bool in pytorch to be compatible with nightly version (#3406)
* Use uint8 instead of bool in pytorch

* Handle type aliases

* Fix syntax error

Co-authored-by: Jinjing Zhou <VoVAllen@users.noreply.github.com>
2021-10-14 17:34:55 +08:00
Quan (Andy) Gan 5d4f6bca2a [Fix] Fix edge ID exclusion not working in EdgeDataLoader (#3412) 2021-10-14 14:37:54 +08:00
Rhett Ying 8798872f54 [Bug] Do not skip graphconv even no edge exists (#3416) 2021-10-14 14:34:42 +08:00
Rhett Ying 7c7b60be18 [BugFix] add count_nonzero() into SA_Client (#3417) 2021-10-12 06:17:30 -07:00
Rhett Ying 2d88db5a3c [Bug] check dtype before convert to gk (#3414) 2021-10-12 14:34:40 +08:00
Israt Nisa 532eaa879b backward now stores DGLGraph index,not DGLGraph object witattached data (#3410)
Co-authored-by: Israt Nisa <nisisrat@amazon.com>
2021-10-11 14:08:01 +08:00
Rhett Ying f9fd7fd7f7 [BugFix] extract gz into target dir (#3389) 2021-09-30 11:35:40 +08:00
Rhett Ying e234fcfa8f [Feature] enable create/set/free cuda stream for internal use (#3334)
* [Feature] enable create/set/free cuda stream for internal use

* add unit test

* fix unit test failure on mxnet and tf

* refactor stream wrapper

* fix lint error

* fix lint error
2021-09-29 15:35:02 +08:00
Jingcheng Yu 5cf48fc69c [Feature] Implement one thread multiple socket (#3200)
Co-authored-by: JingchengYu94 <jingchengyu94@gmail.com>
2021-09-27 21:45:52 -07:00
mszarma bc14829fb3 [Feature] Exclude edges in sample_neighbors (#2971)
* [Feature] Exclude edges in sample_neighbors

Extending sample_neighbors and sample_frontier
API to support exclude_edges parameter.

exclude_edges support tensor and dict data
Feature enable excluding certain edges
during neighborhood sampling
Exclude_edges contains EID's of edges
which will be excluded
during neighbor picking for seed nodes.

Added test case for heterograph and homograph
RFC issue id: 2944

* compatibility

* fix

* fix

Co-authored-by: Quan Gan <coin2028@hotmail.com>
2021-09-22 02:15:56 +08:00
Kay Liu fecd6f3c50 [BugFix] fix typo in fakenews dataset variable name (#3363) 2021-09-21 22:06:26 +08:00
jwyyy bc5cac4426 fix broadcast tensor dim (#3351)
Co-authored-by: Minjie Wang <wmjlyjemaine@gmail.com>
2021-09-19 21:49:56 +08:00
nv-dlasalle 2647afc9b3 [Performance][Feature] Add src_nodes paramter to to_block() to avoid cost running unique() when available. (#2973)
* Add lhs_nodes are paremeter to to_block

* Update unit test

* Switch to simplified node conversion

* Switch lhs_nodes to be in/out parameter

* Update docs

Co-authored-by: Da Zheng <zhengda1936@gmail.com>
Co-authored-by: Jinjing Zhou <VoVAllen@users.noreply.github.com>
Co-authored-by: Quan (Andy) Gan <coin2028@hotmail.com>
Co-authored-by: Minjie Wang <wmjlyjemaine@gmail.com>
2021-09-16 09:05:16 +08:00
xiang song(charlie.song) a609b4f023 [Bugfix] Fix #3291 (#3333)
* Fix #3291

* update

* fix

* Unit key

* Fix

Co-authored-by: Ubuntu <ubuntu@ip-172-31-2-66.ec2.internal>
Co-authored-by: Jinjing Zhou <VoVAllen@users.noreply.github.com>
2021-09-14 08:57:20 +08:00
esang 6454c791b8 [Bugfix] Fix bugs of farthest_point_sampler (#3327)
* fix start_idx

* fix the bug when cuda > 0

Co-authored-by: Tong He <hetong007@gmail.com>
2021-09-10 17:50:06 +08:00
Israt Nisa d17b299a13 [Feature] Update edge features (apply_edge) for heterogeneous graph (#3250)
* rgcn with new heterograph API

* apply_edge() forward for multi relation

* undoing changes from rgcn-hetero

* backward apply_edge(copy_u) added

* unittest for apply_edge(copy_e)

* Compatible with new PRs

* resolving conflict with master

* Bringing back change after resolving conflict

* minor

* minor

Co-authored-by: Israt Nisa <nisisrat@amazon.com>
2021-09-09 22:39:08 +08:00
Israt Nisa 298e4fa627 [Feature] Support builtin binary message function for heterogenenous graph (#3273)
* Added binary builtinMsgFunc forward() for heterograph

* Added backward for u_op_v

* Supports all binary builtin forward

* Supports binary message funcs with reduce func sum

* lint check

* removed import torch from unittest

* enabled GPU test

* lint check

* Fixed docstrings

* rename func get_hs_id

* edited comment

Co-authored-by: Israt Nisa <nisisrat@amazon.com>
2021-09-07 10:01:33 -07:00
Quan (Andy) Gan 75d793a1bc Update dataloader.py (#3322) 2021-09-06 12:16:03 +08:00
xiang song(charlie.song) f4fe518ff7 [Feature] Add a HINT for the per edge type sampler of heterogeneous DistGraph that highlighting the etypes are sorted already. (#3260)
* pass cpp test

* distgraph use sorted edge flag.

* lint

* triger

* update test

Co-authored-by: Ubuntu <ubuntu@ip-172-31-2-66.ec2.internal>
2021-09-01 15:36:01 +08:00
nv-dlasalle a53783c81d [Performance] Only copy and slice index's in subcolumn when data is used. (#2930)
* Make column double indices lazy

* Copy indices to proper contexts

* Fix initialization

* Add unit test

* Fix unit test for tensorflow

* Remove unused member

Co-authored-by: Quan (Andy) Gan <coin2028@hotmail.com>
2021-08-30 19:17:25 -07:00
Da Zheng e5ed7adc12 [Distributed] Fix a bug in sampling an empty frontier (#3298)
* handle empty frontiers.

* fix lint.

* fix

Co-authored-by: Ubuntu <ubuntu@ip-172-31-2-202.us-west-1.compute.internal>
Co-authored-by: xiang song(charlie.song) <classicxsong@gmail.com>
2021-08-29 10:54:46 -07:00
NiklasBeierl 152760f66d [Doc] Note for HeteroGraphConv / Doc build problems (#3149)
* Doc: HetGConv note for `edge_type_subgraph`

For the rational behind this note see the discussion in #3003.

* WIP: Requirements for building the docs.

Had to install all these packages to get further with building the docs.

Didn't successfully build them yet, tho.

* Test

* Update

* Update hetero.py

* Update hetero.py

Co-authored-by: Ubuntu <ubuntu@ip-172-31-13-32.us-west-2.compute.internal>
Co-authored-by: Mufei Li <mufeili1996@gmail.com>
2021-08-29 03:14:43 +08:00
Konstantinos Vandikas 79305862ec allow for configuring default_dir (#3277)
* allow for configuring default_dir

* allow for using DGLDEFAULTDIR environment variable

* Update env_var.rst

Co-authored-by: Quan (Andy) Gan <coin2028@hotmail.com>
Co-authored-by: Jinjing Zhou <VoVAllen@users.noreply.github.com>
2021-08-27 01:29:49 +08:00
Rhett Ying 9cc85aed62 [Doc] fix formula in RelGraphConv (#3285)
* [Doc] fix formula in RelGraphConv

* refine descriptions
2021-08-25 17:59:17 +08:00
Quan (Andy) Gan b4cd60a952 fix relgraphconv bug (#3256) 2021-08-23 17:29:14 +08:00