652f4c0743
[Dist] Add env var for non-default SSH configs in tests ( #4098 )
...
Signed-off-by: Serge Panev <spanev@nvidia.com >
Co-authored-by: Rhett Ying <85214957+Rhett-Ying@users.noreply.github.com >
2022-06-15 12:38:50 +08:00
defa292bc0
[Dataset] Add Flickr and Yelp dataset ( #4099 )
...
* Add Flickr and Yelp dataset
* Update flickr.py
* update
* Update yelp.py
* Update yelp.py
* update
* Update yelp.py
* Update test_data.py
* Update yelp.py
* update
* Update test_data.py
* Update yelp.py
Co-authored-by: Mufei Li <mufeili1996@gmail.com >
2022-06-14 16:14:12 +08:00
9501ed6a07
[Dist] master port should be fixed for all trainers ( #4108 )
...
* [Dist] master port should be fixed for all trainers
* add tests for tools/launch.py
2022-06-14 11:22:22 +08:00
92e7733065
[dataset] Add a reorder flag to builtin datasets ( #4104 )
...
* add argument reorder=False for citation_graph
* add description of the argument reorder
* add reordered/un_reordered save_path
* add version number postfix
Co-authored-by: Mufei Li <mufeili1996@gmail.com >
2022-06-12 12:35:30 +08:00
abcc9cce83
disable multiple groups tests due to random failure in CI ( #4101 )
2022-06-09 17:40:53 +08:00
cac3720b48
[Dist] enable time out when fetching msg ( #4043 )
...
* [ist] enable time out when fetching msg
* fix lint error
* minor refinements
* improve minor log
* fix dist test
* fix timeout issue in tensorpipe
2022-06-08 20:20:03 +08:00
2de80dde7d
[DistTest] add python test of RPC ( #4093 )
...
* [DistTest] add python test of RPC
* remove return
2022-06-08 17:03:02 +08:00
c1ff4c9b41
[DistTest] add basic pipeline for dist test across machines ( #3984 )
...
* [DistTest] add basic pipeline for dist test across machines
* move launch remote cmd to separate file
* add test for rpc
* fix function naming rule
Co-authored-by: Minjie Wang <wmjlyjemaine@gmail.com >
2022-06-08 12:37:02 +08:00
eabcc58e41
[Bug][Feature] Added cublasGemm<__half> specialization ( #3988 ) ( #4029 )
...
* * Added specialization of cublasGemm function for `__half` type, to try to address https://github.com/dmlc/dgl/issues/3988
* * Added USE_FP16 guard
* * Added test cases to test_segment_mm, to test newly-added FP16 specialization of cublasGemm
* * Replaced for loop in test_segment_mm with pytest.mark.parametrize, as recommended
Co-authored-by: Xin Yao <xiny@nvidia.com >
2022-06-07 16:00:02 +08:00
6a91d18151
[DGL-Go] Graph Property Prediction Pipeline ( #3927 )
...
* Update
* Update
* Update
* Fix
* Update
* Update
* Update
* Update
* Update
* Fix
* Update
* Update
* Update
* Fix
* Update
* Update
* update
* Update
* Update
* Update
* Fix
* Fix
* Update
* Update
* Update
* Update
* lr_scheduler
* Update
* Update
* Update
* Update
* Update
* Update
* Fix
* Fix
* Fix
* Fix
* Update
* Update
* Update
* Update
* Update
* Fix
* Update
* Update
* Update
* Update
* Fix
* Update
* Update
* Update
* Fix
* Fix
* Fix
* Update
* Update
* Fix
* Fix
* Update
* Update
* Update
* Update
* Update
* Update
* update
* CI
* Update
* Update
* Update
* Update
* Update
Co-authored-by: Minjie Wang <wmjlyjemaine@gmail.com >
2022-06-04 15:43:34 +08:00
efd909e62e
[NN] Enhance EGATConv branch ( #4062 )
...
* enhance EGATConv| nfeats as tuples
* egatconv modified for bipartite graphs
* modified docstrings
* added/modified unittests for EGATConv
* Update egatconv.py
* rectified lint errors
Co-authored-by: rijulizer <riju.mukherjee@gmail.com >
Co-authored-by: Mufei Li <mufeili1996@gmail.com >
2022-06-03 11:53:10 +08:00
89655cfda2
[Dataset] Add WikiCS Dataset ( #4035 )
...
* Fix bugs & Update dataset
* Update
* Update wikics.py
* Update wikics.py
* Update test_data.py
* Update wikics.py
* Update wikics.py
* Update wikics.py
* update
* Update module.py
* Update dgl.data.rst
* Update wikics.py
* Update wikics.py
Co-authored-by: Mufei Li <mufeili1996@gmail.com >
2022-06-02 23:03:17 +08:00
d9c25521bc
[Data] AsGraphPredDataset ( #4073 )
...
* Update
* CI
* Update
* Update
* Fix
* Fix
2022-06-02 16:18:48 +08:00
00c09b9f91
Revert "[bugfix] Explicitly unpin tensoradapter allocated arrays ( #3997 )" ( #4061 )
...
This reverts commit fdd1fe1908
2022-05-28 20:44:20 +08:00
c577dc9fc3
add sanity check ( #4050 )
2022-05-28 18:51:33 +08:00
7a065a9c56
[Build][Tests] Enable FP16 for GPU builds in CI ( #4030 )
...
* Enable FP16 for GPU builds in CI
* Limit default GPU archs to pascal and above
* Disable FP16 dispatching for cuda architectures less than 60
* Fix linting
* Fix typos
2022-05-26 09:48:28 -07:00
3c129ad71f
[Bugfix] Cython CAPI holding GIL causes deadlock when Python callback is asynchronous ( #4036 )
...
* cython nogil
* move APIs to internal and add unit test
* fix lint
* disable callback array test
2022-05-25 10:02:44 +08:00
230b886ec5
[Bug fix] Misc Fix for Transforms and NN Modules ( #4038 )
...
* Update module.py
* Update utils.py
* Update utils.py
* Update utils.py
* Update module.py
* Update
* Update
* Update
2022-05-24 18:08:08 +08:00
1425150459
Fix test naming ( #4023 )
...
Co-authored-by: Mufei Li <mufeili1996@gmail.com >
2022-05-23 17:21:06 +08:00
3fe5eea791
[NN] Label Propagation & Directional Graph Networks ( #4017 )
...
* add label propagation module
* fix prev bug in example
* add dgn
* fix linting and doc issues
* update label propagation & dgn
* update label propagation & dgn
* update example
* fix unit test
* fix agg heritage issue
* fix agg issue
* fix lint
* fix idx
* fix lp gpu issue
* Update
* Update
Co-authored-by: mufeili <mufeili1996@gmail.com >
2022-05-20 15:23:19 +08:00
53835bdb75
[Dist][BugFix] enable sampling on bipartite ( #4014 )
...
* [Dist][BugFix] enable sampling on bipartite
* add comments for tests
2022-05-18 10:14:54 +08:00
e0e8736fa0
[Feature] Added floating-point conversion functions to dgl.transforms.functional ( #3890 )
...
* * Added half_(), float_(), and double_() functions to DGLHeteroGraph, HeteroNodeDataView, and HeteroEdgeDataView, for converting floating-point tensor data to float16, float32, or float64 precision
* * Extracted out private functions for floating-point type conversion, to reduce code duplication
* * Added test for floating-point data conversion functions, half_(), float_(), and double_()
* * Moved half_(), float_(), and double_() functions from HeteroNodeDataView and HeteroEdgeDataView to Frame class
* * Updated test_float_cast() to use dgl.heterograph instead of dgl.graph
* Added to CONTRIBUTORS.md
* * Changed data type conversion to be deferred until the data is accessed, to avoid redundant conversions of data that isn't used.
* * Addressed issues flagged by linter
* * Worked around a bug in the old version of mxnet that's currently used for DGL testing
* * Only defer Column data type conversion if there is a pending device transfer or index sampling to be done. This is expected to be the desired behaviour based on discussions of a few use cases, as described in the comments.
* * Moved floating-point feature data conversion functions to dgl.transforms.functional
* Changed them from in-place behaviour to shallow copy (out-of-place) behaviour
* * Fixed linter issues
* * Removed lines that unintentionally added to_half, to_float, and to_double to DGLHeteroGraph
* Moved _init_api line to the end of the file again
* * Removed one of the two leading underscores from Frame.__astype_float, making it not fully private
Co-authored-by: nv-dlasalle <63612878+nv-dlasalle@users.noreply.github.com >
2022-05-16 18:17:15 -07:00
1f2e696080
Prevent users from attempting to pin PyTorch non-contiguous tensors or views only encompassing part of tensor. ( #3992 )
...
* Disable pinning non-contiguous memory
* Prevent views from being converted for write
* Fix linting
* Add unit tests
* Improve error message for users
* Switch to pytest function
* exclude mxnet and tensorflow from inplace pinning
* Add skip
* Restrict to pytorch backend
* Use backend to retrieve device
* Fix capitalization in decorator
Co-authored-by: Quan (Andy) Gan <coin2028@hotmail.com >
2022-05-16 14:49:36 -07:00
fdd1fe1908
[bugfix] Explicitly unpin tensoradapter allocated arrays ( #3997 )
...
* Explicitly unpin tensoradapter allocated arrays
* Undo unrelated change
* Add unit test
* update unit test
2022-05-16 13:02:02 -07:00
65b0b9e8c3
[Dataset & Transform] Synthetic Datasets for Explainability and SIGNDiffusion Transform ( #3982 )
...
* Update
* Update
* Update
* Update
* Update
* Update
* Update
* Update
* Update
* Update
* Update
* Update
* Update
* Update
* Update
* Update
* Update
* Update
* Update
* Update
* Update
* Update
* Update
* Update
* Fix
* Update
* Update
* Update
2022-05-16 22:32:09 +08:00
03024f9587
[Peformance] Remove unnecessary induced vertices in EdgeSubgraph ( #3978 )
...
* remove unnecessary induced vertices in EdgeSubgraph
* add unit test
2022-05-16 15:03:42 +08:00
65e6b04d8b
[Build] enable USE_AVX in CI and regression tests ( #4004 )
2022-05-12 21:29:11 -07:00
cb39eae1c4
Supporting DGL build with arch specific optimization ( #3996 )
...
Based on the pull request: https://github.com/dmlc/dgl/pull/3983
2022-05-11 12:38:42 -07:00
22e218d335
[Dist] Enable maximum try times for socket backend via DGL_DIST_MAX_T… ( #3977 )
...
* [Dist] Enable maximum try times for socket backend via DGL_DIST_MAX_TRY_TIMES
* reset env before/after test
* print log for info when trying to connect
* fix
* print log in python instead of cpp
2022-05-11 13:03:06 +08:00
22d7f92407
[CI] print commit/build ID into comment ( #3989 )
2022-05-10 16:04:21 +08:00
b2ec5a2ea6
[Transform] Add FeatMask and RowFeatNormalizer transforms ( #3968 )
...
* [Model]P-GNN
* updata
* [Example]P-GNN
* Update README.md
* Add NodeFeatureMasking and NormalizeFeatures
* Update
* Update transforms.rst
* Update
* Update
* Update
* Update test_transform.py
* Update
* Update
* Update test_transform.py
* Update module.py
* Update module.py
* Update module.py
Co-authored-by: Mufei Li <mufeili1996@gmail.com >
2022-05-07 11:59:39 +08:00
334e6434d2
[DGL-Go] CI for DGL-Go ( #3959 )
...
* Update
* Update
* Fix
* Update
* CI
* Update
* Update
* Update
* Update
* Update
* Update
* Update
* Update
* Update
* Update
* Update
* Update
2022-05-06 12:26:50 +08:00
3f792071f6
[BugFix] fix CI status ( #3963 )
2022-04-29 14:47:19 +08:00
56614f320f
[BugFix] fix job status in master CI ( #3962 )
...
* [BugFix] fix job status in master CI
* finalize
2022-04-29 12:54:13 +08:00
5561af4517
[Feature] Dataloader worker affinitization ( #3723 )
...
* PR3355 + CSR conversion workaround
* Remove debug code
* Fix convention errors
* Remove wrongly added code section during merge
* Update to reflect dataloading changes
* Fix missing changes
* Remove comment
* Fix linter errors
* Fix trailing whitespace
* Add wrapper around worker init function
Co-authored-by: Quan (Andy) Gan <coin2028@hotmail.com >
2022-04-28 13:00:04 +08:00
37be02a486
[Feature] enable socket net_type for rpc ( #3951 )
...
* [Feature] enable socket net_type for rpc
* fix lint
* fix lint
* fix build issue on windows
* fix test failure on windows
* fix test failure
* fix cpp unit test failure
* net_type blocking max_try_times
* fix other comments
* fix lint
* fix comment
* fix lint
* fix cpp
2022-04-28 00:10:06 +08:00
2eaa58e047
[CI] refine status check ( #3958 )
2022-04-27 15:28:26 +08:00
248bece633
[NN] GINEConv ( #3934 )
...
* Update
* Update
* Update
* Update
Co-authored-by: Minjie Wang <wmjlyjemaine@gmail.com >
2022-04-25 14:41:05 +08:00
764b5d0524
Fix test_module_heat_kernel test ( #3941 )
...
Signed-off-by: Serge Panev <spanev@nvidia.com >
Co-authored-by: Mufei Li <mufeili1996@gmail.com >
2022-04-23 13:32:29 +08:00
338db32d21
[Feature] Try upload report to s3 ( #3891 )
...
refactor CI report and log
2022-04-22 16:02:12 +08:00
e06e63d5d5
[Feature] Enable UVA sampling with CPU indices ( #3892 )
...
* enable UVA sampling with CPU indices
* add docs
* add more docs
* lint
* fix
* fix
* better error message
* use mp.Barrier instead of queues
* revert
* revert
* oops
* revert dgl.multiprocessing.spawn
* Update pytorch.py
2022-04-12 20:56:51 +08:00
0d878ff8ef
[Example] Cleaned GraphSAGE node classification example with PyTorch Lightning ( #3863 )
...
* cleaned pl node classification example
* conform to PL's method of updating the dataloader
* update
* lint
* fix test
* fix
2022-04-12 17:26:23 +08:00
baa9292899
[bugfix] Fix EdgePredictionSampler for UVA sampling ( #3904 )
...
* Add failing unit test
* Fix negative sampler edge types
* fix test
* oops
* revert
Co-authored-by: Minjie Wang <wmjlyjemaine@gmail.com >
Co-authored-by: Quan Gan <coin2028@hotmail.com >
2022-04-12 15:25:21 +08:00
5fcd7f290f
[Feature] Enable UVA for GPU PinSAGE and RandomWalk ( #3857 )
...
* enable uva for pinsage sampler
* unit test
* modify some checks on the python side
* remove legacy random walk code
* update unit test
* update unit test
* fix unit test
* adjust checks
* move some checks to c++
* move max_nodes check to cuda kernel
* fix ci for tf
Co-authored-by: Quan (Andy) Gan <coin2028@hotmail.com >
Co-authored-by: nv-dlasalle <63612878+nv-dlasalle@users.noreply.github.com >
2022-04-11 20:01:23 +08:00
adb3a7c11e
[BugFix] record/restore pin status when pickle/unpickle ( #3914 )
...
* [BugFix] record/restore pin status when pickle/unpickle
* disable test on TF
* set version as expected
* unpin memory in test
2022-04-09 11:42:23 +08:00
dc5035b1f3
[NN] Add EGNN & PNA ( #3901 )
...
* add EGNN & PNA
* fix egnn issues
* fix pna issues
* update pna conv
* add doc strings
* update pnaconv
* fix unused args issue
* fix moment aggregation issue
Co-authored-by: Mufei Li <mufeili1996@gmail.com >
2022-04-07 17:44:57 +08:00
35e66f426a
[Bugfix] Fix UVA sampling with partially specified node types ( #3897 )
...
* fix uva with partial node types
* lint
* skip tensorflow unit test
2022-03-31 17:07:02 +08:00
4c7bd314b4
[Feature] Radius Graph ( #3829 )
...
* radius graph
* remove trailing whitespaces from docs
* disable invalid name for transform func
* disable radius graph module invalid name
* move pylint disable before init
* fix missing nodes from point set
* update docs indexing
* add compute mode as optional param
* radius graph test
* remove trailing whitespaces
* fix precision when comparing tensors
Co-authored-by: Mufei Li <mufeili1996@gmail.com >
2022-03-30 17:23:29 +08:00
290b7c25c2
[Transform] Random Walk Positional Encoding & Laplacian Positional Encoding ( #3869 )
...
* [Transform] Random Walk Positional Encoding & Laplacian Positional Encoding
* Update python/dgl/transforms/module.py
Co-authored-by: Mufei Li <mufeili1996@gmail.com >
* Update python/dgl/transforms/functional.py
Co-authored-by: Mufei Li <mufeili1996@gmail.com >
* Update python/dgl/transforms/functional.py
Co-authored-by: Mufei Li <mufeili1996@gmail.com >
* Update python/dgl/transforms/functional.py
Co-authored-by: Mufei Li <mufeili1996@gmail.com >
* Update python/dgl/transforms/functional.py
Co-authored-by: Mufei Li <mufeili1996@gmail.com >
* Update python/dgl/transforms/functional.py
Co-authored-by: Mufei Li <mufeili1996@gmail.com >
* Update python/dgl/transforms/functional.py & python/dgl/transforms/module.py
* update python/dgl/transforms/functional.py
* update doc indexing
* update unit test
* support weighted graphs for random_walk_pe
* change reference
* fix linter errors
* fix datatype compatibility with MXNet & TF
* fix device errors
* fix result precision errors
* change tensorflow abs api
* reboost CI
Co-authored-by: Mufei Li <mufeili1996@gmail.com >
2022-03-30 15:59:28 +08:00
9fee20b91d
[Sampler] [Example] SAINTSampler and Simplify GraphSAINT Example ( #3879 )
...
* Update
* Update
* Update
* Update
* Update
* Update
* Update
* Update
* Update
* Update
* Update
* Fix
Co-authored-by: Quan (Andy) Gan <coin2028@hotmail.com >
2022-03-30 13:51:37 +08:00
Serge Panev