mirrors / dmlc--dgl

提交

3,215 提交 34 分支 42 Git 标签
fix-gpu-sampling-doc
提交图

3215 次代码提交

此分支
此分支
所有分支
作者 SHA1 备注 提交日期
Hongzhi (Steve), Chen be8763fa65 [Misc] Black auto fix. (#4679) 
Co-authored-by: Steve <ubuntu@ip-172-31-34-29.ap-northeast-1.compute.internal>
 2022-10-08 11:59:37 +08:00
kylasa eae6ce2a4f ParMETIS wrapper script to enable ParMETIS to process chunked dataset format (#4605) 
* Creating ParMETIS wrapper script to run parmetis using one script from user perspective

* Addressed all the CI comments from PR https://github.com/dmlc/dgl/pull/4529

* Addressing CI comments.

* Isort, and black changes.

* Replaced python with python3

* Replaced single quote with double quotes per suggestion.

* Removed print statement

* Addressing CI Commets.

* Addressing CI review comments.

* Addressing CI comments as per chime discussion with Rui

* CI Comments, Black and isort changes

* Align with code refactoring, black, isort and code review comments.

* Addressing CI review comments, and fixing merge issues with the master branch

* Updated with proper unit test skip decorator
 2022-10-03 12:23:57 -07:00
kylasa 1f471396d8 Edge Feature support for input graph datasets for dist. graph partitioning pipeline (#4623) 
* Added support for edge features.

* Added comments and removing unnecessary print statements.

* updated data_shuffle.py to remove compile error.

* Repaled python3 with python to match CI test framework.

* Removed unrelated files from the pull request.

* Isort changes.

* black changes on this file.

* Addressing CI review comments.

* Addressing CI comments.

* Removed duplicated and resolved merge conflict code.

* Addressing CI Comments from Rui.

* Addressing CI comments, and fixing merge issues.

* Addressing CI comments, code refactoring, isort and black
 2022-10-03 01:02:15 -07:00
Chang Liu 72cfb9342f [Example][Refactor] RGCN link prediction example refactor (#4548) 2022-09-30 12:57:50 -07:00
Quan (Andy) Gan 14cafe73e2 bump version (#4667) 
* bump version

* Update setup.py

* Update setup.py
 2022-10-01 00:47:38 +08:00
Quan (Andy) Gan 5bf17547f7 [DistTensor] add bitwise or function (#4638) 
* first commit

* add test

* fixes

* ah this is how you skip setup

* fix

* ugh

* address comments

* i like black
 2022-09-30 19:38:37 +08:00
Israt Nisa 09ec5fd5e3 [Sparse] Improve API docs (#4663) 
* replace with pow

* autosummary for attributes

* revert accidental push

* revert accidental push

* added example

Co-authored-by: Israt Nisa <nisisrat@amazon.com>
 2022-09-30 12:34:42 +08:00
czkkkkkk bb7b3c6f25 [Sparse] Add SparseMatrix unittest and fix docstring problem (#4627) 
* [Sparse] Add SparseMatrix unittest and fix docstring problem

* Minor fix

* Update

* check permission

* rm future annonations

* Skip create_from_csr and create_from_csc tests because Pytorch 1.9.0 does not have torch.sparse_csr_tensor

Co-authored-by: Israt Nisa <nisisrat@amazon.com>
 2022-09-30 11:53:33 +08:00
Israt Nisa 2accfc5dd1 replace with pow (#4662) 2022-09-29 22:42:34 -04:00
Minjie Wang 26dc54ec0c [Github] Update Github stable bot (#4659) 
- Disable automatic issue closing
- Correct the labels to exempt.
 2022-09-29 22:03:29 +08:00
Israt Nisa 765d725e15 [Sparse] GAT example using sparse operator (#4645) 
* GAT example

* Complete GAT and Add README

* Update

Co-authored-by: Israt Nisa <nisisrat@amazon.com>
Co-authored-by: czkkkkkk <zekucai@gmail.com>
 2022-09-29 21:45:04 +08:00
czkkkkkk 9ceb63db78 [Sparse] Add Hetero RGCN example (#4650) 
* Add Hetero RGCN example

* Remove HeteroGraphWrapper and move model to entity_classify.py

* Add README
 2022-09-29 14:42:56 +08:00
Israt Nisa 3d01340d23 [Sparse] Add elementwise operators for diagonal matrix (#4644) 
* Add elementwise operators for diagonal matrix

* minor

* resolve ambiguity of ops

* lint check

* lint check

* lint check

Co-authored-by: Israt Nisa <nisisrat@amazon.com>
 2022-09-29 13:08:50 +08:00
LuckyLiuM eb729c5401 Add Deepwalk module (#4562) 
* metapath2vec package

* fix bugs --metapath2vec package

* add unittest and fix bugs

* fix pyling messages

* del init.py

* fix bugs

* modify metapath2vec and add deepwalk

* deepwalk module

* del metapath2vec files

* Update

* Update

* Update

* Update

* Update

* Fix

Co-authored-by: Ubuntu <ubuntu@ip-172-31-9-26.ap-northeast-1.compute.internal>
Co-authored-by: Mufei Li <mufeili1996@gmail.com>
 2022-09-29 09:30:56 +08:00
Israt Nisa fa05ccb961 Add sddmm operator in mock_sparse library (#4579) 
* sddmm init

* SDDMM with N-D nonzero values

* drop support for vector shaped non zero elements

* address comments

* skip cpu test

* skip GPU test too

Co-authored-by: Israt Nisa <nisisrat@amazon.com>
Co-authored-by: Minjie Wang <wmjlyjemaine@gmail.com>
 2022-09-28 11:50:30 -04:00
czkkkkkk ec5e7bc564 [Sparse] Add gcn example (#4634) 2022-09-28 21:30:52 +08:00
Rhett Ying cf19254a19 [Dist] enable to partition many chunks into less partitions via pipeline (#4620) 
* [Dist] enable to partition many chunks into less partitions via pipeline

* refine

* add meta file for num_parts, add more tests, refine docstring

* remove args.num_parts

* create pydantic class for partition metadata

* refine

* rename json file
 2022-09-28 16:52:39 +08:00
Rhett Ying 6c1500d49f [Dist] save original node/edge IDs into separate files (#4649) 
* [Dist] save original node/edge IDs into separate files

* separate nids and eids
 2022-09-28 14:30:24 +08:00
Hongzhi (Steve), Chen 0b9df9d798 [Misc] Black auto fix. (#4652) 
Co-authored-by: Steve <ubuntu@ip-172-31-34-29.ap-northeast-1.compute.internal>
 2022-09-28 10:28:24 +08:00
Hongzhi (Steve), Chen f19f05ce66 [Misc] Black auto fix. (#4651) 
Co-authored-by: Steve <ubuntu@ip-172-31-34-29.ap-northeast-1.compute.internal>
 2022-09-28 10:28:04 +08:00
Mufei Li 977b1ba448 [Sparse] Migration of Unary, Softmax, Matmul Ops (#4616) 
* Update

* lint

* Fix

* Update

* Update

* Update

* update

* Fix

* Update

* Fix

* Fix

* Fix

* CI

* Update

* Update

* Update

* update test

Co-authored-by: Ubuntu <ubuntu@ip-172-31-9-26.ap-northeast-1.compute.internal>
 2022-09-27 19:34:46 +08:00
Rhett Ying b3ae13ab31 Update Jenkinsfile 2022-09-27 16:41:00 +08:00
Chang Liu 99f726ff93 Fix MNIST examples (#4632) 2022-09-27 15:41:18 +08:00
Chang Liu 7f50a6da2e [Example][Bugfix] Fix mlp example (#4631) 
* Fix mlp example

* Remove unused file
 2022-09-27 15:11:00 +08:00
Xin Yao 188bc2bf71 [Fix][Unittest] Fix test stream (#4635) 
* fix test stream

* init cusparse handle
 2022-09-27 12:41:26 +08:00
Hongzhi (Steve), Chen d78a3a4baf [Misc] Black auto fix. (#4640) 
* auto fix

* add more

* sort

Co-authored-by: Steve <ubuntu@ip-172-31-34-29.ap-northeast-1.compute.internal>
 2022-09-26 22:07:53 +08:00
Hongzhi (Steve), Chen 23d09057e3 [Misc] Black auto fix. (#4642) 
* [Misc] Black auto fix.

* sort

Co-authored-by: Steve <ubuntu@ip-172-31-34-29.ap-northeast-1.compute.internal>
 2022-09-26 21:47:11 +08:00
Hongzhi (Steve), Chen a9f2acf323 [Misc] Black auto fix. (#4641) 
* [Misc] Black auto fix.

* sort

Co-authored-by: Steve <ubuntu@ip-172-31-34-29.ap-northeast-1.compute.internal>
 2022-09-26 21:46:32 +08:00
czkkkkkk 08c50eb7c1 [Subgraph] State in the docstring that nodes cannot have any duplicate value when inducing a subgraph (#4637) 2022-09-26 16:25:49 +08:00
czkkkkkk 544a2cd192 [Sparse] Add reduction operators (#4600) 
* [Sparse] Add reduction operators

* Fix linting problem

* Fix linting problem

* Fix linting problem

* Fix docstring

* Fix test cases

* Fix linting problem

* Skip reduction unittests
 2022-09-26 16:06:05 +08:00
Hongzhi (Steve), Chen 80b22ad881 [Readability] Polish udf.py (#4534) 
* Polish udf.py

* Update udf.py

Co-authored-by: Steve <ubuntu@ip-172-31-34-29.ap-northeast-1.compute.internal>
 2022-09-26 14:50:34 +08:00
Israt Nisa 7dba19913e Sparse ops: Support elementwise ops between sparse and diagonal matrix (#4617) 
* initial commit

* address comments

* lint check

Co-authored-by: Israt Nisa <nisisrat@amazon.com>
 2022-09-23 22:22:51 -04:00
kylasa ace76327dd Garbage Collection and memory snapshot code for debugging partitioning pipeline (target as master branch) (#4598) 
* Squashed commit of the following:

commit e605a550b3783dd5f24eb39b6873a2e0e79be9c7
Author: kylasa <kylasa@gmail.com>
Date:   Thu Sep 15 14:45:39 2022 -0700

    Delete pyproject.toml

commit f2db9e700d817212b67b5227f6472d218f0c74f2
Author: kylasa <kylasa@gmail.com>
Date:   Thu Sep 15 14:44:40 2022 -0700

    Changes suggested by isort program to sort imports.

commit 5a6078beac6218a4f1fb378c169f04dda7396425
Author: kylasa <kylasa@gmail.com>
Date:   Thu Sep 15 14:39:50 2022 -0700

    addressing code review comments from the CI process.

commit c8e92decb7aebeb32c7467108e16f058491443ab
Author: kylasa <kylasa@gmail.com>
Date:   Wed Sep 14 18:23:59 2022 -0700

    Corrected a typo in the import statement

commit 14ddb0e9b553d5be3ed2c50d82dee671e84ad8c9
Author: kylasa <kylasa@gmail.com>
Date:   Tue Sep 13 18:47:34 2022 -0700

    Memory snapshot code for debugging memory footprint of the graph partitioning pipeline

Squashed commit done

* Addressing code review comments.

* Update utils.py

* dummy change to trigger CI tests

Co-authored-by: Rhett Ying <85214957+Rhett-Ying@users.noreply.github.com>
 2022-09-23 15:37:29 -07:00
Chang Liu 533afa851e [Example][Refactor] Graphsage link prediction example refactor (#4526) 
* Refactor link pred example for graphsage

* Use ogb evaluator + README update

* Update

* Add comments
 2022-09-23 16:45:32 +08:00
czkkkkkk db64cc3760 [Sparse] Add Transposition for SparseMatrix and DiagMatrix (#4597) 
* [Sparse] Add Transposition

* Fix docstring

* Fix linting problem

* Minor fix

* Minor fix

Co-authored-by: Minjie Wang <wmjlyjemaine@gmail.com>
 2022-09-23 15:17:55 +08:00
Vibhu Jawa d04534c940 [Bugfix][Hotfix] Fix cugraph Pytorch CI failures (#4622) 
* get_more_logs

* Update cugraph_unit_test.sh

* Update test_basics.py

* Update cugraph_unit_test.sh

* Update tests/cugraph/test_basics.py

Co-authored-by: Minjie Wang <wmjlyjemaine@gmail.com>
 2022-09-23 11:49:03 +08:00
Rhett Ying be11409312 [CI] Enable DGL cugaph nightly CI (#4573) 
* [CI] Enable DGL cugaph nightly CI

* fix build issue

* remove runtime
 2022-09-22 15:26:29 +08:00
Rhett Ying dc258603df update dev list 2022-09-22 14:58:50 +08:00
Tong He 33c8abb9f4 [Doc] Update Readme for example Hilander (#4587) 
The example was updated in https://github.com/dmlc/dgl/pull/3972 but the README file was not. This PR updates it to reflect the correct environment requirement.

Co-authored-by: Minjie Wang <wmjlyjemaine@gmail.com>
 2022-09-22 13:54:13 +08:00
Ereboas 92bff4d2bb [Example] SEAL+NGNN for ogbl (#4550) 
* Use black for formatting

* limit line width to 80 characters.

* Use a backslash instead of directly concatenating

* file structure adjustment.

* file structure adjustment(2)

Co-authored-by: Mufei Li <mufeili1996@gmail.com>
 2022-09-22 13:09:27 +08:00
YanJun-Zhao ec4271bf87 [Example] Refactor GNNExplainer Example (#4560) 
* debug

* debug

* readme

* fix readme

* fix readme

* Update

* Update

* update

* fix bug of syn2

Co-authored-by: Ubuntu <ubuntu@ip-172-31-9-26.ap-northeast-1.compute.internal>
Co-authored-by: Mufei Li <mufeili1996@gmail.com>
 2022-09-21 13:34:39 +08:00
Xin Yao 880b3b1f97 [Fix] Enable lint check for cuh files and fix compiler warnings (#4585) 
* disable warning for tensorpipe

* fix warning

* enable lint check for cuh files

* resolve comments
 2022-09-21 10:09:14 +08:00
peizhou001 166b273bec add ssh port config for dispatchdata (#4557) 2022-09-20 20:41:41 +08:00
Mufei Li 73b9f3a1da [Sparse] Migrate DiagMatrix class (#4567) 
* Update

* Update

* Update

* Update

* Update

* Update

* Update

* Update

* Update

* Update

* Update

* Update

* Update

Co-authored-by: Ubuntu <ubuntu@ip-172-31-9-26.ap-northeast-1.compute.internal>
 2022-09-20 17:17:43 +08:00
Quan (Andy) Gan 8366774122 [Feature] Support canonical edge types in HeteroGraphConv (#4440) 
* fix

* Update hetero.py

* why did i remove this

Co-authored-by: Xin Yao <xiny@nvidia.com>
 2022-09-20 14:15:26 +08:00
Quan (Andy) Gan 5ebd3bf05a [DataLoader] Disable the usage of shared memory when persistent_workers=False on single GPU (#4497) 
* toggle shared memory usage

* Update dataloader.py

Co-authored-by: Xin Yao <xiny@nvidia.com>
 2022-09-20 11:40:33 +08:00
nv-dlasalle 2630d2eb02 [Performance][bugfix] Implement is_unibipartite in C++ with caching. (#4556) 
* updates

* Enable caching C++ result

* Add missing docstring

* Remove unused function

* Add unit test

* Address comments
 2022-09-19 16:46:27 -07:00
Xin Yao cded5b80fe [Feature] Bump DLPack to v0.7 and decouple DLPack from the core library (#4454) 
* rename `DLContext` to `DGLContext`

* rename `kDLGPU` to `kDLCUDA`

* replace DLTensor with DGLArray

* fix linting

* Unify DGLType and DLDataType to DGLDataType

* Fix FFI

* rename DLDeviceType to DGLDeviceType

* decouple dlpack from the core library

* fix bug

* fix lint

* fix merge

* fix build

* address comments

* rename dl_converter to dlpack_convert

* remove redundant comments
 2022-09-19 16:02:43 +08:00
Hongzhi (Steve), Chen f1689ad0e1 [Misc]Add pyproject.toml for autopep8 & black. (#4543) 
* Add pyproject.toml for autopep8.

* Add pyproject.toml for autopep8.

Co-authored-by: Steve <ubuntu@ip-172-31-34-29.ap-northeast-1.compute.internal>
 2022-09-19 11:38:58 +08:00
Hongzhi (Steve), Chen 36dbccee12 Delete pylint.yml 2022-09-16 18:35:41 +08:00