文件历史

982 次代码提交

作者 SHA1 备注 提交日期
Theodore Vasiloudis 1ab0170a10 [Distributed] Ensure round-robin edge file downloads, reduce logging, other improvements. (#5578)
Co-authored-by: Rhett Ying <85214957+Rhett-Ying@users.noreply.github.com>
2023-04-27 11:17:55 -07:00
Chang Liu e6eefd1a13 [Bugfix] Fix the uninitialized pin_memory flag for empty graph (#5609) 2023-04-26 17:56:01 -07:00
Chang Liu 00c3edc1cf [Bugfix] Fix unit test failures on older GPUs (#5579) 2023-04-21 18:33:51 -07:00
Kunal Mukherjee c0f346e754 [Model] Implemented SubgraphX Explainer for Heterogeneous graph (#5530)
Co-authored-by: kxm180046 <kxm180046@utdallas.edu>
Co-authored-by: Nick Baker <ndbaker1@outlook.com>
Co-authored-by: Mufei Li <mufeili1996@gmail.com>
2023-04-21 14:05:02 +08:00
czkkkkkk f41934df87 [Sparse] Add conversion between DGLGraph and SparseMatrix. (#5553) 2023-04-20 18:00:34 +08:00
Zhiteng Li b58416f76a [NN] Refine the API of GraphormerLayer (#5565)
Co-authored-by: rudongyu <ru_dongyu@outlook.com>
2023-04-19 16:36:25 +08:00
Kunal Mukherjee 95aaa4934a [Fix] np.float and np.int deprecated usage (#5563)
Co-authored-by: kxm180046 <kxm180046@utdallas.edu>
Co-authored-by: Mufei Li <mufeili1996@gmail.com>
2023-04-17 18:48:03 +08:00
Kunal Mukherjee 23ef2ddd71 [Fix] np.asscalar deprecated usage (#5557)
Co-authored-by: kxm180046 <kxm180046@utdallas.edu>
Co-authored-by: Mufei Li <mufeili1996@gmail.com>
2023-04-17 13:52:25 +08:00
czkkkkkk b57c56d9a1 [Sparse] Support broadcasting operators (#5544) 2023-04-15 10:36:12 +08:00
czkkkkkk 7c465d20fc [Sparse] Support spspdiv (#5541)
Co-authored-by: Hongzhi (Steve), Chen <chenhongzhi.nkcs@gmail.com>
2023-04-14 16:46:51 +08:00
rudongyu bb1f8850e5 [NN] Refactor the Code Structure of GT (#5100) 2023-04-14 11:50:14 +08:00
kylasa 4085ec8a46 Use correct delimiter when reading edge files during parmetis processing step (#5481)
Co-authored-by: xiang song(charlie.song) <classicxsong@gmail.com>
2023-04-13 11:07:08 -07:00
Venzino.Han f1b0a07984 [NN] add egatconv edge_weight (#5539)
Co-authored-by: Mufei Li <mufeili1996@gmail.com>
2023-04-13 20:54:42 +08:00
czkkkkkk 893098888e [Sparse] Support spspmul (#5543) 2023-04-13 09:07:49 +08:00
peizhou001 4864a9f903 [Bug] Merge rather replace when find reverse eids (#5532)
Co-authored-by: Ubuntu <ubuntu@ip-172-31-16-19.ap-northeast-1.compute.internal>
2023-04-12 10:42:42 +08:00
Chang Liu 62b5f50a5c [Feature] Import PyTorch's pin_memory() method for DGL graph structure (#5366) 2023-04-10 19:21:32 -07:00
Tianqi Zhang (张天启) 27b008b9b1 [BugFix] Fix unstable behavior of beuteforce-sharemem KNN (#5515) 2023-04-10 22:26:10 +08:00
schmidt-ju 97286f98d3 [NN] Add EdgeGAT operator (#5282)
Co-authored-by: Quan (Andy) Gan <coin2028@hotmail.com>
2023-04-09 22:54:49 +08:00
Ilia Taraban acb4eb7ecd [Feature] Add bfloat16 support for CPU (#5497)
Co-authored-by: Hongzhi (Steve), Chen <chenhongzhi.nkcs@gmail.com>
2023-04-06 11:16:41 +02:00
Mufei Li a244de579c [Dataset] WisconsinDataset (#5520)
Co-authored-by: Ubuntu <ubuntu@ip-172-31-36-188.ap-northeast-1.compute.internal>
2023-04-04 16:44:26 +08:00
Mufei Li dd4c74ff32 [Dataset] CornellDataset and TexasDataset (#5513)
Co-authored-by: Ubuntu <ubuntu@ip-172-31-36-188.ap-northeast-1.compute.internal>
2023-04-03 16:16:37 +08:00
czkkkkkk 4463b3d6a5 [Sparse] Support strided tensor when calling old DGL APIs (#5506) 2023-03-31 23:18:55 +08:00
Venzino.Han d45eafd47f [NN] add gatconv edge_weight (#5503)
Co-authored-by: venzino-han <venzino.han@buzzvil.com>
Co-authored-by: Mufei Li <mufeili1996@gmail.com>
2023-03-31 19:53:49 +08:00
Mufei Li 2b5921e759 [Dataset] Actor (#5511)
Co-authored-by: Ubuntu <ubuntu@ip-172-31-36-188.ap-northeast-1.compute.internal>
2023-03-31 10:28:50 +08:00
Mufei Li 690f37bbe9 update (#5507)
Co-authored-by: Ubuntu <ubuntu@ip-172-31-36-188.ap-northeast-1.compute.internal>
2023-03-28 19:22:44 +08:00
Hongzhi (Steve), Chen 5b409bf7f5 Rename_test (#5487)
Co-authored-by: Ubuntu <ubuntu@ip-172-31-28-63.ap-northeast-1.compute.internal>
2023-03-24 18:44:24 +08:00
Mufei Li 9e532e7def [Dataset] Chameleon (#5477)
* update

* update

* update

* lint

* update

* CI

* lint

* update doc

---------

Co-authored-by: Ubuntu <ubuntu@ip-172-31-36-188.ap-northeast-1.compute.internal>
2023-03-23 22:34:00 +08:00
ZhenyuLU_Heliodore 4534650f5f [Dataset] Add ZINC Dataset (#5428)
* Update dgl.data.rst

* Add files via upload

* Add files via upload

* Add files via upload

* Update zinc.py

* Update dgl.data.rst

* Update test_data.py

* Add files via upload

* Update cluster.py

* Update pattern.py

* Update zinc.py

* Update zinc.py

* Update test_data.py

* lint

* fix

* fix path

* update test on label shape

---------

Co-authored-by: rudongyu <ru_dongyu@outlook.com>
2023-03-22 18:04:41 +08:00
Xin Yao acb955e15f [Cleanup] Cleanup unused CMake options (#5470)
* cleanup unused cmake options

* disable BUILD_TORCH for cugraph

* resolve comments
2023-03-22 16:06:44 +08:00
czkkkkkk 866c70dace [Sparse] Fix bugs in Diag format conversions (#5465) 2023-03-21 09:24:53 +08:00
Hongzhi (Steve), Chen 8a83027274 [Misc] Merge test utils. (#5440)
* merge

* format

* rename

* sort

* sort

* update

* update

* update

* Update tests/utils/checks.py

Co-authored-by: Mufei Li <mufeili1996@gmail.com>

---------

Co-authored-by: Ubuntu <ubuntu@ip-172-31-28-63.ap-northeast-1.compute.internal>
Co-authored-by: Mufei Li <mufeili1996@gmail.com>
2023-03-20 15:32:45 +08:00
Daniil Sizov 87fb7ed05b [Config] Enable libxsmm by default for AVX cpu (#5165)
* Enable AVX by default

* Fix linting errors

* Fix win64 build (libxsmm not linked)

Libxsmm on Win64 is not linked, should be disabled by default

* Fix clang format issues

* Change lower supported cpu version to LIBXSMM_X86_AVX2

Change lower supported cpu version to LIBXSMM_X86_AVX2 to address https://github.com/dmlc/dgl/issues/3459 issue

* Fix unit test

Remove assumption that libxsmm is enabled in the config by default (only true for intel CPUs with AVX2 instructions)

---------

Co-authored-by: Ubuntu <ubuntu@ip-172-31-15-137.us-west-2.compute.internal>
Co-authored-by: Quan (Andy) Gan <coin2028@hotmail.com>
2023-03-16 02:05:22 +08:00
czkkkkkk 92e383c3b8 [Sparse] Remove the Python DiagMatrix class (#5444)
* [Sparse] Remove the Python DiagMatrix class

* Update

* Update

* update

* Update
2023-03-15 18:17:52 +08:00
kylasa 92e2299593 [DistDGL][Robustness]Replacing numpy's unique with custom implementation (#5391)
* Replacing numpy's unique with custom implementation

* Added docstring to the new function.

* Adding unit tests

* Numpy's version issues with the 'kind' argument.

* Addressing CI Test Failure.

* Addressing CI review comments.

* revised implementation, optimized for time.

* added missing arguments for fallback case.

* Addressing CI test failures.

* Resolving issues with PYTHONPATH

* Fix CI Test Failure issues.

* fix CI test failures.

---------

Co-authored-by: Rhett Ying <85214957+Rhett-Ying@users.noreply.github.com>
2023-03-10 13:38:27 -08:00
kylasa e74b3d3dd2 [DistDGL][TestCoverage]Added testcase for testing distributed lookup service. (#5365)
* Added testcase for testing distributed lookup service.

* Applying lintrunner patch.

* Fixing CI Test environment failures.

* lintrunner patch.

* lintrunner patch

* Fix CI Failure.

* Fixing CI Test failure cases.

* lintrunner patch.

* lintrunner patch and CI test failure.

* Restore no. of test cases.

* Resolving pythonpath issues.

* lintrunner patch.

* updating PYTHONPATH to resolve lib path

* Resolve merge conflicts

* Resolving issues with PYTHONPATH env variable.

* fix module path

* rename utils script under test to avoid ambiguity

* remove unnecessary pythonpath

* fix lint error

* fix lint error

---------

Co-authored-by: RhettYing <rhett_ying@qq.com>
2023-03-10 12:19:41 +08:00
Gleb Bazhenov 54b4bd0acd [Data] new functional for creating data splits in graph (#5418)
* new functional for creating data splits in graph

* minor fix in data split implementation

* apply suggestions from code review

Co-authored-by: Mufei Li <mufeili1996@gmail.com>

* refactoring + unit tests

* fix test file name

* move imports to the top

* Revert "fix test file name"

This reverts commit 126323e38c8de6fdc73c826dccc9048aed8f9634.

* remove nccl submodule

* address linter issues

---------

Co-authored-by: Mufei Li <mufeili1996@gmail.com>
Co-authored-by: Hongzhi (Steve), Chen <chenhongzhi.nkcs@gmail.com>
2023-03-09 18:55:25 +08:00
Hongzhi (Steve), Chen e250ba3d99 [Misc] Rename test_utils -> pytests_utils. (#5438)
* rename

* sort

* rename

---------

Co-authored-by: Ubuntu <ubuntu@ip-172-31-28-63.ap-northeast-1.compute.internal>
2023-03-09 09:42:29 +08:00
kkranen fe3d29ac4d [Dataloading] Ignore edge types without reverse types in edge dataloader (#5411)
* Bugfix for reverse edge issue.

* Resolved copy/paste transcription error

* lint

* Added unit tests for graph with not all reverses.

* linting + added backend device test

---------

Co-authored-by: Quan (Andy) Gan <coin2028@hotmail.com>
Co-authored-by: Rhett Ying <85214957+Rhett-Ying@users.noreply.github.com>
2023-03-08 22:04:51 +08:00
Xin Yao ae4a5b7394 [Feature] Add state_dict, load_state_dict, param_groups to dgl.optim.SparseGradOptimizer (#5311)
* init update

* all get/set optm_state

* add unit tests

* add docstring

* fix for multiple embeddings

* move embedding methods to private

* fix lint

* fix unit tests

* resolve comments

* merge master
2023-03-08 16:46:34 +08:00
Guangyu Zhou 178290249e [Dataset] Add PATTERN dataset (#5422)
* add PATTERN dataset

* fix bug

* fix bugs

* fix issues

* refine according to dongyu's comments

---------

Co-authored-by: BuptTab <gyzhou2000@gmail.com>
Co-authored-by: rudongyu <ru_dongyu@outlook.com>
2023-03-08 14:08:12 +08:00
Xin Yao 8d5d8962ad [Refactor] Replace third_party/nccl with PyTorch's NCCL backend (#4989)
* expose GeneratePermutation

* add sparse_all_to_all_push

* add sparse_all_to_all_pull

* add unit test

* handle world_size=1

* remove python nccl wrapper

* remove the nccl dependency

* use pinned memory to speedup D2H copy

* fix lint

* resolve comments

* fix lint

* fix ut

* resolve comments
2023-03-08 12:59:10 +08:00
kylasa 7b766393f8 [DistDGL][UserEx]Sync parmetis_wrapper with changes in metadata.json (#5385)
* Sync parmetis_wrapper with changes in metadata.json

1. In the preprocess.py, make sure that num_partitions is defined as input argument. Also, align 'input_dir' with the input dataset. schema_file is assumed to be located inside the input_dir. Also, graph_stats.txt file is assumed to be present in the input_dir.

2. Use DGL_HOME environment variable so that parmetis_wrapper command can be run anywhere.

* Fix CI test failure cases.

* Addressing CI review comments.

* Addressing CI test failures.

* Applying lintrunner patch
2023-03-06 15:50:43 -08:00
kylasa 894ad1e3ea Support for no. of chunks smaller than no. of partitions. (#5390)
* Support for no. of chunks smaller than no. of partitions and Adding appropriate test cases.

Following changes are made with this PR.
1. Code changes for handling no. of chunks smaller than no. of partitions
2. Adding new test cases, which were previously deleted, for no. of chunks smaller than no. of partitions.
3. Also adding test cases, where multiple partitions are handled by a single process.

* Committing the missing files in this commit.

* lintrunner patch.

* lintrunner check

* lintrunner patch here.

* CI review comments.
2023-03-06 14:10:51 -08:00
Quan (Andy) Gan 851d66fa65 [Bugfix] Fix duplicate worker_init_fn argument when provided in DataLoader (#5420)
* fix duplicate worker_init_fn

* lint

* lint again

* uugh
2023-03-06 23:41:53 +08:00
Tingyu Wang bfd411d0d5 [Model] Add dgl.nn.CuGraphGATConv model (#5168)
* add CuGraphGATConv model

* lintrunner

* update model to reflect changes in make_mfg_csr(), move max_in_degree to forward()

* simplify pytest markers

* fall back to FG option for large fanout

* update error msg

* add feat_drop and activation options

* add residual option

* Update python/dgl/nn/pytorch/conv/cugraph_gatconv.py

Co-authored-by: Mufei Li <mufeili1996@gmail.com>

* Update python/dgl/nn/pytorch/conv/cugraph_gatconv.py

Co-authored-by: Mufei Li <mufeili1996@gmail.com>

* reset res_fc

---------

Co-authored-by: Mufei Li <mufeili1996@gmail.com>
2023-03-04 14:10:06 +08:00
Mufei Li f00cd6efbd [Utils] Edge and LINKX homophily measure (#5382)
* Update

* lint

* lint

* r prefix

* CI

* lint

* skip TF

* Update

* edge homophily

* linkx homophily

* format

* skip TF

* fix test

* update

* lint

* lint

* review

* lint

* update

* lint

* update

* CI

---------

Co-authored-by: Ubuntu <ubuntu@ip-172-31-36-188.ap-northeast-1.compute.internal>
2023-03-03 16:58:20 +08:00
Hongzhi (Steve), Chen 325e795a18 Revert "Set USE_LIBXSMM default to OFF. (#5287)" (#5392)
This reverts commit a5e3139155.
2023-03-01 16:47:34 +08:00
Zhiteng Li a53ecd229b [Dataset] Add CLUSTER dataset (#5389)
* add CLUSTER dataset

* refine according to dongyu's comments

---------

Co-authored-by: rudongyu <ru_dongyu@outlook.com>
2023-03-01 16:36:12 +08:00
czkkkkkk 999c624582 [Sparse] Support converson to/from torch sparse tensor. (#5388)
* [Sparse] Support converson to/from torch sparse tensor.

* Update
2023-02-28 17:27:23 +08:00
kylasa a14f69c97d [DistDGL][Feature_Request]Changes in the metadata.json file for input graph dataset. (#5310)
* Implemented the following changes.

* Remove NUM_NODES_PER_CHUNK
* Remove NUM_EDGES_PER_CHUNK
* Remove the dependency between no. of edge files per edge type and no. of partitions
* Remove the dependency between no. of edge feature files per edge type and no. of partitions
* Remove the dependency between no. of edge feature files and no. of edge files per edge type.
* Remove the dependency between no. of node feature files and no. of partitions
* Add “node_type_counts”. This will be a list of integers. Each integer will represent total count of a node-type. The index in this list and the index in the “node_type” will be the same for a given node-type.
* Add “edge_type_counts”. This will be a list of integers. Each integer will represent total count of an edge-type. The index in this list and the index in the “edge_type” list will be the same for a given edge-type.

* Applying lintrunner patch.

* Adding missing keys to the metadata in the unit test framework.

* lintrunner patch.

* Resolving CI test failures due to merge conflicts.

* Applying lintrunner patch

* applying lintrunner patch

* Replacing tabspace with spaces - to satisfy lintrunner

* Fixing the CI Test Failure cases.

* Applying lintrunner patch

* lintrunner complaining about a blank line.

* Resolving issues with print statement for NoneType

* Removed tests for the arbitrary chunks tests. Since this functionality is not supported anymore.

* Addressing CI review comments.

* addressing CI review comments

* lintrunner patch

* lintrunner patch.

* Addressing CI review comments.

* lintrunner patch.
2023-02-24 17:01:04 -08:00