文件历史

537 次代码提交

作者 SHA1 备注 提交日期
nv-dlasalle 50dd8517c8 Enable faster validation for pytorch graphsage example (#3361) 2021-11-05 03:11:50 +00:00
HaoWei-TomTom e87dec8599 [Bugfix][Pytorch] Fix model save and load bug of stgcn_wave (#3303)
Co-authored-by: Jinjing Zhou <VoVAllen@users.noreply.github.com>
2021-11-04 08:16:26 +00:00
Christian Clauss 69eae6de49 [Fix] Use ==/!= to compare constant literals (str, bytes, int, float, tuple) (#3415)
* Use ==/!= to compare constant literals (str, bytes, int, float, tuple)

Avoid Syntax Warnings on Python >= 3.8

$ `python3`
```
>>> "" == ""
True
>>> "" is ""
<stdin>:1: SyntaxWarning: "is" with a literal. Did you mean "=="?
True
```

* Use ==/!= to compare constant literals (str, bytes, int, float, tuple)
2021-11-04 08:16:05 +00:00
K 67e3902711 [Model] Refine GraphSAINT (#3328)
* The start of experiments of Jiahang Li on GraphSAINT.

* a nightly build

* a nightly build

Check the basic pipeline of codes. Next to check the details of samplers , GCN layer (forward propagation) and loss (backward propagation)

* a night build

* Implement GraphSAINT with torch.dataloader

There're still some bugs with sampling in training procedure

* Test validity

Succeed in testing validity on ppi_node experiments without testing other setup.
1. Online sampling on ppi_node experiments performs perfectly.
2. Sampling speed is a bit slow because the operations on [dgl.subgraphs], next step is to improve this part by putting the conversion into parallelism
3. Figuring out why offline+online sampling method performs bad, which does not make sense
4. Doing experiments on other setup

* Implement saint with torch.dataloader

Use torch.dataloader to speed up saint sampling with experiments. Except experiments on too large dataset Amazon, we've done some experiments on other four datasets including ppi, flickr, reddit and yelp. Preliminary experimental results show consumed time and metrics reach not bad level. Next step is to employ more accurate profiler which is the line_profiler to test consumed period, and adjust num_workers to speed up sampling procedures on same certain datasets faster.

* a nightly build

* Update .gitignore

* reorganize codes

Reorganize some codes and comments.

* a nightly build

* Update .gitignore

* fix bugs

Fix bugs about why fully offline sampling and author's version don't work

* reorganize files and codes

Reorganize files and codes then do some experiments to test the performance of offline sampling and online sampling

* do some experiments and update README

* a nightly build

* a nightly build

* Update README.md

* delete unnecessary files

* Update README.md

* a nightly update

1. handle directory named 'graphsaintdata'
2. control graph shift between gpu and cpu related to large dataset ('amazon')
3. remove parameter 'train'
4. refine annotations of the sampler
5. update README.md including updating dataset info, dependencies info, etc

* a nightly update

explain config differences in TEST part
remove a sampling time variant
make 'online' an argument
change 'norm' to 'sampler'
explain parameters in README.md

* Update README.md

* a nightly build

* make online an argument
* refine README.md
* refine codes of `collate_fn` in sampler.py, in training phase only return one subgraph, no need to check if the number of subgraphs larger than 1

* Update sampler.py

check the problem on flickr is about overfitting.

* a nightly update

Fix the overfitting problem of `flickr` dataset. We need to restrict the number of subgraphs (also the number of iterations) used in each epoch of training phase. Or it might overfit when validating at the end of each epoch. The method to limit the number is a formula specified by the author.

* Set up a new flag `full` specifying if the number of subgraphs used in training phase equals to that of pre-sampled subgraphs

* Modify codes and annotations related the new flag

* Add a new parameter called `node_budget` in the base class `SAINTSampler` to compute the specific formula

* set `gpu` as a command line argument

* Update README.md

* Finish the experiments on Flickr, which is done after adding new flag `full`

* a nightly update

* use half of edges in the original graph to do sampling
* test dgl.random.choice with or without replacement with half of edges
~ next is to test what if put the calculating probability part out of __getitem__ can speed up sampling and try to implement sampling method of author

* employ cython to implement edge sampling for per edge

* employ cython to implement edge sampling for per edge
* doing experiments to test consumed time and performance
** the consumed time decreased to approximately 480s, the performance decrease about 5 points.
* deprecate cython implementation

* Revert "employ cython to implement edge sampling for per edge"

* This reverts commit 4ba4f092
* Deprecate cython implementation
* Reserve half-edges mechanism

* a nightly update

* delete unnecessary annotations

Co-authored-by: Mufei Li <mufeili1996@gmail.com>
2021-11-04 06:12:21 +00:00
Junwen Yao 3d90edda3e Fix torch import in example (#3372) 2021-11-04 06:10:53 +00:00
Vikram Sharma 039856f8a9 [Doc] Added md5sum info for OGB-LSC dataset (#3332)
* Added md5sum for the large dataset files

md5sum helps in validating the correctness of large dataset files once downloaded. 

Refer: https://github.com/snap-stanford/ogb/issues/253
2021-11-04 06:10:06 +00:00
xiang song(charlie.song) e3eb3ee511 Fix distributed device mapping problem. (#3313)
Co-authored-by: Ubuntu <ubuntu@ip-172-31-2-66.ec2.internal>
2021-11-04 05:47:56 +00:00
xiang song(charlie.song) 508197e807 [New Feature] Per edge type sampler for to_homogeneous graphs. (#3131)
* fix.

* fix.

* fix.

* fix.

* Fix test

* Deprecate old DistEmbedding impl, use synchronized embedding impl

* Basic imple of heterogeneous on homogenenous sampling

* make pass

* Pass C++ test

* Add python test code

* lint

* lint

* Add MultiLayerEtypeNeighborSampler

* Add unitest for single machine dataloader

* Add dist dataloader test for edge type sampler

* Fix lint

* fix

* support for per etype sample

* Fix some bug and enable distributed training with per edge sample

* fix

* Now distributed training works

* turn off some mxnet

* turn off mxnet for some dist test

* fix

* upd

* upd according to the comments

* Fix

* Fix test and now distributed works.

* upd

* upd

* Fix

* Fix bug

* remove dead code.

* upd

* Fix

* upd

* Fix

Co-authored-by: Ubuntu <ubuntu@ip-172-31-71-112.ec2.internal>
Co-authored-by: Ubuntu <ubuntu@ip-172-31-2-66.ec2.internal>
Co-authored-by: Da Zheng <zhengda1936@gmail.com>
2021-11-02 09:21:20 +00:00
Da Zheng 223795eb82 [Distributed] Distributed heterograph training (#3069)
* support hetero RGCN.

* fix.

* simplify code.

* sample_neighbors return heterograph directly.

* avoid using to_heterogeneous.

* compute canonical etypes in advance.

* fix tests.

* fix.

* fix distributed data loader for heterograph.

* use NodeDataLoader.

* fix bugs in partitioning on heterogeneous graphs.

* fix lint.

* fix tests.

* fix.

* fix.

* fix bugs.

* fix tests.

* fix.

* enable coo for distributed.

* fix.

* fix.

* fix.

* fix.

* fix.

Co-authored-by: Ubuntu <ubuntu@ip-172-31-71-112.ec2.internal>
Co-authored-by: Zheng <dzzhen@3c22fba32af5.ant.amazon.com>
2021-11-02 09:18:15 +00:00
Quan (Andy) Gan 1fa3202bbd fix relgraphconv bug (#3256) 2021-08-26 17:31:41 +00:00
Peiqi Yin 3f915a134b GeniePath model add a Tanh. (#3269)
* Update model.py

* Update README.md

Co-authored-by: Zihao Ye <expye@outlook.com>
2021-08-26 17:31:03 +00:00
maqy 682c3e78c6 [Model] add model example EvolveGCN. (#3190)
* add evolveGCN example

* small fix

* fix defect

* fix defect

Co-authored-by: Quan (Andy) Gan <coin2028@hotmail.com>
2021-08-20 02:45:36 +00:00
Peiqi Yin 006ceb6c8e [Model] Fix diffpool loss (#3233) 2021-08-20 02:42:18 +00:00
JOHNW02 0ed0d232ce [example] Create EEG-GCNN example. (#3186)
* Create EEG-GCNN example.

* Update README.md

* Remove gitignore file.

* Update README.md

* change 'datas' to 'datasets'.

* Change train.py to main.py

* Added an entry in the indexing page.

* State "simplified version"; change how to run.

* Fix bug in contact

* Remove paper link in reference.

* Create working branch

* Add normalization of x.

* Update paper link and tags

* Update paper link in readme

* Update readme; add patient level indices

* Update readme. Add comments to models

* Update README.md

* change to with; specify location for ch and el; move note

* fix bug for note

* Add args for models; clean code.

* delete = in readme

* Add reference for spec_coh_values
2021-08-20 02:39:06 +00:00
Ankit Garg d0dcda1c10 [Feature] Add removed edges in distributed graph partitioning to handle heterogeneous graph (#3137)
* Added code for Rectifying (TypeError: unhashable type: 'slice') when copying file

* 1) added distributed preprocessing code to create ParMetis Input from CSV files
2) add code to run pm_dglpart on multiple machines
3) added support for recreating heteregenous graph from homo geneous graph based on dropped edges, as ParMetis currently only supports homogeneous graphs

* move to pandas

* Added comments and remove drop_duplicates as it was redundant

* Addressed Pr Comments

* Rename variable

* Added comment

* Added comment

* updated ReadMe

Co-authored-by: Ankit Garg <gaank@amazon.com>
Co-authored-by: Da Zheng <zhengda1936@gmail.com>
2021-08-20 02:30:05 +00:00
Kay Liu 043806e325 [model] add model example GeniePath (#3199)
* [model] add model example GeniePath

* improvements based on feedback

* improvements based on feedback

Co-authored-by: zhjwy9343 <6593865@qq.com>
2021-08-20 02:19:35 +00:00
KounianhuaDu e6f2ffa48b fix (#3167)
Co-authored-by: xiang song(charlie.song) <classicxsong@gmail.com>
Co-authored-by: zhjwy9343 <6593865@qq.com>
2021-08-20 02:19:17 +00:00
Kay Liu fb5464df76 [Model] add model example CARE-GNN (#3187)
* [Model] add model example CARE-GNN

* update README

* improvements based on the review feedback

* fix missing item()

Co-authored-by: zhjwy9343 <6593865@qq.com>
2021-08-20 02:19:12 +00:00
Jinjing Zhou decd41fe18 [Doc] Fix WeightBasis documentation (#3189)
* fix

* fix type

Co-authored-by: Minjie Wang <wmjlyjemaine@gmail.com>
2021-08-20 02:18:38 +00:00
Kay Liu e4d0b11872 [Model] add model example GCN-based Anti-Spam (#3145)
* add model example GCN-based Anti-Spam

* update example index

* add usage info

* improvements as per comments

* fix image invisiable problem

* add image file

Co-authored-by: zhjwy9343 <6593865@qq.com>
2021-08-20 02:12:39 +00:00
Tianjun Xiao e5f68a04cc train test on face use concat bce (#3180) 2021-08-20 02:12:33 +00:00
Tianjun Xiao 1db38a5af7 change numbers to concat bce (#3175) 2021-08-20 02:12:16 +00:00
Minjie Wang 8126e1bd45 [Doc] Update the example folder README 2021-07-21 11:07:51 +00:00
Jinjing Zhou 88f20eec4e fix tags (#3140)
Co-authored-by: Quan (Andy) Gan <coin2028@hotmail.com>
2021-07-15 11:02:44 +08:00
Mufei Li 3f6f694159 [Bug fix] Various fix from bug bash (#3133)
* Update

* Update

* Update dependencies

* Update

* Update

* Fix ogbn-products gat

* Update

* Update

* Reformat

* Fix typo in node2vec_random_walk

* Specify file encoding

* Working for 6.7

* Update

* Fix subgraph

* Fix doc for sample_neighbors_biased

* Fix hyperlink

* Add example for udf cross reducer

* Fix

* Add example for slice_batch

* Replace dgl.bipartite

* Fix GATConv

* Fix math rendering

* Fix doc

Co-authored-by: Ubuntu <ubuntu@ip-172-31-28-17.us-west-2.compute.internal>
Co-authored-by: Jinjing Zhou <VoVAllen@users.noreply.github.com>
Co-authored-by: Ubuntu <ubuntu@ip-172-31-22-156.us-west-2.compute.internal>
2021-07-15 09:17:15 +08:00
xiang song(charlie.song) d7390763f0 [Distributed] Deprecate old DistEmbedding impl, use synchronized embedding impl (#3111)
* fix.

* fix.

* fix.

* fix.

* Fix test

* Deprecate old DistEmbedding impl, use synchronized embedding impl

* update doc

Co-authored-by: Ubuntu <ubuntu@ip-172-31-71-112.ec2.internal>
Co-authored-by: Ubuntu <ubuntu@ip-172-31-2-66.ec2.internal>
Co-authored-by: Da Zheng <zhengda1936@gmail.com>
Co-authored-by: Jinjing Zhou <VoVAllen@users.noreply.github.com>
2021-07-14 00:15:53 +08:00
Wilfried L. Bounsi ee6bc95175 Update a comment in pytorch HGT example (#3101)
Co-authored-by: Quan (Andy) Gan <coin2028@hotmail.com>
Co-authored-by: Jinjing Zhou <VoVAllen@users.noreply.github.com>
2021-07-13 19:09:17 +08:00
Quan (Andy) Gan b576e617ad [Feature] Add left normalizer for GCN (#3114)
* add left normalizer for gcn

* fix

* fixes and some bug stuff
2021-07-13 12:49:35 +08:00
Kay Liu 0ce92a86ed [BugFix] fix problems found in bug bash (#3116)
* fix breakline in fakenews.py

* fix inconsistent argument name

* modify incorrect example and deprecated graph type

* modify docstring and example in knn_graph

* fix incorrect node type

Co-authored-by: Quan (Andy) Gan <coin2028@hotmail.com>
2021-07-12 13:34:50 +08:00
Jinjing Zhou 3641829211 fix docs (#3126)
Co-authored-by: Quan (Andy) Gan <coin2028@hotmail.com>
2021-07-12 11:43:15 +08:00
Tomohiro Endo fc55225f08 Fix module name (#3128) 2021-07-12 11:15:02 +08:00
Quan (Andy) Gan 5798ee8d98 [Performance] Add a warning for ChebConv (#3099)
* add a warning for chebconv

* fix and docstrings

* update bgnn

* fix

Co-authored-by: Minjie Wang <wmjlyjemaine@gmail.com>
Co-authored-by: Jinjing Zhou <VoVAllen@users.noreply.github.com>
2021-07-09 14:49:15 +08:00
Hengrui Zhang 0d1dcdcd2e [bugfix] fix a bug found in v0.7 bug bash in the 'grace' model (#3109)
* Update aug.py

* Update aug.py

Co-authored-by: Mufei Li <mufeili1996@gmail.com>
2021-07-07 14:50:02 +08:00
Tianjun Xiao 22e8c120be [Example ] fix faiss issue on k 3 for hilander model (#3105)
* fix faiss issue on k 3

* Add Hilander paper link

Co-authored-by: Tong He <hetong007@gmail.com>
2021-07-06 13:22:56 +08:00
Tong He 9c41c22d7b [Model] Official implementation for HiLANDER model. (#3087)
* add hilander model implementation draft

* use focal loss

* fix

* change data root

* add necessary scripts

* update download links

* update

* update example table

* fix

* update readme with numbers

* add empty folder

* only eval at the end

* set up hilander

* inform results may fluctuate

* address comments

Co-authored-by: sneakerkg <xiaotj1990327@gmail.com>
Co-authored-by: Ubuntu <ubuntu@ip-172-31-19-212.us-east-2.compute.internal>
2021-07-04 20:08:58 +08:00
Da Zheng 0884d02465 [Distributed] Fix bugs in partitioning on heterogeneous graphs. (#3085)
* fix bugs in partitioning on heterogeneous graphs.

* fix.

* fix.

* fix example.

* fix.

* fix test.

* fix.

* fix.

* fix.

* fix tests.

Co-authored-by: Ubuntu <ubuntu@ip-172-31-71-112.ec2.internal>
Co-authored-by: Zheng <dzzhen@3c22fba32af5.ant.amazon.com>
2021-07-02 21:16:14 +08:00
nv-dlasalle 02e5d47d2a [Example][Bugfix] Fix RGCN example datasplitting (#3037)
* Fix example datasplitting

* Remove left-over split parameter

* Remove unused parameter

* Set epoch when using multiple GPUs

Co-authored-by: xiang song(charlie.song) <classicxsong@gmail.com>
2021-06-29 10:16:28 +08:00
Tomohiro Endo 7f4086da7a cuda() to to(device) (#3064)
Co-authored-by: Quan (Andy) Gan <coin2028@hotmail.com>
2021-06-28 11:56:24 +08:00
WangYQ 2f43cdb3c8 deal with situation where num_layers equals 1 (#3066) 2021-06-28 10:17:16 +08:00
Quan (Andy) Gan 427a5a96e0 [Doc] Update NodeDataLoader and EdgeDataLoader for GPU-based neighbor sampling (#3046)
* update docstrings and tidy code

* add docs

* address comments

* Update __init__.py

* address comments
2021-06-25 10:46:21 +08:00
Quan (Andy) Gan acd21a6d60 [Feature] Support direct creation from CSR and CSC (#3045)
* csr and csc creation

* fix

* fix

* fixes to adj transpose

* fine

* raise error if indptr did not match number of nodes

* fix

* huh?

* oh

Co-authored-by: Minjie Wang <wmjlyjemaine@gmail.com>
2021-06-25 10:05:47 +08:00
maqy 31f4483af7 add HAN sampling demo (#3005)
Co-authored-by: maqy1995 <maqingyun0718>
Co-authored-by: Quan (Andy) Gan <coin2028@hotmail.com>
2021-06-23 20:27:18 +08:00
Tomohiro Endo cb2327d4a9 [Example] Fix error in gcn train due to missing argument (#3040)
* Fix example

* Remove register_data_args and revert  to dataset

Co-authored-by: Minjie Wang <wmjlyjemaine@gmail.com>
2021-06-23 15:50:07 +08:00
Quan (Andy) Gan e667545da5 [Feature] Node2vec (#2992)
* add seal example

* 1. add paper infomation in examples/README
2. adjust codes
3. option test

* use latest `to_simple` to replace coalesce graph function

* remove outdated codes

* remove useless comment

* Node2vec
1.implement node2vec random walk c++ op
2.implement node2vec model
3.implement node2vec example

* add CMakeLists file modify

* refine c++ codes

* refine c++ codes

* add missing whitespace

* refine python codes

* add codes

* add node2vec_impl.h

* fix codes

* fix code style problem

* fixes

* remove

* lots of changes

* add benchmark

* fixes

Co-authored-by: smilexuhc <smile.xuhc@gmail.com>
Co-authored-by: Minjie Wang <wmjlyjemaine@gmail.com>
2021-06-23 14:47:56 +08:00
Mufei Li ff519f98c3 [API] Standardize Subgraph APIs (#2929)
* Update

* Update

* Update

* Update

* Update

* Update

* Update

* Fix

* Update

* Fix subgraph tests

* Capture stdout for distributed test

* Capture stdout for distributed test

* Update

* Update

* Update

* Update subgraph.cc

Co-authored-by: Ubuntu <ubuntu@ip-172-31-28-17.us-west-2.compute.internal>
Co-authored-by: Jinjing Zhou <VoVAllen@users.noreply.github.com>
2021-06-21 19:53:37 +08:00
Da Zheng aaec3d8a0b [Distributed] Support hierarchical partitioning (#3000)
* add.

* fix.

* fix.

* fix.

* fix.

* add tests.

* support node split and edge split.

* support 1 partition.

* add tests.

* fix.

* fix test.

* use hierarchical partition.

* add check.

Co-authored-by: Zheng <dzzhen@3c22fba32af5.ant.amazon.com>
Co-authored-by: Ubuntu <ubuntu@ip-172-31-22-57.us-west-2.compute.internal>
Co-authored-by: Ubuntu <ubuntu@ip-172-31-71-112.ec2.internal>
2021-06-16 16:58:23 +08:00
Hengrui Zhang 18eaad17cc fix bugs (#3008)
Co-authored-by: zhjwy9343 <6593865@qq.com>
2021-06-16 15:27:47 +08:00
Hengrui Zhang 36c6c64957 Replace QM9_v2 with built-in QM9Edge Dataset (#3026)
Co-authored-by: Mufei Li <mufeili1996@gmail.com>
2021-06-16 14:35:40 +08:00
espylapiza 305d5c16df [Example] update ogbn-arxiv and ogbn-proteins results (#3018)
* [Example] GCN on ogbn-arxiv dataset

* Add README.md

* Update GCN implementation on ogbn-arxiv

* Update GCN on ogbn-arxiv

* Fix typo

* Use evaluator to get results

* Fix duplicated

* Fix duplicated

* Update GCN on ogbn-arxiv

* Add GAT for ogbn-arxiv

* Update README.md

* Update GAT on ogbn-arxiv

* Update README.md

* Update README

* Update README.md

* Update README.md

* Add GAT implementation for ogbn-proteins

* Add GAT implementation for ogbn-proteins

* Add GAT implementation for ogbn-proteins

* Add GAT implementation for ogbn-proteins

* Add GAT implementation for ogbn-proteins

* Update examples for ogbn-arxiv

* Update examples for ogbn-arxiv

* Update examples for ogbn-arxiv

* Update examples for ogbn-arxiv

* Update examples for ogbn-arxiv

* Update examples for ogbn-arxiv

* Update examples for ogbn-arxiv

* Update examples for ogbn-arxiv

* Update examples for ogbn-arxiv

* Update examples for ogbn-arxiv

* Update examples for ogbn-arxiv

* Update examples for ogbn-arxiv

* Update examples for ogbn-arxiv

* Update examples for ogbn-arxiv

* Add examples for ogbn-products.

* Update examples for ogbn-proteins.

* Update examples for ogbn-proteins.

* Update examples for ogbn-proteins.

* Update examples for ogbn-proteins.

* Update examples for ogbn-proteins.

* Update examples for ogbn-proteins.

* Update examples for ogbn-proteins.

* Update examples for ogbn-proteins.

* Update examples for ogbn-proteins.

* Update examples for ogbn-products.

* Update examples for ogbn-products.

* Update examples for ogbn-arxiv.

* Update examples for ogbn-arxiv.

* Update examples for ogbn-arxiv.

* Update examples for ogbn-proteins.

* Update examples for ogbn-products.

* Update examples for ogbn-proteins.

* Update examples for ogbn-arxiv.

* Update examples for ogbn-proteins.

* Update README.md

* [Example] ogbn-arxiv & ogbn-proteins

* [Example] ogbn-arxiv & ogbn-proteins

* [Example] ogbn-arxiv & ogbn-proteins

* [Example] ogbn-arxiv & ogbn-proteins

Co-authored-by: Mufei Li <mufeili1996@gmail.com>
Co-authored-by: Zihao Ye <expye@outlook.com>
2021-06-16 12:33:43 +08:00
Hengrui Zhang b4ad59d77f [Model] reformat and update performance of grace (#3009)
* reformat and update performance

* Update README.md

* Fix typos

Co-authored-by: Mufei Li <mufeili1996@gmail.com>
2021-06-15 17:02:37 +08:00