mirrors / dmlc--dgl

文件历史

1,954 提交 34 分支 42 Git 标签
0.7.x
提交图

25 次代码提交

作者 SHA1 备注 提交日期
Quan (Andy) Gan 427a5a96e0 [Doc] Update NodeDataLoader and EdgeDataLoader for GPU-based neighbor sampling (#3046) 
* update docstrings and tidy code

* add docs

* address comments

* Update __init__.py

* address comments
 2021-06-25 10:46:21 +08:00
nv-dlasalle 8b64ae59b8 [Performance] Perform to_block on the GPU when the dataloader is created with a GPU device. (#3016) 
* add output device for dataloading

* Update dataloader

* Get sampler device from dataloader

* Fix line length

* Update examples

* Fix to_block GPU for empty relation types

* Handle the case where the DistGraph has None for the underlying graph

Co-authored-by: Da Zheng <zhengda1936@gmail.com>
 2021-06-13 18:51:00 +08:00
Quan (Andy) Gan f91a97d067 [Dataloader] Fix compatibility of DistributedSampler for older PyTorch versions (#2997) 
* fix compatibility

* fix

* lint
 2021-06-09 20:14:26 +08:00
Quan (Andy) Gan a7fe461c1c [Doc] Single-machine Multi-GPU node classification tutorial (#2976) 
* multi-GPU node classification tutorial

* Update 2_node_classification.py

* fixes

* elaborate a bit more

* address comments

* address comments
 2021-06-08 10:28:02 +08:00
Quan (Andy) Gan 7c7113f660 add use_ddp to dataloaders (#2911) 2021-05-17 15:46:02 +08:00
Quan (Andy) Gan 70695ff8f8 [Model] Training GraphSAGE with PyTorch Lightning (#2878) 
* pytorch lightning initial examples

* revert most changes in dataloader to favor #2886.

* address comments
 2021-05-11 11:28:13 +08:00
Justus Schock bfef789ea1 [Dataloading] Make loader iters iterator (#2886) 
* Make loader items iterator

* Update test_dataloader.py

* Update __init__.py

* Update test_dataloader.py

Co-authored-by: Quan (Andy) Gan <coin2028@hotmail.com>
 2021-05-07 10:15:49 +08:00
nv-dlasalle e70138bbe4 [Performance][GPU] Enable GPU uniform edge sampling (#2716) 
* Start on uniform GPU sampling

* Save more work

* Get cu file compiling

* Update sampling

* More changes

* Get GPU sampling for uniform probabilities solved

* Fix batch tensor migration

* Fix

* update kernels

* expand blocking

* Undo testing change

* Cut down on sampling overhead

* Fix replacement

* Update unit tests

* Add option to gpu sample in graphsage

* Copy only csc to gpu

* Add ogbn support

* Fix linting

* Remove nvtx from sample

* Improve documentation and error checking

* Expand documentation

* Update assert checking

* delete extra space

* Use standard dataloader when dataset is a dictionary

* ogb -> ogbn

* Fix edge selection determinism

* Fix typos

* Remove nvtx

* Add comment for self.fanout_arrays and assert

* Fix linting

* Migrate to scalarbatcher

* Fix indentation

* Fix batcher

* Fix indexing

* Only use databatcher for GPU

* Convert to DGL NDArray to PyTorch Tensor

* Add optimization for PyTorch's F.tensor() for list of GPU tensors

Co-authored-by: Da Zheng <zhengda1936@gmail.com>
 2021-04-14 18:55:09 -07:00
Quan (Andy) Gan 48b9ecd201 Fix discrepancy in dgl.dataloading.EdgeDataLoader (#2819) 
* fix discrepancy

* address comments
 2021-04-07 16:08:14 +08:00
Quan (Andy) Gan 99751d4960 [Doc] Rename block to message flow graph (#2702) 
* rename block to mfg

* revert

* rename
 2021-02-25 18:26:19 +08:00
Quan (Andy) Gan d93a975997 revert (#2672) 2021-02-19 12:05:42 +08:00
Quan (Andy) Gan 98ac391ed9 [Doc] Large graph training tutorials (#2595) 
* large graph training tutorials

* add full graph link prediction update

* fix

* fix

* fix

* addressed comments
 2021-02-07 17:55:49 +08:00
Mufei Li 5da3439c16 [Feature] Add Device Flag in Data Loaders (#2450) 
* Update

* Update

* Update

* Update

* Update

* Update

* Update

* Update

* Update

* Update

* Update

* Update

* Update

Co-authored-by: Minjie Wang <wmjlyjemaine@gmail.com>
 2021-01-15 07:39:26 +08:00
Tong He a9f8f2589c [Doc] Update GraphDataLoader in our docs (#2504) 
* update graphdataloader in docs

* fix

* update examples

* fix sagpool

Co-authored-by: Quan (Andy) Gan <coin2028@hotmail.com>
 2021-01-11 13:11:19 +08:00
Quan (Andy) Gan bdb88df576 [Performance] Allow DataLoaders to return indices of the seed array (#2495) 
* return indices from dataloader

* fixes

* fix

* fix distgraph and added some todos

* Update dataloader.py

* Update dataloader.py

Co-authored-by: xiang song(charlie.song) <classicxsong@gmail.com>
 2021-01-08 14:30:52 +08:00
Tong He e2e524df41 [Feature] Add GraphDataLoader implementation (#2496) 
* add graph dataloader

* add to doc

* fix

* fix

* fix docstring

* update according to torch default_collate

* add unittest

* fix

* fix lint

* fix
 2021-01-07 13:38:21 +08:00
Quan (Andy) Gan 38077e298b installation and doc fix (#2379) 2020-11-30 19:47:40 +08:00
Quan (Andy) Gan 49e96970e2 [Doc] fix typos in PyTorch DataLoaders (#2216) 
* fix doc

* fix doc
 2020-09-20 13:21:05 +08:00
Mufei Li f3f646bbfd [Doc and User Guide] Minor Fix (#2205) 
* Fix doc and user guide

* Update heterograph.py

Co-authored-by: Ubuntu <ubuntu@ip-172-31-13-9.us-west-2.compute.internal>
 2020-09-17 03:01:12 +08:00
Quan (Andy) Gan ac5c79cdb8 [Bug] Fixes issues in feature pickling and transmission for subgraphs and blocks (#2139) 
* bug fixes

* remove __deepcopy__; not sure what the behavior should be

* lint

* skip gpu test

* fix

* fix dist dataloader

* add comment

* remove assert
 2020-09-03 12:48:59 +08:00
Quan (Andy) Gan ef976be1e9 [Bug][Doc] Fix NodeDataLoader docstrings and code (#2063) 2020-08-19 21:59:02 +08:00
Quan (Andy) Gan 4f1da61b58 [Doc] fix inconsistencies in minibatch user guide (#2032) 2020-08-17 12:43:43 +08:00
Da Zheng 1ad46fd015 [Distributed] support distributed sampling in NodeDataLoader (#2012) 
* fix.

* doesn't support EdgeDataLoader

* add test.

* fix.

* fix test.

* catch errors in the test.

* fix.

* fix error message

* add print.

* join the server processes.

* update test.

* fix test.
 2020-08-13 22:49:21 -07:00
Quan (Andy) Gan cd48435206 [Transform] Docstring and subframes (#1962) 
* update knn graph docs

* more docs

* [Doc] transform module docstrings

* remove copy_ndata and copy_edata

* fix

* lint

* fix

* fix

* fix

* clean up docstrings

* fix docstring

* dtype specifications

* addresses comments

* fix

Co-authored-by: Mufei Li <mufeili1996@gmail.com>
Co-authored-by: xiang song(charlie.song) <classicxsong@gmail.com>
 2020-08-13 10:41:43 +08:00
Quan (Andy) Gan f5eb80d221 [Feature] Edge DataLoader for edge classification & link prediction (#1828) 
* clean commit

* oops forgot the most important files

* use einsum

* copy feature from frontier to block

* Revert "copy feature from frontier to block"

This reverts commit 5224ec963eb6a3ef1b6ab74d8ecbd44e4e42f285.

* temp fix

* unit test

* fix

* revert jtnn

* lint

* fix win64

* docstring fixes and doc indexing

* revert einsum in sparse bidecoder

* fix some examples

* lint

* fix due to some tediousness in remove_edges

* addresses comments

* fix

* more jtnn fixes

* fix
 2020-08-11 18:00:58 +08:00