f91a97d067
[Dataloader] Fix compatibility of DistributedSampler for older PyTorch versions ( #2997 )
...
* fix compatibility
* fix
* lint
2021-06-09 20:14:26 +08:00
a7fe461c1c
[Doc] Single-machine Multi-GPU node classification tutorial ( #2976 )
...
* multi-GPU node classification tutorial
* Update 2_node_classification.py
* fixes
* elaborate a bit more
* address comments
* address comments
2021-06-08 10:28:02 +08:00
7c7113f660
add use_ddp to dataloaders ( #2911 )
2021-05-17 15:46:02 +08:00
70695ff8f8
[Model] Training GraphSAGE with PyTorch Lightning ( #2878 )
...
* pytorch lightning initial examples
* revert most changes in dataloader to favor #2886 .
* address comments
2021-05-11 11:28:13 +08:00
bfef789ea1
[Dataloading] Make loader iters iterator ( #2886 )
...
* Make loader items iterator
* Update test_dataloader.py
* Update __init__.py
* Update test_dataloader.py
Co-authored-by: Quan (Andy) Gan <coin2028@hotmail.com >
2021-05-07 10:15:49 +08:00
e70138bbe4
[Performance][GPU] Enable GPU uniform edge sampling ( #2716 )
...
* Start on uniform GPU sampling
* Save more work
* Get cu file compiling
* Update sampling
* More changes
* Get GPU sampling for uniform probabilities solved
* Fix batch tensor migration
* Fix
* update kernels
* expand blocking
* Undo testing change
* Cut down on sampling overhead
* Fix replacement
* Update unit tests
* Add option to gpu sample in graphsage
* Copy only csc to gpu
* Add ogbn support
* Fix linting
* Remove nvtx from sample
* Improve documentation and error checking
* Expand documentation
* Update assert checking
* delete extra space
* Use standard dataloader when dataset is a dictionary
* ogb -> ogbn
* Fix edge selection determinism
* Fix typos
* Remove nvtx
* Add comment for self.fanout_arrays and assert
* Fix linting
* Migrate to scalarbatcher
* Fix indentation
* Fix batcher
* Fix indexing
* Only use databatcher for GPU
* Convert to DGL NDArray to PyTorch Tensor
* Add optimization for PyTorch's F.tensor() for list of GPU tensors
Co-authored-by: Da Zheng <zhengda1936@gmail.com >
2021-04-14 18:55:09 -07:00
48b9ecd201
Fix discrepancy in dgl.dataloading.EdgeDataLoader ( #2819 )
...
* fix discrepancy
* address comments
2021-04-07 16:08:14 +08:00
99751d4960
[Doc] Rename block to message flow graph ( #2702 )
...
* rename block to mfg
* revert
* rename
2021-02-25 18:26:19 +08:00
d93a975997
revert ( #2672 )
2021-02-19 12:05:42 +08:00
98ac391ed9
[Doc] Large graph training tutorials ( #2595 )
...
* large graph training tutorials
* add full graph link prediction update
* fix
* fix
* fix
* addressed comments
2021-02-07 17:55:49 +08:00
5da3439c16
[Feature] Add Device Flag in Data Loaders ( #2450 )
...
* Update
* Update
* Update
* Update
* Update
* Update
* Update
* Update
* Update
* Update
* Update
* Update
* Update
Co-authored-by: Minjie Wang <wmjlyjemaine@gmail.com >
2021-01-15 07:39:26 +08:00
a9f8f2589c
[Doc] Update GraphDataLoader in our docs ( #2504 )
...
* update graphdataloader in docs
* fix
* update examples
* fix sagpool
Co-authored-by: Quan (Andy) Gan <coin2028@hotmail.com >
2021-01-11 13:11:19 +08:00
bdb88df576
[Performance] Allow DataLoaders to return indices of the seed array ( #2495 )
...
* return indices from dataloader
* fixes
* fix
* fix distgraph and added some todos
* Update dataloader.py
* Update dataloader.py
Co-authored-by: xiang song(charlie.song) <classicxsong@gmail.com >
2021-01-08 14:30:52 +08:00
e2e524df41
[Feature] Add GraphDataLoader implementation ( #2496 )
...
* add graph dataloader
* add to doc
* fix
* fix
* fix docstring
* update according to torch default_collate
* add unittest
* fix
* fix lint
* fix
2021-01-07 13:38:21 +08:00
38077e298b
installation and doc fix ( #2379 )
2020-11-30 19:47:40 +08:00
49e96970e2
[Doc] fix typos in PyTorch DataLoaders ( #2216 )
...
* fix doc
* fix doc
2020-09-20 13:21:05 +08:00
f3f646bbfd
[Doc and User Guide] Minor Fix ( #2205 )
...
* Fix doc and user guide
* Update heterograph.py
Co-authored-by: Ubuntu <ubuntu@ip-172-31-13-9.us-west-2.compute.internal >
2020-09-17 03:01:12 +08:00
ac5c79cdb8
[Bug] Fixes issues in feature pickling and transmission for subgraphs and blocks ( #2139 )
...
* bug fixes
* remove __deepcopy__; not sure what the behavior should be
* lint
* skip gpu test
* fix
* fix dist dataloader
* add comment
* remove assert
2020-09-03 12:48:59 +08:00
ef976be1e9
[Bug][Doc] Fix NodeDataLoader docstrings and code ( #2063 )
2020-08-19 21:59:02 +08:00
4f1da61b58
[Doc] fix inconsistencies in minibatch user guide ( #2032 )
2020-08-17 12:43:43 +08:00
1ad46fd015
[Distributed] support distributed sampling in NodeDataLoader ( #2012 )
...
* fix.
* doesn't support EdgeDataLoader
* add test.
* fix.
* fix test.
* catch errors in the test.
* fix.
* fix error message
* add print.
* join the server processes.
* update test.
* fix test.
2020-08-13 22:49:21 -07:00
cd48435206
[Transform] Docstring and subframes ( #1962 )
...
* update knn graph docs
* more docs
* [Doc] transform module docstrings
* remove copy_ndata and copy_edata
* fix
* lint
* fix
* fix
* fix
* clean up docstrings
* fix docstring
* dtype specifications
* addresses comments
* fix
Co-authored-by: Mufei Li <mufeili1996@gmail.com >
Co-authored-by: xiang song(charlie.song) <classicxsong@gmail.com >
2020-08-13 10:41:43 +08:00
f5eb80d221
[Feature] Edge DataLoader for edge classification & link prediction ( #1828 )
...
* clean commit
* oops forgot the most important files
* use einsum
* copy feature from frontier to block
* Revert "copy feature from frontier to block"
This reverts commit 5224ec963eb6a3ef1b6ab74d8ecbd44e4e42f285.
* temp fix
* unit test
* fix
* revert jtnn
* lint
* fix win64
* docstring fixes and doc indexing
* revert einsum in sparse bidecoder
* fix some examples
* lint
* fix due to some tediousness in remove_edges
* addresses comments
* fix
* more jtnn fixes
* fix
2020-08-11 18:00:58 +08:00
Quan (Andy) Gan