ae3316c846
[Doc] Update doc of dataloading package. ( #3886 )
...
* wip: dataloading doc
* update dataloading package doc and many others
* lint
2022-03-26 21:59:02 +08:00
e963256882
[Doc] Update message-api.rst ( #3844 )
...
fix #3812
Co-authored-by: Quan (Andy) Gan <coin2028@hotmail.com >
Co-authored-by: Minjie Wang <wmjlyjemaine@gmail.com >
2022-03-25 23:22:20 +08:00
7d4160869c
[Bug] Fix multiple issues in distributed multi-GPU GraphSAGE example ( #3870 )
...
* fix distributed multi-GPU example device
* try Join
* update version requirement in README
* use model.join
* fix docs
Co-authored-by: Jinjing Zhou <VoVAllen@users.noreply.github.com >
2022-03-25 22:04:02 +08:00
8425c936c2
update doc for gpu&uva sampling ( #3787 )
...
Co-authored-by: Quan (Andy) Gan <coin2028@hotmail.com >
2022-02-28 21:17:32 +08:00
d41d07d0f6
[Doc and bugfix] Add docs and user guide and update tutorial for sampling pipeline ( #3774 )
...
* huuuuge update
* remove
* lint
* lint
* fix
* what happened to nccl
* update multi-gpu unsupervised graphsage example
* replace most of the dgl.mp.process with torch.mp.spawn
* update if condition for use_uva case
* update user guide
* address comments
* incorporating suggestions from @jermainewang
* oops
* fix tutorial to pass CI
* oops
* fix again
Co-authored-by: Xin Yao <xiny@nvidia.com >
2022-02-28 02:21:51 +08:00
6d9433b04f
[Transform] [Doc] Rename transform to transforms and update doc ( #3765 )
...
* Update
* Update
* Update
* Fix
* Update
* Update
* Update
* Fix
2022-02-24 21:28:15 +08:00
8db2dd3355
[Dataset][Fix] Allow non-numeric values and some fix on doc ( #3757 )
...
* [Fix] be able to parse ids if numeric and non-numeric values are used together
* add required package info and cache note into docstring
* duplicate node id is not allowed
2022-02-23 17:26:12 +08:00
6106a99d0a
refine
2022-02-17 02:00:10 +00:00
3b49370d3e
refine doc
2022-02-17 00:52:20 +00:00
8d861d9443
refine especiaaly for data parser
2022-02-17 00:52:20 +00:00
e0f054fb27
[Doc] add doc for DGLCSVDataset
2022-02-17 00:52:16 +00:00
fcd8ed9acc
[Feature] Launch Long Live Servers and Multiple Client Groups ( #3688 )
...
* enable to launch multiple client groups sequentially
* launch simultaneously is enabled
* refine docstring
* revert unnecessary change
* [DOC] add doc for long live server
* refine
* refine doc
* refine doc
2022-02-09 15:56:38 +08:00
738e8318fd
[Feature] CUDA UVA sampling for MultiLayerNeighborSampler ( #3674 )
...
* implement pin_memory/unpin_memory/is_pinned for dgl.graph
* update python docstring
* update c++ docstring
* add test
* fix the broken UnifiedTensor
* XPU_SWITCH for kDLCPUPinned
* a rough version ready for testing
* eliminate extra context parameter for pin/unpin
* update train_sampling
* fix linting
* fix typo
* multi-gpu uva sampling case
* disable new format materialization for pinned graphs
* update python doc for pin_memory_
* fix unit test
* UVA sampling for link prediction
* dispatch most csr ops
* update graphsage example to combine uva sampling and UnifiedTensor
* update graphsage example to combine uva sampling and UnifiedTensor
* update graphsage example to combine uva sampling and UnifiedTensor
* update doc
* update examples
* change unitgraph and heterograph's PinMemory to in-place
* update examples for multi-gpu uva sampling
* update doc
* fix linting
* fix cpu build
* fix is_pinned for DistGraph
* fix is_pinned for DistGraph
* update graphsage unsupervised example
* update doc for gpu sampling
* update some check for sampling device switching
* fix linting
* adapt for new dataloader
* fix linting
* fix
* fix some name issue
* adjust device check
* add unit test for uva sampling & fix some zero_copy bug
* fix linting
* update num_threads in graphsage examples
Co-authored-by: Quan (Andy) Gan <coin2028@hotmail.com >
Co-authored-by: Jinjing Zhou <VoVAllen@users.noreply.github.com >
2022-02-09 14:06:17 +08:00
701b4fccc2
[Sampling] New sampling pipeline plus asynchronous prefetching ( #3665 )
...
* initial update
* more
* more
* multi-gpu example
* cluster gcn, finalize homogeneous
* more explanation
* fix
* bunch of fixes
* fix
* RGAT example and more fixes
* shadow-gnn sampler and some changes in unit test
* fix
* wth
* more fixes
* remove shadow+node/edge dataloader tests for possible ux changes
* lints
* add legacy dataloading import just in case
* fix
* update pylint for f-strings
* fix
* lint
* lint
* lint again
* cherry-picking commit fa9f494
* oops
* fix
* add sample_neighbors in dist_graph
* fix
* lint
* fix
* fix
* fix
* fix tutorial
* fix
* fix
* fix
* fix warning
* remove debug
* add get_foo_storage apis
* lint
2022-01-30 16:13:00 +08:00
069dc45d50
[Docs] Fix sampling tutorials ( #3683 )
...
Fix #3626
2022-01-26 18:05:41 +08:00
8f5baa15e4
[Doc] Fix spelling, references and update info on building docs ( #3682 )
...
* Fix ref to message-passing guide
* Fix pygments and spacing
* Update build documentation steps in README.md
* Use links
* Adjust parameters in SAGEConv docstring in same order as init
* Fix spelling error
* Change doc link
2022-01-25 17:22:18 +08:00
3aef467733
[Doc] User Guide for Using Edge Weights in Training ( #3509 )
...
* Update
* Update
* CI
2021-11-18 11:58:15 +08:00
863c249568
Fix User Guide EN and CN typo ( #3495 )
...
* Update graph-heterogeneous.rst
`tensor([0, 1, 2, 0, 1, 2])` should be output instead of code
* Update message-api.rst
`updata_all_example()` should be `update_all_example()`
* Update message-efficient.rst
`cat_feat` need to concatenate with `dim=1` for the # edge features to match # edges
* Update nn-construction.rst
all `max_pool` in the aggregator type of `SAGEConv` should be `pool` instead
* Update graph-heterogeneous.rst
`tensor([0, 1, 2, 0, 1, 2])` should be output instead of code
* Update message-api.rst
`updata_all_example()` should be `update_all_example()`
* Update message-efficient.rst
`cat_feat` need to concatenate with `dim=1` for the # edge features to match # edges
* Update nn-construction.rst
all `max_pool` in the aggregator type of `SAGEConv` should be `pool` instead
* Update nn-forward.rst
all `max_pool` in the aggregator type of `SAGEConv` should be `pool` instead
* Update nn-forward.rst
all `max_pool` in the aggregator type of `SAGEConv` should be `pool` instead
Co-authored-by: zhjwy9343 <6593865@qq.com >
2021-11-14 20:37:39 +08:00
31772b142e
fixed typos in docs and docstring ( #3231 )
...
Co-authored-by: Quan (Andy) Gan <coin2028@hotmail.com >
2021-08-16 13:58:45 +08:00
3f6f694159
[Bug fix] Various fix from bug bash ( #3133 )
...
* Update
* Update
* Update dependencies
* Update
* Update
* Fix ogbn-products gat
* Update
* Update
* Reformat
* Fix typo in node2vec_random_walk
* Specify file encoding
* Working for 6.7
* Update
* Fix subgraph
* Fix doc for sample_neighbors_biased
* Fix hyperlink
* Add example for udf cross reducer
* Fix
* Add example for slice_batch
* Replace dgl.bipartite
* Fix GATConv
* Fix math rendering
* Fix doc
Co-authored-by: Ubuntu <ubuntu@ip-172-31-28-17.us-west-2.compute.internal >
Co-authored-by: Jinjing Zhou <VoVAllen@users.noreply.github.com >
Co-authored-by: Ubuntu <ubuntu@ip-172-31-22-156.us-west-2.compute.internal >
2021-07-15 09:17:15 +08:00
d7390763f0
[Distributed] Deprecate old DistEmbedding impl, use synchronized embedding impl ( #3111 )
...
* fix.
* fix.
* fix.
* fix.
* Fix test
* Deprecate old DistEmbedding impl, use synchronized embedding impl
* update doc
Co-authored-by: Ubuntu <ubuntu@ip-172-31-71-112.ec2.internal >
Co-authored-by: Ubuntu <ubuntu@ip-172-31-2-66.ec2.internal >
Co-authored-by: Da Zheng <zhengda1936@gmail.com >
Co-authored-by: Jinjing Zhou <VoVAllen@users.noreply.github.com >
2021-07-14 00:15:53 +08:00
186ef59283
[Feature] apply dgl.reorder() onto several node classification datase… ( #3102 )
...
* [Feature] apply dgl.reorder() onto several node classification datasets in DGL
* rebase on latest dgl.reorder_graph()
2021-07-13 08:52:17 +08:00
ced0e443c2
[Doc] Add user guide for GPU-based sampling ( #3070 )
...
* add user guide for gpu sampling
* Update minibatch-gpu-sampling.rst
Co-authored-by: Minjie Wang <wmjlyjemaine@gmail.com >
2021-07-05 12:07:43 +08:00
81456af8c5
[Doc] fix inconsistent variable names ( #3065 )
...
Co-authored-by: Quan (Andy) Gan <coin2028@hotmail.com >
2021-06-28 13:30:08 +08:00
ff519f98c3
[API] Standardize Subgraph APIs ( #2929 )
...
* Update
* Update
* Update
* Update
* Update
* Update
* Update
* Fix
* Update
* Fix subgraph tests
* Capture stdout for distributed test
* Capture stdout for distributed test
* Update
* Update
* Update
* Update subgraph.cc
Co-authored-by: Ubuntu <ubuntu@ip-172-31-28-17.us-west-2.compute.internal >
Co-authored-by: Jinjing Zhou <VoVAllen@users.noreply.github.com >
2021-06-21 19:53:37 +08:00
895d6fff72
[Doc] changing of output dimension ( #2981 )
...
Co-authored-by: zhjwy9343 <6593865@qq.com >
2021-06-05 22:12:41 +08:00
6383e64937
[Doc] correct the matrix multiplication symbols ( #2961 )
...
* correct the matrix multiplication symbols
* modified dimensionality of linear
Co-authored-by: Minjie Wang <wmjlyjemaine@gmail.com >
2021-06-03 08:51:23 +08:00
2ae190d690
[Doc] fix shape mismatch problem in user guide ( #2938 )
...
Co-authored-by: Minjie Wang <wmjlyjemaine@gmail.com >
2021-06-02 12:18:10 +08:00
a90296aa9c
fix. ( #2907 )
...
Co-authored-by: Zheng <dzzhen@3c22fba32af5.ant.amazon.com >
2021-05-13 16:55:31 +08:00
5498cf051e
[Doc]Fix examples on negative graph sampler ( #2863 )
...
* Fix examples on negative graph sampler
In heterogeneous graph, the old example may build a negative graph without edges. In dgl.dataloading.dataloader line637, it shows the key of neg_edges dict should be item in g.canonical_etypes.
* poke ci
Co-authored-by: Quan (Andy) Gan <coin2028@hotmail.com >
2021-05-06 21:34:31 +08:00
975eb8fc5d
[Distributed] Distributed node embedding and sparse optimizer ( #2733 )
...
* Draft for sparse emb
* add some notes
* Fix
* Add sparse optim for dist pytorch
* Update test
* Fix
* upd
* upd
* Fix
* Fix
* Fix bug
* add transductive exmpale
* Fix example
* Some fix
* Upd
* Fix lint
* lint
* lint
* lint
* upd
* Fix lint
* lint
* upd
* remove dead import
* update
* lint
* update unitest
* update example
* Add adam optimizer
* Add unitest and update data
* upd
* upd
* upd
* Fix docstring and fix some bug in example code
* Update rgcn readme
Co-authored-by: Ubuntu <ubuntu@ip-172-31-57-25.ec2.internal >
Co-authored-by: Ubuntu <ubuntu@ip-172-31-24-210.ec2.internal >
Co-authored-by: Ubuntu <ubuntu@ip-172-31-2-66.ec2.internal >
2021-05-03 08:37:40 +08:00
45ec21b033
[Distributed] fix docs for distributed training. ( #2840 )
...
* update distributed training doc.
* explain data split.
* fix message passing.
* id mapping.
* fix.
* test data reshuffling.
* fix a bug.
* fix test.
* Revert "fix test."
This reverts commit 907f1dd88994894db94ffcd77b5995279f76b489.
* Revert "fix a bug."
This reverts commit ff0a4d893bbe4911a75ecb04bcbd9bc65315166b.
* Revert "test data reshuffling."
This reverts commit 99bb2f6405de67fc73652220b02e7184461c3e5e.
Co-authored-by: Zheng <dzzhen@3c22fba32af5.ant.amazon.com >
2021-04-29 14:38:41 +08:00
e36c5db614
[Distributed] Simplify distributed API ( #2775 )
...
* remove num_workers.
* remove num_workers.
* remove num_workers.
* remove num-servers.
* update error message.
* update docstring.
* fix docs.
* fix tests.
* fix test.
* fix.
* print messages in test.
* fix.
* fix test.
* fix.
Co-authored-by: Ubuntu <ubuntu@ip-172-31-9-132.us-west-1.compute.internal >
2021-03-29 19:19:23 -07:00
1789972c4b
[Bugfix] add default value for BlockSampler ( #2771 )
...
* [Bugfix] add default value for BlockSampler
* [Doc] modify user_guide description about MultiLayerDropoutSample
Co-authored-by: Quan (Andy) Gan <coin2028@hotmail.com >
2021-03-22 14:02:27 +08:00
17f863569e
fix ( #2744 )
2021-03-21 22:38:55 -07:00
99751d4960
[Doc] Rename block to message flow graph ( #2702 )
...
* rename block to mfg
* revert
* rename
2021-02-25 18:26:19 +08:00
48a1794f85
[Doc] Fix the user guide for distributed partitioning. ( #2684 )
...
* fix doc.
* explain the schema file.
* fix.
2021-02-22 18:59:15 -08:00
8a07ab7737
[Doc] Tutorials re-organization ( #2683 )
...
* reorg
* change titles
* rm some stale API doc; minor fix
* fix docs
* add warning
* rm new-tutorial run in ci
* lint
2021-02-20 17:42:45 +08:00
0fc649523b
[Doc] Distributed heterogeneous graph training ( #2654 )
...
* update DistGraph docstrings.
* add user guide.
* add doc string.
* fix.
* fix.
* fix.
Co-authored-by: Jinjing Zhou <VoVAllen@users.noreply.github.com >
2021-02-19 10:48:05 -08:00
e4ff484494
[Distributed] Distributed METIS partition ( #2576 )
...
* add convert.
* fix.
* add write_mag.
* fix convert_partition.py
* write data.
* use pyarrow to read.
* update write_mag.py
* fix convert_partition.py.
* load node/edge features when necessary.
* reshuffle nodes.
* write mag correctly.
* fix a bug: inner nodes in a partition might be empty.
* fix bugs.
* add verify code.
* insert reverse edges.
* fix a bug.
* add get node/edge data.
* add instructions.
* remove unnecessary argument.
* update distributed preprocessing.
* fix readme.
* fix.
* fix.
* fix.
* fix readme.
* fix doc.
* fix.
* update readme
* update doc.
* update readme.
Co-authored-by: Ubuntu <ubuntu@ip-172-31-9-132.us-west-1.compute.internal >
Co-authored-by: Ubuntu <ubuntu@ip-172-31-2-202.us-west-1.compute.internal >
2021-02-08 17:19:18 -08:00
8ccb8206bf
[Doc] Update docs to motivate the use of set_batch_num_nodes and set_batch_num_edges ( #2630 )
...
* fix doc
* update docstring for transformation on batch graph
* update cn guide
* fix format
* update rst
2021-02-08 14:43:24 +08:00
3ca52b1e59
[Fix] Various Fix after Bug Bash ( #2620 )
...
* update
* Misc fix
* Update
2021-02-05 17:34:16 +08:00
b1840f49fa
[Dataset] Change the Data Type of the Node Features in GINDataset/TUDataset from Float64 to Float32 ( #2592 )
...
* Update
* Update
* Update
* update
Co-authored-by: Jinjing Zhou <VoVAllen@users.noreply.github.com >
Co-authored-by: Tong He <hetong007@gmail.com >
2021-02-03 21:00:45 +08:00
7bab1365e2
[feature] Supporting half precision floating data type (fp16). ( #2552 )
...
* add tvm as submodule
* compilation is ok but calling fails
* can call now
* pack multiple modules, change names
* upd
* upd
* upd
* fix cmake
* upd
* upd
* upd
* upd
* fix
* relative path
* upd
* upd
* upd
* singleton
* upd
* trigger
* fix
* upd
* count reducible
* upd
* upd
* upd
* upd
* upd
* upd
* upd
* upd
* upd
* only keep related files
* upd
* upd
* upd
* upd
* lint
* lint
* lint
* lint
* pylint
* upd
* upd
* compilation
* fix
* upd
* upd
* upd
* upd
* upd
* upd
* upd doc
* refactor
* fix
* upd number
Co-authored-by: Zhi Lin <linzhilynn@gmail.com >
Co-authored-by: Ubuntu <ubuntu@ip-172-31-42-78.us-east-2.compute.internal >
Co-authored-by: Ubuntu <ubuntu@ip-172-31-21-156.us-east-2.compute.internal >
Co-authored-by: Jinjing Zhou <VoVAllen@users.noreply.github.com >
2021-01-28 11:21:58 +08:00
c448e61b55
[Doc] CN User Guide Chapter 7 ( #2481 )
...
* [Doc] Add Chapter 7
* [Doc] Add CN part 7, 7.1, 7.2, and 7.3
* [Doc] Add CN part 7, 7.1, 7.2, and 7.3
* [Doc] 1st round copyediting, 7, 7.1, 7.2, and 7.3, removing EN parts.
* [Doc] 2nd round copyediting.
* [Doc] 3rd round copyediting.
* [Doc] Copyedit with reviewers' comments.
Co-authored-by: Mufei Li <mufeili1996@gmail.com >
2021-01-13 19:28:20 +08:00
31f65f036a
[Doc] user guide CN chapter 6 ( #2452 )
...
* [Doc] Add 1st CN in chapter 6
* [Doc] Add 1st CN in chapter 6
* [Doc] Add 1st CN in chapter 6.1
* [Doc] Add 1st CN in chapter 6.1
* [Doc] Add 1st CN in chapter 6.2
* [Doc] Add CN in chapter 6.2
* [Doc] Add CN in chapter 6.3
* [Doc] Fix a code bug in chapter 6.3
* [Doc] Add CN in chapter 6.4, 6.5, and 6.6.
* [Doc] Add CN in chapter 6.4, 6.5, and 6.6，then remove EN parts.
* [Doc] revised 6.4, 6.5, and 6.6.
* [Doc] 2nd round of copyediting.
* Delete syn1.bin
Remove this unrelated file to this branch
* [Doc] Update guide_cn index.rst.
* [Doc] Update guide_cn index.rst.
* [Doc] Update guide_cn index.rst.
* [Doc] Update guide_cn index.rst.
* [Doc] Add chapter 7 in index page
* [Doc] edit chapter 6 in PR
* [Doc] edit chapter 6 in PR
* [Doc] Copyediting with Murphy and Minjie's comments.
* [Doc] Fix doc line in the previous chapters.
Co-authored-by: Jinjing Zhou <VoVAllen@users.noreply.github.com >
Co-authored-by: Mufei Li <mufeili1996@gmail.com >
Co-authored-by: Minjie Wang <wmjlyjemaine@gmail.com >
2021-01-13 17:12:33 +08:00
a9f8f2589c
[Doc] Update GraphDataLoader in our docs ( #2504 )
...
* update graphdataloader in docs
* fix
* update examples
* fix sagpool
Co-authored-by: Quan (Andy) Gan <coin2028@hotmail.com >
2021-01-11 13:11:19 +08:00
4507bebc1a
add compute_loss example in link prediction user guide ( #2487 )
2021-01-06 14:27:51 +08:00
492ad9be81
[Fix] Avoid Overloading Nonzero for PyTorch Backend ( #2434 )
...
* Update gatedgraphconv.py
* Update entity_classify.py
* Update data-process.rst
* Update reading_data.py
* Update data-process.rst
* Update utils.py
* Update knowledge_graph.py
* Update entity_classify.py
* Update rdf.py
* Update entity_classify_mb.py
* Update test_classify.py
* Update tensor.py
* Update sparse.py
* Update entity_classify_mp.py
* Update 6_line_graph.py
2020-12-20 13:12:17 +08:00
50f1f4ae78
Remove details about message passing optimization ( #2425 )
...
* remove details about message passing optimization
* address comments
2020-12-16 14:56:38 +08:00
Minjie Wang