d8375c10ec
[BugFix] involve indices_devices for other dataset object. ( #3810 )
...
* involve indices_devices for other dataset object.
* modify raise error when device not found.
* remove empty line
* fix line too long
2022-03-30 11:50:03 +08:00
fbbca994b7
[Feature] METIS Partition with Communication Volume Minimization ( #3821 )
...
* upd
* upd
* upd
* upd
* upd
* fix OpenMP compatibility issues
* typo
* partition
* misc
* fix typo
* num_parts=1
* import torch
* long
* print info
* print info
* print info
* upd
* remove debug code
* revert partition.py
* fix cut count
* fix cut count
* Revert "fix cut count"
This reverts commit 10926b4fd48f45c8f1ddb58be7db6c22e653effd.
* Revert "fix cut count"
This reverts commit 76465283bef093a2b4209ad70dd15d2437b2ec8a.
* type of deprecate
* typo in deprecate info
* fix typo
* use cv for partitioning
* CE
* no message
* revert
* typo
* add objtype
* no message
* fix bug
* fix bug
* fix bug
* ?
* semicolon
* drop tensors
* no message
* backward
* backward
* max op
* store X.shape
* th
* test
* Revert "test"
This reverts commit 92b3b2f64a3a1128590098fa03ce429c5466e6ce.
* test
* tolist
* debug
* to cuda
* tuple
* fix bug
* remove X
* no message
* fix bug
* workload balance
* Revert "workload balance"
This reverts commit d7f8e4a16ba2a7eabb4a9bb945523bfe6623e723.
* reverse
* Revert "reverse"
This reverts commit 8a71cf25685aa7d889b9b8881b46f7a16b7d6e6d.
* Revert "Revert "reverse""
This reverts commit 196b143932d5cf9813576ece7c990b63d322d063.
* Revert "Revert "Revert "reverse"""
This reverts commit cf9e89a07013582056e7cde235e51331aca7fa9c.
* no message
* Merge commit '5498cf051e9cf450dcb798ca09920bbde008a661'
# Conflicts:
# python/dgl/distributed/partition.py
* Revert "Merge commit '5498cf051e9cf450dcb798ca09920bbde008a661'"
This reverts commit f79be2ad777897c7025b28308454cad81ad6bb27.
* fix bug
* third party
* no message
* try to avoid memory leak
* try to avoid memory leak
* avoid memory leak with no hope
* Revert "avoid memory leak with no hope"
This reverts commit c77befe9479f46758e744642f66dd209b50eef7d.
* no message
* Revert "no message"
This reverts commit 478cb28fe25fb1002b2f1dc202bb9bdaad8b2a56.
* del
* Revert "del"
This reverts commit 1b468e45ce646b400ff3ffa61a0b2da058b3bdfd.
* no message
* no message
* Revert "no message"
This reverts commit 92e4f5561ed42da0606618b2fff9f1ad5ed439d9.
* third party
* document
* Update metis_partition.cc
* Update metis_partition_hetero.cc
* Update metis_partition_hetero.cc
* Update partition.py
* Update partition.py
* Update partition.py
Co-authored-by: yzh119 <expye@outlook.com >
Co-authored-by: chwan-rice <54331508+chwan-rice@users.noreply.github.com >
Co-authored-by: Jinjing Zhou <VoVAllen@users.noreply.github.com >
Co-authored-by: Da Zheng <zhengda1936@gmail.com >
2022-03-27 14:22:01 -07:00
ae3316c846
[Doc] Update doc of dataloading package. ( #3886 )
...
* wip: dataloading doc
* update dataloading package doc and many others
* lint
2022-03-26 21:59:02 +08:00
f758db386f
[Bug] Fix dtype mismatch in heterogeneous DataLoader ( #3878 )
...
* fix
* unit test
2022-03-26 13:56:21 +08:00
f73c7a648b
[bugfix] Set stacklevel=2 for dgl_warning ( #3816 )
...
Co-authored-by: Jinjing Zhou <VoVAllen@users.noreply.github.com >
Co-authored-by: Minjie Wang <wmjlyjemaine@gmail.com >
2022-03-25 23:21:05 +08:00
a0e8cf0d3e
[Bugfix] Fix UVA sampling with lazy feature slicing ( #3862 )
...
* fix uva sampling with features
* fix
* add is_listlike function to distinguish strings from sequence
* fix
Co-authored-by: nv-dlasalle <63612878+nv-dlasalle@users.noreply.github.com >
2022-03-24 20:13:01 +08:00
223a3da5ae
[Bugfix] Fix multiple bugs and code refactor ( #3841 )
...
* fix
* remove setcxx methods
* move pin flag to CSR and COO matrix
Co-authored-by: Jinjing Zhou <VoVAllen@users.noreply.github.com >
2022-03-24 18:24:49 +08:00
12e97c54ac
[Feature] get_attention parameter in GlobalAttentionPooling ( #3837 )
...
* get_attention parameter in GlobalAttentionPooling
* removed trailing whitespace
* lint fix
Co-authored-by: decoherencer <decoherencer@users.noreply.github.com >
Co-authored-by: Mufei Li <mufeili1996@gmail.com >
Co-authored-by: Quan (Andy) Gan <coin2028@hotmail.com >
2022-03-24 12:49:40 +08:00
61edb7980a
[NN] Update GNNExplainer ( #3848 )
...
* Update
* Update
* Update
2022-03-23 18:40:49 +08:00
8005978e1e
[NN] Grouped reversible residual connections for GNNs ( #3842 )
...
* Update
* Fix
* Update
* Update
* Update
* Update
* Update
* Update
* Update
* Update
2022-03-23 16:58:39 +08:00
480a4ae35c
[BugFix] pass ntype/etype into partition book when node/edge_split ( #3828 )
...
* [BugFix] pass ntype/etype into partition book when node/edge_split
* fix test failure
* fix test failue on mxnet
* fix test failure
2022-03-14 15:11:01 -07:00
44638b9336
fix ddp dataloader in heterogeneous cases ( #3801 )
2022-03-07 16:56:43 +08:00
bb6cec23b4
[BugFix] fix incorrect name when fetch data in sparse optim ( #3808 )
2022-03-06 10:43:43 -08:00
1d80d91a32
[BugFix] call g.is_homogenous instead of len(g.etypes) ( #3793 )
2022-03-02 14:27:52 +08:00
7f1a5e080b
bump version ( #3795 )
2022-03-02 13:02:55 +08:00
e0f0fa2a78
Fix a bug in sparse optimizer. ( #3779 )
...
* fix a bug.
* Update pylintrc
* fix.
Co-authored-by: Quan (Andy) Gan <coin2028@hotmail.com >
2022-02-28 12:04:32 -08:00
62e23bd5b1
[Bugs] Fix distributed example error and import error ( #3783 )
...
* fix
* raise an error
* fix docserver crash
2022-02-28 14:58:50 +08:00
d41d07d0f6
[Doc and bugfix] Add docs and user guide and update tutorial for sampling pipeline ( #3774 )
...
* huuuuge update
* remove
* lint
* lint
* fix
* what happened to nccl
* update multi-gpu unsupervised graphsage example
* replace most of the dgl.mp.process with torch.mp.spawn
* update if condition for use_uva case
* update user guide
* address comments
* incorporating suggestions from @jermainewang
* oops
* fix tutorial to pass CI
* oops
* fix again
Co-authored-by: Xin Yao <xiny@nvidia.com >
2022-02-28 02:21:51 +08:00
3bd5a9b6d1
[Doc] Fix Doc ( #3777 )
...
* Update
* Update
* Update
* Update
2022-02-25 17:21:06 +08:00
6d9433b04f
[Transform] [Doc] Rename transform to transforms and update doc ( #3765 )
...
* Update
* Update
* Update
* Fix
* Update
* Update
* Update
* Fix
2022-02-24 21:28:15 +08:00
ccaa0bf282
[Doc] refine docstring and examples for reorder_graph ( #3770 )
...
* [Doc] refine docstring and examples for reorder_graph
* refine docstring
2022-02-24 17:31:00 +08:00
609a49a9ba
[Doc] fix example in dataset adapter docstring ( #3772 )
2022-02-24 16:57:25 +08:00
2f4146a4c2
[Dataset] add train_idx/val_idx/test_idx as dataset attributes ( #3769 )
...
* add train_idx/val_idx/test_idx as dataset attributes
* refine docstring
2022-02-24 15:17:40 +08:00
8db2dd3355
[Dataset][Fix] Allow non-numeric values and some fix on doc ( #3757 )
...
* [Fix] be able to parse ids if numeric and non-numeric values are used together
* add required package info and cache note into docstring
* duplicate node id is not allowed
2022-02-23 17:26:12 +08:00
0227ddfb66
[NN] Rework RelGraphConv and HGTConv ( #3742 )
...
* WIP: TypedLinear and new RelGraphConv
* wip
* further simplify RGCN
* a bunch of tweak for performance; add basic cpu support
* update on segmm
* wip: segment.cu
* new backward kernel works
* fix a bunch of bugs in kernel; leave idx_a for future
* add nn test for typed_linear
* rgcn nn test
* bugfix in corner case; update RGCN README
* doc
* fix cpp lint
* fix lint
* fix ut
* wip: hgtconv; presorted flag for rgcn
* hgt code and ut; WIP: some fix on reorder graph
* better typed linear init
* fix ut
* fix lint; add docstring
2022-02-23 12:10:20 +08:00
4f00d5ac6f
[Bugfix] Fix graph being duplicated in multi-GPU and CPU dataloader workers ( #3760 )
...
* fix shared memory issue
* oops
* add explanation
* add explanation
2022-02-22 18:00:47 +08:00
3f138ebaaf
[Bugfix] Bug fixes in new dataloader ( #3727 )
...
* fixes
* fix
* more fixes
* update
* oops
* lint?
* temporarily revert - will fix in another PR
* more fixes
* skipping mxnet test
* address comments
* fix DDP
* fix edge dataloader exclusion problems
* stupid bug
* fix
* use_uvm option
* fix
* fixes
* fixes
* fixes
* fixes
* add evaluation for cluster gcn and ddp
* stupid bug again
* fixes
* move sanity checks to only support DGLGraphs
* pytorch lightning compatibility fixes
* remove
* poke
* more fixes
* fix
* fix
* disable test
* docstrings
* why is it getting a memory leak?
* fix
* update
* updates and temporarily disable forkingpickler
* update
* fix?
* fix?
* oops
* oops
* fix
* lint
* huh
* uh
* update
* fix
* made it memory efficient
* refine exclude interface
* fix tutorial
* fix tutorial
* fix graph duplication in CPU dataloader workers
* lint
* lint
* Revert "lint"
This reverts commit 805484dd553695111b5fb37f2125214a6b7276e9.
* Revert "lint"
This reverts commit 0bce411b2b415c2ab770343949404498436dc8b2.
* Revert "fix graph duplication in CPU dataloader workers"
This reverts commit 9e3a8cf34c175d3093c773f6bb023b155f2bd27f.
Co-authored-by: xiny <xiny@nvidia.com >
Co-authored-by: Jinjing Zhou <VoVAllen@users.noreply.github.com >
2022-02-22 01:30:31 +08:00
f247d29f6c
Minor fix to DGL Enter ( #3753 )
...
* [Fix] Convert float64 to float32 when creating tensor
* fix
Co-authored-by: RhettYing <rhett_ying@qq.com >
Co-authored-by: Rhett Ying <85214957+Rhett-Ying@users.noreply.github.com >
2022-02-18 18:04:07 +08:00
5558ce2911
[Fix] Convert float64 to float32 when creating tensor ( #3751 )
...
* [Fix] Convert float64 to float32 when creating tensor
* refine docstring
2022-02-18 17:34:07 +08:00
539335cece
DGL Enter ( #3690 )
...
* add
* fix
* fix
* fix
* fix
* add
* add
* fix
* fix
* fix
* new loader
* fix
* fix
* fix for 3.6
* fix
* add
* add receipes and also some bug fixes
* fix
* fix
* fix
* fix receipies
* allow AsNodeDataset to work on ogb
* add ut
* many fixes for nodepred-ns pipeline
* receipe for nodepred-ns
* Update enter/README.md
Co-authored-by: Zihao Ye <zihaoye.cs@gmail.com >
* fix layers
* fix
* fix
* fix
* fix
* fix multiple issues
* fix for citation2
* fix comment
* fix
* fix
* clean up
* fix
Co-authored-by: Minjie Wang <wmjlyjemaine@gmail.com >
Co-authored-by: Minjie Wang <minjie.wang@nyu.edu >
Co-authored-by: Zihao Ye <zihaoye.cs@gmail.com >
2022-02-18 15:55:41 +08:00
80fb4dbe26
[Doc] fix examples ( #3747 )
2022-02-17 18:46:13 +08:00
9e358dfe66
[NN] HeteroLinear and HeteroEmbedding ( #3678 )
...
* modify hetero
* modify rst document
* update hetero
* update hetero
* update hetero
* update hetero
* Update
* Update
* Update
* Update
* 20220216
* Update
* Update
* Fix
Co-authored-by: Mufei Li <mufeili1996@gmail.com >
Co-authored-by: ShelkerX <925089962@qq.com >
2022-02-17 16:16:51 +08:00
e9c3c0e8ad
[Model] Simplify RGCN
...
* Update (#5 )
* Update
* Update
* Update
* Update
* Update
* Update
* Update
* Update
* Update
* Update
* Update
* Update
* Update
* FIx
* Try
* Update
* Update
* Update
* Fix
* Update
* Fix
* Fix
* Fix
* Fix
* Update
* Fix
* Update
* Update
* Update
* Fix
* Fix
* Update
* Update
* Update
* Update
* Fix
* Fix
* Fix
* Update
* Update
* Update
* Update
* Update
* Update README.md
* Update
* Fix
* Update
* Update
* Fix
* Fix
* Fix
* Update
* Update
* Update
Co-authored-by: Ubuntu <ubuntu@ip-172-31-6-240.us-west-2.compute.internal >
* Update
* Update
* Fix
* Update
* Update
* Update
* Fix
* Update
* Update
* Update
* Update
* Update
* Update
* CI
Co-authored-by: Ubuntu <ubuntu@ip-172-31-6-240.us-west-2.compute.internal >
Co-authored-by: Ubuntu <ubuntu@ip-172-31-57-123.us-west-2.compute.internal >
Co-authored-by: Quan (Andy) Gan <coin2028@hotmail.com >
2022-02-17 15:33:27 +08:00
22272de652
[Fix] normalize by dst if edge_weight is None ( #3744 )
...
* [Fix] normalize by dst if edge_weight is None
* [Doc] fix math formula display issue
2022-02-17 13:51:37 +08:00
6106a99d0a
refine
2022-02-17 02:00:10 +00:00
e0f054fb27
[Doc] add doc for DGLCSVDataset
2022-02-17 00:52:16 +00:00
39121dfdb8
[Feature] support non-numeric node_id/src_id/dst_id/graph_id and rena… ( #3740 )
...
* [Feature] support non-numeric node_id/src_id/dst_id/graph_id and rename CSVDataset
* change return value when iterate dataset
* refine data_parser
* force reload
2022-02-17 08:35:39 +08:00
42f8c8f335
[doc] fix module typo ( #3734 )
...
Co-authored-by: Mufei Li <mufeili1996@gmail.com >
2022-02-16 11:10:06 +08:00
97a6d740ad
[doc] fix error in example results ( #3735 )
...
Co-authored-by: Mufei Li <mufeili1996@gmail.com >
2022-02-16 09:40:45 +08:00
4f7ad2582c
[doc] fix error in example ( #3736 )
2022-02-15 18:44:15 +08:00
8b8fd2c0be
[Dataset] Add transform argument to built-in datasets ( #3733 )
...
* Update
* Fix
* Update
2022-02-15 16:45:47 +08:00
b3d3a2c4b0
[Feature] Gather mm ( #3641 )
...
* init
* init
* working cublasGemm
* benchmark high-mem/low-mem, err gather_mm output
* cuda kernel for bmm like kernel
* removed cpu copy for E_per_Rel
* benchmark code from Minjie
* fixed cublas results in gathermm sorted
* use GPU shared mem in unsorted gather mm
* minor
* Added an optimal version of gather_mm_unsorted
* lint
* init gather_mm_scatter
* cublas transpose added
* fixed h_offset for multiple rel
* backward unittest
* cublas support to transpose W
* adding missed file
* forgot to add header file
* lint
* lint
* cleanup
* lint
* docstring
* lint
* added unittest
* lint
* lint
* unittest
* changed err type
* skip cpu test
* skip CPU code
* move in-len loop inside
* lint
* added check different dim length for B
* w_per_len is optional now
* moved gather_mm to pytorch/backend with backward support
* removed a_/b_trans support
* transpose op inside GEMM call
* removed out alloc from API, changed W 2D to 3D
* Added se_gather_mm, Separate API for sortedE
* Fixed gather_mm (unsorted) user interface
* unsorted gmm backward + separate CAPI for un/sorted A
* typecast to float to support atomicAdd
* lint typecast
* lint
* added gather_mm_scatter
* minor
* const
* design changes
* Added idx_a, idx_b support gmm_scatter
* dgl doc
* lint
* adding gather_mm in ops
* lint
* lint
* minor
* removed benchmark files
* minor
* empty commit
Co-authored-by: Israt Nisa <nisisrat@amazon.com >
2022-02-14 22:27:23 -05:00
dc78e11c3f
[Dataset] Adapter to convert a dataset for link prediction task ( #3699 )
...
* add ut
* add doc link
* install dep
* add
* Revert "install dep"
This reverts commit e574a8377144749056c6849b655004df2771e179.
* add
* merge fix
* rm files
* fix
* fix
* fix
* fix
* fix typo
* fix tf
* fix
* fix
* fix
* fix
* fix
* fix dependency
* fix test
* fix
* fix
* add doc
* fix
* fix
* fix test
* fix test
Co-authored-by: Minjie Wang <wmjlyjemaine@gmail.com >
2022-02-11 16:59:14 +08:00
bc8f8b0b7a
New fused edge_softmax op ( #3650 )
...
* [feature] edge softmax refact.
* delete file
* fix backward and cmake version
* fix backward
* format function
* fix setting
* refix
* refix
* refix
* refix
* refix
* refix
* refix
* refix
* refix
* refix
* refix
* refix
* add cuda kernel for backward and rename some function
* add benchmark for edge_softmax
* fix format
* remove cuda_backwrd
* fix code format and add comment for op on CPU
* fix lint
Co-authored-by: Jinjing Zhou <VoVAllen@users.noreply.github.com >
2022-02-11 13:34:24 +08:00
45ac57260a
[data] refine AsNodePredDataset and add tests for DGLCSVDataset ( #3722 )
...
* [data] refine AsNodePredDataset and add tests for DGLCSVDataset
* fix
* remove add_self_loop
* refine
2022-02-10 17:46:39 +08:00
fcd8ed9acc
[Feature] Launch Long Live Servers and Multiple Client Groups ( #3688 )
...
* enable to launch multiple client groups sequentially
* launch simultaneously is enabled
* refine docstring
* revert unnecessary change
* [DOC] add doc for long live server
* refine
* refine doc
* refine doc
2022-02-09 15:56:38 +08:00
738e8318fd
[Feature] CUDA UVA sampling for MultiLayerNeighborSampler ( #3674 )
...
* implement pin_memory/unpin_memory/is_pinned for dgl.graph
* update python docstring
* update c++ docstring
* add test
* fix the broken UnifiedTensor
* XPU_SWITCH for kDLCPUPinned
* a rough version ready for testing
* eliminate extra context parameter for pin/unpin
* update train_sampling
* fix linting
* fix typo
* multi-gpu uva sampling case
* disable new format materialization for pinned graphs
* update python doc for pin_memory_
* fix unit test
* UVA sampling for link prediction
* dispatch most csr ops
* update graphsage example to combine uva sampling and UnifiedTensor
* update graphsage example to combine uva sampling and UnifiedTensor
* update graphsage example to combine uva sampling and UnifiedTensor
* update doc
* update examples
* change unitgraph and heterograph's PinMemory to in-place
* update examples for multi-gpu uva sampling
* update doc
* fix linting
* fix cpu build
* fix is_pinned for DistGraph
* fix is_pinned for DistGraph
* update graphsage unsupervised example
* update doc for gpu sampling
* update some check for sampling device switching
* fix linting
* adapt for new dataloader
* fix linting
* fix
* fix some name issue
* adjust device check
* add unit test for uva sampling & fix some zero_copy bug
* fix linting
* update num_threads in graphsage examples
Co-authored-by: Quan (Andy) Gan <coin2028@hotmail.com >
Co-authored-by: Jinjing Zhou <VoVAllen@users.noreply.github.com >
2022-02-09 14:06:17 +08:00
fa343873a8
Fix docs on GraphSAGE normalization ( #3711 )
...
Co-authored-by: Jinjing Zhou <VoVAllen@users.noreply.github.com >
2022-02-07 17:56:04 +08:00
f282ee30ad
[bugfix] Fix set_default_backend() keyword ( #3710 )
...
* Add unit test
* Fix typo
Co-authored-by: Jinjing Zhou <VoVAllen@users.noreply.github.com >
2022-02-07 16:15:02 +08:00
25c9221b83
Add check for aggregator_type enum in SAGEConv init ( #3691 )
...
Co-authored-by: Quan (Andy) Gan <coin2028@hotmail.com >
Co-authored-by: Mufei Li <mufeili1996@gmail.com >
2022-02-03 12:02:35 +08:00
Peiqi Yin