Rhett Ying
35d98b6077
[dev] update minimum torch version to 2.1.0 ( #7401 )
2024-05-16 09:11:57 +08:00
Rhett Ying
0de1de3dcd
[dev] upgrade minimum required torch version to 2.0.0 ( #7358 )
2024-04-26 16:58:15 +08:00
Rhett Ying
821c1e427f
[dev] update minimum pytorch version to 1.13.0 ( #6412 )
2023-10-09 19:33:35 +08:00
Andrei Ivanov
cf829dc38e
Fixing some unittest warnings. ( #6122 )
...
Co-authored-by: Hongzhi (Steve), Chen <chenhongzhi.nkcs@gmail.com >
2023-08-10 11:53:20 +08:00
Ilia Taraban
8c213ef122
[Feature] Enable bfloat16 convert functions in Python API ( #5760 )
2023-07-31 18:09:32 +08:00
nv-dlasalle
c08192cbb4
[Bugfix] Allow pinning of empty tensor ( #6044 )
2023-07-25 16:03:26 -07:00
Xin Yao
2eb3f08c1f
[Bugfix] Fix the version check for alpha version PyTorch in NGC containers ( #5673 )
...
Co-authored-by: Hongzhi (Steve), Chen <chenhongzhi.nkcs@gmail.com >
2023-05-11 09:02:46 +08:00
Xin Yao
8e73c75f4a
[Fix] Fix tensor.storage() deprecation warning ( #5656 )
2023-05-09 13:41:53 +08:00
Xin Yao
170203ae2b
[Performance] Creating out buffers for segment_mm|sddmm via torch.empty() ( #5462 )
...
* update for segmentMM
* update for sddmm
* fix a bug
2023-03-23 17:41:07 +08:00
peizhou001
56ffb650fe
[API Deprecation]Deprecate contrib module ( #5114 )
2023-01-06 20:16:01 +08:00
Xin Yao
f4eef72628
[Fix core lib warning] Remove LooseVersion ( #5026 )
...
* replace LooseVersion with packaging.version
* import packaging from setuptools
* import packaging.version in dgl.utils
* format
* revert changes to apps/kg
* revert changes to _dataloading
2022-12-19 09:02:14 +08:00
Xin Yao
3db6604e67
[Fix core lib warning] Fix using torch.tensor for tensor conversion ( #5028 )
2022-12-15 13:50:33 +08:00
Hongzhi (Steve), Chen
a208e8868b
[Misc] Black auto fix. ( #4680 )
...
* [Misc] Black auto fix.
* fix pylint disable
Co-authored-by: Steve <ubuntu@ip-172-31-34-29.ap-northeast-1.compute.internal >
2022-10-08 14:15:56 +08:00
Quan (Andy) Gan
2efdaa5df3
[Bug] Revert clearing backward cache for retain_graph flag ( #4249 )
...
Co-authored-by: Minjie Wang <wmjlyjemaine@gmail.com >
2022-07-14 16:32:01 +08:00
Xin Yao
32f12ee19e
[Doc] Unify the minimal versions required for PyTorch/TensorFlow/MXNet ( #4180 )
2022-06-29 18:37:19 +08:00
nv-dlasalle
1f2e696080
Prevent users from attempting to pin PyTorch non-contiguous tensors or views only encompassing part of tensor. ( #3992 )
...
* Disable pinning non-contiguous memory
* Prevent views from being converted for write
* Fix linting
* Add unit tests
* Improve error message for users
* Switch to pytest function
* exclude mxnet and tensorflow from inplace pinning
* Add skip
* Restrict to pytorch backend
* Use backend to retrieve device
* Fix capitalization in decorator
Co-authored-by: Quan (Andy) Gan <coin2028@hotmail.com >
2022-05-16 14:49:36 -07:00
Quan (Andy) Gan
3f138ebaaf
[Bugfix] Bug fixes in new dataloader ( #3727 )
...
* fixes
* fix
* more fixes
* update
* oops
* lint?
* temporarily revert - will fix in another PR
* more fixes
* skipping mxnet test
* address comments
* fix DDP
* fix edge dataloader exclusion problems
* stupid bug
* fix
* use_uvm option
* fix
* fixes
* fixes
* fixes
* fixes
* add evaluation for cluster gcn and ddp
* stupid bug again
* fixes
* move sanity checks to only support DGLGraphs
* pytorch lightning compatibility fixes
* remove
* poke
* more fixes
* fix
* fix
* disable test
* docstrings
* why is it getting a memory leak?
* fix
* update
* updates and temporarily disable forkingpickler
* update
* fix?
* fix?
* oops
* oops
* fix
* lint
* huh
* uh
* update
* fix
* made it memory efficient
* refine exclude interface
* fix tutorial
* fix tutorial
* fix graph duplication in CPU dataloader workers
* lint
* lint
* Revert "lint"
This reverts commit 805484dd553695111b5fb37f2125214a6b7276e9.
* Revert "lint"
This reverts commit 0bce411b2b415c2ab770343949404498436dc8b2.
* Revert "fix graph duplication in CPU dataloader workers"
This reverts commit 9e3a8cf34c175d3093c773f6bb023b155f2bd27f.
Co-authored-by: xiny <xiny@nvidia.com >
Co-authored-by: Jinjing Zhou <VoVAllen@users.noreply.github.com >
2022-02-22 01:30:31 +08:00
Mufei Li
e9c3c0e8ad
[Model] Simplify RGCN
...
* Update (#5 )
* Update
* Update
* Update
* Update
* Update
* Update
* Update
* Update
* Update
* Update
* Update
* Update
* Update
* FIx
* Try
* Update
* Update
* Update
* Fix
* Update
* Fix
* Fix
* Fix
* Fix
* Update
* Fix
* Update
* Update
* Update
* Fix
* Fix
* Update
* Update
* Update
* Update
* Fix
* Fix
* Fix
* Update
* Update
* Update
* Update
* Update
* Update README.md
* Update
* Fix
* Update
* Update
* Fix
* Fix
* Fix
* Update
* Update
* Update
Co-authored-by: Ubuntu <ubuntu@ip-172-31-6-240.us-west-2.compute.internal >
* Update
* Update
* Fix
* Update
* Update
* Update
* Fix
* Update
* Update
* Update
* Update
* Update
* Update
* CI
Co-authored-by: Ubuntu <ubuntu@ip-172-31-6-240.us-west-2.compute.internal >
Co-authored-by: Ubuntu <ubuntu@ip-172-31-57-123.us-west-2.compute.internal >
Co-authored-by: Quan (Andy) Gan <coin2028@hotmail.com >
2022-02-17 15:33:27 +08:00
Mufei Li
2b98e764e8
[Transform] Modules for Augmentation ( #3668 )
...
* Update
* Update
* Fix
* Update
* Update
* Update
* Update
* Fix
* Update
* Update
* Update
* Update
* Fix lint
* lint
* Update
* Update
* lint fix
* Fix CI
* Fix
* Fix CI
* Update
* Fix
* Update
* Update
* Augmentation (#10 )
* Update
* PPR
* Update
* Update
* Update
* Update
* Update
* Update
* Update
* Update
* Update
* Update
* Update
* Update
* CI
* lint
* lint
* Update
* Update
* Fix AddEdge
* try import
* Update
* Fix
* CI
Co-authored-by: Ubuntu <ubuntu@ip-172-31-31-136.us-west-2.compute.internal >
Co-authored-by: Minjie Wang <wmjlyjemaine@gmail.com >
2022-01-25 20:29:46 +08:00
Mufei Li
dfa32ae092
[NN] GNNExplainer ( #3490 )
...
* Update
* Update
* Update
* Fix
* Update
* Update
* Update
* Update
* Update
* Update
* Fix
* Fix
* Update
* Update
* Update
* Update
* Update
* Update
* lint fix
* lint fix
* Fix lint
* Update
* Fix CI
* Fix CI
* Fix
* CI
* Fix
* Update
* Fix
* Fix
* Fix CI
* Fix CI
2021-11-11 02:22:22 +08:00
Quan (Andy) Gan
cac25f636f
fix compatibility with PyTorch 1.10 ( #3454 )
2021-10-29 09:33:08 +08:00
Cheng Wan
ff94ee80b1
[BugFix] Avoid Memory Leak Issue in PyTorch Backend ( #3386 )
...
* try to avoid memory leak
* try to avoid memory leak
* avoid memory leak with no hope
* Revert "avoid memory leak with no hope"
This reverts commit c77befe9479f46758e744642f66dd209b50eef7d.
* no message
* Update sparse.py
* Update tensor.py
Co-authored-by: Jinjing Zhou <VoVAllen@users.noreply.github.com >
2021-10-18 17:24:54 +08:00
nv-dlasalle
b81efb2b2d
[PyTorch][Bugfix] Use uint8 instead of bool in pytorch to be compatible with nightly version ( #3406 )
...
* Use uint8 instead of bool in pytorch
* Handle type aliases
* Fix syntax error
Co-authored-by: Jinjing Zhou <VoVAllen@users.noreply.github.com >
2021-10-14 17:34:55 +08:00
Jingcheng Yu
b379dbd6c8
Optimize dist_graph/_split_even_to_part memory usage ( #3132 )
...
Co-authored-by: yujingcheng02 <yujingcheng02@meituan.com >
Co-authored-by: Quan (Andy) Gan <coin2028@hotmail.com >
2021-07-15 11:51:56 +08:00
nv-dlasalle
17d604b5c7
[Feature] Allow using NCCL for communication in dgl.NodeEmbedding and dgl.SparseOptimizer ( #2824 )
...
* Split from NCCL PR
* Fix type in comment
* Expand documentation for sparse_all_to_all_push
* Restore previous behavior in example
* Re-work optimizer to use NCCL based on gradient location
* Allow for running with embedding on CPU but using NCCL for gradient exchange
* Optimize single partition case
* Fix pylint errors
* Add missing include
* fix gradient indexing
* Fix line continuation
* Migrate 'first_step'
* Skip tests without enough GPUs to run NCCL
* Improve empty tensor handling for pytorch 1.5
* Fix indentation
* Allow multiple NCCL communicator to coexist
* Improve handling of empty message
* Update python/dgl/nn/pytorch/sparse_emb.py
Co-authored-by: xiang song(charlie.song) <classicxsong@gmail.com >
* Update python/dgl/nn/pytorch/sparse_emb.py
Co-authored-by: xiang song(charlie.song) <classicxsong@gmail.com >
* Keepy empty tensor dimensionaless
* th.empty -> th.tensor
* Preserve shape for empty non-zero dimension tensors
* Use shared state, when embedding is shared
* Add support for gathering an embedding
* Fix typo
* Fix more typos
* Fix backend call
* Use NodeDataLoader to take advantage of ddp
* Update training script to share memory
* Only squeeze last dimension
* Better handle empty message
* Keep embedding on the target device GPU if dgl_sparse if false in RGCN example
* Fix typo in comment
* Add asserts
* Improve documentation in example
Co-authored-by: xiang song(charlie.song) <classicxsong@gmail.com >
2021-06-10 21:19:00 -07:00
Quan (Andy) Gan
2a3a9a0011
[Bugfix] to() method ignores PyTorch default CUDA device ( #2897 )
2021-05-08 13:23:30 +08:00
nv-dlasalle
e70138bbe4
[Performance][GPU] Enable GPU uniform edge sampling ( #2716 )
...
* Start on uniform GPU sampling
* Save more work
* Get cu file compiling
* Update sampling
* More changes
* Get GPU sampling for uniform probabilities solved
* Fix batch tensor migration
* Fix
* update kernels
* expand blocking
* Undo testing change
* Cut down on sampling overhead
* Fix replacement
* Update unit tests
* Add option to gpu sample in graphsage
* Copy only csc to gpu
* Add ogbn support
* Fix linting
* Remove nvtx from sample
* Improve documentation and error checking
* Expand documentation
* Update assert checking
* delete extra space
* Use standard dataloader when dataset is a dictionary
* ogb -> ogbn
* Fix edge selection determinism
* Fix typos
* Remove nvtx
* Add comment for self.fanout_arrays and assert
* Fix linting
* Migrate to scalarbatcher
* Fix indentation
* Fix batcher
* Fix indexing
* Only use databatcher for GPU
* Convert to DGL NDArray to PyTorch Tensor
* Add optimization for PyTorch's F.tensor() for list of GPU tensors
Co-authored-by: Da Zheng <zhengda1936@gmail.com >
2021-04-14 18:55:09 -07:00
Zihao Ye
cf8a3fb305
[hotfix] Address the performance issue of topk. ( #2628 )
...
* upd
* fix
* upd
* upd
* udp
* upd
* upd
* upd
* upd
* upd
* upd
Co-authored-by: Jinjing Zhou <VoVAllen@users.noreply.github.com >
2021-02-11 00:00:39 +08:00
Da Zheng
25ac334403
[Distributed] Heterogeneous graph support ( #2457 )
...
* Distributed heterograph (#3 )
* heterogeneous graph partition.
* fix graph partition book for heterograph.
* load heterograph partitions.
* update DistGraphServer to support heterograph.
* make DistGraph runnable for heterograph.
* partition a graph and store parts with homogeneous graph structure.
* update DistGraph server&client to use homogeneous graph.
* shuffle node Ids based on node types.
* load mag in heterograph.
* fix per-node-type mapping.
* balance node types.
* fix for homogeneous graph
* store etype for now.
* fix data name.
* fix a bug in example.
* add profiler in rgcn.
* heterogeneous RGCN.
* map homogeneous node ids to hetero node ids.
* fix graph partition book.
* fix DistGraph.
* shuffle eids.
* verify eids and their mappings when loading a partition.
* Id map from homogneous Ids to per-type Ids.
* verify partitioned results.
* add test for distributed sampler.
* add mapping from per-type Ids to homogeneous Ids.
* update example.
* fix DistGraph.
* Revert "add profiler in rgcn."
This reverts commit 36daaed8b660933dac8f61a39faec3da2467d676.
* add tests for homogeneous graphs.
* fix a bug.
* fix test.
* fix for one partition.
* fix for standalone training and evaluation.
* small fix.
* fix two bugs.
* initialize projection matrix.
* small fix on RGCN.
* Fix rgcn performance (#17 )
Co-authored-by: Ubuntu <ubuntu@ip-172-31-62-171.ec2.internal >
* fix lint.
* fix lint.
* fix lint.
* fix lint.
* fix lint.
* fix lint.
* fix.
* fix test.
* fix lint.
* test partitions.
* remove redundant test for partitioning.
* remove commented code.
* fix partition.
* fix tests.
* fix RGCN.
* fix test.
* fix test.
* fix test.
* fix.
* fix a bug.
* update dmlc-core.
* fix.
* fix rgcn.
* update readme.
* add comments.
Co-authored-by: Ubuntu <ubuntu@ip-172-31-2-202.us-west-1.compute.internal >
Co-authored-by: Ubuntu <ubuntu@ip-172-31-9-132.us-west-1.compute.internal >
Co-authored-by: xiang song(charlie.song) <classicxsong@gmail.com >
Co-authored-by: Ubuntu <ubuntu@ip-172-31-62-171.ec2.internal >
* fix.
* fix.
* add div_int.
* fix.
* fix.
* fix lint.
* fix.
* fix.
* fix.
* adjust.
* move code.
* handle heterograph.
* return pytorch tensor in GPB.
* remove some tests in example.
* add to_block for distributed training.
* use distributed to_block.
* remove unnecessary function in DistGraph.
* remove distributed to_block.
* use pytorch tensor.
* fix a bug in ntypes and etypes.
* enable norm.
* make the data loader compatible with the old format.
* fix.
* add comments.
* fix a bug.
* add test for heterograph.
* support partition without reshuffle.
* add test.
* support partition without reshuffle.
* fix.
* add test.
* fix bugs.
* fix lint.
* fix dataset.
* fix for mxnet.
* update docstring.
* rename to floor_div
* avoid exposing NodePartitionPolicy and EdgePartitionPolicy.
* fix docstring.
* fix error.
* fixes.
* fix comments.
* rename.
* rename.
* explain IdMap.
* fix docstring.
* fix docstring.
* update docstring.
* remove the code of returning heterograph.
* remove argument.
* fix example.
* make GraphPartitionBook an abstract class.
* fix.
* fix.
* fix a bug.
* fix a bug in example
* fix a bug
* reverse heterograph sampling.
* temp fix.
* fix lint.
* Revert "temp fix."
This reverts commit c450717b9f578b8c48769c675f2a19d6c1e64381.
* compute norm.
* Revert "reverse heterograph sampling."
This reverts commit bd6deb7f52998de76508f800441ff518e2fadcb9.
* fix.
* move id_map.py
* remove check
* add more comments.
* update docstring.
Co-authored-by: Ubuntu <ubuntu@ip-172-31-2-202.us-west-1.compute.internal >
Co-authored-by: Ubuntu <ubuntu@ip-172-31-9-132.us-west-1.compute.internal >
Co-authored-by: xiang song(charlie.song) <classicxsong@gmail.com >
Co-authored-by: Ubuntu <ubuntu@ip-172-31-62-171.ec2.internal >
2021-01-24 19:18:00 -08:00
Jinjing Zhou
917a755291
[Fix] fix version check ( #2544 )
2021-01-19 19:35:43 +08:00
Mufei Li
492ad9be81
[Fix] Avoid Overloading Nonzero for PyTorch Backend ( #2434 )
...
* Update gatedgraphconv.py
* Update entity_classify.py
* Update data-process.rst
* Update reading_data.py
* Update data-process.rst
* Update utils.py
* Update knowledge_graph.py
* Update entity_classify.py
* Update rdf.py
* Update entity_classify_mb.py
* Update test_classify.py
* Update tensor.py
* Update sparse.py
* Update entity_classify_mp.py
* Update 6_line_graph.py
2020-12-20 13:12:17 +08:00
Zihao Ye
3adbfa1812
[Performance] Use segment operators for graph readout. ( #2361 )
...
* upd
* upd
* update
* upd
* upd
* upd
* fix
* lint
* lint
* pylint
* doc
2020-11-23 01:45:33 +08:00
nv-dlasalle
c6890c231a
[Performance] In HeteroNodeView, build arange on target device, instead of on CPU and copying it ( #2266 )
...
* Build arange on target device
* Utilize arange device in viewpy:HeteroNodeView.__call__
* Work around uint64 error in TF to_dlpack
* Restore else clause
Co-authored-by: Jinjing Zhou <VoVAllen@users.noreply.github.com >
Co-authored-by: Da Zheng <zhengda1936@gmail.com >
2020-11-02 14:03:26 -08:00
Jinjing Zhou
35e25914ad
Update version check of PyTorch to 1.5 ( #2079 )
2020-08-20 21:33:29 +08:00
Quan (Andy) Gan
63e2ba23c6
[WIP][Kernel] Set the built-in reduce result of zero-degree nodes to 0 in C ( #2017 )
...
* test idea
* cuda kernels
* lint and fixes
* lint
* change to another strategy
* use infinity
* fix
Co-authored-by: Zihao Ye <expye@outlook.com >
2020-08-14 22:59:24 +08:00
Zihao Ye
6294677f8a
[hotfix] Set reduce results to all zero for nodes with zero in-degrees. ( #2011 )
2020-08-13 01:20:56 +08:00
Quan (Andy) Gan
f5eb80d221
[Feature] Edge DataLoader for edge classification & link prediction ( #1828 )
...
* clean commit
* oops forgot the most important files
* use einsum
* copy feature from frontier to block
* Revert "copy feature from frontier to block"
This reverts commit 5224ec963eb6a3ef1b6ab74d8ecbd44e4e42f285.
* temp fix
* unit test
* fix
* revert jtnn
* lint
* fix win64
* docstring fixes and doc indexing
* revert einsum in sparse bidecoder
* fix some examples
* lint
* fix due to some tediousness in remove_edges
* addresses comments
* fix
* more jtnn fixes
* fix
2020-08-11 18:00:58 +08:00
Minjie Wang
22167f7203
[Refactor] Enable new kernel in all message passing APIs ( #1953 )
...
* WIP: frame refactor
* new frame
* simple update_all builtin
* move all subgraph routines into the same file
* sddmm & spmm schedule; node & edge udf
* degree bucketing
* some tricky 0deg corner cases
* bug in frame append
* merge test_hetero_basics and test_basics
* some code rearange
* fix test_heterograph
* add mean spmm
* enable all builtin combinations
* pass gpu test
* pass pytorch tests
* wip
* fix some pt debugging codes
* fix bug in mxnet backward
* pass all mxnet utests
* passed tf tests
* docstring
* lint
* lint
* fix broadcasting bugs
* add warning and clamp for mean reducer
* add test for zero-degree mean
* address comments
* lint
* small fix
2020-08-07 15:40:25 +08:00
Minjie Wang
444becf00a
[Misc] Move many deprecated codes to the deprecate folder ( #1893 )
...
* some file movements
* move some codes to deprecated
* more deprecation
* lint
* remove useless test
2020-07-30 18:17:33 +08:00
Minjie Wang
44089c8b4d
[Refactor][Graph] Merge DGLGraph and DGLHeteroGraph ( #1862 )
...
* Merge
* [Graph][CUDA] Graph on GPU and many refactoring (#1791 )
* change edge_ids behavior and C++ impl
* fix unittests; remove utils.Index in edge_id
* pass mx and th tests
* pass tf test
* add aten::Scatter_
* Add nonzero; impl CSRGetDataAndIndices/CSRSliceMatrix
* CSRGetData and CSRGetDataAndIndices passed tests
* CSRSliceMatrix basic tests
* fix bug in empty slice
* CUDA CSRHasDuplicate
* has_node; has_edge_between
* predecessors, successors
* deprecate send/recv; fix send_and_recv
* deprecate send/recv; fix send_and_recv
* in_edges; out_edges; all_edges; apply_edges
* in deg/out deg
* subgraph/edge_subgraph
* adj
* in_subgraph/out_subgraph
* sample neighbors
* set/get_n/e_repr
* wip: working on refactoring all idtypes
* pass ndata/edata tests on gpu
* fix
* stash
* workaround nonzero issue
* stash
* nx conversion
* test_hetero_basics except update routines
* test_update_routines
* test_hetero_basics for pytorch
* more fixes
* WIP: flatten graph
* wip: flatten
* test_flatten
* test_to_device
* fix bug in to_homo
* fix bug in CSRSliceMatrix
* pass subgraph test
* fix send_and_recv
* fix filter
* test_heterograph
* passed all pytorch tests
* fix mx unittest
* fix pytorch test_nn
* fix all unittests for PyTorch
* passed all mxnet tests
* lint
* fix tf nn test
* pass all tf tests
* lint
* lint
* change deprecation
* try fix compile
* lint
* update METIDS
* fix utest
* fix
* fix utests
* try debug
* revert
* small fix
* fix utests
* upd
* upd
* upd
* fix
* upd
* upd
* upd
* upd
* upd
* trigger
* +1s
* [kernel] Use heterograph index instead of unitgraph index (#1813 )
* upd
* upd
* upd
* fix
* upd
* upd
* upd
* upd
* upd
* trigger
* +1s
* [Graph] Mutation for Heterograph (#1818 )
* mutation add_nodes and add_edges
* Add support for remove_edges, remove_nodes, add_selfloop, remove_selfloop
* Fix
Co-authored-by: Ubuntu <ubuntu@ip-172-31-51-214.ec2.internal >
* upd
* upd
* upd
* fix
* [Transfom] Mutable transform (#1833 )
* add nodesy
* All three
* Fix
* lint
* Add some test case
* Fix
* Fix
* Fix
* Fix
* Fix
* Fix
* fix
* triger
* Fix
* fix
Co-authored-by: Ubuntu <ubuntu@ip-172-31-51-214.ec2.internal >
* [Graph] Migrate Batch & Readout module to heterograph (#1836 )
* dgl.batch
* unbatch
* fix to device
* reduce readout; segment reduce
* change batch_num_nodes|edges to function
* reduce readout/ softmax
* broadcast
* topk
* fix
* fix tf and mx
* fix some ci
* fix batch but unbatch differently
* new checkk
* upd
* upd
* upd
* idtype behavior; code reorg
* idtype behavior; code reorg
* wip: test_basics
* pass test_basics
* WIP: from nx/ to nx
* missing files
* upd
* pass test_basics:test_nx_conversion
* Fix test
* Fix inplace update
* WIP: fixing tests
* upd
* pass test_transform cpu
* pass gpu test_transform
* pass test_batched_graph
* GPU graph auto cast to int32
* missing file
* stash
* WIP: rgcn-hetero
* Fix two datasety
* upd
* weird
* Fix capsuley
* fuck you
* fuck matthias
* Fix dgmg
* fix bug in block degrees; pass rgcn-hetero
* rgcn
* gat and diffpool fix
also fix ppi and tu dataset
* Tree LSTM
* pointcloud
* rrn; wip: sgc
* resolve conflicts
* upd
* sgc and reddit dataset
* upd
* Fix deepwalk, gindt and gcn
* fix datasets and sign
* optimization
* optimization
* upd
* upd
* Fix GIN
* fix bug in add_nodes add_edges; tagcn
* adaptive sampling and gcmc
* upd
* upd
* fix geometric
* fix
* metapath2vec
* fix agnn
* fix pickling problem of block
* fix utests
* miss file
* linegraph
* upd
* upd
* upd
* graphsage
* stgcn_wave
* fix hgt
* on unittests
* Fix transformer
* Fix HAN
* passed pytorch unittests
* lint
* fix
* Fix cluster gcn
* cluster-gcn is ready
* on fixing block related codes
* 2nd order derivative
* Revert "2nd order derivative"
This reverts commit 523bf6c249bee61b51b1ad1babf42aad4167f206.
* passed torch utests again
* fix all mxnet unittests
* delete some useless tests
* pass all tf cpu tests
* disable
* disable distributed unittest
* fix
* fix
* lint
* fix
* fix
* fix script
* fix tutorial
* fix apply edges bug
* fix 2 basics
* fix tutorial
Co-authored-by: yzh119 <expye@outlook.com >
Co-authored-by: xiang song(charlie.song) <classicxsong@gmail.com >
Co-authored-by: Ubuntu <ubuntu@ip-172-31-51-214.ec2.internal >
Co-authored-by: Ubuntu <ubuntu@ip-172-31-7-42.us-west-2.compute.internal >
Co-authored-by: Ubuntu <ubuntu@ip-172-31-1-5.us-west-2.compute.internal >
Co-authored-by: Ubuntu <ubuntu@ip-172-31-68-185.ec2.internal >
2020-07-28 14:30:41 +08:00
Da Zheng
ff8f7082a3
[Distributed] turn off recording on embeddings in the inference. ( #1861 )
...
* turn on/off recording in sparse embedding.
* add test.
2020-07-27 00:42:40 -07:00
Zihao Ye
f25b1a064d
[Feature] Autograd of gspmm and gsddmm on PyTorch/MXNet/Tensorflow ( #1680 )
...
* init
* reverse(by minjie
* upd
* upd
* upd
* upd
* upd
* upd
* upd
* gpu
* upd
* upd
* upd
* upd
* udp
* upd
* upd
* imidiot
* fix
* upd
* upd
* upd
* udp
* upd
* upd
* fix
* udp
* upd
* upd
* upd
* upd
* upd
* fix
* remove redundency
* upd
* upd
* upd
* cache
* upd
* upd
* upd
* upd
* upd
* udp
* upd
* trigger
* upd
* fix
* upd
* unused import
* upd
* upd
2020-07-13 23:21:22 +08:00
Da Zheng
6a3685bea0
[BUGFIX] fix a bug in graph partitioning. ( #1769 )
...
* fix
* use utils.toindex in the right place.
* fix.
* update tensor for mxnet backend.
* fix
* fix
2020-07-09 01:16:42 -07:00
Da Zheng
cadcc1c2a6
[Feature] add sparse embedding. ( #1497 )
...
* add sparse embedding.
* fix
* add test.
* man fixes.
* many fixes
* fix sparse emb.
* fix.
* fix lint.
* fix lint.
* fix kvstore.
* expose DistTensor.
* test sparse embeddings.
* add attach_grad to the backends.
* remove part_id
* fix.
* move backward computation.
* move more computation to backend.
* fix a bug when applying learning rate.
* fix a few things.
* fix a few things.
* add docstring
* fix.
* apply no_grad.
* fix tests.
* fix for other frameworks.
* add examples in docstring.
2020-07-03 10:42:09 -07:00
Minjie Wang
f1b19a6b67
[CUDA] Many CUDA operators; Prepare for DGLGraph on CUDA ( #1660 )
...
* add cuda utils; change g.to; add g.device
* split array.h into several headers
* cuda index select
* file
* three cuda kernels
* add cuda elementwise arith and several others
* cuda CSRIsNonZero
* fix lint
* lint
* lint
* fix bug in changing ctx to property
* address comments
* remove unused codes
* address comments
2020-06-19 15:44:42 +08:00
Da Zheng
41349dcef5
[Feature] Range partition ( #1522 )
...
* add reorder immutable graph.
* add python API.
* add reorder for csr.
* remove gk version.
* fix
* add cpp test.
* bug fixes
* fix tests.
* fix bugs and add check
* fix test.
* add omp.
* add comments.
* add coo reorder.
* fix a bug.
* handle reorder for different graph structues.
* fix lint.
* fix.
* add original ids.
* reshuffle nodes before metis partition.
* inner nodes are in contiguous Id range.
* reshuffle nodes/edges when partitioning.
* load partition return graph partition book.
* use inner_node/inner_edges
* add and test range partition book.
* count inner_edge correctly.
* fix lint.
* fix lint.
* fix lint.
* fix errors.
* fix errors.
* fix for TF.
* fix.
* fix.
* change docstring.
* support logical and.
* add comments.
* avoid copy.
* fix
* update docstring.
* fix a bug.
* add range search.
* fix
* fix a bug.
* add more tests.
* load graph partition book.
* support shared memory for range partition book.
* fix a bug.
* fix.
* fix lint.
* remove check
* fix test.
* remove num_nodes and num_edges
* fix lint.
* fix graph partition book.
* address comments.
* use makedirs.
* fix compile
Co-authored-by: xiang song(charlie.song) <classicxsong@gmail.com >
Co-authored-by: Chao Ma <mctt90@gmail.com >
2020-06-15 11:43:04 -07:00
Zihao Ye
04522a76c6
[bugfix] Quick fix of #1547 ( #1600 )
...
* upd
* upd
2020-06-15 09:27:37 +08:00
Da Zheng
96984faca4
[Feature] Split data for distributed training ( #1505 )
...
* fix tests in graph partition book.
* implement node_split and edge_split.
* fix a bug.
* add tests.
* remove unnecessary code.
* avoid storing graph structure in partition book.
* add partition book in DistGraph.
* Revert "avoid storing graph structure in partition book."
This reverts commit 55b11fbf9293efcae5f8c97e93f1e121399dadae.
* small fixes.
* add a test for boolean mask vector.
* fix test.
* fix bugs.
* make it work for all different cases.
* fix tests.
* fix boolean mask
* fix for TF
* fix for tensorflow.
* fix test for TF
* only support boolean mask for now.
* fix tests.
* make the code more readable.
* fix test.
Co-authored-by: Chao Ma <mctt90@gmail.com >
Co-authored-by: Jinjing Zhou <VoVAllen@users.noreply.github.com >
2020-05-14 12:46:37 -07:00
Jinjing Zhou
dc8ca88e58
[Refactor] Explicit dtype for HeteroGraph ( #1467 )
...
* 111
* 111
* lint
* lint
* lint
* lint
* fix
* lint
* try
* fix
* lint
* lint
* test
* fix
* ttt
* test
* fix
* fix
* fix
* mxnet
* 111
* fix 64bits computation
* pylint
* roll back
* fix
* lint
* fix hetero_from_relations
* remove index_dtype in to_homo and to_hetero
* fix
* fix
* fix
* fix
* remove default
* fix
* lint
* fix
* fix error message
* fix error
* lint
* macro dispatch
* try
* lint
* remove nbits
* error message
* fix
* fix
* lint
* lint
* lint
* fix
* lint
* fix
* fix random walk
* lint
* lint
* fix
* fix
* fix
* lint
* fix
* lint
Co-authored-by: Minjie Wang <wmjlyjemaine@gmail.com >
2020-05-08 14:26:28 +08:00
Minjie Wang
f25bc176d0
[Hetero] Improve speed of several Hetero APIs ( #1486 )
...
* add clone function to frame
* add utest
* replace all local_var with local_scope
* fix utest
* avoid creating canonical types in __getitem__
* lint
* try another utest appraoch for mx
* utest
2020-05-01 15:21:33 +08:00