f9d51fdf0b
[Feature] Add a HINT for the per edge type sampler of heterogeneous DistGraph that highlighting the etypes are sorted already. ( #3260 )
...
* pass cpp test
* distgraph use sorted edge flag.
* lint
* triger
* update test
Co-authored-by: Ubuntu <ubuntu@ip-172-31-2-66.ec2.internal >
2021-11-04 06:02:42 +00:00
508197e807
[New Feature] Per edge type sampler for to_homogeneous graphs. ( #3131 )
...
* fix.
* fix.
* fix.
* fix.
* Fix test
* Deprecate old DistEmbedding impl, use synchronized embedding impl
* Basic imple of heterogeneous on homogenenous sampling
* make pass
* Pass C++ test
* Add python test code
* lint
* lint
* Add MultiLayerEtypeNeighborSampler
* Add unitest for single machine dataloader
* Add dist dataloader test for edge type sampler
* Fix lint
* fix
* support for per etype sample
* Fix some bug and enable distributed training with per edge sample
* fix
* Now distributed training works
* turn off some mxnet
* turn off mxnet for some dist test
* fix
* upd
* upd according to the comments
* Fix
* Fix test and now distributed works.
* upd
* upd
* Fix
* Fix bug
* remove dead code.
* upd
* Fix
* upd
* Fix
Co-authored-by: Ubuntu <ubuntu@ip-172-31-71-112.ec2.internal >
Co-authored-by: Ubuntu <ubuntu@ip-172-31-2-66.ec2.internal >
Co-authored-by: Da Zheng <zhengda1936@gmail.com >
2021-11-02 09:21:20 +00:00
e56bbafd25
[Feature] Biased Neighbor Sampling ( #2987 )
...
* update
* update
* update
* update
* lint
* lint
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* lint
* update
* clone
* update
* update
* update
* update
* replace idarray with ndarray
* refactor cpp part
* refactor python part
* debug
* refactor interface
* test and doc
* lint and test
* lint
* fix
* fix
* fix
* const
* doc
* fix
* fix
* fix
* fix
* fix & doc
* fix
* fix
* update
* update
* update
* merge
* doc
* doc
* lint
* fix
* more tests
* doc
* fix
* fix
* update
* update
* update
* fix
* fix
Co-authored-by: Minjie Wang <wmjlyjemaine@gmail.com >
2021-06-23 17:44:51 +08:00
5be937a7fb
[Kernel] Slicing Batched Graphs ( #2965 )
...
* Update
* Update
* Update
* Update
* Update
* Update
* Update
* Update
* Update
* Add files via upload
* Add files via upload
* Add files via upload
* Add files via upload
* Update
* Update
* Add files via upload
* Add files via upload
* Update
* Lint
* Add files via upload
* Lint
* Update
* Update
* Update
* Update
* Update
* Lint Fix
* Lint
Co-authored-by: Ubuntu <ubuntu@ip-172-31-12-161.us-west-2.compute.internal >
Co-authored-by: Jinjing Zhou <VoVAllen@users.noreply.github.com >
Co-authored-by: xiang song(charlie.song) <classicxsong@gmail.com >
2021-06-10 12:07:44 +08:00
b8fe2b4837
[Feature][Sampler] Sort CSR by tag ( #1664 )
...
* update
* update
* update
* update
* lint
* lint
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* lint
* update
* clone
* update
* update
* update
* update
* replace idarray with ndarray
* refactor cpp part
* refactor python part
* debug
* refactor interface
* test and doc
* lint and test
* lint
* fix
* fix
* fix
* const
* doc
* fix
* fix
* fix
* fix
* fix & doc
* fix
* fix
* fix
* fix
* fix
* fix
* update
Co-authored-by: Minjie Wang <wmjlyjemaine@gmail.com >
2021-06-01 23:33:56 +08:00
ab2bd1f13d
[Feature] Add cuda support for Sparse Matrix multiplication, summation and masking ( #2782 )
...
* init cuda support
* cuSPARSE err
* passed unittest for csr_mm/SpGEMM. int64 not supported
* Debugging cuSPARSE error 3
* csrgeam only supports int32?
* disabling int64 for cuda
* refactor and add CSRMask
* lint
* oops
* remove todo
* rewrite CSRMask with CSRGetData
* lint
* fix test
* address comments
* lint
* fix
* addresses comments and rename BUG_ON
Co-authored-by: Israt Nisa <nisisrat@amazon.com >
Co-authored-by: Ubuntu <ubuntu@ip-172-31-30-71.ec2.internal >
Co-authored-by: Quan Gan <coin2028@hotmail.com >
Co-authored-by: Jinjing Zhou <VoVAllen@users.noreply.github.com >
Co-authored-by: Minjie Wang <wmjlyjemaine@gmail.com >
2021-04-27 16:06:35 +08:00
929d863447
[Feature] Sparse-sparse matrix multiplication, addition, and masking ( #2753 )
...
* test
* more stuff
* add test
* fixes
* optimize algo
* replace unordered_map with arrays
* lint
* lint x2
* oops
* disable gpu csrmm tests
* remove gpu invocation
* optimize with openmp
* remove python functions
* add back with docstrings
* lint
* lint
* update python interface
* functionize
* functionize
* lint
* lint
2021-03-24 17:24:41 +08:00
7bab1365e2
[feature] Supporting half precision floating data type (fp16). ( #2552 )
...
* add tvm as submodule
* compilation is ok but calling fails
* can call now
* pack multiple modules, change names
* upd
* upd
* upd
* fix cmake
* upd
* upd
* upd
* upd
* fix
* relative path
* upd
* upd
* upd
* singleton
* upd
* trigger
* fix
* upd
* count reducible
* upd
* upd
* upd
* upd
* upd
* upd
* upd
* upd
* upd
* only keep related files
* upd
* upd
* upd
* upd
* lint
* lint
* lint
* lint
* pylint
* upd
* upd
* compilation
* fix
* upd
* upd
* upd
* upd
* upd
* upd
* upd doc
* refactor
* fix
* upd number
Co-authored-by: Zhi Lin <linzhilynn@gmail.com >
Co-authored-by: Ubuntu <ubuntu@ip-172-31-42-78.us-east-2.compute.internal >
Co-authored-by: Ubuntu <ubuntu@ip-172-31-21-156.us-east-2.compute.internal >
Co-authored-by: Jinjing Zhou <VoVAllen@users.noreply.github.com >
2021-01-28 11:21:58 +08:00
9fc5eed6fd
[Doc] Fix docstring of aten::Sort ( #2579 )
...
A small patch to #2391 .
2021-01-27 17:24:28 +08:00
2576647c1f
[Performance] Improve COO to CSR, and sort columns of CSR only when necessary. ( #2391 )
...
* Remove double-checking sorted
* Remove sorting of CSR by default
* Update unit test to use unsorted matix
* delete whitespace
* Expand unit tests
* Replace cusparse sort
* Fix row column sorting
* Explicitly don't sort columns
* Fix linting errors
* Fix bit-width calculation
* Fix sorting assertion and unit test
* Fix linting
* Improve CPU COO2CSR
* Remove references
* Rename and add documentation to edge encoding/decoding funcionts
* Fix sorting keys as 64 bit
* Revert cosmetic changes to unit tests
* Update documentation
* Update complexity documentation for coo to csr conversion
* Remove COOIsSorted check in CPU implementation too
2021-01-27 15:33:34 +08:00
f4608c2227
[CUDA][Kernel] A bunch of int64 kernels for COO and CSR ( #1883 )
...
* COO sort
* COOToCSR
* CSR2COO
* CSRSort; CSRTranspose
* pass all CSR tests
* lint
* remove int32 conversion
* fix tensorflow nn tests
* turn on CI
* fix
* addreess comments
2020-07-30 21:02:07 +08:00
40950629b2
[Feature] Shared memory utilities ( #1807 )
...
* update
* update
* update
* update
* fix
* update
* fix
* update
* update
* win32
* update
* fix
* update
* update
* update
* updat
* update
* update
* fix
* update
* update
* update
* update
* update
* fix
* TODO
* 111
* fix
* minor fix
* minor fix
* fox
* Update shared_mem_manager.cc
* update
* update
* update
* update metis
* update metis
* update
Co-authored-by: VoVAllen <jz1749@nyu.edu >
Co-authored-by: Jinjing Zhou <VoVAllen@users.noreply.github.com >
2020-07-28 15:26:15 +08:00
44089c8b4d
[Refactor][Graph] Merge DGLGraph and DGLHeteroGraph ( #1862 )
...
* Merge
* [Graph][CUDA] Graph on GPU and many refactoring (#1791 )
* change edge_ids behavior and C++ impl
* fix unittests; remove utils.Index in edge_id
* pass mx and th tests
* pass tf test
* add aten::Scatter_
* Add nonzero; impl CSRGetDataAndIndices/CSRSliceMatrix
* CSRGetData and CSRGetDataAndIndices passed tests
* CSRSliceMatrix basic tests
* fix bug in empty slice
* CUDA CSRHasDuplicate
* has_node; has_edge_between
* predecessors, successors
* deprecate send/recv; fix send_and_recv
* deprecate send/recv; fix send_and_recv
* in_edges; out_edges; all_edges; apply_edges
* in deg/out deg
* subgraph/edge_subgraph
* adj
* in_subgraph/out_subgraph
* sample neighbors
* set/get_n/e_repr
* wip: working on refactoring all idtypes
* pass ndata/edata tests on gpu
* fix
* stash
* workaround nonzero issue
* stash
* nx conversion
* test_hetero_basics except update routines
* test_update_routines
* test_hetero_basics for pytorch
* more fixes
* WIP: flatten graph
* wip: flatten
* test_flatten
* test_to_device
* fix bug in to_homo
* fix bug in CSRSliceMatrix
* pass subgraph test
* fix send_and_recv
* fix filter
* test_heterograph
* passed all pytorch tests
* fix mx unittest
* fix pytorch test_nn
* fix all unittests for PyTorch
* passed all mxnet tests
* lint
* fix tf nn test
* pass all tf tests
* lint
* lint
* change deprecation
* try fix compile
* lint
* update METIDS
* fix utest
* fix
* fix utests
* try debug
* revert
* small fix
* fix utests
* upd
* upd
* upd
* fix
* upd
* upd
* upd
* upd
* upd
* trigger
* +1s
* [kernel] Use heterograph index instead of unitgraph index (#1813 )
* upd
* upd
* upd
* fix
* upd
* upd
* upd
* upd
* upd
* trigger
* +1s
* [Graph] Mutation for Heterograph (#1818 )
* mutation add_nodes and add_edges
* Add support for remove_edges, remove_nodes, add_selfloop, remove_selfloop
* Fix
Co-authored-by: Ubuntu <ubuntu@ip-172-31-51-214.ec2.internal >
* upd
* upd
* upd
* fix
* [Transfom] Mutable transform (#1833 )
* add nodesy
* All three
* Fix
* lint
* Add some test case
* Fix
* Fix
* Fix
* Fix
* Fix
* Fix
* fix
* triger
* Fix
* fix
Co-authored-by: Ubuntu <ubuntu@ip-172-31-51-214.ec2.internal >
* [Graph] Migrate Batch & Readout module to heterograph (#1836 )
* dgl.batch
* unbatch
* fix to device
* reduce readout; segment reduce
* change batch_num_nodes|edges to function
* reduce readout/ softmax
* broadcast
* topk
* fix
* fix tf and mx
* fix some ci
* fix batch but unbatch differently
* new checkk
* upd
* upd
* upd
* idtype behavior; code reorg
* idtype behavior; code reorg
* wip: test_basics
* pass test_basics
* WIP: from nx/ to nx
* missing files
* upd
* pass test_basics:test_nx_conversion
* Fix test
* Fix inplace update
* WIP: fixing tests
* upd
* pass test_transform cpu
* pass gpu test_transform
* pass test_batched_graph
* GPU graph auto cast to int32
* missing file
* stash
* WIP: rgcn-hetero
* Fix two datasety
* upd
* weird
* Fix capsuley
* fuck you
* fuck matthias
* Fix dgmg
* fix bug in block degrees; pass rgcn-hetero
* rgcn
* gat and diffpool fix
also fix ppi and tu dataset
* Tree LSTM
* pointcloud
* rrn; wip: sgc
* resolve conflicts
* upd
* sgc and reddit dataset
* upd
* Fix deepwalk, gindt and gcn
* fix datasets and sign
* optimization
* optimization
* upd
* upd
* Fix GIN
* fix bug in add_nodes add_edges; tagcn
* adaptive sampling and gcmc
* upd
* upd
* fix geometric
* fix
* metapath2vec
* fix agnn
* fix pickling problem of block
* fix utests
* miss file
* linegraph
* upd
* upd
* upd
* graphsage
* stgcn_wave
* fix hgt
* on unittests
* Fix transformer
* Fix HAN
* passed pytorch unittests
* lint
* fix
* Fix cluster gcn
* cluster-gcn is ready
* on fixing block related codes
* 2nd order derivative
* Revert "2nd order derivative"
This reverts commit 523bf6c249bee61b51b1ad1babf42aad4167f206.
* passed torch utests again
* fix all mxnet unittests
* delete some useless tests
* pass all tf cpu tests
* disable
* disable distributed unittest
* fix
* fix
* lint
* fix
* fix
* fix script
* fix tutorial
* fix apply edges bug
* fix 2 basics
* fix tutorial
Co-authored-by: yzh119 <expye@outlook.com >
Co-authored-by: xiang song(charlie.song) <classicxsong@gmail.com >
Co-authored-by: Ubuntu <ubuntu@ip-172-31-51-214.ec2.internal >
Co-authored-by: Ubuntu <ubuntu@ip-172-31-7-42.us-west-2.compute.internal >
Co-authored-by: Ubuntu <ubuntu@ip-172-31-1-5.us-west-2.compute.internal >
Co-authored-by: Ubuntu <ubuntu@ip-172-31-68-185.ec2.internal >
2020-07-28 14:30:41 +08:00
33330fcb2d
[Kernel] Line graph with new Kernel ( #1744 )
...
* line graph
* update docstring
* Add test and compile OK
* Add python API
* Fix linty
* Fix
* Fix
* upd
* upd
* Fix
* merge
* Fix
* fix
* upd
* lint
* Fix
Co-authored-by: Ubuntu <ubuntu@ip-172-31-51-214.ec2.internal >
Co-authored-by: Minjie Wang <wmjlyjemaine@gmail.com >
2020-07-10 12:24:01 +08:00
27cad329db
[Kernel] Matrix Union ( #1752 )
...
* Matrix union
* Pass test
* Fix lint
* return map for unionCOO/unionCSR
* Revert "return map for unionCOO/unionCSR"
This reverts commit 28e96c40f0659f02b33d88bcf528af6a6267726d.
* Update
* lint
* lint
* Fix doc
Co-authored-by: Ubuntu <ubuntu@ip-172-31-51-214.ec2.internal >
2020-07-09 14:22:49 +08:00
29e6c93fba
[Kernel] Matrix toSimple ( #1756 )
...
* Matrix to simple
* Pass test
* new impl
* Fix test
* Fix lint
* trigger
* upd
* Fix comments
Co-authored-by: Ubuntu <ubuntu@ip-172-31-51-214.ec2.internal >
2020-07-09 13:50:41 +08:00
9cd0d3f80d
[Aten] Add nonzero op ( #1746 )
...
* add nonzero op
* 111
* fix doc
Co-authored-by: xiang song(charlie.song) <classicxsong@gmail.com >
2020-07-05 22:20:59 +08:00
5747542f35
[Kernel] Migrate batching/unbatching on adjlist to CSR/COO ( #1687 )
...
* start
* coo csr union partition
* lint
* lint
* lint
* Add matrix->data transform
* update
* Fix window compile
* Add CSR support for DisjointPartition
* lint
* Fix
* Use IdArray Op
* Concat ready
* Fix and all pass
* resolve comments
* Add union COO C++ test
* Add C++ test for csr
* lint
* triger
* Update include
* Fix merge
* test
Co-authored-by: Ubuntu <ubuntu@ip-172-31-51-214.ec2.internal >
2020-06-28 23:33:55 +08:00
870da747ea
[CUDA][Kernel] More CUDA kernels; Standardize the behavior for sorted COO/CSR ( #1704 )
...
* add cub; array cumsum
* CSRSliceRows
* fix warning
* operator << for ndarray; CSRSliceRows
* add CSRIsSorted
* add csr_sort
* inplace coosort and outplace csrsort
* WIP: coo is sorted
* mv cuda_utils
* add AllTrue utility
* csr sort
* coo sort
* coo2csr for sorted coo arrays
* CSRToCOO from sorted
* pass tests for the new kernel changes
* cannot use inplace sort
* lint
* try fix msvc error
* Fix g.copy_to and g.asnumbits; ToBlock no longer uses CSC
* stash
* revert some hack
* revert some changes
* address comments
* fix
* fix to_block unittest
* add todo note
2020-06-28 18:37:28 +08:00
071cba1f2b
[kernel] New SpMM & SDDMM kernel on CPU and CUDA ( #1644 )
...
* udp
* simplify
* sddmm dot cpu
* upd
* format
* upd
* compatible with MJ's PR
* lint
* upd
* upd
* upd
* python end
* upd
* upd
* lint
* lint
* upd
* upd
* upd
* upd
* upd
* lint
* fix mxnet
* upd
* lint
* use minjie's ptr
* macro
* upd
* reorg
* lint
* fix corner cases
* upd
* enrich cpu docs
* upd
* upd
* lint
* lint
* pylint
* sx review
* improve docstring
* python doc
* upd
* restructure
* lint
* upd test
* upd
* pylint
* fix corner cases and test
2020-06-22 23:18:32 +08:00
f1b19a6b67
[CUDA] Many CUDA operators; Prepare for DGLGraph on CUDA ( #1660 )
...
* add cuda utils; change g.to; add g.device
* split array.h into several headers
* cuda index select
* file
* three cuda kernels
* add cuda elementwise arith and several others
* cuda CSRIsNonZero
* fix lint
* lint
* lint
* fix bug in changing ctx to property
* address comments
* remove unused codes
* address comments
2020-06-19 15:44:42 +08:00
xiang song(charlie.song)