91ade38a25
[CUDA] Add CUDA11 support ( #2308 )
...
* add support for cuda 11
* fix inc bug in pytorch 1.8
* poke ci
* fix
* small fix
* try fix
* try fix
Co-authored-by: Jinjing Zhou <VoVAllen@users.noreply.github.com >
Co-authored-by: Quan (Andy) Gan <coin2028@hotmail.com >
2020-11-27 03:20:07 +00:00
9eaace9216
rename create_format_ to create_formats_ ( #2126 )
2020-08-29 22:49:27 +08:00
be444e52d9
[Doc/Feature] Refactor, doc update and behavior fix for graphs ( #1983 )
...
* Update graph
* Fix for dgl.graph
* from_scipy
* Replace canonical_etypes with relations
* from_networkx
* Update for hetero_from_relations
* Roll back the change of canonical_etypes to relations
* heterograph
* bipartite
* Update doc
* Fix lint
* Fix lint
* Fix test cases
* Fix
* Fix
* Fix
* Fix
* Fix
* Fix
* Update
* Fix test
* Fix
* Update
* Use DGLError
* Update
* Update
* Update
* Update
* Fix
* Fix
* Fix
* Fix
* Fix
* Fix
* Fix
* Fix
* Update
* Fix
* Update
* Fix
* Fix
* Fix
* Update
* Fix
* Update
* Fix
* Update
* Update
* Update
* Update
* Update
* Update
* Update
* Fix
* Fix
* Update
* Update
* Update
* Update
* Update
* Update
* rewrite sanity checks
* delete unnecessary checks
* Update
* Update
* Update
* Update
* Update
* Update
* Update
* Update
* Fix
* Update
* Update
* Update
* Fix
* Fix
* Fix
* Update
* Fix
* Update
* Fix
* Fix
* Update
* Fix
* Update
* Fix
Co-authored-by: xiang song(charlie.song) <classicxsong@gmail.com >
Co-authored-by: Minjie Wang <wmjlyjemaine@gmail.com >
Co-authored-by: Quan Gan <coin2028@hotmail.com >
2020-08-18 04:26:29 +08:00
34a067eaa0
[bugfix] Fix the memory leak issue of Cluster GAT under 0.5 kernel and simplify the bipartite GAT. ( #1908 )
...
* uipd
* upd
* upd
* upd
* upd
2020-08-02 00:59:27 +08:00
40950629b2
[Feature] Shared memory utilities ( #1807 )
...
* update
* update
* update
* update
* fix
* update
* fix
* update
* update
* win32
* update
* fix
* update
* update
* update
* updat
* update
* update
* fix
* update
* update
* update
* update
* update
* fix
* TODO
* 111
* fix
* minor fix
* minor fix
* fox
* Update shared_mem_manager.cc
* update
* update
* update
* update metis
* update metis
* update
Co-authored-by: VoVAllen <jz1749@nyu.edu >
Co-authored-by: Jinjing Zhou <VoVAllen@users.noreply.github.com >
2020-07-28 15:26:15 +08:00
44089c8b4d
[Refactor][Graph] Merge DGLGraph and DGLHeteroGraph ( #1862 )
...
* Merge
* [Graph][CUDA] Graph on GPU and many refactoring (#1791 )
* change edge_ids behavior and C++ impl
* fix unittests; remove utils.Index in edge_id
* pass mx and th tests
* pass tf test
* add aten::Scatter_
* Add nonzero; impl CSRGetDataAndIndices/CSRSliceMatrix
* CSRGetData and CSRGetDataAndIndices passed tests
* CSRSliceMatrix basic tests
* fix bug in empty slice
* CUDA CSRHasDuplicate
* has_node; has_edge_between
* predecessors, successors
* deprecate send/recv; fix send_and_recv
* deprecate send/recv; fix send_and_recv
* in_edges; out_edges; all_edges; apply_edges
* in deg/out deg
* subgraph/edge_subgraph
* adj
* in_subgraph/out_subgraph
* sample neighbors
* set/get_n/e_repr
* wip: working on refactoring all idtypes
* pass ndata/edata tests on gpu
* fix
* stash
* workaround nonzero issue
* stash
* nx conversion
* test_hetero_basics except update routines
* test_update_routines
* test_hetero_basics for pytorch
* more fixes
* WIP: flatten graph
* wip: flatten
* test_flatten
* test_to_device
* fix bug in to_homo
* fix bug in CSRSliceMatrix
* pass subgraph test
* fix send_and_recv
* fix filter
* test_heterograph
* passed all pytorch tests
* fix mx unittest
* fix pytorch test_nn
* fix all unittests for PyTorch
* passed all mxnet tests
* lint
* fix tf nn test
* pass all tf tests
* lint
* lint
* change deprecation
* try fix compile
* lint
* update METIDS
* fix utest
* fix
* fix utests
* try debug
* revert
* small fix
* fix utests
* upd
* upd
* upd
* fix
* upd
* upd
* upd
* upd
* upd
* trigger
* +1s
* [kernel] Use heterograph index instead of unitgraph index (#1813 )
* upd
* upd
* upd
* fix
* upd
* upd
* upd
* upd
* upd
* trigger
* +1s
* [Graph] Mutation for Heterograph (#1818 )
* mutation add_nodes and add_edges
* Add support for remove_edges, remove_nodes, add_selfloop, remove_selfloop
* Fix
Co-authored-by: Ubuntu <ubuntu@ip-172-31-51-214.ec2.internal >
* upd
* upd
* upd
* fix
* [Transfom] Mutable transform (#1833 )
* add nodesy
* All three
* Fix
* lint
* Add some test case
* Fix
* Fix
* Fix
* Fix
* Fix
* Fix
* fix
* triger
* Fix
* fix
Co-authored-by: Ubuntu <ubuntu@ip-172-31-51-214.ec2.internal >
* [Graph] Migrate Batch & Readout module to heterograph (#1836 )
* dgl.batch
* unbatch
* fix to device
* reduce readout; segment reduce
* change batch_num_nodes|edges to function
* reduce readout/ softmax
* broadcast
* topk
* fix
* fix tf and mx
* fix some ci
* fix batch but unbatch differently
* new checkk
* upd
* upd
* upd
* idtype behavior; code reorg
* idtype behavior; code reorg
* wip: test_basics
* pass test_basics
* WIP: from nx/ to nx
* missing files
* upd
* pass test_basics:test_nx_conversion
* Fix test
* Fix inplace update
* WIP: fixing tests
* upd
* pass test_transform cpu
* pass gpu test_transform
* pass test_batched_graph
* GPU graph auto cast to int32
* missing file
* stash
* WIP: rgcn-hetero
* Fix two datasety
* upd
* weird
* Fix capsuley
* fuck you
* fuck matthias
* Fix dgmg
* fix bug in block degrees; pass rgcn-hetero
* rgcn
* gat and diffpool fix
also fix ppi and tu dataset
* Tree LSTM
* pointcloud
* rrn; wip: sgc
* resolve conflicts
* upd
* sgc and reddit dataset
* upd
* Fix deepwalk, gindt and gcn
* fix datasets and sign
* optimization
* optimization
* upd
* upd
* Fix GIN
* fix bug in add_nodes add_edges; tagcn
* adaptive sampling and gcmc
* upd
* upd
* fix geometric
* fix
* metapath2vec
* fix agnn
* fix pickling problem of block
* fix utests
* miss file
* linegraph
* upd
* upd
* upd
* graphsage
* stgcn_wave
* fix hgt
* on unittests
* Fix transformer
* Fix HAN
* passed pytorch unittests
* lint
* fix
* Fix cluster gcn
* cluster-gcn is ready
* on fixing block related codes
* 2nd order derivative
* Revert "2nd order derivative"
This reverts commit 523bf6c249bee61b51b1ad1babf42aad4167f206.
* passed torch utests again
* fix all mxnet unittests
* delete some useless tests
* pass all tf cpu tests
* disable
* disable distributed unittest
* fix
* fix
* lint
* fix
* fix
* fix script
* fix tutorial
* fix apply edges bug
* fix 2 basics
* fix tutorial
Co-authored-by: yzh119 <expye@outlook.com >
Co-authored-by: xiang song(charlie.song) <classicxsong@gmail.com >
Co-authored-by: Ubuntu <ubuntu@ip-172-31-51-214.ec2.internal >
Co-authored-by: Ubuntu <ubuntu@ip-172-31-7-42.us-west-2.compute.internal >
Co-authored-by: Ubuntu <ubuntu@ip-172-31-1-5.us-west-2.compute.internal >
Co-authored-by: Ubuntu <ubuntu@ip-172-31-68-185.ec2.internal >
2020-07-28 14:30:41 +08:00
53fc639201
[Torch] Fix inter-process communication for PyTorch ( #1858 )
...
* fix
* add comment
2020-07-24 18:15:24 +08:00
0e92dad69a
[Transfom] Add support for to_bidirected of heterogeneous graphs ( #1793 )
...
* code
* joint_union
* joint union pass all test
* test case for test_transform
* upd
* lint
* lint
* Fix
* list
* Fix
* Fix
* update to_bidirected impl
* Fix
* Fix
* upd
* remove joint_union
Co-authored-by: Ubuntu <ubuntu@ip-172-31-51-214.ec2.internal >
2020-07-15 18:01:02 +08:00
f25b1a064d
[Feature] Autograd of gspmm and gsddmm on PyTorch/MXNet/Tensorflow ( #1680 )
...
* init
* reverse(by minjie
* upd
* upd
* upd
* upd
* upd
* upd
* upd
* gpu
* upd
* upd
* upd
* upd
* udp
* upd
* upd
* imidiot
* fix
* upd
* upd
* upd
* udp
* upd
* upd
* fix
* udp
* upd
* upd
* upd
* upd
* upd
* fix
* remove redundency
* upd
* upd
* upd
* cache
* upd
* upd
* upd
* upd
* upd
* udp
* upd
* trigger
* upd
* fix
* upd
* unused import
* upd
* upd
2020-07-13 23:21:22 +08:00
200340ab38
[Transform] Reverse for heterogenous graph ( #1784 )
...
* reverse
* Add more test
* Fix lint
* Fix
* move to transform
* upd
* upd
* upd
* Add more test
* lint
* Fix
* Fix doc
* Fix
* test
* doc
* Fix
Co-authored-by: Ubuntu <ubuntu@ip-172-31-51-214.ec2.internal >
2020-07-13 18:05:44 +08:00
feabcabd97
[Kernel]GraphOp::Reverse ( #1730 )
...
* Compile OK
* Fix compile
* Explore reverse to heterograph_indx and add python test code
* lint
* Fix some bug
* Fix bug
* upd
* Fix
* fix lint
* Fix
* Fix
* test
* triger
* Fix
* upd
* add TODO
* upd
Co-authored-by: Ubuntu <ubuntu@ip-172-31-51-214.ec2.internal >
Co-authored-by: Zihao Ye <expye@outlook.com >
Co-authored-by: Jinjing Zhou <VoVAllen@users.noreply.github.com >
2020-07-04 13:52:47 +08:00
18a26fcfb1
[Data] Support HeteroGraph save/load ( #1526 )
...
* 111
* add history version test
* fix
* 111
* save
* ``
* fix1
* 111
* add save heterograph
* lint
* lint
* add tests
* minor fix
* fix
* docs
* add format tets
* use unique_ptr
* fix
* fix interface
* 111
* 111
* fix
* lint
* fix
* add support to s3
* fix
* fix
* fix leak
* fix
* fix docs
* fix
* linlt
* fix
* fix
* fix
* address comment
* address comment
Co-authored-by: Minjie Wang <wmjlyjemaine@gmail.com >
Co-authored-by: xiang song(charlie.song) <classicxsong@gmail.com >
2020-06-30 13:34:50 +08:00
5747542f35
[Kernel] Migrate batching/unbatching on adjlist to CSR/COO ( #1687 )
...
* start
* coo csr union partition
* lint
* lint
* lint
* Add matrix->data transform
* update
* Fix window compile
* Add CSR support for DisjointPartition
* lint
* Fix
* Use IdArray Op
* Concat ready
* Fix and all pass
* resolve comments
* Add union COO C++ test
* Add C++ test for csr
* lint
* triger
* Update include
* Fix merge
* test
Co-authored-by: Ubuntu <ubuntu@ip-172-31-51-214.ec2.internal >
2020-06-28 23:33:55 +08:00
f1b19a6b67
[CUDA] Many CUDA operators; Prepare for DGLGraph on CUDA ( #1660 )
...
* add cuda utils; change g.to; add g.device
* split array.h into several headers
* cuda index select
* file
* three cuda kernels
* add cuda elementwise arith and several others
* cuda CSRIsNonZero
* fix lint
* lint
* lint
* fix bug in changing ctx to property
* address comments
* remove unused codes
* address comments
2020-06-19 15:44:42 +08:00
0a4e8b32b6
[Optimization] Optimize pickling of heterograph ( #1570 )
...
* update
* update
* update
* update
* update
* update
* backward compatibility
* update
* update
* update
* update
* update
* test
* test
* update
* update
* update
* update
* update
* update
Co-authored-by: Jinjing Zhou <VoVAllen@users.noreply.github.com >
2020-06-18 19:43:42 +08:00
d6d517bb02
[Kernel] CUDA CSR2COO COOSort COO2CSR ( #1620 )
...
* add cuda source
* moving codes from kernel2 branch
* operator overloading
* Better error message for unsupported device
* fix c tests
* coo sort using cusparse
* move test_rpc to distributed
* lint
* address comments and add utests
Co-authored-by: Jinjing Zhou <VoVAllen@users.noreply.github.com >
Co-authored-by: Chao Ma <mctt90@gmail.com >
Co-authored-by: xiang song(charlie.song) <classicxsong@gmail.com >
2020-06-15 14:35:12 +08:00
70dc2ee9c6
[Feature] Add a request_format api and enrich related docstring. ( #1528 )
...
* upd
* upd
* lint
* fix
* bloody lint
2020-05-16 01:17:06 +08:00
20ec7bb0d9
[Bug?] Fixing compatibility of pickles across DGL versions ( #1507 )
...
* pickle compatibility before 0.4.2
* fixing for utils.Index
* add TODOs
* fix
* fix
* more compatibility checks for DGLGraph and DGLHeteroGraph objects
* lint
Co-authored-by: Jinjing Zhou <VoVAllen@users.noreply.github.com >
Co-authored-by: Minjie Wang <wmjlyjemaine@gmail.com >
2020-05-15 00:02:58 +08:00
c2e61ce10b
[Refactor] Restrict sparse format for DGLHeteroGraph ( #1474 )
...
* upd
* simplify
* further simplify
* lint
* doc
* upd
* upd
* upd
* upd
* upd
* upd
* upd
* lint
* rename format
* upd
* lint
* upd
* upd
* upd
* udp
* debug
* upd
* upd
* upd
* upd
* upd
* 无可厚非吧
* 中三边肥
* 你一定要喊吗
* lint
* upd
* upd
* upd
* upd
* upd
* upd
* upd
* Update unit_graph.h
Co-authored-by: Zihao Ye <yzh119@192.168 .0.110>
Co-authored-by: Minjie Wang <wmjlyjemaine@gmail.com >
Co-authored-by: Quan (Andy) Gan <coin2028@hotmail.com >
2020-05-14 22:11:12 +08:00
dc8ca88e58
[Refactor] Explicit dtype for HeteroGraph ( #1467 )
...
* 111
* 111
* lint
* lint
* lint
* lint
* fix
* lint
* try
* fix
* lint
* lint
* test
* fix
* ttt
* test
* fix
* fix
* fix
* mxnet
* 111
* fix 64bits computation
* pylint
* roll back
* fix
* lint
* fix hetero_from_relations
* remove index_dtype in to_homo and to_hetero
* fix
* fix
* fix
* fix
* remove default
* fix
* lint
* fix
* fix error message
* fix error
* lint
* macro dispatch
* try
* lint
* remove nbits
* error message
* fix
* fix
* lint
* lint
* lint
* fix
* lint
* fix
* fix random walk
* lint
* lint
* fix
* fix
* fix
* lint
* fix
* lint
Co-authored-by: Minjie Wang <wmjlyjemaine@gmail.com >
2020-05-08 14:26:28 +08:00
67cb7a43a0
[Feature] Deprecate multigraph ( #1389 )
...
* Deprecate multi-graph
* Handle heterograph and edge_ids
* lint
* Fix
* Remove multigraph in C++ end
* Fix lint
* Add some test and fix something
* Fix
* Fix
* upd
* Fix some test case
* Fix
* Fix
Co-authored-by: Ubuntu <ubuntu@ip-172-31-51-214.ec2.internal >
Co-authored-by: Jinjing Zhou <VoVAllen@users.noreply.github.com >
Co-authored-by: Minjie Wang <wmjlyjemaine@gmail.com >
2020-03-28 21:31:24 +08:00
ce6e19f233
[Bugfix] Allows node types with no inbound/outbound edges ( #1323 )
...
* add num nodes in ctors
* fix
* lint
* addresses comments
* replace with constexpr
* remove function with rvalue reference
* address comments
2020-03-08 01:11:44 +08:00
5dd35580f7
[Feature] Improve sampling speed; Better pickle/unpickle; other fixes ( #1299 )
...
* improve performance of sample_neighbors
* some more improve
* test script
* benchmarks
* multi process
* update more tests
* WIP
* adding two API for state saving
* add create from state
* upd test
* missing file
* wip: pickle/unpickle
* more c apis
* find the problem of empty data array
* add null array; pickling speed is bad
* still bad perf
* still bad perf
* wip
* fix the pickle speed test; now everything looks good
* minor fix
* bugfix
* some lint fix
* address comments
* more fix
* fix lint
* add utest for random.choice
* add utest for dgl.rand_graph
* fix cpp utests
* try fix ci
* fix bug in TF backend
* upd choice docstring
* address comments
* upd
* try fix compile
* add comment
2020-03-02 23:16:05 +08:00
c3a33407fe
[Feature] PinSAGE sampler ( #1249 )
...
* [WIP] PinSAGE operators
* moved the edge remapping mess into C
* some docstrings
* lint
* lint x2
* lint x3
* skip gpu test on topk
* extend pinsage to any metapath
* lint x4
* addresses #1265
* add always_preserve (fixes #1266 ) and fix a silly bug
* disable gpu test on compaction
* lint
* fix a horrible bug and add more tests
* lint
* addresses comments
* lint
* bugfix
* addresses comments
Co-authored-by: Minjie Wang <minjie.wang@nyu.edu >
2020-02-28 20:46:13 +08:00
eeeb52f464
[Feature] Preference to COO for "hypersparse" unit graphs & graph compaction ( #1238 )
...
* unit graph that prefers coo queries
* auto detect coo preference
* forgot some functions
* disable lint on detect_prefer_coo
* reorg
* change comment
* lint
* fix
* move array_utils.h to src
* compact graph impl
* fix redundant copying in idhashmap
* docstring
* moving preference detection to C
* lint
* fix unit test & address comments
* hypersparse autorestrict
* docstring & fix
* revert copyto and asnumbits
* fix stupid bug
* lint
* leave a TODO for sorted COO
* fixing same node type mapping to different id in different graphs
* addresses comments
* made induced nodes a feautre column
* lint?
2020-02-04 22:39:28 +08:00
3ef757dbff
[Feature] Pickle support for heterograph ( #1177 )
...
* [Feature] Pickle support for heterograph
* fix lint
Co-authored-by: VoVAllen <VoVAllen@users.noreply.github.com >
2020-01-09 13:27:29 +08:00
ead64de98e
[Hetero] Batching/Unbatching DGLHeteroGraph ( #1017 )
...
* Update
* Update
* Update
* Fix
* CI style fix
* CI fix style
* Fix
* Try CI
* Fix test
* Update
* Update
* Update
* Update
2019-11-26 14:40:50 +08:00
e2b7f745ca
[Hetero] Doc ( #892 )
...
* Update
* Update
* Update
* Update
* Update
* Update
* Update
* Update
* Update
* Update
* Update
* Update
* Update
* Update
* Update
* Update
* Update
* style fixes & undefined name fix
* transpose=False in test
2019-10-06 20:17:40 +08:00
e3921d5dec
[Sampler] Metapath sampler for metapath2vec ( #861 )
...
* metapath sampler
* lint & fixes
* lint x2
* lint x3
* fix windows
* remove max_cycle argument
* add todo note
2019-09-26 16:42:33 -04:00
9b4d60799a
[Hetero] New syntax ( #824 )
...
* WIP. remove graph arg in NodeBatch and EdgeBatch
* refactor: use graph adapter for scheduler
* WIP: recv
* draft impl
* stuck at bipartite
* bipartite->unitgraph; support dsttype == srctype
* pass test_query
* pass test_query
* pass test_view
* test apply
* pass udf message passing tests
* pass quan's test using builtins
* WIP: wildcard slicing
* new construct methods
* broken
* good
* add stack cross reducer
* fix bug; fix mx
* fix bug in csrmm2 when the CSR is not square
* lint
* removed FlattenedHeteroGraph class
* WIP
* prop nodes, prop edges, filter nodes/edges
* add DGLGraph tests to heterograph. Fix several bugs
* finish nx<->hetero graph conversion
* create bipartite from nx
* more spec on hetero/homo conversion
* silly fixes
* check node and edge types
* repr
* to api
* adj APIs
* inc
* fix some lints and bugs
* fix some lints
* hetero/homo conversion
* fix flatten test
* more spec in hetero_from_homo and test
* flatten using concat names
* WIP: creators
* rewrite hetero_from_homo in a more efficient way
* remove useless variables
* fix lint
* subgraphs and typed subgraphs
* lint & removed heterosubgraph class
* lint x2
* disable heterograph mutation test
* docstring update
* add edge id for nx graph test
* fix mx unittests
* fix bug
* try fix
* fix unittest when cross_reducer is stack
* fix ci
* fix nx bipartite bug; docstring
* fix scipy creation bug
* lint
* fix bug when converting heterograph from homograph
* fix bug in hetero_from_homo about ntype order
* trailing white
* docstring fixes for add_foo and data views
* docstring for relation slice
* to_hetero and to_homo with feature support
* lint
* lint
* DGLGraph compatibility
* incidence matrix & docstring fixes
* example string fixes
* feature in hetero_from_relations
* deduplication of edge types in to_hetero
* fix lint
* fix
2019-09-17 15:41:57 -04:00
52d4535b61
[Hetero][RFC] Heterogeneous graph Python interfaces & Message Passing ( #752 )
...
* moving heterograph index to another file
* node view
* python interfaces
* heterograph init
* bug fixes
* docstring for readonly
* more docstring
* unit tests & lint
* oops
* oops x2
* removed node/edge addition
* addressed comments
* lint
* rw on frames with one node/edge type
* homograph with underlying heterograph demo
* view is not necessary
* bugfix
* replace
* scheduler, builtins not working yet
* moving bipartite.h to header
* moving back bipartite to bipartite.h
* oops
* asbits and copyto for bipartite
* tested update_all and send_and_recv
* lightweight node & edge type retrieval
* oops
* sorry
* removing obsolete code
* oops
* lint
* various bug fixes & more tests
* UDF tests
* multiple type number_of_nodes and number_of_edges
* docstring fixes
* more tests
* going for dict in initialization
* lint
* updated api as per discussions
* lint
* bug
* bugfix
* moving back bipartite impl to cc
* note on views
* fix
2019-08-23 15:45:37 -04:00
Minjie Wang