3af0e91c0e
[Frame] Fix for Column Index Device ( #2055 )
...
* Update frame.py
* add unit test
* fix test
* fix
* fix
* fix
Co-authored-by: Quan Gan <coin2028@hotmail.com >
2020-08-19 16:10:52 +08:00
167536db71
[Windows] Work around the bug from CL 19.10 ( #2059 )
...
* [Windows] Work around the bug from CL 19.10
* fix
2020-08-19 15:24:46 +08:00
75ffc31f76
[Doc] Update the docstring of distributed APIs. ( #2025 )
...
* add doc.
* update DistGraph.
* add DistTensor.
* update DistEmbedding.
* add partition.py
* add sampling.
* fix.
* add graph partition book and create a base class.
* fix test.
* add rst.
* update doc rst.
* update.
* fix.
* fix docs
* update distributed tensor and embeddings.
* add checks.
* update DistGraph.
* update initialization.
* fix graph partition book.
* update graph partition book.
* update partition.
* update partition.
* fix.
* add example code.
* update DistGraph
* Update python/dgl/distributed/dist_context.py
Co-authored-by: Quan (Andy) Gan <coin2028@hotmail.com >
* Update python/dgl/distributed/dist_context.py
Co-authored-by: Quan (Andy) Gan <coin2028@hotmail.com >
* Update python/dgl/distributed/dist_dataloader.py
Co-authored-by: Quan (Andy) Gan <coin2028@hotmail.com >
* Update python/dgl/distributed/dist_dataloader.py
Co-authored-by: Quan (Andy) Gan <coin2028@hotmail.com >
* Update python/dgl/distributed/dist_dataloader.py
Co-authored-by: Quan (Andy) Gan <coin2028@hotmail.com >
* update initialize.
* update dataloader.
* update distgraph.
* update DistGraph.
* update DistTensor.
* update.
* more updates.
* fix lint.
* add num_nodes and num_edges
Co-authored-by: Chao Ma <mctt90@gmail.com >
Co-authored-by: Quan (Andy) Gan <coin2028@hotmail.com >
Co-authored-by: xiang song(charlie.song) <classicxsong@gmail.com >
2020-08-18 11:53:45 -07:00
dacc7afeb2
[Convert] Reserve node/edge IDs in to_heterogeneous ( #2045 )
...
* Fix
* Fix
Co-authored-by: xiang song(charlie.song) <classicxsong@gmail.com >
2020-08-18 23:16:33 +08:00
9088c63592
[Feature] Change the Default Value of transpose in DGLGraph.adj ( #2046 )
...
* Update adj
* Fix
2020-08-18 22:45:46 +08:00
09ec6020ac
[Example] rm gcn spmv ( #2044 )
...
* rm gcn spmv
* remove useless test
* remove useless test
Co-authored-by: Ubuntu <ubuntu@ip-172-31-51-214.ec2.internal >
2020-08-18 17:48:38 +08:00
47c96dd114
[Test] Remove Test for metapath_random_walk ( #2039 )
...
* Update test_randomwalk.py
* Update test_randomwalk.py
2020-08-18 11:19:31 +08:00
aa19df1bbb
[Bugfix] Fix batching isolated node types ( #2035 )
...
* [Bugfix] Fix batching isolated ntypes
* fix test
* remove test.py
Co-authored-by: Minjie Wang <wmjlyjemaine@gmail.com >
Co-authored-by: Jinjing Zhou <VoVAllen@users.noreply.github.com >
2020-08-18 09:29:05 +08:00
be444e52d9
[Doc/Feature] Refactor, doc update and behavior fix for graphs ( #1983 )
...
* Update graph
* Fix for dgl.graph
* from_scipy
* Replace canonical_etypes with relations
* from_networkx
* Update for hetero_from_relations
* Roll back the change of canonical_etypes to relations
* heterograph
* bipartite
* Update doc
* Fix lint
* Fix lint
* Fix test cases
* Fix
* Fix
* Fix
* Fix
* Fix
* Fix
* Update
* Fix test
* Fix
* Update
* Use DGLError
* Update
* Update
* Update
* Update
* Fix
* Fix
* Fix
* Fix
* Fix
* Fix
* Fix
* Fix
* Update
* Fix
* Update
* Fix
* Fix
* Fix
* Update
* Fix
* Update
* Fix
* Update
* Update
* Update
* Update
* Update
* Update
* Update
* Fix
* Fix
* Update
* Update
* Update
* Update
* Update
* Update
* rewrite sanity checks
* delete unnecessary checks
* Update
* Update
* Update
* Update
* Update
* Update
* Update
* Update
* Fix
* Update
* Update
* Update
* Fix
* Fix
* Fix
* Update
* Fix
* Update
* Fix
* Fix
* Update
* Fix
* Update
* Fix
Co-authored-by: xiang song(charlie.song) <classicxsong@gmail.com >
Co-authored-by: Minjie Wang <wmjlyjemaine@gmail.com >
Co-authored-by: Quan Gan <coin2028@hotmail.com >
2020-08-18 04:26:29 +08:00
0afc3cf8e1
[NN] Add ChebConv for Tensorflow ( #2038 )
...
* add chebconv
* fix
* lint
* fix lint
* docs
2020-08-17 22:12:27 +08:00
b1e69105d4
[Doc] API Doc update for mxnet and tf, remove some degree check ( #2028 )
...
* mx tf relconv
* use method instead of private attr
* src and dst have different fc for gat
* update edgeconv
* change sage and sgconv
* no degree check on gin
* add remainding API doc
* fix pylint
* infer fc_src and fc_dst, only one tensor for block
* fix pytest
2020-08-17 13:23:44 +08:00
b8a4b446e5
[NN][Fix] fix some random test ( #2031 )
...
Co-authored-by: Minjie Wang <wmjlyjemaine@gmail.com >
2020-08-17 10:19:31 +08:00
efa95d8673
[Distributed] Fix bugs ( #2009 )
...
* fix.
* add tests.
* fix.
* fix.
2020-08-13 23:51:11 -07:00
1ad46fd015
[Distributed] support distributed sampling in NodeDataLoader ( #2012 )
...
* fix.
* doesn't support EdgeDataLoader
* add test.
* fix.
* fix test.
* catch errors in the test.
* fix.
* fix error message
* add print.
* join the server processes.
* update test.
* fix test.
2020-08-13 22:49:21 -07:00
4672c022a8
[hotfix] no in-degree check on sage ( #2014 )
...
* no degre check on sage
* fix pytest
* no in degree check for heteroconv
2020-08-13 13:11:55 +08:00
cd48435206
[Transform] Docstring and subframes ( #1962 )
...
* update knn graph docs
* more docs
* [Doc] transform module docstrings
* remove copy_ndata and copy_edata
* fix
* lint
* fix
* fix
* fix
* clean up docstrings
* fix docstring
* dtype specifications
* addresses comments
* fix
Co-authored-by: Mufei Li <mufeili1996@gmail.com >
Co-authored-by: xiang song(charlie.song) <classicxsong@gmail.com >
2020-08-13 10:41:43 +08:00
6294677f8a
[hotfix] Set reduce results to all zero for nodes with zero in-degrees. ( #2011 )
2020-08-13 01:20:56 +08:00
5362908236
Fix save/load for old version files ( #1994 )
...
* load hetero
* fix
* more error message
* add warning
* add alias to dgl namespace
* fix tests
2020-08-12 23:45:21 +08:00
69f5869f3b
[Doc] NN doc refactor Conv Layers ( #1672 )
...
* go through gcn, relgcn
* fix tagconv formula
* fix doc in sageconv
* fix sgconv doc
* replace hat with tilde
* more comments on gmmconv
* fix agnnconv chebconv doc
* modify nnconv doc
* remove &
* add nn conv examples
* Rebase master
* More merge conflicts
* check homo
* add back self loop for some convs, check homo in tranform
* add example for denseconv
* add example and doc for dotgat and cfconv
* check in-degree for graphconv
* add language fix
* gconv address all comments
* another round of change based on api template
* change agnn
* go through agnn, appnp, atomic, cf, cheb, dense, gat, sage modules
* finish pytorch part of nn conv
* mxnet graphconv done
* tensorflow graphconv works
* add new modules into doc
* add comments to not split code
* refine doc
* resr
* more comments
* more fix
* finish conv and dense conv part api
* pylint fix
* fix pylink
* fix pylint
* more fix
* fix
* fix test fail because zere in degree
* fix test fail
* sage is not update for mxnet tf
Co-authored-by: Ubuntu <ubuntu@ip-172-31-0-81.us-east-2.compute.internal >
2020-08-12 18:47:19 +08:00
5e34ca8bb5
[Feature] Lazy copy ndata, edata to device ( #1986 )
...
* Lazy to device
* remove print
* lint
* Fix
* Fix
* Fix
* Fix
* Fix
* Fix
* Fix
* lint
* Fix
* Revert "Fix"
This reverts commit 615c9b8f80f5f6ee2ab43c849a22f0083deedf3b.
* Add test for frame lazy update
* disable tensorflow
* upd
Co-authored-by: Ubuntu <ubuntu@ip-172-31-51-214.ec2.internal >
Co-authored-by: Minjie Wang <wmjlyjemaine@gmail.com >
2020-08-12 13:04:47 +08:00
d1cf5c383e
[Distributed] adjust various APIs. ( #1993 )
...
* rename get_data_size.
* remove g from DistTensor.
* remove g from DistEmbedding.
* clean up API of graph partition book.
* fix DistGraph
* fix lint.
* collect all part policies.
* fix.
* fix.
* support distributed sampler.
* remove partition.py
2020-08-11 20:22:00 -07:00
f5eb80d221
[Feature] Edge DataLoader for edge classification & link prediction ( #1828 )
...
* clean commit
* oops forgot the most important files
* use einsum
* copy feature from frontier to block
* Revert "copy feature from frontier to block"
This reverts commit 5224ec963eb6a3ef1b6ab74d8ecbd44e4e42f285.
* temp fix
* unit test
* fix
* revert jtnn
* lint
* fix win64
* docstring fixes and doc indexing
* revert einsum in sparse bidecoder
* fix some examples
* lint
* fix due to some tediousness in remove_edges
* addresses comments
* fix
* more jtnn fixes
* fix
2020-08-11 18:00:58 +08:00
d340ea3aa8
[Distributed] Remove server_count from ip_config.txt ( #1985 )
...
* remove server_count from ip_config.txt
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* lint
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* Update dist_context.py
* fix lint.
* make it work for multiple spaces.
* update ip_config.txt.
* fix examples.
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* udpate
* update
* update
* update
* update
* update
Co-authored-by: Da Zheng <zhengda1936@gmail.com >
Co-authored-by: Ubuntu <ubuntu@ip-172-31-19-1.us-west-2.compute.internal >
2020-08-11 17:41:48 +08:00
ee30b2aadd
[Distributed] Fix standalone ( #1974 )
...
* fix tests.
* fix.
* remove a test.
* make code work in the standalone mode.
* fix example.
* more fix.
* make DistDataloader work with num_workers=0
* fix DistDataloader tests.
* fix.
* fix lint.
* fix cleanup.
* fix test
* remove unnecessary code.
* remove tests.
* fix.
* fix.
* fix.
* fix example
* fix.
* fix.
* fix launch script.
Co-authored-by: Jinjing Zhou <VoVAllen@users.noreply.github.com >
Co-authored-by: Ubuntu <ubuntu@ip-172-31-19-1.us-west-2.compute.internal >
2020-08-10 15:49:28 -07:00
729ff2ef38
Fix the performance issue of graph partitioning in new DGLGraph ( #1934 )
...
* fix perf.
* fix.
* accelerate metis.
* fix lint.
* use gklib.
* fix perf.
* fix.
* update metis.
* update launch script
* handle synchronized API.
* fix.
* fix example.
* fix dataloader.
* temp fix.
* temp fix omp.
* distinguish roles.
* initialize iterator of DistDataloader correctly.
* check the correctness of launch script.
* move feature copy to sampler.
* measure mem/network copy time.
* remove
* Revert "measure mem/network copy time."
This reverts commit 86cefdc14b7815fcf5aad6496af912dba48e4aa6.
* fix.
* fix
* fix.
* fix cmake.
* disable metis in windows.
* disable metis tests in windows.
* remove test for multigraph.
* fix test.
* fix.
* fix cmake.
* fix.
* revert.
Co-authored-by: Ubuntu <ubuntu@ip-172-31-19-115.us-west-2.compute.internal >
Co-authored-by: Ubuntu <ubuntu@ip-172-31-19-1.us-west-2.compute.internal >
2020-08-09 18:33:05 -07:00
5454471fc8
[Distributed] Add roles ( #1971 )
...
* distinguish roles.
* add comments.
* fix lint.
* move roles to server_state.
* fix text.
* fix tests.
* fix tests.
* Revert "fix tests."
This reverts commit 5baa136b872a4550d4e612bfb1dfe363d7814adf.
2020-08-08 01:41:51 -07:00
bab32d5ba1
[Distributed] Fix dataloader ( #1970 )
...
* fix dataloader.
* initialize iterator of DistDataloader correctly.
* update test.
2020-08-07 18:09:21 -07:00
18bfec24cf
[hotfix] Refactor edge softmax module ( #1967 )
...
* upd
* upd
* upd
* upd
* upd
* upd
* upd
* upd
2020-08-07 23:50:12 +08:00
22167f7203
[Refactor] Enable new kernel in all message passing APIs ( #1953 )
...
* WIP: frame refactor
* new frame
* simple update_all builtin
* move all subgraph routines into the same file
* sddmm & spmm schedule; node & edge udf
* degree bucketing
* some tricky 0deg corner cases
* bug in frame append
* merge test_hetero_basics and test_basics
* some code rearange
* fix test_heterograph
* add mean spmm
* enable all builtin combinations
* pass gpu test
* pass pytorch tests
* wip
* fix some pt debugging codes
* fix bug in mxnet backward
* pass all mxnet utests
* passed tf tests
* docstring
* lint
* lint
* fix broadcasting bugs
* add warning and clamp for mean reducer
* add test for zero-degree mean
* address comments
* lint
* small fix
2020-08-07 15:40:25 +08:00
35c9473ba5
[HotFix] Fix add_reverse_edges ( #1960 )
...
* Hot fix
* more test
Co-authored-by: Ubuntu <ubuntu@ip-172-31-51-214.ec2.internal >
2020-08-07 13:07:06 +08:00
4f499c7ffb
[Distributed] DistDataloader ( #1901 )
...
* 111
* 111
* fix
* 111
* fix
* 11
* fix
* lint
* Update __init__.py
* lint
* fix
* lint
* fix
* fix
* fix
* fix
* fix
* try fix
* try fix
* fix
* Revert "fix"
This reverts commit a0b954fd4e99b7df92b53db8334dcb583d6e1551.
* fixes.
* fix.
* fix test.
* fix exit.
* fix.
* fix
* fix
* lint
* lint
* lint
* fix
* Update .gitignore
* 111
* fix
* 111
* 111
* fff
* 1111
* 111
* 1325315
* ffff
* f???
* fff
* 1111
* 111
* fix
* 111
* asda
* 1111
* 11
* 123
* 啊啊啊啊啊啊啊啊啊啊啊啊啊啊啊啊
* spawn
* 1231231
* up
* 111
* fix
* fix
* Revert "fix"
This reverts commit 7373f95312fdcaa36d2fc330bf242339e89c045d.
* fix
* fix
* 1111
* fix
* fix tests
* start kvclient as early as possible.
* lint
* fix test
* lint
* 1111
* fix
* fix
* 111
* fix
* fix
* 1
* fix
* fix
* lint
* fix
* lint
* lint
* remove quit
* fix
* lint
* fix
* fix several
* lint
* fix minor
* fix
* lint
Co-authored-by: Da Zheng <zhengda1936@gmail.com >
Co-authored-by: xiang song(charlie.song) <classicxsong@gmail.com >
2020-08-05 17:43:17 +08:00
879e4ae5f2
[Transform] Add add_reverse_edges ( #1936 )
...
* Add add_reverse_edges and is_simple_graph
Update to_bidirected
* remove is_simple_graph
* Fix lint
* to bidirected only support cpu
* support copy ndata
* upd
Co-authored-by: Ubuntu <ubuntu@ip-172-31-51-214.ec2.internal >
2020-08-05 15:09:55 +08:00
d2ccd218cf
[hotfix] Allow creating graph from edges with restrict formats excluding coo. ( #1926 )
...
* upd
* upd
* upd
* upd
2020-08-04 00:33:36 +08:00
56339b34bf
[Fix] Update ogb examples according to new API. ( #1922 )
...
* upd
* upd
Co-authored-by: Ubuntu <ubuntu@ip-172-31-29-3.us-east-2.compute.internal >
2020-08-03 23:08:50 +08:00
b5be4f4bbf
[Dataset] Update dataset hash with deterministic function ( #1919 )
...
* update hash with deterministic function
* update docstring
* add test on determination
2020-08-03 16:17:00 +08:00
a4c931a9bf
[Distributed] Support multiple servers ( #1886 )
...
* client init graph on the backup servers.
* fix.
* test multi-server.
* fix anonymous dist tensors.
* check #parts.
* fix init_data
* add multi-server multi-client tests.
* update tests in kvstore.
* fix.
* verify the loaded partition.
* fix a bug.
* fix lint.
* fix.
* fix example.
* fix rpc.
* fix pull/push handler for backup kvstore
* fix example readme.
* change ip.
* update docstring.
Co-authored-by: Ubuntu <ubuntu@ip-172-31-19-1.us-west-2.compute.internal >
2020-08-02 19:50:34 -07:00
56bbf9cb6d
[Distributed][Example] Distributed training for unsupervised graphsage ( #1853 )
...
* Standalone can run
* fix
* Add save
* Fix
* Fix
* Fix
* Fix
* debug
* test
* test
* Fix
* Fix
* log
* Fix
* fix
* Profile
* auto sync grad
* update
* add test for unsupervised dist training
* upd
* Fix lr
* Fix update
* sync
* fix
* Revert "fix"
This reverts commit d5caa7398b36125f6d6e2c742a95c6ff4298c9e9.
* Fix
* unsupervised
* Fix
* remove debug
* Add test case for dist_graph find_edges()
* Fix
* skip tensorflow test for find_edges
* Update readme
* remove some test
* upd
* Update partition_graph.py
Co-authored-by: Ubuntu <ubuntu@ip-172-31-68-185.ec2.internal >
Co-authored-by: Ubuntu <ubuntu@ip-172-31-24-210.ec2.internal >
Co-authored-by: Da Zheng <zhengda1936@gmail.com >
2020-08-01 12:24:55 -07:00
34a067eaa0
[bugfix] Fix the memory leak issue of Cluster GAT under 0.5 kernel and simplify the bipartite GAT. ( #1908 )
...
* uipd
* upd
* upd
* upd
* upd
2020-08-02 00:59:27 +08:00
4be4b13424
[Distributed] add copy_partitions.py ( #1866 )
...
* fix bugs.
* eval on both vaidation and testing.
* add script.
* update.
* update launch.
* make train_dist.py independent.
* update readme.
* update readme.
* update readme.
* update readme.
* generate undirected graph.
* rename conf_file to part_config
* use rsync
* make train_dist independent.
Co-authored-by: Ubuntu <ubuntu@ip-172-31-19-1.us-west-2.compute.internal >
Co-authored-by: Ubuntu <ubuntu@ip-172-31-19-115.us-west-2.compute.internal >
Co-authored-by: xiang song(charlie.song) <classicxsong@gmail.com >
2020-07-31 11:11:56 -07:00
e5e1a99d46
[KVStore] Fix bug in barrier. ( #1904 )
...
* update
* update
* fix lint
* update
* update
2020-07-31 22:01:03 +08:00
03f251ced1
upd ( #1905 )
2020-07-31 20:13:24 +08:00
a28bfa9f5f
[hotfix] Activate kernel unittest for tensorflow ( #1895 )
...
* upd
* upd
* upd
* upd
* upd
* trigger
* simplify unittest
Co-authored-by: Jinjing Zhou <VoVAllen@users.noreply.github.com >
2020-07-31 19:57:53 +08:00
f4608c2227
[CUDA][Kernel] A bunch of int64 kernels for COO and CSR ( #1883 )
...
* COO sort
* COOToCSR
* CSR2COO
* CSRSort; CSRTranspose
* pass all CSR tests
* lint
* remove int32 conversion
* fix tensorflow nn tests
* turn on CI
* fix
* addreess comments
2020-07-30 21:02:07 +08:00
5b515cf667
[KVStore] Support group barrier ( #1880 )
...
* udpate
* update
* update
* update
* update
* update
* update
* update
* fix lint
* update
* update
* update
* update
* udpate
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
Co-authored-by: Da Zheng <zhengda1936@gmail.com >
2020-07-30 19:21:20 +08:00
444becf00a
[Misc] Move many deprecated codes to the deprecate folder ( #1893 )
...
* some file movements
* move some codes to deprecated
* more deprecation
* lint
* remove useless test
2020-07-30 18:17:33 +08:00
68a978d4de
[Model] Fixes JTNN for 0.5 ( #1879 )
...
* jtnn and fixes
* make metagraph a method
* fix test
* fix
2020-07-30 13:36:08 +08:00
3e2f94ed20
[Distributed] Refactor distributed training to new DGLGraph. ( #1874 )
...
* fix tests in partition.
* fix DistGraph.
* fix without shared memory.
* fix sampling.
* enable distributed test.
* fix tests.
* fix a bug in shared-mem heterograph.
* print better error messages.
* fix.
* don't specify formats.
* fix.
* fix
* small fix.
2020-07-28 22:07:24 -07:00
2fa2b4534e
[Feature] Support higher order derivative for message passing. ( #1877 )
...
* upd
* fix typo
2020-07-28 23:11:06 +08:00
71cf78652d
Revert "[Distributed] DistDataloader ( #1870 )" ( #1876 )
...
This reverts commit 6557291fdc
2020-07-28 17:57:57 +08:00
6557291fdc
[Distributed] DistDataloader ( #1870 )
...
* 111
* 111
* fix
* 111
* fix
* 11
* fix
* lint
* Update __init__.py
* lint
* fix
* lint
* fix
* fix
* fix
* fix
* fix
* try fix
* try fix
* fix
* Revert "fix"
This reverts commit a0b954fd4e99b7df92b53db8334dcb583d6e1551.
* fixes.
* fix.
* fix test.
* fix exit.
* fix.
* fix
* fix
* lint
* lint
* lint
* fix
* Update .gitignore
Co-authored-by: Da Zheng <zhengda1936@gmail.com >
2020-07-28 16:36:37 +08:00
Mufei Li