faf8c71163
[Performance] Use segment operators for graph readout. ( #2361 )
...
* upd
* upd
* update
* upd
* upd
* upd
* fix
* lint
* lint
* pylint
* doc
2020-11-27 03:21:04 +00:00
c83685c855
[Performance] Dynamic cpu kernel V3 for SpMMSumCsr all Ops ( #2309 )
...
* support AVX512
* env DGL_CPU_INTEL_KERNEL_ENABLED=1
* env DGL_CPU_INTEL_KERNEL_LOG=1
* Add unittest test_spmm.cc
Co-authored-by: Izabela Mazur <izabela.mazur@intel.com >
Co-authored-by: Michal Szarmach <michal.szarmach@intel.com >
Review patch
2020-11-27 03:20:27 +00:00
317be7f188
[Bugfix] GINDataset check whether labels are all valid ( #2319 )
...
* PPIDataset
* Revert "PPIDataset"
This reverts commit 264bd0c960cfa698a7bb946dad132bf52c2d0c8a.
* check whether the original labels are valid
* add unit test for gin dataset
* bug of asscalar in mxnet<=1.6
* mxnet<=1.6 asscalar requires ndarray to be shaped (1,)
* skip gpu while testing datasets
* Update test_data.py
* test of gin dataset takes too much time
2020-11-27 03:17:22 +00:00
4286bd2b94
fix bug in flatten and is_unibipartite ( #2279 )
2020-11-27 03:17:12 +00:00
3f994308c0
[bugfix] Fix the behavior of min/max reducer for 1-dim dta. ( #2250 )
...
* udp
* add test
* udp
* fix mxnet
2020-11-27 03:17:12 +00:00
26757bd383
[HeteroGraph] Fix the failure of apply_nodes when the input function changes feature size for all nodes ( #2223 )
...
* Fix
* Fix
2020-11-27 03:17:11 +00:00
7d8522a29f
[Bug] fix cumsum on an empty array with prepend_zero returning an empty array ( #2179 )
...
* fix cumsum
* udp
Co-authored-by: Zihao <expye@outlook.com >
2020-09-11 18:23:44 +08:00
8f4594074b
[Hotfix] Fix degree bucket edge ordering ( #2176 )
...
* fix degree bucket edge ordering
* unit test
* fix
2020-09-11 14:16:52 +08:00
cbd55eb12f
[performance] Batch DGLGraph in C++ end. ( #2155 )
...
* upd
* upd
* upd
* upd
* upd
* upd
* upd
* upd
* upd
* upd
* upd
* fix
* upd
* upd
* upd
* upd
* fix
* upd
Co-authored-by: VoVAllen <jz1749@nyu.edu >
2020-09-11 02:54:27 +08:00
ac570c1dae
[Bugfix] Fix flatten not wrapping unit graph ( #2170 )
...
* fix flatten not wrapping unit graph
* fix doc
2020-09-10 17:41:52 +08:00
c9c6171b9f
Revert "[Feature] Basic utils to handle raw data features ( #2102 )" ( #2147 )
...
This reverts commit 33a8bb93bfwmjlyjemaine@gmail.com >
2020-09-08 10:33:59 +08:00
ac5c79cdb8
[Bug] Fixes issues in feature pickling and transmission for subgraphs and blocks ( #2139 )
...
* bug fixes
* remove __deepcopy__; not sure what the behavior should be
* lint
* skip gpu test
* fix
* fix dist dataloader
* add comment
* remove assert
2020-09-03 12:48:59 +08:00
9eaace9216
rename create_format_ to create_formats_ ( #2126 )
2020-08-29 22:49:27 +08:00
642bdbaf04
[Traversal] Fall back to CPU for Graph Traversal as a Workaround ( #2115 )
...
* workaround
* Allow Test for Traversal on GPU Graphs
Co-authored-by: Ubuntu <ubuntu@ip-172-31-1-5.us-west-2.compute.internal >
Co-authored-by: Quan (Andy) Gan <coin2028@hotmail.com >
2020-08-29 16:34:31 +08:00
3808dc950b
[hotfix] Disable hypersparse memory optimization. ( #2121 )
...
* upd
* upd
2020-08-28 15:07:53 +08:00
33a8bb93bf
[Feature] Basic utils to handle raw data features ( #2102 )
...
* add feature utils and add test for feature norm
* Add docstring and test
* upd
* dis able some test
* Update
* update doc string
* update
Co-authored-by: Ubuntu <ubuntu@ip-172-31-68-185.ec2.internal >
2020-08-27 11:36:39 +08:00
10cba2f223
Add selfloop ( #2105 )
...
Co-authored-by: Ubuntu <ubuntu@ip-172-31-68-185.ec2.internal >
2020-08-26 11:06:52 +08:00
2ce426d956
[Bug] add_edges() crashes if the input tensor is empty ( #2100 )
...
* [Bug] add_edges() crashes if the input tensor is empty
* lint
* fix
2020-08-24 16:04:41 +08:00
3af0e91c0e
[Frame] Fix for Column Index Device ( #2055 )
...
* Update frame.py
* add unit test
* fix test
* fix
* fix
* fix
Co-authored-by: Quan Gan <coin2028@hotmail.com >
2020-08-19 16:10:52 +08:00
167536db71
[Windows] Work around the bug from CL 19.10 ( #2059 )
...
* [Windows] Work around the bug from CL 19.10
* fix
2020-08-19 15:24:46 +08:00
75ffc31f76
[Doc] Update the docstring of distributed APIs. ( #2025 )
...
* add doc.
* update DistGraph.
* add DistTensor.
* update DistEmbedding.
* add partition.py
* add sampling.
* fix.
* add graph partition book and create a base class.
* fix test.
* add rst.
* update doc rst.
* update.
* fix.
* fix docs
* update distributed tensor and embeddings.
* add checks.
* update DistGraph.
* update initialization.
* fix graph partition book.
* update graph partition book.
* update partition.
* update partition.
* fix.
* add example code.
* update DistGraph
* Update python/dgl/distributed/dist_context.py
Co-authored-by: Quan (Andy) Gan <coin2028@hotmail.com >
* Update python/dgl/distributed/dist_context.py
Co-authored-by: Quan (Andy) Gan <coin2028@hotmail.com >
* Update python/dgl/distributed/dist_dataloader.py
Co-authored-by: Quan (Andy) Gan <coin2028@hotmail.com >
* Update python/dgl/distributed/dist_dataloader.py
Co-authored-by: Quan (Andy) Gan <coin2028@hotmail.com >
* Update python/dgl/distributed/dist_dataloader.py
Co-authored-by: Quan (Andy) Gan <coin2028@hotmail.com >
* update initialize.
* update dataloader.
* update distgraph.
* update DistGraph.
* update DistTensor.
* update.
* more updates.
* fix lint.
* add num_nodes and num_edges
Co-authored-by: Chao Ma <mctt90@gmail.com >
Co-authored-by: Quan (Andy) Gan <coin2028@hotmail.com >
Co-authored-by: xiang song(charlie.song) <classicxsong@gmail.com >
2020-08-18 11:53:45 -07:00
dacc7afeb2
[Convert] Reserve node/edge IDs in to_heterogeneous ( #2045 )
...
* Fix
* Fix
Co-authored-by: xiang song(charlie.song) <classicxsong@gmail.com >
2020-08-18 23:16:33 +08:00
9088c63592
[Feature] Change the Default Value of transpose in DGLGraph.adj ( #2046 )
...
* Update adj
* Fix
2020-08-18 22:45:46 +08:00
09ec6020ac
[Example] rm gcn spmv ( #2044 )
...
* rm gcn spmv
* remove useless test
* remove useless test
Co-authored-by: Ubuntu <ubuntu@ip-172-31-51-214.ec2.internal >
2020-08-18 17:48:38 +08:00
47c96dd114
[Test] Remove Test for metapath_random_walk ( #2039 )
...
* Update test_randomwalk.py
* Update test_randomwalk.py
2020-08-18 11:19:31 +08:00
aa19df1bbb
[Bugfix] Fix batching isolated node types ( #2035 )
...
* [Bugfix] Fix batching isolated ntypes
* fix test
* remove test.py
Co-authored-by: Minjie Wang <wmjlyjemaine@gmail.com >
Co-authored-by: Jinjing Zhou <VoVAllen@users.noreply.github.com >
2020-08-18 09:29:05 +08:00
be444e52d9
[Doc/Feature] Refactor, doc update and behavior fix for graphs ( #1983 )
...
* Update graph
* Fix for dgl.graph
* from_scipy
* Replace canonical_etypes with relations
* from_networkx
* Update for hetero_from_relations
* Roll back the change of canonical_etypes to relations
* heterograph
* bipartite
* Update doc
* Fix lint
* Fix lint
* Fix test cases
* Fix
* Fix
* Fix
* Fix
* Fix
* Fix
* Update
* Fix test
* Fix
* Update
* Use DGLError
* Update
* Update
* Update
* Update
* Fix
* Fix
* Fix
* Fix
* Fix
* Fix
* Fix
* Fix
* Update
* Fix
* Update
* Fix
* Fix
* Fix
* Update
* Fix
* Update
* Fix
* Update
* Update
* Update
* Update
* Update
* Update
* Update
* Fix
* Fix
* Update
* Update
* Update
* Update
* Update
* Update
* rewrite sanity checks
* delete unnecessary checks
* Update
* Update
* Update
* Update
* Update
* Update
* Update
* Update
* Fix
* Update
* Update
* Update
* Fix
* Fix
* Fix
* Update
* Fix
* Update
* Fix
* Fix
* Update
* Fix
* Update
* Fix
Co-authored-by: xiang song(charlie.song) <classicxsong@gmail.com >
Co-authored-by: Minjie Wang <wmjlyjemaine@gmail.com >
Co-authored-by: Quan Gan <coin2028@hotmail.com >
2020-08-18 04:26:29 +08:00
0afc3cf8e1
[NN] Add ChebConv for Tensorflow ( #2038 )
...
* add chebconv
* fix
* lint
* fix lint
* docs
2020-08-17 22:12:27 +08:00
b1e69105d4
[Doc] API Doc update for mxnet and tf, remove some degree check ( #2028 )
...
* mx tf relconv
* use method instead of private attr
* src and dst have different fc for gat
* update edgeconv
* change sage and sgconv
* no degree check on gin
* add remainding API doc
* fix pylint
* infer fc_src and fc_dst, only one tensor for block
* fix pytest
2020-08-17 13:23:44 +08:00
b8a4b446e5
[NN][Fix] fix some random test ( #2031 )
...
Co-authored-by: Minjie Wang <wmjlyjemaine@gmail.com >
2020-08-17 10:19:31 +08:00
efa95d8673
[Distributed] Fix bugs ( #2009 )
...
* fix.
* add tests.
* fix.
* fix.
2020-08-13 23:51:11 -07:00
1ad46fd015
[Distributed] support distributed sampling in NodeDataLoader ( #2012 )
...
* fix.
* doesn't support EdgeDataLoader
* add test.
* fix.
* fix test.
* catch errors in the test.
* fix.
* fix error message
* add print.
* join the server processes.
* update test.
* fix test.
2020-08-13 22:49:21 -07:00
4672c022a8
[hotfix] no in-degree check on sage ( #2014 )
...
* no degre check on sage
* fix pytest
* no in degree check for heteroconv
2020-08-13 13:11:55 +08:00
cd48435206
[Transform] Docstring and subframes ( #1962 )
...
* update knn graph docs
* more docs
* [Doc] transform module docstrings
* remove copy_ndata and copy_edata
* fix
* lint
* fix
* fix
* fix
* clean up docstrings
* fix docstring
* dtype specifications
* addresses comments
* fix
Co-authored-by: Mufei Li <mufeili1996@gmail.com >
Co-authored-by: xiang song(charlie.song) <classicxsong@gmail.com >
2020-08-13 10:41:43 +08:00
6294677f8a
[hotfix] Set reduce results to all zero for nodes with zero in-degrees. ( #2011 )
2020-08-13 01:20:56 +08:00
5362908236
Fix save/load for old version files ( #1994 )
...
* load hetero
* fix
* more error message
* add warning
* add alias to dgl namespace
* fix tests
2020-08-12 23:45:21 +08:00
69f5869f3b
[Doc] NN doc refactor Conv Layers ( #1672 )
...
* go through gcn, relgcn
* fix tagconv formula
* fix doc in sageconv
* fix sgconv doc
* replace hat with tilde
* more comments on gmmconv
* fix agnnconv chebconv doc
* modify nnconv doc
* remove &
* add nn conv examples
* Rebase master
* More merge conflicts
* check homo
* add back self loop for some convs, check homo in tranform
* add example for denseconv
* add example and doc for dotgat and cfconv
* check in-degree for graphconv
* add language fix
* gconv address all comments
* another round of change based on api template
* change agnn
* go through agnn, appnp, atomic, cf, cheb, dense, gat, sage modules
* finish pytorch part of nn conv
* mxnet graphconv done
* tensorflow graphconv works
* add new modules into doc
* add comments to not split code
* refine doc
* resr
* more comments
* more fix
* finish conv and dense conv part api
* pylint fix
* fix pylink
* fix pylint
* more fix
* fix
* fix test fail because zere in degree
* fix test fail
* sage is not update for mxnet tf
Co-authored-by: Ubuntu <ubuntu@ip-172-31-0-81.us-east-2.compute.internal >
2020-08-12 18:47:19 +08:00
5e34ca8bb5
[Feature] Lazy copy ndata, edata to device ( #1986 )
...
* Lazy to device
* remove print
* lint
* Fix
* Fix
* Fix
* Fix
* Fix
* Fix
* Fix
* lint
* Fix
* Revert "Fix"
This reverts commit 615c9b8f80f5f6ee2ab43c849a22f0083deedf3b.
* Add test for frame lazy update
* disable tensorflow
* upd
Co-authored-by: Ubuntu <ubuntu@ip-172-31-51-214.ec2.internal >
Co-authored-by: Minjie Wang <wmjlyjemaine@gmail.com >
2020-08-12 13:04:47 +08:00
d1cf5c383e
[Distributed] adjust various APIs. ( #1993 )
...
* rename get_data_size.
* remove g from DistTensor.
* remove g from DistEmbedding.
* clean up API of graph partition book.
* fix DistGraph
* fix lint.
* collect all part policies.
* fix.
* fix.
* support distributed sampler.
* remove partition.py
2020-08-11 20:22:00 -07:00
f5eb80d221
[Feature] Edge DataLoader for edge classification & link prediction ( #1828 )
...
* clean commit
* oops forgot the most important files
* use einsum
* copy feature from frontier to block
* Revert "copy feature from frontier to block"
This reverts commit 5224ec963eb6a3ef1b6ab74d8ecbd44e4e42f285.
* temp fix
* unit test
* fix
* revert jtnn
* lint
* fix win64
* docstring fixes and doc indexing
* revert einsum in sparse bidecoder
* fix some examples
* lint
* fix due to some tediousness in remove_edges
* addresses comments
* fix
* more jtnn fixes
* fix
2020-08-11 18:00:58 +08:00
d340ea3aa8
[Distributed] Remove server_count from ip_config.txt ( #1985 )
...
* remove server_count from ip_config.txt
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* lint
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* Update dist_context.py
* fix lint.
* make it work for multiple spaces.
* update ip_config.txt.
* fix examples.
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* udpate
* update
* update
* update
* update
* update
Co-authored-by: Da Zheng <zhengda1936@gmail.com >
Co-authored-by: Ubuntu <ubuntu@ip-172-31-19-1.us-west-2.compute.internal >
2020-08-11 17:41:48 +08:00
ee30b2aadd
[Distributed] Fix standalone ( #1974 )
...
* fix tests.
* fix.
* remove a test.
* make code work in the standalone mode.
* fix example.
* more fix.
* make DistDataloader work with num_workers=0
* fix DistDataloader tests.
* fix.
* fix lint.
* fix cleanup.
* fix test
* remove unnecessary code.
* remove tests.
* fix.
* fix.
* fix.
* fix example
* fix.
* fix.
* fix launch script.
Co-authored-by: Jinjing Zhou <VoVAllen@users.noreply.github.com >
Co-authored-by: Ubuntu <ubuntu@ip-172-31-19-1.us-west-2.compute.internal >
2020-08-10 15:49:28 -07:00
729ff2ef38
Fix the performance issue of graph partitioning in new DGLGraph ( #1934 )
...
* fix perf.
* fix.
* accelerate metis.
* fix lint.
* use gklib.
* fix perf.
* fix.
* update metis.
* update launch script
* handle synchronized API.
* fix.
* fix example.
* fix dataloader.
* temp fix.
* temp fix omp.
* distinguish roles.
* initialize iterator of DistDataloader correctly.
* check the correctness of launch script.
* move feature copy to sampler.
* measure mem/network copy time.
* remove
* Revert "measure mem/network copy time."
This reverts commit 86cefdc14b7815fcf5aad6496af912dba48e4aa6.
* fix.
* fix
* fix.
* fix cmake.
* disable metis in windows.
* disable metis tests in windows.
* remove test for multigraph.
* fix test.
* fix.
* fix cmake.
* fix.
* revert.
Co-authored-by: Ubuntu <ubuntu@ip-172-31-19-115.us-west-2.compute.internal >
Co-authored-by: Ubuntu <ubuntu@ip-172-31-19-1.us-west-2.compute.internal >
2020-08-09 18:33:05 -07:00
5454471fc8
[Distributed] Add roles ( #1971 )
...
* distinguish roles.
* add comments.
* fix lint.
* move roles to server_state.
* fix text.
* fix tests.
* fix tests.
* Revert "fix tests."
This reverts commit 5baa136b872a4550d4e612bfb1dfe363d7814adf.
2020-08-08 01:41:51 -07:00
bab32d5ba1
[Distributed] Fix dataloader ( #1970 )
...
* fix dataloader.
* initialize iterator of DistDataloader correctly.
* update test.
2020-08-07 18:09:21 -07:00
18bfec24cf
[hotfix] Refactor edge softmax module ( #1967 )
...
* upd
* upd
* upd
* upd
* upd
* upd
* upd
* upd
2020-08-07 23:50:12 +08:00
22167f7203
[Refactor] Enable new kernel in all message passing APIs ( #1953 )
...
* WIP: frame refactor
* new frame
* simple update_all builtin
* move all subgraph routines into the same file
* sddmm & spmm schedule; node & edge udf
* degree bucketing
* some tricky 0deg corner cases
* bug in frame append
* merge test_hetero_basics and test_basics
* some code rearange
* fix test_heterograph
* add mean spmm
* enable all builtin combinations
* pass gpu test
* pass pytorch tests
* wip
* fix some pt debugging codes
* fix bug in mxnet backward
* pass all mxnet utests
* passed tf tests
* docstring
* lint
* lint
* fix broadcasting bugs
* add warning and clamp for mean reducer
* add test for zero-degree mean
* address comments
* lint
* small fix
2020-08-07 15:40:25 +08:00
35c9473ba5
[HotFix] Fix add_reverse_edges ( #1960 )
...
* Hot fix
* more test
Co-authored-by: Ubuntu <ubuntu@ip-172-31-51-214.ec2.internal >
2020-08-07 13:07:06 +08:00
4f499c7ffb
[Distributed] DistDataloader ( #1901 )
...
* 111
* 111
* fix
* 111
* fix
* 11
* fix
* lint
* Update __init__.py
* lint
* fix
* lint
* fix
* fix
* fix
* fix
* fix
* try fix
* try fix
* fix
* Revert "fix"
This reverts commit a0b954fd4e99b7df92b53db8334dcb583d6e1551.
* fixes.
* fix.
* fix test.
* fix exit.
* fix.
* fix
* fix
* lint
* lint
* lint
* fix
* Update .gitignore
* 111
* fix
* 111
* 111
* fff
* 1111
* 111
* 1325315
* ffff
* f???
* fff
* 1111
* 111
* fix
* 111
* asda
* 1111
* 11
* 123
* 啊啊啊啊啊啊啊啊啊啊啊啊啊啊啊啊
* spawn
* 1231231
* up
* 111
* fix
* fix
* Revert "fix"
This reverts commit 7373f95312fdcaa36d2fc330bf242339e89c045d.
* fix
* fix
* 1111
* fix
* fix tests
* start kvclient as early as possible.
* lint
* fix test
* lint
* 1111
* fix
* fix
* 111
* fix
* fix
* 1
* fix
* fix
* lint
* fix
* lint
* lint
* remove quit
* fix
* lint
* fix
* fix several
* lint
* fix minor
* fix
* lint
Co-authored-by: Da Zheng <zhengda1936@gmail.com >
Co-authored-by: xiang song(charlie.song) <classicxsong@gmail.com >
2020-08-05 17:43:17 +08:00
879e4ae5f2
[Transform] Add add_reverse_edges ( #1936 )
...
* Add add_reverse_edges and is_simple_graph
Update to_bidirected
* remove is_simple_graph
* Fix lint
* to bidirected only support cpu
* support copy ndata
* upd
Co-authored-by: Ubuntu <ubuntu@ip-172-31-51-214.ec2.internal >
2020-08-05 15:09:55 +08:00
Zihao Ye