9a0511c8e9
[NN] nn modules & examples update ( #890 )
...
* upd
* damn it
* fuck
* fuck pylint
* fudge
* remove some comments about MXNet
* upd
* upd
* damn it
* damn it
* fuck
* fuck
* upd
* upd
* pylint bastard
* upd
* upd
* upd
* upd
* upd
* upd
* upd
* upd
* upd
2019-11-03 17:29:42 -05:00
82499e602b
[Bug Fix] Fix package reliability bug of networkx ( #949 )
...
* upd
* fig edgebatch edges
* add test
* trigger
* Update README.md for pytorch PinSage example.
Add noting that the PinSage model example under
example/pytorch/recommendation only work with Python 3.6+
as its dataset loader depends on stanfordnlp package
which work only with Python 3.6+.
* Provid a frame agnostic API to test nn modules on both CPU and CUDA side.
1. make dgl.nn.xxx frame agnostic
2. make test.backend include dgl.nn modules
3. modify test_edge_softmax of test/mxnet/test_nn.py and
test/pytorch/test_nn.py work on both CPU and GPU
* Fix style
* Delete unused code
* Make agnostic test only related to tests/backend
1. clear all agnostic related code in dgl.nn
2. make test_graph_conv agnostic to cpu/gpu
* Fix code style
* fix
* doc
* Make all test code under tests.mxnet/pytorch.test_nn.py
work on both CPU and GPU.
* Fix syntex
* Remove rand
* Add TAGCN nn.module and example
* Now tagcn can run on CPU.
* Add unitest for TGConv
* Fix style
* For pubmed dataset, using --lr=0.005 can achieve better acc
* Fix style
* Fix some descriptions
* trigger
* Fix doc
* Add nn.TGConv and example
* Fix bug
* Update data in mxnet.tagcn test acc.
* Fix some comments and code
* delete useless code
* Fix namming
* Fix bug
* Fix bug
* Add test for mxnet TAGCov
* Add test code for mxnet TAGCov
* Update some docs
* Fix some code
* Update docs dgl.nn.mxnet
* Update weight init
* Fix
* reproduce the bug
* Fix concurrency bug reported at #755 .
Also make test_shared_mem_store.py more deterministic.
* Update test_shared_mem_store.py
* Update dmlc/core
* networkx >= 2.4 will break our examples
* Update tutorials/requirements
* fix selfloop edges
* upd version
2019-10-29 23:34:31 -04:00
ff9f67ee0d
Send any shape of tensor rather than matrix ( #942 )
2019-10-21 17:27:03 +08:00
9737b2700f
[Model][Hetero] GCMC using new hetero APIs ( #860 )
...
* init
* rm data
* README
* fix rating values that are not decimal
* rm stale codes
* small fix
* upd
* rewrite decoder
* fix many
* many fix; performance matched
* upd; handle sparse input
* upd
* address comments
* more docstring; download data automatically
* shared param mode
2019-09-26 17:50:38 -04:00
7782276962
[KVStore] Distributed kvstore ( #851 )
...
* update
* speedup
* add some comments
2019-09-11 14:54:50 +08:00
6a4b5ae98a
[Feature] Edge softmax on a subset of edges in the graph. ( #842 )
...
* upd
* add test
* fix
* upd
* merge
* hotfix
* upd
* fix
2019-09-09 13:44:56 +08:00
e17add5602
[NN] Add MXNet impl for TAGCN module. ( #799 )
...
* upd
* fig edgebatch edges
* add test
* trigger
* Update README.md for pytorch PinSage example.
Add noting that the PinSage model example under
example/pytorch/recommendation only work with Python 3.6+
as its dataset loader depends on stanfordnlp package
which work only with Python 3.6+.
* Provid a frame agnostic API to test nn modules on both CPU and CUDA side.
1. make dgl.nn.xxx frame agnostic
2. make test.backend include dgl.nn modules
3. modify test_edge_softmax of test/mxnet/test_nn.py and
test/pytorch/test_nn.py work on both CPU and GPU
* Fix style
* Delete unused code
* Make agnostic test only related to tests/backend
1. clear all agnostic related code in dgl.nn
2. make test_graph_conv agnostic to cpu/gpu
* Fix code style
* fix
* doc
* Make all test code under tests.mxnet/pytorch.test_nn.py
work on both CPU and GPU.
* Fix syntex
* Remove rand
* Add TAGCN nn.module and example
* Now tagcn can run on CPU.
* Add unitest for TGConv
* Fix style
* For pubmed dataset, using --lr=0.005 can achieve better acc
* Fix style
* Fix some descriptions
* trigger
* Fix doc
* Add nn.TGConv and example
* Fix bug
* Update data in mxnet.tagcn test acc.
* Fix some comments and code
* delete useless code
* Fix namming
* Fix bug
* Fix bug
* Add test code for mxnet TAGCov
* Update some docs
* Fix some code
* Update docs dgl.nn.mxnet
* Update weight init
* Fix
2019-08-28 13:19:17 +08:00
9314aabd1f
[Refactor] Interface of nn modules ( #798 )
...
* refactor
* upd mpnn
2019-08-27 22:29:25 +08:00
708765f0a1
[NN] RGCN modules ( #744 )
...
* rgcn module
* support id input
* WIP: model codes
* use faster index select
* dropout
* self loop
* WIP: link prediction
* fix lint
* WIP: docs
* docstring
* docstring
* merge two child classes
* mxnet rgcn module
* fix lint
* fix lint
* fix rename bug
* add uniform edge sampler
* fix fn name
* docstring
* fix mxnet rgcn module
* fix mx rgcn
* enable test on cuda
2019-08-23 16:38:48 -04:00
0f12763725
[Model] Early stop GAT ( #750 )
...
* Add early stop
* add mxnet version
* Poke ci
2019-08-21 14:58:56 +08:00
94ecb8eb96
[BUGFIX] copy graph index to shared memory. ( #634 )
...
* copy graph index to shared memory.
* fix.
* fix.
* fix.
* use a diff name for in-csr and out-csr.
* fix lint.
* remove print.
* add test.
* add comments.
2019-06-12 01:32:25 -07:00
411bcd7e6c
[BUGFIX] extand DGLGraph graph_data. ( #632 )
...
* enable tutorial test in CI.
* extand DGLGraph graph_data.
* update doc.
* Revert "enable tutorial test in CI."
This reverts commit cd774067180922bb6ae979bde4aecbffc61c8147.
* accept DGLGraph in graph store.
2019-06-09 17:22:04 -07:00
fc7775a20f
Define node/edge Ids in NodeFlow more clearly ( #628 )
...
* add tests.
* distinguish layer-local nid and nodeflow nid.
* use numpy assert_array_equal and assert_allclose
* fix map_from_parent_nid
* fix test
* fix test.
* renmae remap.
* update doc.
* update doc.
* update doc.
* fix test.
* fix test.
2019-06-09 12:10:07 -07:00
dec8b49b5d
[Examples] Run all the examples ( #623 )
...
* all pytorch examples
* scan through mxnet examples
* change reddit data
* tweak numerical range for unittest
* fix ci
* fix ci
* fix
* add seed to workaround
2019-06-09 00:26:13 -04:00
74e13eea61
[Model] Update GAT model code ( #622 )
...
* fix gat code to use latest edge softmax module
* avoid transpose
* update README
* use edge_softmax op
* mxnet edge softmax op
* mxnet gat
* update README
* fix unittest
* fix ci
* fix mxnet nn test; relax criteria for prod reducer
2019-06-08 21:41:38 -04:00
01a4cc5b7b
[Graph] Add API to convert graph to simple graph ( #587 )
...
* to simple
* WIP: multigraph flag
* graph index refactor; pass basic testing
* graph index refactor; pass basic testing
* fix bug in to_simple; pass torch test
* fix mx utest
* fix example
* fix lint
* fix ci
* poke ci
* poke ci
* WIP
* poke ci
* poke ci
* poke ci
* change ci workspace
* poke ci
* poke ci
* poke ci
* poke ci
* delete ci
* use enum for multigraph flag
2019-06-01 23:32:46 -04:00
e0ce190dfe
[Doc] Update README.MD of demo for distributed sampler ( #579 )
...
* Update README.md for the demo of distributed sampler
* Update README.MD of demo for distributed sampler
2019-05-30 01:24:13 -04:00
e0004f7199
[Doc] sampler readme update. ( #581 )
2019-05-29 23:47:57 -04:00
08d4900fd1
Update README.md for the demo of distributed sampler ( #577 )
2019-05-28 17:24:33 +08:00
9aa5ffcab1
[DEMO] Update demo of distributed sampler ( #564 )
...
* update
* update
* update demo
2019-05-26 12:10:53 +08:00
8f378d90ad
[BUGFIX] fix bugs for running GCN on giant graphs. ( #561 )
...
* load mxnet csr.
* enable load large csr.
* fix
* fix.
* fix int overflow.
* fix test.
2019-05-25 11:09:33 -07:00
924efc6520
[Perf] Improve performance of graph store. ( #554 )
...
* fix.
* use inplace.
* move to shared memory graph store.
* fix.
* add more unit tests.
* fix.
* fix test.
* fix test.
* disable test.
* fix.
2019-05-23 12:23:31 -07:00
49c4a9e4cc
[DEMO] Remove duplicate code for sampling ( #557 )
...
* update
* update
* re-use single-machine code
* update
* use relative path
* update
* update
* update
* add __init__.py
* add __init__.py
* import sys, os
* fix typo
* update
2019-05-23 16:57:35 +08:00
28379f927f
[DEMO] Reproduce numbers of distributed training in AMLC giant graph paper ( #556 )
...
* update
* update
* update
* update num_hops
* fix bug
* update
* report numbers of distributed training in AMLC giant graph paper
2019-05-23 14:23:14 +08:00
f99725adbc
all demo use python-3 ( #555 )
2019-05-23 10:38:05 +08:00
b2b8be25bb
[API] update graph store API. ( #549 )
...
* add init_ndata and init_edata in DGLGraph.
* adjust SharedMemoryGraph API.
* print warning.
* fix comment.
* update example
* fix.
* fix examples.
* add unit tests.
* add comments.
2019-05-21 03:27:05 -07:00
cdfca992e1
[BUGFix] Improve multi-processing training ( #526 )
...
* fix.
* add comment.
* remove.
* temp fix.
* initialize for shared memory.
* fix graphsage.
* fix gcn.
* add more unit tests.
* add more tests.
* avoid creating shared-memory exclusively.
* redefine remote initializer.
* improve initializer.
* fix unit test.
* fix lint.
* fix lint.
* initialize data in the graph store server properly.
* fix test.
* fix test.
* fix test.
* small fix.
* add comments.
* cleanup server.
* test graph store with a random port.
* print.
* print to stderr.
* test1
* test2
* remove comment.
* adjust the initializer signature.
2019-05-20 14:23:19 -07:00
3a1392e641
[Model] add multiprocessing training with sampling. ( #484 )
...
* reorganize sampling code.
* add multi-process training.
* speed up gcn_cv
* fix graphsage_cv.
* add new API in graph store.
* update barrier impl.
* support both local and distributed training.
* fix multiprocess train.
* fix.
* fix barrier.
* add script for loading data.
* multiprocessing sampling.
* accel training.
* replace pull with spmv for speedup.
* nodeflow copy from parent with context.
* enable GPU.
* fix a bug in graph store.
* enable multi-GPU training.
* fix lint.
* add comments.
* rename to run_store_server.py
* fix gcn_cv.
* fix a minor bug in sampler.
* handle error better in graph store.
* improve graphsage_cv for distributed mode.
* update README.
* fix.
* update.
2019-05-06 23:51:56 -07:00
2ff8ecfbac
update test_batch_size ( #510 )
2019-04-25 13:28:36 +08:00
fe7d5e9b8b
[Sampler] Change Distributed Sampler API ( #499 )
...
* Change Distributed Sampler API
* fix lint
* fix lint
* update demo
* update
* update
* update
* update demo
* update demo
2019-04-22 09:41:47 +08:00
6124667f42
[Model] Refactor the sampling examples ( #498 )
...
* reorganize sampling code.
* speedup gcn_ns.
* speed up gcn_cv
* fix graphsage_cv.
* undo the modification.
* accel training.
* update readme.
2019-04-17 01:31:14 -07:00
b89dcce16c
[RPC] Refactoring networking APIs ( #496 )
...
* Refactoring network API
* update demo
* update
* update demo
* update demo
* add num_sender
* update
* fix lint
* fix lint
* fix lint
* update
2019-04-16 16:33:29 +08:00
688a9228a8
fix. ( #491 )
2019-04-11 15:38:35 -07:00
039a711da1
[Model] fix self-edge bug in GCN and GAT. ( #482 )
...
* Update gcn_mp.py
* Update train.py
* Update train.py
* Update train.py
* Update gat_batch.py
* Update gat_batch.py
* Update gcn_mp.py
2019-04-10 09:04:19 -04:00
4ea42e3e08
fix gcn. ( #469 )
2019-04-05 10:56:09 -07:00
da3ab84c3c
Add demo for distributed sampler ( #474 )
...
* add C++ rpc infrastructure and distributed sampler
* update
* update lint
* update lint
* update lint
* update
* update
* update
* updare
* update
* update
* update
* update serialize and unittest
* update serialize
* lint
* update
* update
* update
* update
* update
* update
* update unittest
* put Finalize() to __del__
* update unittest
* update
* delete buffer in Finalize
* update unittest
* update unittest
* update unittest
* update unittest
* update
* update
* fix small bug
* windows socket impl
* update API
* fix bug in serialize
* fix bug in serialzie
* set parent graph
* update
* update
* update
* update
* update
* update
* fix lint
* fix lint
* fix
* fix windows compilation error
* fix windows error
* change API to lower-case
* update test
* fix typo
* update
* add SamplerPool
* add SamplerPool
* update
* update test
* update
* update
* update
* update
* add example
* update
* update
* add distributed sampler demo
* add index
* update demo of distributed sampler
* fix lower-case
* print subg index
* update README.md
* update
* remove --gpu args
2019-04-03 16:09:59 -07:00
ca2a7e1ca1
[Refactor] Nodeflow, sampling, CAPI ( #430 )
...
* enable cython
* add helper function and data structure for void_p vector return
* move sampler from graph index to contrib.sampling
* WIP
* WIP
* refactor layer sampling
* pass tests
* fix lint
* fix graphsage
* remove comments
* pickle test
* fix comments
* update dev guide for cython build
2019-03-05 14:07:22 -05:00
bea07b41b3
[Sampler] fix the API of neighbor sampler. ( #407 )
...
* don't return aux_info.
* fix sampler test.
* fix sse.
* fix.
* add comment.
2019-02-28 13:45:21 -08:00
7e30382e4f
[Model][MXNet] neighbor sampling & skip connection & control variate & graphsage ( #322 )
...
* neighbor sampling draft
* val/test acc
* control variate draft
* control variate
* update
* fix new_history
* maintain aggregated history while updating new history
* preprocess the first layer, change push to pull
* update
* fix subg_degree
* nodeflow
* clear
* readme
* doc and unittest for self loop
* address comments
* rename
* update
* fix
* Update node_flow.py
* Update node_flow.py
2019-02-28 13:29:51 -08:00
565f0c88fc
[WIP] [NN] Refactor NN package ( #406 )
...
* refactor graph conv
* docs & tests
* fix lint
* fix lint
* fix lint
* fix lint script
* fix lint
* Update
* Style fix
* Fix style
* Fix style
* Fix gpu case
* Fix for gpu case
* Hotfix edgesoftmax docs
* Handle repeated features
* Add docstring
* Set default arguments
* Remove dropout from nn.conv
* Fix
* add util fn for renaming
* revert gcn_spmv.py
* mx folder
* fix wierd bug
* fix mx
* fix lint
2019-02-25 18:41:21 -05:00
f370e628cd
[Feature] add NodeFlow API ( #361 )
...
* sample layer subgraphs.
* fix.
* fix.
* add layered subgraph.
* fix lint.
* fix.
* fix tutorial.
* fix.
* remove copy_to_parent.
* add num_layers
* move sampling code to sampler.cc
* fix.
* move subgraph construction out.
* Revert "move subgraph construction out."
This reverts commit 24b3d13b0d8ed5f91847ea75a7674ee8f7d45cff.
* change to NodeFlow.
* use NodeFlow in Python.
* use NodeFlowIndex.
* add node_mapping and edge_mapping.
* remove unnecessary code in SSE tutorial.
* Revert "remove unnecessary code in SSE tutorial."
This reverts commit 093f0413d5fa2e63ca5f80c46c80a126a9fb720c.
* fix tutorial.
* move to node_flow.
* update gcn cv updater.
* import NodeFlow.
* update.
* add demo code for vanilla control variate sampler.
* update.
* update.
* add neighbor sampling.
* return flow offsets.
* update node_flow.
* add test.
* fix sampler.
* fix graph index.
* fix a bug in sampler.
* fix map_to_layer_nid and map_to_flow_eid.
* fix apply_flow.
* remove model code.
* implement flow_compute.
* fix a bug.
* reverse the csr physically.
* add mini-batch test.
* add mini batch test.
* update flow_compute.
* add prop_flows
* run on specific nodes.
* test copy
* fix a bug in creating frame in NodeFlow.
* add init gcn_cv_updater.
* fix a minor bug.
* fix gcn_cv_updater.
* fix a bug.
* fix a bug in NodeFlow.
* use new h in gcn_cv_updater.
* add layer_in_degree and layer_out_degree.
* fix gcn_cv_updater for gpu.
* temp fix in NodeFlow for diff context.
* allow enabling/disabling copy back.
* add with-updater option.
* fix a bug in computing degree.
* add with-cv option.
* rename and add comments.
* fix lint complain.
* fix lint.
* avoid assert.
* remove assert.
* fix.
* fix.
* fix.
* fix.
* fix the methods in NodeFlow.
* fix lint.
* update SSE.
* remove gcn_cv_updater.
* correct comments for the schedulers.
* update comment.
* add map_to_nodeflow_nid
* address comment.
* remove duplicated test.
* fix int.
* fix comments.
* fix lint
* fix.
* replace subgraph with NodeFlow.
* move view.
* address comments.
* fix lint.
* fix lint.
* remove static_cast.
* fix docstring.
* fix comments.
* break SampleSubgraph.
* move neighbor sampling to sampler.cc
* fix comments.
* rename.
* split neighbor_list.
* address comments.
* fix.
* remove TODO.
2019-02-19 15:49:28 -08:00
6c3dba867a
[Tutorial] Update prerequisites of README ( #380 )
...
* Update prerequisites of README
* dependencies for pytorch models
* dependencies for mxnet models
* minor
2019-02-11 22:58:17 -05:00
9cd0df7dde
[Doc] Update README in MXNet GCN. ( #373 )
...
* update readme.
* Revert "update readme."
This reverts commit cd5ea512059adadfcb22a615a2c42bba12f334a8.
* update.
2019-02-02 21:59:07 -08:00
ddc2faa547
[Bugfix] Fix gat residual bug ( #355 )
...
* fix gat residual bug
* fix the residual addition; output heads; add some shape notations;
* minor
* fix the output head average
* add requests package in requirement
2019-01-12 08:37:01 -05:00
efae0f97d8
[Model] Improve GAT models ( #348 )
...
* two better GAT implementations
* update numbers
* use version switch for spmm
* add missing dropout and output heads
2019-01-11 02:02:06 -05:00
1e50cd2eda
[Model][MXNet] MXNet Tree LSTM example ( #279 )
...
* TreeLSTM MXNet example
* hybridize
* add glove download
* usability
* Update README.md
2018-12-27 10:57:23 +08:00
896dc50e70
[Model] fix bugs in pygat and mxgat. ( #323 )
...
* mxgat
* pygat
* Update gat_batch.py
* add train
* Update gat_batch.py
* Update gat.py
* Update gat_batch.py
2018-12-23 20:45:25 -05:00
632d598c77
[Doc] Add readme to mxnet gat ( #300 )
...
* readme
* Update and rename README to README.md
* Update README.md
* Update README.md
* Update README.md
* Update README.md
* Update README.md
* Update README.md
* Update README.md
* Update README.md
2018-12-17 04:36:26 -08:00
f8811c7d3c
[BUGFIX] fix some minor problems in GAT ( #308 )
...
* fix gat.
* fix context.
2018-12-16 22:20:27 -08:00
dba36c87af
Fix some minor problems in SSE ( #309 )
...
* fix SSE.
* fix.
* fix.
2018-12-16 21:21:35 -08:00
Zihao Ye