e17add5602
[NN] Add MXNet impl for TAGCN module. ( #799 )
...
* upd
* fig edgebatch edges
* add test
* trigger
* Update README.md for pytorch PinSage example.
Add noting that the PinSage model example under
example/pytorch/recommendation only work with Python 3.6+
as its dataset loader depends on stanfordnlp package
which work only with Python 3.6+.
* Provid a frame agnostic API to test nn modules on both CPU and CUDA side.
1. make dgl.nn.xxx frame agnostic
2. make test.backend include dgl.nn modules
3. modify test_edge_softmax of test/mxnet/test_nn.py and
test/pytorch/test_nn.py work on both CPU and GPU
* Fix style
* Delete unused code
* Make agnostic test only related to tests/backend
1. clear all agnostic related code in dgl.nn
2. make test_graph_conv agnostic to cpu/gpu
* Fix code style
* fix
* doc
* Make all test code under tests.mxnet/pytorch.test_nn.py
work on both CPU and GPU.
* Fix syntex
* Remove rand
* Add TAGCN nn.module and example
* Now tagcn can run on CPU.
* Add unitest for TGConv
* Fix style
* For pubmed dataset, using --lr=0.005 can achieve better acc
* Fix style
* Fix some descriptions
* trigger
* Fix doc
* Add nn.TGConv and example
* Fix bug
* Update data in mxnet.tagcn test acc.
* Fix some comments and code
* delete useless code
* Fix namming
* Fix bug
* Fix bug
* Add test code for mxnet TAGCov
* Update some docs
* Fix some code
* Update docs dgl.nn.mxnet
* Update weight init
* Fix
2019-08-28 13:19:17 +08:00
9314aabd1f
[Refactor] Interface of nn modules ( #798 )
...
* refactor
* upd mpnn
2019-08-27 22:29:25 +08:00
708765f0a1
[NN] RGCN modules ( #744 )
...
* rgcn module
* support id input
* WIP: model codes
* use faster index select
* dropout
* self loop
* WIP: link prediction
* fix lint
* WIP: docs
* docstring
* docstring
* merge two child classes
* mxnet rgcn module
* fix lint
* fix lint
* fix rename bug
* add uniform edge sampler
* fix fn name
* docstring
* fix mxnet rgcn module
* fix mx rgcn
* enable test on cuda
2019-08-23 16:38:48 -04:00
0f12763725
[Model] Early stop GAT ( #750 )
...
* Add early stop
* add mxnet version
* Poke ci
2019-08-21 14:58:56 +08:00
94ecb8eb96
[BUGFIX] copy graph index to shared memory. ( #634 )
...
* copy graph index to shared memory.
* fix.
* fix.
* fix.
* use a diff name for in-csr and out-csr.
* fix lint.
* remove print.
* add test.
* add comments.
2019-06-12 01:32:25 -07:00
411bcd7e6c
[BUGFIX] extand DGLGraph graph_data. ( #632 )
...
* enable tutorial test in CI.
* extand DGLGraph graph_data.
* update doc.
* Revert "enable tutorial test in CI."
This reverts commit cd774067180922bb6ae979bde4aecbffc61c8147.
* accept DGLGraph in graph store.
2019-06-09 17:22:04 -07:00
fc7775a20f
Define node/edge Ids in NodeFlow more clearly ( #628 )
...
* add tests.
* distinguish layer-local nid and nodeflow nid.
* use numpy assert_array_equal and assert_allclose
* fix map_from_parent_nid
* fix test
* fix test.
* renmae remap.
* update doc.
* update doc.
* update doc.
* fix test.
* fix test.
2019-06-09 12:10:07 -07:00
dec8b49b5d
[Examples] Run all the examples ( #623 )
...
* all pytorch examples
* scan through mxnet examples
* change reddit data
* tweak numerical range for unittest
* fix ci
* fix ci
* fix
* add seed to workaround
2019-06-09 00:26:13 -04:00
74e13eea61
[Model] Update GAT model code ( #622 )
...
* fix gat code to use latest edge softmax module
* avoid transpose
* update README
* use edge_softmax op
* mxnet edge softmax op
* mxnet gat
* update README
* fix unittest
* fix ci
* fix mxnet nn test; relax criteria for prod reducer
2019-06-08 21:41:38 -04:00
01a4cc5b7b
[Graph] Add API to convert graph to simple graph ( #587 )
...
* to simple
* WIP: multigraph flag
* graph index refactor; pass basic testing
* graph index refactor; pass basic testing
* fix bug in to_simple; pass torch test
* fix mx utest
* fix example
* fix lint
* fix ci
* poke ci
* poke ci
* WIP
* poke ci
* poke ci
* poke ci
* change ci workspace
* poke ci
* poke ci
* poke ci
* poke ci
* delete ci
* use enum for multigraph flag
2019-06-01 23:32:46 -04:00
e0ce190dfe
[Doc] Update README.MD of demo for distributed sampler ( #579 )
...
* Update README.md for the demo of distributed sampler
* Update README.MD of demo for distributed sampler
2019-05-30 01:24:13 -04:00
e0004f7199
[Doc] sampler readme update. ( #581 )
2019-05-29 23:47:57 -04:00
08d4900fd1
Update README.md for the demo of distributed sampler ( #577 )
2019-05-28 17:24:33 +08:00
9aa5ffcab1
[DEMO] Update demo of distributed sampler ( #564 )
...
* update
* update
* update demo
2019-05-26 12:10:53 +08:00
8f378d90ad
[BUGFIX] fix bugs for running GCN on giant graphs. ( #561 )
...
* load mxnet csr.
* enable load large csr.
* fix
* fix.
* fix int overflow.
* fix test.
2019-05-25 11:09:33 -07:00
924efc6520
[Perf] Improve performance of graph store. ( #554 )
...
* fix.
* use inplace.
* move to shared memory graph store.
* fix.
* add more unit tests.
* fix.
* fix test.
* fix test.
* disable test.
* fix.
2019-05-23 12:23:31 -07:00
49c4a9e4cc
[DEMO] Remove duplicate code for sampling ( #557 )
...
* update
* update
* re-use single-machine code
* update
* use relative path
* update
* update
* update
* add __init__.py
* add __init__.py
* import sys, os
* fix typo
* update
2019-05-23 16:57:35 +08:00
28379f927f
[DEMO] Reproduce numbers of distributed training in AMLC giant graph paper ( #556 )
...
* update
* update
* update
* update num_hops
* fix bug
* update
* report numbers of distributed training in AMLC giant graph paper
2019-05-23 14:23:14 +08:00
f99725adbc
all demo use python-3 ( #555 )
2019-05-23 10:38:05 +08:00
b2b8be25bb
[API] update graph store API. ( #549 )
...
* add init_ndata and init_edata in DGLGraph.
* adjust SharedMemoryGraph API.
* print warning.
* fix comment.
* update example
* fix.
* fix examples.
* add unit tests.
* add comments.
2019-05-21 03:27:05 -07:00
cdfca992e1
[BUGFix] Improve multi-processing training ( #526 )
...
* fix.
* add comment.
* remove.
* temp fix.
* initialize for shared memory.
* fix graphsage.
* fix gcn.
* add more unit tests.
* add more tests.
* avoid creating shared-memory exclusively.
* redefine remote initializer.
* improve initializer.
* fix unit test.
* fix lint.
* fix lint.
* initialize data in the graph store server properly.
* fix test.
* fix test.
* fix test.
* small fix.
* add comments.
* cleanup server.
* test graph store with a random port.
* print.
* print to stderr.
* test1
* test2
* remove comment.
* adjust the initializer signature.
2019-05-20 14:23:19 -07:00
3a1392e641
[Model] add multiprocessing training with sampling. ( #484 )
...
* reorganize sampling code.
* add multi-process training.
* speed up gcn_cv
* fix graphsage_cv.
* add new API in graph store.
* update barrier impl.
* support both local and distributed training.
* fix multiprocess train.
* fix.
* fix barrier.
* add script for loading data.
* multiprocessing sampling.
* accel training.
* replace pull with spmv for speedup.
* nodeflow copy from parent with context.
* enable GPU.
* fix a bug in graph store.
* enable multi-GPU training.
* fix lint.
* add comments.
* rename to run_store_server.py
* fix gcn_cv.
* fix a minor bug in sampler.
* handle error better in graph store.
* improve graphsage_cv for distributed mode.
* update README.
* fix.
* update.
2019-05-06 23:51:56 -07:00
2ff8ecfbac
update test_batch_size ( #510 )
2019-04-25 13:28:36 +08:00
fe7d5e9b8b
[Sampler] Change Distributed Sampler API ( #499 )
...
* Change Distributed Sampler API
* fix lint
* fix lint
* update demo
* update
* update
* update
* update demo
* update demo
2019-04-22 09:41:47 +08:00
6124667f42
[Model] Refactor the sampling examples ( #498 )
...
* reorganize sampling code.
* speedup gcn_ns.
* speed up gcn_cv
* fix graphsage_cv.
* undo the modification.
* accel training.
* update readme.
2019-04-17 01:31:14 -07:00
b89dcce16c
[RPC] Refactoring networking APIs ( #496 )
...
* Refactoring network API
* update demo
* update
* update demo
* update demo
* add num_sender
* update
* fix lint
* fix lint
* fix lint
* update
2019-04-16 16:33:29 +08:00
688a9228a8
fix. ( #491 )
2019-04-11 15:38:35 -07:00
039a711da1
[Model] fix self-edge bug in GCN and GAT. ( #482 )
...
* Update gcn_mp.py
* Update train.py
* Update train.py
* Update train.py
* Update gat_batch.py
* Update gat_batch.py
* Update gcn_mp.py
2019-04-10 09:04:19 -04:00
4ea42e3e08
fix gcn. ( #469 )
2019-04-05 10:56:09 -07:00
da3ab84c3c
Add demo for distributed sampler ( #474 )
...
* add C++ rpc infrastructure and distributed sampler
* update
* update lint
* update lint
* update lint
* update
* update
* update
* updare
* update
* update
* update
* update serialize and unittest
* update serialize
* lint
* update
* update
* update
* update
* update
* update
* update unittest
* put Finalize() to __del__
* update unittest
* update
* delete buffer in Finalize
* update unittest
* update unittest
* update unittest
* update unittest
* update
* update
* fix small bug
* windows socket impl
* update API
* fix bug in serialize
* fix bug in serialzie
* set parent graph
* update
* update
* update
* update
* update
* update
* fix lint
* fix lint
* fix
* fix windows compilation error
* fix windows error
* change API to lower-case
* update test
* fix typo
* update
* add SamplerPool
* add SamplerPool
* update
* update test
* update
* update
* update
* update
* add example
* update
* update
* add distributed sampler demo
* add index
* update demo of distributed sampler
* fix lower-case
* print subg index
* update README.md
* update
* remove --gpu args
2019-04-03 16:09:59 -07:00
ca2a7e1ca1
[Refactor] Nodeflow, sampling, CAPI ( #430 )
...
* enable cython
* add helper function and data structure for void_p vector return
* move sampler from graph index to contrib.sampling
* WIP
* WIP
* refactor layer sampling
* pass tests
* fix lint
* fix graphsage
* remove comments
* pickle test
* fix comments
* update dev guide for cython build
2019-03-05 14:07:22 -05:00
bea07b41b3
[Sampler] fix the API of neighbor sampler. ( #407 )
...
* don't return aux_info.
* fix sampler test.
* fix sse.
* fix.
* add comment.
2019-02-28 13:45:21 -08:00
7e30382e4f
[Model][MXNet] neighbor sampling & skip connection & control variate & graphsage ( #322 )
...
* neighbor sampling draft
* val/test acc
* control variate draft
* control variate
* update
* fix new_history
* maintain aggregated history while updating new history
* preprocess the first layer, change push to pull
* update
* fix subg_degree
* nodeflow
* clear
* readme
* doc and unittest for self loop
* address comments
* rename
* update
* fix
* Update node_flow.py
* Update node_flow.py
2019-02-28 13:29:51 -08:00
565f0c88fc
[WIP] [NN] Refactor NN package ( #406 )
...
* refactor graph conv
* docs & tests
* fix lint
* fix lint
* fix lint
* fix lint script
* fix lint
* Update
* Style fix
* Fix style
* Fix style
* Fix gpu case
* Fix for gpu case
* Hotfix edgesoftmax docs
* Handle repeated features
* Add docstring
* Set default arguments
* Remove dropout from nn.conv
* Fix
* add util fn for renaming
* revert gcn_spmv.py
* mx folder
* fix wierd bug
* fix mx
* fix lint
2019-02-25 18:41:21 -05:00
f370e628cd
[Feature] add NodeFlow API ( #361 )
...
* sample layer subgraphs.
* fix.
* fix.
* add layered subgraph.
* fix lint.
* fix.
* fix tutorial.
* fix.
* remove copy_to_parent.
* add num_layers
* move sampling code to sampler.cc
* fix.
* move subgraph construction out.
* Revert "move subgraph construction out."
This reverts commit 24b3d13b0d8ed5f91847ea75a7674ee8f7d45cff.
* change to NodeFlow.
* use NodeFlow in Python.
* use NodeFlowIndex.
* add node_mapping and edge_mapping.
* remove unnecessary code in SSE tutorial.
* Revert "remove unnecessary code in SSE tutorial."
This reverts commit 093f0413d5fa2e63ca5f80c46c80a126a9fb720c.
* fix tutorial.
* move to node_flow.
* update gcn cv updater.
* import NodeFlow.
* update.
* add demo code for vanilla control variate sampler.
* update.
* update.
* add neighbor sampling.
* return flow offsets.
* update node_flow.
* add test.
* fix sampler.
* fix graph index.
* fix a bug in sampler.
* fix map_to_layer_nid and map_to_flow_eid.
* fix apply_flow.
* remove model code.
* implement flow_compute.
* fix a bug.
* reverse the csr physically.
* add mini-batch test.
* add mini batch test.
* update flow_compute.
* add prop_flows
* run on specific nodes.
* test copy
* fix a bug in creating frame in NodeFlow.
* add init gcn_cv_updater.
* fix a minor bug.
* fix gcn_cv_updater.
* fix a bug.
* fix a bug in NodeFlow.
* use new h in gcn_cv_updater.
* add layer_in_degree and layer_out_degree.
* fix gcn_cv_updater for gpu.
* temp fix in NodeFlow for diff context.
* allow enabling/disabling copy back.
* add with-updater option.
* fix a bug in computing degree.
* add with-cv option.
* rename and add comments.
* fix lint complain.
* fix lint.
* avoid assert.
* remove assert.
* fix.
* fix.
* fix.
* fix.
* fix the methods in NodeFlow.
* fix lint.
* update SSE.
* remove gcn_cv_updater.
* correct comments for the schedulers.
* update comment.
* add map_to_nodeflow_nid
* address comment.
* remove duplicated test.
* fix int.
* fix comments.
* fix lint
* fix.
* replace subgraph with NodeFlow.
* move view.
* address comments.
* fix lint.
* fix lint.
* remove static_cast.
* fix docstring.
* fix comments.
* break SampleSubgraph.
* move neighbor sampling to sampler.cc
* fix comments.
* rename.
* split neighbor_list.
* address comments.
* fix.
* remove TODO.
2019-02-19 15:49:28 -08:00
6c3dba867a
[Tutorial] Update prerequisites of README ( #380 )
...
* Update prerequisites of README
* dependencies for pytorch models
* dependencies for mxnet models
* minor
2019-02-11 22:58:17 -05:00
9cd0df7dde
[Doc] Update README in MXNet GCN. ( #373 )
...
* update readme.
* Revert "update readme."
This reverts commit cd5ea512059adadfcb22a615a2c42bba12f334a8.
* update.
2019-02-02 21:59:07 -08:00
ddc2faa547
[Bugfix] Fix gat residual bug ( #355 )
...
* fix gat residual bug
* fix the residual addition; output heads; add some shape notations;
* minor
* fix the output head average
* add requests package in requirement
2019-01-12 08:37:01 -05:00
efae0f97d8
[Model] Improve GAT models ( #348 )
...
* two better GAT implementations
* update numbers
* use version switch for spmm
* add missing dropout and output heads
2019-01-11 02:02:06 -05:00
1e50cd2eda
[Model][MXNet] MXNet Tree LSTM example ( #279 )
...
* TreeLSTM MXNet example
* hybridize
* add glove download
* usability
* Update README.md
2018-12-27 10:57:23 +08:00
896dc50e70
[Model] fix bugs in pygat and mxgat. ( #323 )
...
* mxgat
* pygat
* Update gat_batch.py
* add train
* Update gat_batch.py
* Update gat.py
* Update gat_batch.py
2018-12-23 20:45:25 -05:00
632d598c77
[Doc] Add readme to mxnet gat ( #300 )
...
* readme
* Update and rename README to README.md
* Update README.md
* Update README.md
* Update README.md
* Update README.md
* Update README.md
* Update README.md
* Update README.md
* Update README.md
2018-12-17 04:36:26 -08:00
f8811c7d3c
[BUGFIX] fix some minor problems in GAT ( #308 )
...
* fix gat.
* fix context.
2018-12-16 22:20:27 -08:00
dba36c87af
Fix some minor problems in SSE ( #309 )
...
* fix SSE.
* fix.
* fix.
2018-12-16 21:21:35 -08:00
f35ac5443e
[Graph][Model] Cache adj & inc; MX GCN ( #307 )
...
* add cache to adj and incmat
* Fix bug in cached adj/inc
* mx gcn spmv runnable; acc debugging...
* fix bug in mx gcn that loss is not correctly calculated
* fix mx utest
* fix as requested
* use raw parameter tensors rather than dense layer
* fix dropout
* Add numbers in readme
2018-12-16 22:51:01 -05:00
cffa4034f5
[Model] fix GCN ( #305 )
...
* mxnet gcn spmv
* update readme
* fix gcn
* pytorch gcn
* update readme
2018-12-16 12:44:41 -05:00
ac660f45ef
[Doc] Readme ( #265 )
...
* [Doc] updated readme
* contribution guide change
* small edits
* add perf #
* Update README.md
* Update README.md
* add others...
* rewrite scalability
* model & code links
* some note for treelstm
* rewrite scalability
2018-12-06 00:31:04 -05:00
f4a9a455f5
[Doc] Fix hyperlink in tutorial of tutorals ( #260 )
...
* fix all code tutorial links and typos in texts
* sse readme format
* fix
* sse paper link
* gat readme
* fix
2018-12-05 15:04:27 -05:00
e557ed89ff
[Doc][Model] example folder doc and model summary ( #259 )
...
* update example readme
* mx example readme
* add results in readme
* mx rgcn readme
2018-12-05 14:35:14 -05:00
2c5b48ab60
[Model][MXNet] RGCN Entity Classification ( #246 )
...
* entity classify work for examples
* add loop_msg
* remove wrong assert
* remove one reshape
* add readme
* add MRR
* remove mrr from entity task
2018-12-05 10:27:59 -08:00
xiang song(charlie.song)