94ecb8eb96
[BUGFIX] copy graph index to shared memory. ( #634 )
...
* copy graph index to shared memory.
* fix.
* fix.
* fix.
* use a diff name for in-csr and out-csr.
* fix lint.
* remove print.
* add test.
* add comments.
2019-06-12 01:32:25 -07:00
411bcd7e6c
[BUGFIX] extand DGLGraph graph_data. ( #632 )
...
* enable tutorial test in CI.
* extand DGLGraph graph_data.
* update doc.
* Revert "enable tutorial test in CI."
This reverts commit cd774067180922bb6ae979bde4aecbffc61c8147.
* accept DGLGraph in graph store.
2019-06-09 17:22:04 -07:00
fc7775a20f
Define node/edge Ids in NodeFlow more clearly ( #628 )
...
* add tests.
* distinguish layer-local nid and nodeflow nid.
* use numpy assert_array_equal and assert_allclose
* fix map_from_parent_nid
* fix test
* fix test.
* renmae remap.
* update doc.
* update doc.
* update doc.
* fix test.
* fix test.
2019-06-09 12:10:07 -07:00
dec8b49b5d
[Examples] Run all the examples ( #623 )
...
* all pytorch examples
* scan through mxnet examples
* change reddit data
* tweak numerical range for unittest
* fix ci
* fix ci
* fix
* add seed to workaround
2019-06-09 00:26:13 -04:00
01a4cc5b7b
[Graph] Add API to convert graph to simple graph ( #587 )
...
* to simple
* WIP: multigraph flag
* graph index refactor; pass basic testing
* graph index refactor; pass basic testing
* fix bug in to_simple; pass torch test
* fix mx utest
* fix example
* fix lint
* fix ci
* poke ci
* poke ci
* WIP
* poke ci
* poke ci
* poke ci
* change ci workspace
* poke ci
* poke ci
* poke ci
* poke ci
* delete ci
* use enum for multigraph flag
2019-06-01 23:32:46 -04:00
e0ce190dfe
[Doc] Update README.MD of demo for distributed sampler ( #579 )
...
* Update README.md for the demo of distributed sampler
* Update README.MD of demo for distributed sampler
2019-05-30 01:24:13 -04:00
e0004f7199
[Doc] sampler readme update. ( #581 )
2019-05-29 23:47:57 -04:00
08d4900fd1
Update README.md for the demo of distributed sampler ( #577 )
2019-05-28 17:24:33 +08:00
9aa5ffcab1
[DEMO] Update demo of distributed sampler ( #564 )
...
* update
* update
* update demo
2019-05-26 12:10:53 +08:00
8f378d90ad
[BUGFIX] fix bugs for running GCN on giant graphs. ( #561 )
...
* load mxnet csr.
* enable load large csr.
* fix
* fix.
* fix int overflow.
* fix test.
2019-05-25 11:09:33 -07:00
924efc6520
[Perf] Improve performance of graph store. ( #554 )
...
* fix.
* use inplace.
* move to shared memory graph store.
* fix.
* add more unit tests.
* fix.
* fix test.
* fix test.
* disable test.
* fix.
2019-05-23 12:23:31 -07:00
49c4a9e4cc
[DEMO] Remove duplicate code for sampling ( #557 )
...
* update
* update
* re-use single-machine code
* update
* use relative path
* update
* update
* update
* add __init__.py
* add __init__.py
* import sys, os
* fix typo
* update
2019-05-23 16:57:35 +08:00
28379f927f
[DEMO] Reproduce numbers of distributed training in AMLC giant graph paper ( #556 )
...
* update
* update
* update
* update num_hops
* fix bug
* update
* report numbers of distributed training in AMLC giant graph paper
2019-05-23 14:23:14 +08:00
f99725adbc
all demo use python-3 ( #555 )
2019-05-23 10:38:05 +08:00
b2b8be25bb
[API] update graph store API. ( #549 )
...
* add init_ndata and init_edata in DGLGraph.
* adjust SharedMemoryGraph API.
* print warning.
* fix comment.
* update example
* fix.
* fix examples.
* add unit tests.
* add comments.
2019-05-21 03:27:05 -07:00
cdfca992e1
[BUGFix] Improve multi-processing training ( #526 )
...
* fix.
* add comment.
* remove.
* temp fix.
* initialize for shared memory.
* fix graphsage.
* fix gcn.
* add more unit tests.
* add more tests.
* avoid creating shared-memory exclusively.
* redefine remote initializer.
* improve initializer.
* fix unit test.
* fix lint.
* fix lint.
* initialize data in the graph store server properly.
* fix test.
* fix test.
* fix test.
* small fix.
* add comments.
* cleanup server.
* test graph store with a random port.
* print.
* print to stderr.
* test1
* test2
* remove comment.
* adjust the initializer signature.
2019-05-20 14:23:19 -07:00
3a1392e641
[Model] add multiprocessing training with sampling. ( #484 )
...
* reorganize sampling code.
* add multi-process training.
* speed up gcn_cv
* fix graphsage_cv.
* add new API in graph store.
* update barrier impl.
* support both local and distributed training.
* fix multiprocess train.
* fix.
* fix barrier.
* add script for loading data.
* multiprocessing sampling.
* accel training.
* replace pull with spmv for speedup.
* nodeflow copy from parent with context.
* enable GPU.
* fix a bug in graph store.
* enable multi-GPU training.
* fix lint.
* add comments.
* rename to run_store_server.py
* fix gcn_cv.
* fix a minor bug in sampler.
* handle error better in graph store.
* improve graphsage_cv for distributed mode.
* update README.
* fix.
* update.
2019-05-06 23:51:56 -07:00
2ff8ecfbac
update test_batch_size ( #510 )
2019-04-25 13:28:36 +08:00
fe7d5e9b8b
[Sampler] Change Distributed Sampler API ( #499 )
...
* Change Distributed Sampler API
* fix lint
* fix lint
* update demo
* update
* update
* update
* update demo
* update demo
2019-04-22 09:41:47 +08:00
6124667f42
[Model] Refactor the sampling examples ( #498 )
...
* reorganize sampling code.
* speedup gcn_ns.
* speed up gcn_cv
* fix graphsage_cv.
* undo the modification.
* accel training.
* update readme.
2019-04-17 01:31:14 -07:00
b89dcce16c
[RPC] Refactoring networking APIs ( #496 )
...
* Refactoring network API
* update demo
* update
* update demo
* update demo
* add num_sender
* update
* fix lint
* fix lint
* fix lint
* update
2019-04-16 16:33:29 +08:00
da3ab84c3c
Add demo for distributed sampler ( #474 )
...
* add C++ rpc infrastructure and distributed sampler
* update
* update lint
* update lint
* update lint
* update
* update
* update
* updare
* update
* update
* update
* update serialize and unittest
* update serialize
* lint
* update
* update
* update
* update
* update
* update
* update unittest
* put Finalize() to __del__
* update unittest
* update
* delete buffer in Finalize
* update unittest
* update unittest
* update unittest
* update unittest
* update
* update
* fix small bug
* windows socket impl
* update API
* fix bug in serialize
* fix bug in serialzie
* set parent graph
* update
* update
* update
* update
* update
* update
* fix lint
* fix lint
* fix
* fix windows compilation error
* fix windows error
* change API to lower-case
* update test
* fix typo
* update
* add SamplerPool
* add SamplerPool
* update
* update test
* update
* update
* update
* update
* add example
* update
* update
* add distributed sampler demo
* add index
* update demo of distributed sampler
* fix lower-case
* print subg index
* update README.md
* update
* remove --gpu args
2019-04-03 16:09:59 -07:00
ca2a7e1ca1
[Refactor] Nodeflow, sampling, CAPI ( #430 )
...
* enable cython
* add helper function and data structure for void_p vector return
* move sampler from graph index to contrib.sampling
* WIP
* WIP
* refactor layer sampling
* pass tests
* fix lint
* fix graphsage
* remove comments
* pickle test
* fix comments
* update dev guide for cython build
2019-03-05 14:07:22 -05:00
bea07b41b3
[Sampler] fix the API of neighbor sampler. ( #407 )
...
* don't return aux_info.
* fix sampler test.
* fix sse.
* fix.
* add comment.
2019-02-28 13:45:21 -08:00
7e30382e4f
[Model][MXNet] neighbor sampling & skip connection & control variate & graphsage ( #322 )
...
* neighbor sampling draft
* val/test acc
* control variate draft
* control variate
* update
* fix new_history
* maintain aggregated history while updating new history
* preprocess the first layer, change push to pull
* update
* fix subg_degree
* nodeflow
* clear
* readme
* doc and unittest for self loop
* address comments
* rename
* update
* fix
* Update node_flow.py
* Update node_flow.py
2019-02-28 13:29:51 -08:00
Da Zheng