ca2a7e1ca1
[Refactor] Nodeflow, sampling, CAPI ( #430 )
...
* enable cython
* add helper function and data structure for void_p vector return
* move sampler from graph index to contrib.sampling
* WIP
* WIP
* refactor layer sampling
* pass tests
* fix lint
* fix graphsage
* remove comments
* pickle test
* fix comments
* update dev guide for cython build
2019-03-05 14:07:22 -05:00
d3c24cc25b
[BugFix] Fix bug in RGCN data processing and use index_select to improve speed ( #429 )
...
* use index_select instead of __getitem__
* fix bug in dataset processing
* fix edge_type shape bug
* comments
2019-03-04 10:52:21 -05:00
fb4246e564
[Feature]Uniform layer-wise sampler ( #416 )
...
* migrate to node-flow
* uniform layer sampler test cases
* more test cases
* documentations
* fix lint errors
* fix lint errors
* fix lint errors
* iota
* add asnumpy
* requested changes
* fix indptr error
* fix lint errors
* requested changes & fix lint errors
* fix lint errors
* fix LayerSampler unit test
2019-03-02 16:37:18 -08:00
a88f351174
[Doc] update doc string ( #426 )
2019-03-02 14:00:52 -05:00
bea07b41b3
[Sampler] fix the API of neighbor sampler. ( #407 )
...
* don't return aux_info.
* fix sampler test.
* fix sse.
* fix.
* add comment.
2019-02-28 13:45:21 -08:00
7e30382e4f
[Model][MXNet] neighbor sampling & skip connection & control variate & graphsage ( #322 )
...
* neighbor sampling draft
* val/test acc
* control variate draft
* control variate
* update
* fix new_history
* maintain aggregated history while updating new history
* preprocess the first layer, change push to pull
* update
* fix subg_degree
* nodeflow
* clear
* readme
* doc and unittest for self loop
* address comments
* rename
* update
* fix
* Update node_flow.py
* Update node_flow.py
2019-02-28 13:29:51 -08:00
2e1cbd5d68
[Feature] Random walk traces generation ( #392 )
...
* random walk traces generation
* remove outdated comments
* oops put in the wrong place
* explicit inline
* moving rand_r to util
* moving random walk to public function
* per-thread seed and openmp support
* type cast styles
2019-02-20 10:41:59 -05:00
f370e628cd
[Feature] add NodeFlow API ( #361 )
...
* sample layer subgraphs.
* fix.
* fix.
* add layered subgraph.
* fix lint.
* fix.
* fix tutorial.
* fix.
* remove copy_to_parent.
* add num_layers
* move sampling code to sampler.cc
* fix.
* move subgraph construction out.
* Revert "move subgraph construction out."
This reverts commit 24b3d13b0d8ed5f91847ea75a7674ee8f7d45cff.
* change to NodeFlow.
* use NodeFlow in Python.
* use NodeFlowIndex.
* add node_mapping and edge_mapping.
* remove unnecessary code in SSE tutorial.
* Revert "remove unnecessary code in SSE tutorial."
This reverts commit 093f0413d5fa2e63ca5f80c46c80a126a9fb720c.
* fix tutorial.
* move to node_flow.
* update gcn cv updater.
* import NodeFlow.
* update.
* add demo code for vanilla control variate sampler.
* update.
* update.
* add neighbor sampling.
* return flow offsets.
* update node_flow.
* add test.
* fix sampler.
* fix graph index.
* fix a bug in sampler.
* fix map_to_layer_nid and map_to_flow_eid.
* fix apply_flow.
* remove model code.
* implement flow_compute.
* fix a bug.
* reverse the csr physically.
* add mini-batch test.
* add mini batch test.
* update flow_compute.
* add prop_flows
* run on specific nodes.
* test copy
* fix a bug in creating frame in NodeFlow.
* add init gcn_cv_updater.
* fix a minor bug.
* fix gcn_cv_updater.
* fix a bug.
* fix a bug in NodeFlow.
* use new h in gcn_cv_updater.
* add layer_in_degree and layer_out_degree.
* fix gcn_cv_updater for gpu.
* temp fix in NodeFlow for diff context.
* allow enabling/disabling copy back.
* add with-updater option.
* fix a bug in computing degree.
* add with-cv option.
* rename and add comments.
* fix lint complain.
* fix lint.
* avoid assert.
* remove assert.
* fix.
* fix.
* fix.
* fix.
* fix the methods in NodeFlow.
* fix lint.
* update SSE.
* remove gcn_cv_updater.
* correct comments for the schedulers.
* update comment.
* add map_to_nodeflow_nid
* address comment.
* remove duplicated test.
* fix int.
* fix comments.
* fix lint
* fix.
* replace subgraph with NodeFlow.
* move view.
* address comments.
* fix lint.
* fix lint.
* remove static_cast.
* fix docstring.
* fix comments.
* break SampleSubgraph.
* move neighbor sampling to sampler.cc
* fix comments.
* rename.
* split neighbor_list.
* address comments.
* fix.
* remove TODO.
2019-02-19 15:49:28 -08:00
929742b588
[Feature] Reimplement Immutable graph index in DGL ( #342 )
...
* init.
* it's compiled.
* add immutable graph constructor.
* add immutable graph API.
* fix.
* impl get adjacency matrix.
* fix.
* fix graph_index from scipy matrix.
* add neighbor sampling.
* remap vertex ids.
* fix.
* move sampler test.
* fix tests.
* add comments
* remove mxnet-specific immutable graph.
* fix.
* fix lint.
* fix.
* try to fix windows compile error.
* fix.
* fix.
* add test.
* unify Graph and ImmutableGraph.
* fix bugs.
* fix compile.
* move immutable graph.
* fix.
* remove print.
* fix lint.
* fix
* fix lint.
* fix lint.
* fix test.
* fix comments.
* merge GraphIndex and ImmutableGraphIndex.
* temp fix.
* impl GetAdj.
* fix lint
* fix.
* fix.
* fix.
* fix.
* fix.
* use csr only for readonly graph.
* Revert "use csr only for readonly graph."
This reverts commit 8e24bb033af8504531b22849de5b7567b168e0d5.
* remove code.
* fix.
* fix.
* fix.
* fix.
* fix.
* fix.
* address comments.
* fix for comments.
* fix comments.
* revert.
* move test_graph_index to compute.
* fix.
* fix.
* impl GetAdj for coo.
* fix.
* fix tests.
* address comments.
* address comments.
* fix comment.
* address comments.
* use lambda.
* other comments.
* address comments.
* modify the semantics of edges.
* fix order.
* use DGLIdIter
* fix.
* remove NotImplemented.
* revert some code.
2019-01-17 09:59:53 +08:00
707334ce85
minor spelling tweaks ( #349 )
...
* minor spelling tweaks
* Update CONTRIBUTORS.md
2019-01-10 12:02:31 -05:00
30107407fd
add prefetcher for neighbor sampler ( #298 )
2018-12-15 19:14:17 -08:00
0cbe521b99
[Doc] Fix document building for multiple tensor backends ( #301 )
...
* remove loading backend in sse
* build mxnet in a second run
* a third run to fix everything
* fix docstring in sampler
* fix docstring in transformer
* README for doc build
* some reordering and printing
* use filename_pattern instead of ignore_pattern to reduce warning at the cost of redundant work...
* add env var to use mxnet in Jenkinsfile
* remove step 3, it's already fixed by previous commit
2018-12-12 11:07:46 -05:00
18ed7868fe
[Doc] update neighbor sampler doc. ( #287 )
2018-12-11 12:48:22 -05:00
cd907cddfa
[Tutorial] Add sse tutorial & MXNet Tutorial CI ( #252 )
...
* add sse tutorial
* add mxnet tutorial ci
* fix ci
* fix ci
* fix ci
* fix ci
* fix ci
* fix ci
* Fix ci
* Fix ci
* Fix ci
* fix ci
* fix ci
* fix ci
* fix ci
* fix ci
* fix ci
* Fix CI
Fix CI image
* permission fix
* fix a bug in the code.
* small fix
* fix doc
* fix ci
* shorten the iters
* fix
* remove extra file
* add load_backend api to dynamically switch to another backend
* try fix
* fix tutorial
* fix tutorial
* fix bug in tutorial
2018-12-05 16:21:44 -05:00
7c7cc7e0c2
[sampler] Adjust the sampler API for the future extension. ( #243 )
...
* return seed ids.
* fix tests.
* implement.
2018-12-05 10:05:10 -08:00
274e1082f5
[Doc] API doc string for many components ( #245 )
...
* builtin function docstring
* init docstring
* view docstring
* add init to index and fix
* node /edge feature
* Example -> Examples
* fix func hyperlink
* traversal
* fix
* from/to_networkx docstring
* minor
* fix duplicate label
* comment about tensor framework
* from scipy sparse matrix
* fix format errors
2018-12-04 17:52:00 -05:00
a5a35d1f7a
[Sampler] improve random shuffle performance in sampler ( #228 )
...
* fix.
* make it generic.
* add the API.
* fix.
* remove mxnet.
2018-12-04 09:24:32 -08:00
5680f8dc13
[DOC] Documentation strings for graph mutation, queries, and subgraphing ( #207 )
...
* docstrings for graph mutation & queries
* [Doc] contrib.sampler. (#200 )
* subgraph docs
* updates
2018-12-02 14:41:25 -05:00
57b07fce92
[Model] Accelerate SSE ( #172 )
...
* lazy eval edge ids.
* parallelize node id lookup.
* fix a bug.
* use mxnet for index.
* use update_all in the subgraph training.
* sample neighbors.
* Revert "parallelize node id lookup."
This reverts commit e661f69bb06cb5a7c246f0e106f245e27800e220.
* update README.
* cache subgraphs.
* support all degrees.
* cache adj in CPU.
* fix a bug in sse.
* print.
* raise error on mutable graphs.
* measure train time per epoch.
* fix a bug in graph_index.
* remove readonly in DGLSubGraph.
* cache subgraph properly.
* accelerate getting adjacency.
* split infer.
* lazy eval edges.
* specify inference mode.
* update for new sampler.
* use new mxnet sampling api.
* fix indent.
* remove profiling code.
* remove mxnet from sampler.
* return a lambda function for graph edges.
* add docs for immutable subgraph.
* Revert "return a lambda function for graph edges."
This reverts commit 0de5d7f100e230c518a3fb8976a6227f474d09ee.
* get parent_eid.
2018-12-02 12:43:25 -05:00
5278220f85
update s3 links ( #215 )
2018-12-02 20:48:29 +08:00
0f121eeb76
[Doc] RGCN tutorial ( #206 )
...
* rgcn tutorial
* data processing for rgcn
* many fix
* requirements for rgcn tutorial
* fix comments
* description of rgcn dataset
* author
* bug fix
* move all dataset to s3
2018-12-01 14:58:13 -05:00
2389df8155
[API] Subgraph sampling API. ( #138 )
...
* add neighbor sampler.
* fix sampler.
* handle non-existing nodes differently in MapParentIdToSubgraphId.
* fix sampling tests.
* parallelize sampling.
* add more tests.
* fix a bug in subgraph loader.
* get number of sampled nodes directly.
* load mxnet CSR to DGLGraph directly.
* create graph from mxnet csr array directly.
* use subgraph loader in SSE.
* fix a bug in sampling.
* output framework tensor.
* fix.
* remove unnecessary code.
* fix tests.
* add SSE README.
* move to contrib.
* address comments.
* add tests.
2018-11-14 13:51:27 -08:00
Minjie Wang