b89dcce16c
[RPC] Refactoring networking APIs ( #496 )
...
* Refactoring network API
* update demo
* update
* update demo
* update demo
* add num_sender
* update
* fix lint
* fix lint
* fix lint
* update
2019-04-16 16:33:29 +08:00
c69dbbb736
[Bug Fix] Fix TUDataset Processing bug ( #489 )
...
* add graph classification dataset
* add node label
* add TUDataset
* Modify to consistent with Qi Huang's implementation
* add docs
* Add docs
* Fix change of environment variable
* Update tu.py
* Update tu.py
* Fix error when add node with np.int64
* Fix processing bug
2019-04-11 19:30:50 +08:00
00fc680aae
[Dataset] Add TUDataset ( #473 )
...
* add graph classification dataset
* add node label
* add TUDataset
* Modify to consistent with Qi Huang's implementation
* add docs
* Add docs
* Fix change of environment variable
* Update tu.py
* Update tu.py
* Fix error when add node with np.int64
2019-04-10 09:37:53 -04:00
bfdd1eaa44
[Feature] Create shared memory graph store. ( #468 )
...
* accelerate gcn_ns.
* add timing.
* run infer with whole graph.
* distributed gcn_ns.
* reconstruct gcn_ns.
* minor fix.
* change graphsage_cv for numa.
* fix #OMP threads.
* accelerate graphsage_cv.
* fix a weird bug.
* add profiler in graphsage_cv.
* accelerate graphsage_cv.
manually aggregate neighbors' embeddings with pull.
* load csr directly in gcn_ns_sc.
* parallel sort for graph index.
* Revert "parallel sort for graph index."
This reverts commit 86fe2c7117fe5e56b0d481b39849c258b166945b.
* run gcn_ns_sc on GPUs.
* acc gcn_cv_sc.
* change gcn_cv for numa.
* fix gcn_cv to use numa and gpu.
* improve graphsage_cv to use numa and gpu.
* improve gcn_ns.
* improve graphsage_cv.
* init shared memory graph store.
* fix.
* enable init ndata.
* improve tests.
* add bidirectional communication.
* link to rt.
* fix compilation error.
* fix shared memory init.
* use MessageQueue for inter-process communication.
* reconstruct immutable graph csr.
* fix gcn.
* load csr to shared memory.
* fix minor bugs.
* add comments.
* refactor SharedMemory.
* fix bugs in ImmutableGraph.
* create CSR graph from shared memory.
* add more test for loading a csr graph.
* terminate graph store properly.
* allow initializing ndata in the graph store server.
* use RPC for inter-process communication.
* a script for loading a graph.
* allow customizing port.
* list all ndata and edata.
* support dtype.
* reorganize SharedMemoryGraphStore.
* fix ndata shape.
* reconstruct gcn_ns.
* print info.
* set omp in gcn_ns.
* reset sampling examples.
* fix lint.
* fix lint.
* reset gcn.
* disable shared memory in windows.
* fix.
* fix.
* reset changes.
* revert nodeflow changes.
* fix cmake.
* fix test.
* fix test.
* fix test.
* fix test.
* add comments.
* fix test.
* move vector out.
* fix lint.
* fix lint.
* move SharedMemory.
* update cmake.
* update comment.
* fix comments.
* Revert "update cmake."
This reverts commit 592445e37077f70a6e3f2e5245f9a3d086b04f3b.
* update cmake.
* add comments.
* rename.
* change the comment.
* fix a bug.
* rename.
* add comments.
* add comments.
* add init_edata.
* rewrite memory alloc.
* move vector to CSR.
* fix.
* init data.
* Revert "init data."
This reverts commit 2b217b9553911b7dd84a9f1d9b68430b5aa18e23.
* init data.
* init new columns correctly.
2019-04-08 12:09:02 -07:00
8058f1c579
[Fix] Update inner API of distributed sampler ( #478 )
...
* update inner API of distributed sampler
* update
2019-04-05 10:00:36 +08:00
da3ab84c3c
Add demo for distributed sampler ( #474 )
...
* add C++ rpc infrastructure and distributed sampler
* update
* update lint
* update lint
* update lint
* update
* update
* update
* updare
* update
* update
* update
* update serialize and unittest
* update serialize
* lint
* update
* update
* update
* update
* update
* update
* update unittest
* put Finalize() to __del__
* update unittest
* update
* delete buffer in Finalize
* update unittest
* update unittest
* update unittest
* update unittest
* update
* update
* fix small bug
* windows socket impl
* update API
* fix bug in serialize
* fix bug in serialzie
* set parent graph
* update
* update
* update
* update
* update
* update
* fix lint
* fix lint
* fix
* fix windows compilation error
* fix windows error
* change API to lower-case
* update test
* fix typo
* update
* add SamplerPool
* add SamplerPool
* update
* update test
* update
* update
* update
* update
* add example
* update
* update
* add distributed sampler demo
* add index
* update demo of distributed sampler
* fix lower-case
* print subg index
* update README.md
* update
* remove --gpu args
2019-04-03 16:09:59 -07:00
5d494c6207
[RPC] add C++ RPC infrastructure and distributed sampler ( #465 )
...
* add C++ rpc infrastructure and distributed sampler
* update
* update lint
* update lint
* update lint
* update
* update
* update
* updare
* update
* update
* update
* update serialize and unittest
* update serialize
* lint
* update
* update
* update
* update
* update
* update
* update unittest
* put Finalize() to __del__
* update unittest
* update
* delete buffer in Finalize
* update unittest
* update unittest
* update unittest
* update unittest
* update
* update
* fix small bug
* windows socket impl
* update API
* fix bug in serialize
* fix bug in serialzie
* set parent graph
* update
* update
* update
* update
* update
* update
* fix lint
* fix lint
* fix
* fix windows compilation error
* fix windows error
* change API to lower-case
* update test
* fix typo
* update
* add SamplerPool
* add SamplerPool
* update
* update test
* update
* update
* update
* update
* add example
* update
* update
2019-03-29 16:48:45 +08:00
6066fee935
[Model][Feature] PinSage & Random Walk with Restart ( #453 )
...
* random walk traces generation
* remove outdated comments
* oops put in the wrong place
* explicit inline
* moving rand_r to util
* pinsage-like model on movielens
* the code runs now
* support cuda
* using readonly graph
* moving random walk to public function
* per-thread seed and openmp support
* pinsage-like model on movielens
* the code runs now
* support cuda
* using readonly graph
* using C random walk
* removing profile decorators
* param initialization
* no grad
* leaky relu fixes everything
* train and save
* WIP
* WIP
* WIP
* seems to work
* evaluation output
* swapping order of val/test and train
* debug
* hyperparam tuning
* prior/training dataset split changes
* random walk reorg
* random walk with restart
* signed comparison fix
* migrating random walk to nodeflow
* Revert "migrating random walk to nodeflow"
This reverts commit f2565347cced7c912a58a529b257c033d9f375b7.
* add README and remove dataset
* new endpoint
* lint
* lint x2
* oops forgot test
* including bpr - better for baseline
* addressing fixes
* throwing random walks out from SamplerOp class
* forgot to move RandomWalk; why did this even work?
* removing legacy garbage
* add todo
* address comments
* stupid bug fix
* call ndarrayvector converter to handle traces
2019-03-29 13:01:18 +08:00
341dbea0a1
[Bug] Fix unused prefetch switch for NeighborSampler and LayerSampler ( #457 )
...
* forgot prefetch switch
* yet another stupid bug
2019-03-19 14:57:10 +08:00
33b9c38389
[Bugfix] fix bug in pickling ( #456 )
...
* fix bug in pickling
* fix lint
2019-03-18 23:48:20 -04:00
6f603bbf8f
[BugFix] Fix performance bug in EdgeSoftmax ( #452 )
...
* fix performance bug in EdgeSoftmax
* minor
2019-03-18 16:22:38 -04:00
681e5217dd
[Refactor] Sampler code refactor ( #454 )
...
* refactored sampler code
* docstring
* fix tutorial
2019-03-18 10:41:35 -04:00
eb1acecd0d
[BugFix] Handle case when calling send with builtin message function ( #449 )
...
* fix send with builtin bug
* test cases
* remove todo comment
2019-03-13 14:49:50 -04:00
d1d580ecc1
[feature & bugfix] adjacency_matrix_scipy, wrong order of edges in immutable graph. ( #437 )
...
* fix rgcn tutorial
* small fix
* upd
* findedge/s
* upd
* upd
* upd
* upd
* add test
* remove redundancy
* upd
* upd
* upd
* upd
* add edge_subgraph
* explicit cast
* add test immutable subg
* reformat
* reformat
* fix bug
* upd
* hotfix
* subgraph docs
* fix adj mat
* fix edges() order
* add test
* revert
* upd
* fix
* upd
2019-03-12 23:57:13 -04:00
13272628b5
[Doc] added index [0] to torch.max ( #443 )
2019-03-08 18:29:16 -05:00
2ade0ef96d
[Hotfix] fix cython bug ( #442 )
...
* fix cython bug
* fix
* fix
2019-03-08 17:07:17 -05:00
cd4f0a2bfc
[Release] update version ( #440 )
...
* update version
* update news
2019-03-08 11:12:16 -05:00
8651be54c2
[Perf] Accelerate block_compute when all nodes are invoked. ( #434 )
...
* refactor.
* accelerate update_all in nodeflow.
* fix.
* refactor.
* fix lint.
* fix lint.
* reorganize.
* reorg.
* remove.
* add doc.
* impl block_incidence_matrix
* fix lint.
* fix.
* simple fix.
* fix test.
* fix interface.
* fix eid.
* fix comments.
2019-03-07 13:39:39 -08:00
ca2a7e1ca1
[Refactor] Nodeflow, sampling, CAPI ( #430 )
...
* enable cython
* add helper function and data structure for void_p vector return
* move sampler from graph index to contrib.sampling
* WIP
* WIP
* refactor layer sampling
* pass tests
* fix lint
* fix graphsage
* remove comments
* pickle test
* fix comments
* update dev guide for cython build
2019-03-05 14:07:22 -05:00
d3c24cc25b
[BugFix] Fix bug in RGCN data processing and use index_select to improve speed ( #429 )
...
* use index_select instead of __getitem__
* fix bug in dataset processing
* fix edge_type shape bug
* comments
2019-03-04 10:52:21 -05:00
fb4246e564
[Feature]Uniform layer-wise sampler ( #416 )
...
* migrate to node-flow
* uniform layer sampler test cases
* more test cases
* documentations
* fix lint errors
* fix lint errors
* fix lint errors
* iota
* add asnumpy
* requested changes
* fix indptr error
* fix lint errors
* requested changes & fix lint errors
* fix lint errors
* fix LayerSampler unit test
2019-03-02 16:37:18 -08:00
a88f351174
[Doc] update doc string ( #426 )
2019-03-02 14:00:52 -05:00
3cc32a9775
[Feature] Reduce messages with scatter_add in PyTorch ( #427 )
...
* implement pytorch spmm with gather and scatter add
* fix
* replace torch take with index_select
* comments
* comment about pytorch __getitem__ operator pitfall
* typo
2019-03-01 22:51:51 -05:00
fe44ffe5dc
[Doc] fix equation in nn.conv ( #425 )
2019-03-01 15:56:08 -05:00
bea07b41b3
[Sampler] fix the API of neighbor sampler. ( #407 )
...
* don't return aux_info.
* fix sampler test.
* fix sse.
* fix.
* add comment.
2019-02-28 13:45:21 -08:00
7e30382e4f
[Model][MXNet] neighbor sampling & skip connection & control variate & graphsage ( #322 )
...
* neighbor sampling draft
* val/test acc
* control variate draft
* control variate
* update
* fix new_history
* maintain aggregated history while updating new history
* preprocess the first layer, change push to pull
* update
* fix subg_degree
* nodeflow
* clear
* readme
* doc and unittest for self loop
* address comments
* rename
* update
* fix
* Update node_flow.py
* Update node_flow.py
2019-02-28 13:29:51 -08:00
724aa0caf0
[Feature] FindEdge/FindEdges for Immutable Graph ( #404 )
...
* fix rgcn tutorial
* small fix
* upd
* findedge/s
* upd
* upd
* upd
* upd
* add test
* remove redundancy
* upd
* upd
* upd
* upd
* add edge_subgraph
* explicit cast
* add test immutable subg
* reformat
* reformat
* fix bug
* upd
2019-02-27 15:32:32 +08:00
c07ae34a99
[Bugfix] removing non-determinism in data loading ( #413 )
...
[Bugfix] Removing non-determinism in data loading
2019-02-26 01:24:48 -05:00
565f0c88fc
[WIP] [NN] Refactor NN package ( #406 )
...
* refactor graph conv
* docs & tests
* fix lint
* fix lint
* fix lint
* fix lint script
* fix lint
* Update
* Style fix
* Fix style
* Fix style
* Fix gpu case
* Fix for gpu case
* Hotfix edgesoftmax docs
* Handle repeated features
* Add docstring
* Set default arguments
* Remove dropout from nn.conv
* Fix
* add util fn for renaming
* revert gcn_spmv.py
* mx folder
* fix wierd bug
* fix mx
* fix lint
2019-02-25 18:41:21 -05:00
bfe3e9d64a
[Feature] Add switch readonly state interface ( #389 )
...
* fix rgcn tutorial
* small fix
* add switch readonly state interface
* remove trailing ws
* fix
* fix
* change signature
* change signature
* remove trailing ws
* upd
* upd interface
* upd
* rm trailing ws
* reformat
* trailing space
* upd
2019-02-20 18:51:56 -05:00
2e1cbd5d68
[Feature] Random walk traces generation ( #392 )
...
* random walk traces generation
* remove outdated comments
* oops put in the wrong place
* explicit inline
* moving rand_r to util
* moving random walk to public function
* per-thread seed and openmp support
* type cast styles
2019-02-20 10:41:59 -05:00
f370e628cd
[Feature] add NodeFlow API ( #361 )
...
* sample layer subgraphs.
* fix.
* fix.
* add layered subgraph.
* fix lint.
* fix.
* fix tutorial.
* fix.
* remove copy_to_parent.
* add num_layers
* move sampling code to sampler.cc
* fix.
* move subgraph construction out.
* Revert "move subgraph construction out."
This reverts commit 24b3d13b0d8ed5f91847ea75a7674ee8f7d45cff.
* change to NodeFlow.
* use NodeFlow in Python.
* use NodeFlowIndex.
* add node_mapping and edge_mapping.
* remove unnecessary code in SSE tutorial.
* Revert "remove unnecessary code in SSE tutorial."
This reverts commit 093f0413d5fa2e63ca5f80c46c80a126a9fb720c.
* fix tutorial.
* move to node_flow.
* update gcn cv updater.
* import NodeFlow.
* update.
* add demo code for vanilla control variate sampler.
* update.
* update.
* add neighbor sampling.
* return flow offsets.
* update node_flow.
* add test.
* fix sampler.
* fix graph index.
* fix a bug in sampler.
* fix map_to_layer_nid and map_to_flow_eid.
* fix apply_flow.
* remove model code.
* implement flow_compute.
* fix a bug.
* reverse the csr physically.
* add mini-batch test.
* add mini batch test.
* update flow_compute.
* add prop_flows
* run on specific nodes.
* test copy
* fix a bug in creating frame in NodeFlow.
* add init gcn_cv_updater.
* fix a minor bug.
* fix gcn_cv_updater.
* fix a bug.
* fix a bug in NodeFlow.
* use new h in gcn_cv_updater.
* add layer_in_degree and layer_out_degree.
* fix gcn_cv_updater for gpu.
* temp fix in NodeFlow for diff context.
* allow enabling/disabling copy back.
* add with-updater option.
* fix a bug in computing degree.
* add with-cv option.
* rename and add comments.
* fix lint complain.
* fix lint.
* avoid assert.
* remove assert.
* fix.
* fix.
* fix.
* fix.
* fix the methods in NodeFlow.
* fix lint.
* update SSE.
* remove gcn_cv_updater.
* correct comments for the schedulers.
* update comment.
* add map_to_nodeflow_nid
* address comment.
* remove duplicated test.
* fix int.
* fix comments.
* fix lint
* fix.
* replace subgraph with NodeFlow.
* move view.
* address comments.
* fix lint.
* fix lint.
* remove static_cast.
* fix docstring.
* fix comments.
* break SampleSubgraph.
* move neighbor sampling to sampler.cc
* fix comments.
* rename.
* split neighbor_list.
* address comments.
* fix.
* remove TODO.
2019-02-19 15:49:28 -08:00
220a1e68fb
[BUG] Fixing bug in pickling readonly graphs ( #397 )
...
* fixing bug in pickling readonly graphs
* multigraph test coverage
* fixing lint (??????)
* another lint
* is_readonly interface
2019-02-19 00:14:11 -05:00
788d8dd4ad
[Model]PPI dataloader and inductive learning script. ( #395 )
...
* Create ppi.py
* Create train_ppi.py
* Update train_ppi.py
* Update train_ppi.py
* Create gat.py
* Update train.py
* Update train_ppi.py
* Update ppi.py
* Update train_ppi.py
* Update ppi.py
* Update train_ppi.py
* Update train_ppi.py
* Update ppi.py
* Update train_ppi.py
* update docs and readme
2019-02-17 16:41:30 -05:00
40afdf7cd5
[Bugfix] Remove unnecessary assert in from_scipy_sparse_matrix ( #391 )
2019-02-13 17:45:22 -05:00
51293a3273
[Data] reddit data loader ( #372 )
...
* reddit data loader
* upload to S3
* update
* add self loop
* address comments
* fi
2019-02-08 10:53:39 -08:00
5b9147c464
[Feature] Edge Group Apply API ( #358 )
...
* add rtfd
* rrr
* update
* change env
* temp fix
* update
* fix
* fix
* add
* conf
* Move file_pattern from Makefile to conf.py
* remove yml
* fix
* fix
* fix
* fix
* remove yml
* remove yml
* add doc docker
* add dgl install script
* change name
* change dockerfile
* fix
* name
* add
* fix
* fix
* fix
* fix
* fix docker
* delete sphinx.py for doc-build backend
* Add softmax to test backend
* Add group apply function and tests
* Delete unnecessary file
* Update comments and test
* Fix lint
* remove unused bucketing code
* group apply edge bucketing code
* gen degree bucket schedule for group apply edge
* schedule and graph code
* fix compiling
* fix
* fix lint
* naming
* harder test case
* fix comments
* more comments
* tweak function name
2019-02-03 11:14:52 -05:00
3cbfc25a32
[Tutorial] Batched Graph Classification ( #360 )
...
* batched_graph_classification
* Fix
* Fix
* update tutorial with new dataset
* Final
* Fix doc for dataset
* small fix
2019-01-25 15:13:52 -05:00
abf12fc757
[Data] Synthetic dataset for graph classificaiton ( #364 )
...
* minigc dataset
* more comments
* sphinx
2019-01-25 10:47:47 -05:00
525bb61245
[Doc] Fix a typo ( #365 )
2019-01-25 10:41:37 -05:00
929742b588
[Feature] Reimplement Immutable graph index in DGL ( #342 )
...
* init.
* it's compiled.
* add immutable graph constructor.
* add immutable graph API.
* fix.
* impl get adjacency matrix.
* fix.
* fix graph_index from scipy matrix.
* add neighbor sampling.
* remap vertex ids.
* fix.
* move sampler test.
* fix tests.
* add comments
* remove mxnet-specific immutable graph.
* fix.
* fix lint.
* fix.
* try to fix windows compile error.
* fix.
* fix.
* add test.
* unify Graph and ImmutableGraph.
* fix bugs.
* fix compile.
* move immutable graph.
* fix.
* remove print.
* fix lint.
* fix
* fix lint.
* fix lint.
* fix test.
* fix comments.
* merge GraphIndex and ImmutableGraphIndex.
* temp fix.
* impl GetAdj.
* fix lint
* fix.
* fix.
* fix.
* fix.
* fix.
* use csr only for readonly graph.
* Revert "use csr only for readonly graph."
This reverts commit 8e24bb033af8504531b22849de5b7567b168e0d5.
* remove code.
* fix.
* fix.
* fix.
* fix.
* fix.
* fix.
* address comments.
* fix for comments.
* fix comments.
* revert.
* move test_graph_index to compute.
* fix.
* fix.
* impl GetAdj for coo.
* fix.
* fix tests.
* address comments.
* address comments.
* fix comment.
* address comments.
* use lambda.
* other comments.
* address comments.
* modify the semantics of edges.
* fix order.
* use DGLIdIter
* fix.
* remove NotImplemented.
* revert some code.
2019-01-17 09:59:53 +08:00
ed1948b555
[BugFix] Make program thread-local to support multi-threading ( #338 )
...
* make program thread local
* doc string
2019-01-12 22:04:08 -05:00
ddc2faa547
[Bugfix] Fix gat residual bug ( #355 )
...
* fix gat residual bug
* fix the residual addition; output heads; add some shape notations;
* minor
* fix the output head average
* add requests package in requirement
2019-01-12 08:37:01 -05:00
efae0f97d8
[Model] Improve GAT models ( #348 )
...
* two better GAT implementations
* update numbers
* use version switch for spmm
* add missing dropout and output heads
2019-01-11 02:02:06 -05:00
3a868eb04b
[Feature] Max readout and consecutive labeling for networkx ( #341 )
...
* Max readout and consecutive labeling
* Delete test_readout.py
* Delete test_basics.py
* Test case and fix
* Recover accidentally removed file
* Fix import order
* Fix test case
* Fix
* Fix
* Fix
* Fix
* Fix
* revert
* Fix
* Fix
* Fix
2019-01-10 12:58:05 -05:00
707334ce85
minor spelling tweaks ( #349 )
...
* minor spelling tweaks
* Update CONTRIBUTORS.md
2019-01-10 12:02:31 -05:00
e19cd62ecd
[Test] Unify tests for different backends ( #333 )
...
* test basics
* batched graph & filter, mxnet filter fix
* frame and function; bugfix
* test graph adj and inc matrices
* fixing start = 0 for mxnet
* test index
* inplace update & line graph
* multi send recv
* more tests
* oops
* more tests
* removing old test files; readonly graphs for mxnet still kept
* modifying test scripts
* adding a placeholder for pytorch to reserve directory
* torch 0.4.1 compat fixes
* moving backend out of compute to avoid nose detection
* tests guide
* mx sparse-to-dense/sparse-to-numpy is buggy
* oops
* contribution guide for unit tests
* printing incmat
* printing dlpack
* small push
* typo
* fixing duplicate entries that causes undefined behavior
* move equal comparison to backend
2019-01-05 23:32:33 -05:00
24bbdb745e
[Feature] Reversed Graph and Transform Module ( #331 )
...
* reverse a graph
* Reverse a graph
* Fix
* Revert "Fix"
This reverts commit 1728826b4f3a083b76dfc0fdecd2bbf943a971b2.
* Fix
* Fix
* Delete vcs.xml
* Delete Project_Default.xml
* Fix
* Fix
* Fix
* Remove outdated test
* Reorg transform and update reverse (#2 )
* Reorg transform and update reverse
* Fix doc and test
* Update test
* Resolve conflict
* CI oriented fix
* Remove outdated import
* Fix import
* Fix import
* define __all__ for wildcard imports
* Fix import
* Address circular imports
* Fix
* Fix test case
* Fix
* Fix
* Remove unused import
* Fix
* Fix
* Fix
2019-01-04 13:51:19 -05:00
4bd4d6e348
[Lint] Pylint ( #330 )
...
* fix lint for graph_index.py
* pylint for base.py
* pylint for batched_graph.py
* pylint for frame.py; simplify and fix bugs in frame when index is slice type
* pylint for graph.py
* pylint for immutable_graph_index.py
* pylint for init.py
* pylint for rest files in root package
* pylint for _ffi package
* pylint for function package
* pylint for runtime package
* pylint for runtime.ir package
* add pylint to ci
* fix mx tests
* fix lint errors
* fix ci
* fix as requested
* fix lint
2019-01-01 15:15:41 -05:00
2664ed2dff
[Bugfix] Fix multiple send recv ( #320 )
...
* fix bug: frame append should check itself
* more test case
* fix multi-send-recv bug
* remv msg graph and clean up
* test cases
* more test case
* fix for batchedgraph
* fix bugs: converting from a graph with edges
* fix
* add more operators to utils.Index
* clear frame executor
* change message indicator to a graph level index
* fix test cases
* guard the case that mxnet does not support concat zero shape tensor
* fix bug: avoid convert full slice to numpy
* test multi-send-recv after conversion
* fix as request (partially)
* add dtype, ctx to full_1d
* add slice data to utils.Index
* fix
* more doc string
* fix as requested
2018-12-23 21:35:49 -05:00
Chao Ma