52d4535b61
[Hetero][RFC] Heterogeneous graph Python interfaces & Message Passing ( #752 )
...
* moving heterograph index to another file
* node view
* python interfaces
* heterograph init
* bug fixes
* docstring for readonly
* more docstring
* unit tests & lint
* oops
* oops x2
* removed node/edge addition
* addressed comments
* lint
* rw on frames with one node/edge type
* homograph with underlying heterograph demo
* view is not necessary
* bugfix
* replace
* scheduler, builtins not working yet
* moving bipartite.h to header
* moving back bipartite to bipartite.h
* oops
* asbits and copyto for bipartite
* tested update_all and send_and_recv
* lightweight node & edge type retrieval
* oops
* sorry
* removing obsolete code
* oops
* lint
* various bug fixes & more tests
* UDF tests
* multiple type number_of_nodes and number_of_edges
* docstring fixes
* more tests
* going for dict in initialization
* lint
* updated api as per discussions
* lint
* bug
* bugfix
* moving back bipartite impl to cc
* note on views
* fix
2019-08-23 15:45:37 -04:00
66971c1aa4
[Feature] Add edge sampling for link prediction ( #780 )
...
* add edge sampler.
* add test and run.
* add negative sampling.
* remap the edge subgraph vid.
* negative graph excludes edges of positive edgs.
* remove print.
* avoid sampling NodeFlow when expand_factor or num_hops is 0.
* fix a bug when excluding nodes in negative graph.
* support multigraph.
* exclude positive edges.
* fix memory leak.
* return subgraph object directly.
* fix many problems.
* add comments.
* address comments
2019-08-21 23:05:24 -07:00
2bff8339dd
[Test] Provid a frame agnostic API to test nn modules on both CPU and CUDA side. ( #775 )
...
* upd
* fig edgebatch edges
* add test
* trigger
* Update README.md for pytorch PinSage example.
Add noting that the PinSage model example under
example/pytorch/recommendation only work with Python 3.6+
as its dataset loader depends on stanfordnlp package
which work only with Python 3.6+.
* Provid a frame agnostic API to test nn modules on both CPU and CUDA side.
1. make dgl.nn.xxx frame agnostic
2. make test.backend include dgl.nn modules
3. modify test_edge_softmax of test/mxnet/test_nn.py and
test/pytorch/test_nn.py work on both CPU and GPU
* Fix style
* Delete unused code
* Make agnostic test only related to tests/backend
1. clear all agnostic related code in dgl.nn
2. make test_graph_conv agnostic to cpu/gpu
* Fix code style
* fix
* doc
* Make all test code under tests.mxnet/pytorch.test_nn.py
work on both CPU and GPU.
* Fix syntex
* Remove rand
2019-08-21 16:40:41 +08:00
be936da849
use FFI for subgraph. ( #781 )
2019-08-21 01:04:11 -07:00
02029dce9b
Sync initializers ( #772 )
2019-08-17 20:25:54 +08:00
fd3d54ba98
bump up version for prerelease ( #768 )
2019-08-16 10:32:54 +08:00
cd9fb7baa0
[Model Zoo] Refactor GCN on Tox21 ( #766 )
...
* [Model zoo] Model zoo (#765 )
* tox21
* fix ci
* fix ci
* fix urls to url
* add doc
* remove binary
* model zoo
* test
* markdown
* fix typo
* fix typo
* fix typo
* raise error
* fix lint
* remove unnecessary
* fix doc
* fix
* fix
* fix
* fix
* fix
* fix
* Update
* CI
* Fix
* Fix
* Fix
* Fix
* Fix
* CI
2019-08-16 02:49:25 +08:00
bdcba9c85c
setup for prerelease builds ( #763 )
2019-08-14 23:13:37 +08:00
2ee3c78c7c
[Dataset] Tox21 ( #760 )
...
* tox21
* fix ci
* fix ci
* fix urls to url
* add doc
* remove binary
2019-08-14 16:55:01 +08:00
17b60e1af0
[Bugfix] EdgeBatch.edges call attempts tuple item assignment ( #747 )
...
* upd
* fig edgebatch edges
* add test
* trigger
2019-08-11 04:07:41 +08:00
16061925d5
[NodeFlow] Non-uniform neighbor sampling ( #711 )
...
* nonuniform sampler
* unit test
* test on out neighbors
* error checks
* lint
* fix
* clarification
* use macro switcher
* use empty array for uniform sampling
* oops
* Revert "oops"
This reverts commit a11f9ae707aaeb67fb5921c887a17d3711d5b04a.
* Revert "use empty array for uniform sampling"
This reverts commit 8526ce4cade89f2c1b09a08aca8830375ebafb31.
* re-reverting
* use a method
2019-08-07 09:42:08 +08:00
742d79a792
upd ( #741 )
2019-08-06 18:39:05 +08:00
5d3f470b72
[Feature] DGL Pooling modules ( #669 )
...
* removal doc
* glob
* upd
* rm knn
* add softmax
* upd
* upd
* add broadcast and s2s
* optimize max_on
* forsaken changes to heterograph
* upd
* upd
* upd
* upd
* upd
* bugfix
* upd
* upd
* upd
* upd
* format upd
* upd format
* upd doc
* upd
* import order
* upd
* rm warnings
* fix
* upd test
* upd
* upd
* fix device
* upd
* upd
* upd
* upd
* remove 1.1
* upd
* trigger
* trigger
* add more tests
* fix device
* upd
* upd
* refactor
* fix?
* fix
* upd docstring
* refactor
* upd
* fix
* upd
* upd
* upd
* fix
* upd docs
* add shape
* refactor & upd doc
* upd doc
* upd
2019-08-06 01:43:25 +08:00
c3516f1a8e
[Network] Refactoring Communicator ( #679 )
...
* Refactoring Communicator
* fix lint
* change non-const reference
* add header file
* use MemoryBuffer
* update PR
* fix bug on csr shape
* zero-copy msg_queue
* fix lint
* fix lint
* fix lint
* add header file
* fix windows build error
* fix windows build error
* update
* fix lint
* update
* fix lint
* fix lint
* add more test
* fix windows test
* update windows test
* update windows test
* update windows test
* update
* fix lint
* fix lint
* update
* update
* update
* update
* use STATUS code
* update test
* remove mem_cpy
* fix lint
* update
* finish
* ConstructNFTensor
* add test for deallocator
* update
* fix lint
2019-08-05 10:49:25 +08:00
fc9d30fae4
[Graph] add local scope function ( #735 )
...
* add local scope function
* fix lint
* fix docstring
* change local_scope to local_var; add context manager
* address comments
2019-08-02 00:11:48 -04:00
e9e587b6cb
[Refactor] C random number generator ( #729 )
...
* rng refactor
* fix bugs
* unit test
* remove setsize
* lint
* fix test
* use explicit instantiation instead of inlining
* stricter test
* use tvm solution
* moved python interface to dgl.random
* lint
* address comments
* make getthreadid an inline function
2019-07-31 17:54:30 +08:00
86f28d6553
[Misc] Provide a "return 1s instead of edge IDs" option in scipy adjacency matrix ( #730 )
...
* return 1 option in scipy adjacency matrix
* lint
* use dgl warning
* i'm an idiot
* lint x2
* rename
2019-07-29 21:40:09 +08:00
7ad663c3a9
[Hetero] Heterograph C++ implementation; Bipartite and Python wrapper ( #725 )
...
* finish bipartite graph implementation; compiled
* finished heterograph implementation; compiled
* WIP: apis
* C API codes
* compiled
* WIP: python
* HeteroGraphIndex
* WIP: test
* add DGLContext support in ffi
* fix bug in has edge
* unittests except edge subgraph
* edge subgraph
* fix lint
* address comments
* poke ci
* try fix
* fix msvc
2019-07-27 15:22:56 -04:00
67dc11971f
[Refactor] Use object system for all CAPIs ( #716 )
...
* WIP: using object system for graph
* c++ side refactoring done; compiled
* remove stale apis
* fix bug in DGLGraphCreate; passed test_graph.py
* fix bug in python modify; passed utest for pytorch/cpu
* fix lint
* address comments
2019-07-23 12:47:05 -04:00
b0d9e7aa43
[Refactor] Separating graph and sparse matrix operations ( #699 )
...
* WIP: array refactoring
* WIP: implementation
* wip
* most csr part
* WIP: on coo
* WIP: coo
* finish refactoring immutable graph
* compiled
* fix undefined ndarray copy bug; add COOToCSR when coo has no data array
* fix bug in COOToCSR
* fix bug in CSR constructor
* fix bug in in_edges(vid)
* fix OutEdges bug
* pass test_graph
* pass test_graph
* fix bug in CSR constructor
* fix bug in CSR constructor
* fix bug in CSR constructor
* fix stupid bug
* pass gpu test
* remove debug printout
* fix lint
* rm biparate grpah
* fix lint
* address comments
* fix bug in Clone
* cpp utests
2019-07-17 17:49:38 -04:00
9cc83b4bc7
[Bugfix] Fix nodeflow.prop_flow range check ( #700 )
2019-07-10 14:11:06 -04:00
bf3994eea6
[Model][Hotfix] DiffPool formatting fix ( #696 )
...
* formatting
* formatting
2019-07-02 15:19:57 +08:00
90e78c5854
[FFI] FFI container support, custom structure extension via Object ( #693 )
...
* WIP: import tvm runtime node system
* WIP: object system
* containers
* tested basic container composition
* tested custom object
* fix setattr bug
* tested object container return
* fix lint
* some comments about get/set state
* fix lint
* fix lint
* update cython
* fix cython
* ffi doc
* fix doc
2019-07-01 14:40:07 -04:00
684a61ad09
[Model] DiffPool with both DGL and tensorized operatons ( #665 )
...
* diffpool original file added
* make diffpool fuse up and running
* minor tweak on tu dataset statistics method
* fix tu
* break
* delete break
* pre_org
* diffpool fuse reorg
* fix random shuffling
* fix bn
* add dgl layers
* early stopping
* add readme
* fix
* add diffpool preprocess script
* tweak tu dataset
* tweak
* tweak
* tweak
* tweak
* tweak
* preprocess dataset
* fix early stopping
* fix
* fix
* fix
* tweak
* readme
* code review
* code review
* dataset code review
* update README
* code review
* tu doc
2019-07-01 20:00:15 +08:00
fc2e166ba6
[Fix] Fix Memory Leak in Edge Softmax ( #692 )
...
* Add serialization
* fix memory leak
* Revert "Add serialization"
This reverts commit e838bb1faa2503d14593d702be00514f936c9027.
* fix
2019-06-28 17:31:54 -04:00
8ecedfb369
[Fix] Bugfix in docs and check gradient of edge_softmax in test ( #686 )
...
* upd
* Add stronger test
* Update test_nn.py
* Update test_nn.py
* trigger
* trigger
* trigger
2019-06-27 00:43:26 +08:00
401f22cadd
[API] Heterograph ( #657 )
...
* [Feature][RFC] Heterogeneous graph interface (#553 )
* heterogeneous graph interface
* lint
* disable lints
* disable lint checks
* change node_types to dict
* update
* update
* heterograph view
* message passing with types
* clarifications
* graph queries
* clarifications
* moving add_XXX to Base
* from_networkx
* register functions
* Update heterograph.py
* lint.
2019-06-17 16:59:04 +08:00
11974812ca
[Backend] use new split in MXNet ( #660 )
...
* use new split.
* fix.
* fix.
* add zero copy from numpy.
2019-06-15 14:08:42 -07:00
8059fa6f8b
print errors if users sample from mutable graph. ( #649 )
...
* give warning.
* fix.
* update error msg.
2019-06-12 17:54:02 +08:00
059b1a6d6f
[Release] Bump up version ( #636 )
...
* bump up version
* conda+cuda trial
* switch conda branch
* revert
* disable cudnn
2019-06-12 16:50:05 +08:00
94ecb8eb96
[BUGFIX] copy graph index to shared memory. ( #634 )
...
* copy graph index to shared memory.
* fix.
* fix.
* fix.
* use a diff name for in-csr and out-csr.
* fix lint.
* remove print.
* add test.
* add comments.
2019-06-12 01:32:25 -07:00
16ec2a8b10
we need to sync for mxnet. ( #648 )
2019-06-11 18:22:21 -07:00
e16e895d53
[Doc] fix some document warnings ( #645 )
...
* fix doc
* fix some format and warnings
* fix
2019-06-11 13:41:41 -04:00
463807c511
[Doc] indexing missing docs. ( #625 )
...
* add doc of NodeFlow.
* add missing API in nodeflow.
* add docs and two more API to NodeFlow.
* add more docs.
* fix.
* fix.
* fix.
* add docs for distributed sampler.
2019-06-10 18:11:36 -07:00
5549c70d33
[BugFix] Fix memory leak in DGL edge softmax module ( #643 )
...
* fix gat memory increase bug
* work around mxnet memory leak bug
* comments
* poke linter
* lint
* lint
2019-06-10 18:44:23 -04:00
d6a9265d16
[Doc] docstring for node/edge removal APIs ( #639 )
2019-06-10 12:38:06 -04:00
fb9dcc51ff
[Feature] Add API to convert graph to bidirected graph ( #598 )
...
* to_bidirected
* to_bidirected
* Fix style
* Fix
* Update
* Fix
* Fix
* Update
* Add examples
2019-06-10 14:02:29 +08:00
411bcd7e6c
[BUGFIX] extand DGLGraph graph_data. ( #632 )
...
* enable tutorial test in CI.
* extand DGLGraph graph_data.
* update doc.
* Revert "enable tutorial test in CI."
This reverts commit cd774067180922bb6ae979bde4aecbffc61c8147.
* accept DGLGraph in graph store.
2019-06-09 17:22:04 -07:00
2e9949d228
[BUGFIX] Fix bugs in shared mem graph store. ( #630 )
...
* fix graph store for Pytorch.
* add test.
* fix dtype error in test
* disable test on GPU.
* test avoid windows.
* fix shared-memory test.
* use script to control testing environment.
* update test.
* enable all tests.
* fix test script.
2019-06-09 13:08:47 -07:00
fc7775a20f
Define node/edge Ids in NodeFlow more clearly ( #628 )
...
* add tests.
* distinguish layer-local nid and nodeflow nid.
* use numpy assert_array_equal and assert_allclose
* fix map_from_parent_nid
* fix test
* fix test.
* renmae remap.
* update doc.
* update doc.
* update doc.
* fix test.
* fix test.
2019-06-09 12:10:07 -07:00
dec8b49b5d
[Examples] Run all the examples ( #623 )
...
* all pytorch examples
* scan through mxnet examples
* change reddit data
* tweak numerical range for unittest
* fix ci
* fix ci
* fix
* add seed to workaround
2019-06-09 00:26:13 -04:00
74e13eea61
[Model] Update GAT model code ( #622 )
...
* fix gat code to use latest edge softmax module
* avoid transpose
* update README
* use edge_softmax op
* mxnet edge softmax op
* mxnet gat
* update README
* fix unittest
* fix ci
* fix mxnet nn test; relax criteria for prod reducer
2019-06-08 21:41:38 -04:00
993fd3f94b
[Enhancement] Add DGLGraph.to for PyTorch and MXNet backend ( #600 )
...
* add graph_to
* use backend copy_to
* add test
* fix test
* framework agnostic to() test
* disable pylint complaint
* add examples
* fix docstring
* formatting
* Format
* Update test_to_device.py
2019-06-08 16:21:29 +08:00
baa16231f3
[Feature] Remove nodes/edges. ( #599 )
...
* upd
* upd
* reformat
* upd
* upd
* add test
* fix arange
* fix slight bug
* upd
* trigger
* upd docs
* upd
* upd
* upd
* change subgraph to be raw data wrapper
* upd
* fix test
2019-06-08 13:44:36 +08:00
8bf97719fa
[Bugfix] Fix performance bug in edge softmax operator ( #624 )
2019-06-07 16:15:29 -07:00
7ad0485ace
[BUGFIX] handle more negative layer id and block id. ( #606 )
...
* handle negative layer id and block id.
* add tests.
* fix.
* fix.
2019-06-07 15:04:38 -07:00
34dfaf7532
quick-fix ( #620 )
2019-06-08 00:49:36 +08:00
5da57663cc
[BUGFIX] fix sampler. ( #616 )
...
* fix sampler.
* update doc.
* fix.
2019-06-06 20:47:59 -07:00
70ee86648b
[Docker]Move to the latest MXNet version. ( #610 )
...
* use the right version of mxnet.
* fix.
2019-06-06 13:56:35 -07:00
653428bdc7
[Feature][Kernel] DGL kernel support ( #596 )
...
* [Kernel] Minigun integration and fused kernel support (#519 )
* kernel interface
* add minigun
* Add cuda build
* functors
* working on binary elewise
* binary reduce
* change kernel interface
* WIP
* wip
* fix minigun
* compile
* binary reduce kernels
* compile
* simple test passed
* more reducers
* fix thrust problem
* fix cmake
* fix cmake; add proper guard for atomic
* WIP: bcast
* WIP
* bcast kernels
* update to new minigun pass-by-value practice
* broadcasting dim
* add copy src and copy edge
* fix linking
* fix none array problem
* fix copy edge
* add device_type and device_id to backend operator
* cache csr adj, remove cache for adjmat and incmat
* custom ops in backend and pytorch impl
* change dgl-mg kernel python interface
* add id_mapping var
* clean up plus v2e spmv schedule
* spmv schedule & clean up fall back
* symbolic message and reduce func, remove bundle func
* new executors
* new backend interface for dgl kernels and pytorch impl
* minor fix
* fix
* fix docstring, comments, func names
* nodeflow
* fix message id mapping and bugs...
* pytorch test case & fix
* backward binary reduce
* fix bug
* WIP: cusparse
* change to int32 csr for cusparse workaround
* disable cusparse
* change back to int64
* broadcasting backward
* cusparse; WIP: add rev_csr
* unit test for kernels
* pytorch backward with dgl kernel
* edge softmax
* fix backward
* improve softmax
* cache edge on device
* cache mappings on device
* fix partial forward code
* cusparse done
* copy_src_sum with cusparse
* rm id getter
* reduce grad for broadcast
* copy edge reduce backward
* kernel unit test for broadcasting
* full kernel unit test
* add cpu kernels
* edge softmax unit test
* missing ref
* fix compile and small bugs
* fix bug in bcast
* Add backward both
* fix torch utests
* expose infershape
* create out tensor in python
* fix c++ lint
* [Kernel] Add GPU utest and kernel utest (#524 )
* fix gpu utest
* cuda utest runnable
* temp disable test nodeflow; unified test for kernel
* cuda test kernel done
* [Kernel] Update kernel branch (#550 )
* [Model] add multiprocessing training with sampling. (#484 )
* reorganize sampling code.
* add multi-process training.
* speed up gcn_cv
* fix graphsage_cv.
* add new API in graph store.
* update barrier impl.
* support both local and distributed training.
* fix multiprocess train.
* fix.
* fix barrier.
* add script for loading data.
* multiprocessing sampling.
* accel training.
* replace pull with spmv for speedup.
* nodeflow copy from parent with context.
* enable GPU.
* fix a bug in graph store.
* enable multi-GPU training.
* fix lint.
* add comments.
* rename to run_store_server.py
* fix gcn_cv.
* fix a minor bug in sampler.
* handle error better in graph store.
* improve graphsage_cv for distributed mode.
* update README.
* fix.
* update.
* [Tutorial] add sampling tutorial. (#522 )
* add sampling tutorial.
* add readme
* update author list.
* fix indent in the code.
* rename the file.
* update tutorial.
* fix the last API.
* update image.
* [BUGFIX] fix the problems in the sampling tutorial. (#523 )
* add index.
* update.
* update tutorial.
* fix gpu utest
* cuda utest runnable
* temp disable test nodeflow; unified test for kernel
* cuda test kernel done
* Fixing typo in JTNN after interface change (#536 )
* [BugFix] Fix getting src and dst id of ALL edges in NodeFlow.apply_block (#515 )
* [Bug Fix] Fix inplace op at backend (#546 )
* Fix inplace operation
* fix line seprator
* [Feature] Add batch and unbatch for immutable graph (#539 )
* Add batch and unbatch for immutable graph
* fix line seprator
* fix lintr
* remove unnecessary include
* fix code review
* [BUGFix] Improve multi-processing training (#526 )
* fix.
* add comment.
* remove.
* temp fix.
* initialize for shared memory.
* fix graphsage.
* fix gcn.
* add more unit tests.
* add more tests.
* avoid creating shared-memory exclusively.
* redefine remote initializer.
* improve initializer.
* fix unit test.
* fix lint.
* fix lint.
* initialize data in the graph store server properly.
* fix test.
* fix test.
* fix test.
* small fix.
* add comments.
* cleanup server.
* test graph store with a random port.
* print.
* print to stderr.
* test1
* test2
* remove comment.
* adjust the initializer signature.
* [API] update graph store API. (#549 )
* add init_ndata and init_edata in DGLGraph.
* adjust SharedMemoryGraph API.
* print warning.
* fix comment.
* update example
* fix.
* fix examples.
* add unit tests.
* add comments.
* [Refactor] Immutable graph index (#543 )
* WIP
* header
* WIP .cc
* WIP
* transpose
* wip
* immutable graph .h and .cc
* WIP: nodeflow.cc
* compile
* remove all tmp dl managed ctx; they caused refcount issue
* one simple test
* WIP: testing
* test_graph
* fix graph index
* fix bug in sampler; pass pytorch utest
* WIP on mxnet
* fix lint
* fix mxnet unittest w/ unfortunate workaround
* fix msvc
* fix lint
* SliceRows and test_nodeflow
* resolve reviews
* resolve reviews
* try fix win ci
* try fix win ci
* poke win ci again
* poke
* lazy multigraph flag; stackoverflow error
* revert node subgraph test
* lazy object
* try fix win build
* try fix win build
* poke ci
* fix build script
* fix compile
* add a todo
* fix reviews
* fix compile
* [Kernel] Update kernel branch (#576 )
* [Model] add multiprocessing training with sampling. (#484 )
* reorganize sampling code.
* add multi-process training.
* speed up gcn_cv
* fix graphsage_cv.
* add new API in graph store.
* update barrier impl.
* support both local and distributed training.
* fix multiprocess train.
* fix.
* fix barrier.
* add script for loading data.
* multiprocessing sampling.
* accel training.
* replace pull with spmv for speedup.
* nodeflow copy from parent with context.
* enable GPU.
* fix a bug in graph store.
* enable multi-GPU training.
* fix lint.
* add comments.
* rename to run_store_server.py
* fix gcn_cv.
* fix a minor bug in sampler.
* handle error better in graph store.
* improve graphsage_cv for distributed mode.
* update README.
* fix.
* update.
* [Tutorial] add sampling tutorial. (#522 )
* add sampling tutorial.
* add readme
* update author list.
* fix indent in the code.
* rename the file.
* update tutorial.
* fix the last API.
* update image.
* [BUGFIX] fix the problems in the sampling tutorial. (#523 )
* add index.
* update.
* update tutorial.
* fix gpu utest
* cuda utest runnable
* temp disable test nodeflow; unified test for kernel
* cuda test kernel done
* Fixing typo in JTNN after interface change (#536 )
* [BugFix] Fix getting src and dst id of ALL edges in NodeFlow.apply_block (#515 )
* [Bug Fix] Fix inplace op at backend (#546 )
* Fix inplace operation
* fix line seprator
* [Feature] Add batch and unbatch for immutable graph (#539 )
* Add batch and unbatch for immutable graph
* fix line seprator
* fix lintr
* remove unnecessary include
* fix code review
* [BUGFix] Improve multi-processing training (#526 )
* fix.
* add comment.
* remove.
* temp fix.
* initialize for shared memory.
* fix graphsage.
* fix gcn.
* add more unit tests.
* add more tests.
* avoid creating shared-memory exclusively.
* redefine remote initializer.
* improve initializer.
* fix unit test.
* fix lint.
* fix lint.
* initialize data in the graph store server properly.
* fix test.
* fix test.
* fix test.
* small fix.
* add comments.
* cleanup server.
* test graph store with a random port.
* print.
* print to stderr.
* test1
* test2
* remove comment.
* adjust the initializer signature.
* [API] update graph store API. (#549 )
* add init_ndata and init_edata in DGLGraph.
* adjust SharedMemoryGraph API.
* print warning.
* fix comment.
* update example
* fix.
* fix examples.
* add unit tests.
* add comments.
* [Refactor] Immutable graph index (#543 )
* WIP
* header
* WIP .cc
* WIP
* transpose
* wip
* immutable graph .h and .cc
* WIP: nodeflow.cc
* compile
* remove all tmp dl managed ctx; they caused refcount issue
* one simple test
* WIP: testing
* test_graph
* fix graph index
* fix bug in sampler; pass pytorch utest
* WIP on mxnet
* fix lint
* fix mxnet unittest w/ unfortunate workaround
* fix msvc
* fix lint
* SliceRows and test_nodeflow
* resolve reviews
* resolve reviews
* try fix win ci
* try fix win ci
* poke win ci again
* poke
* lazy multigraph flag; stackoverflow error
* revert node subgraph test
* lazy object
* try fix win build
* try fix win build
* poke ci
* fix build script
* fix compile
* add a todo
* fix reviews
* fix compile
* all demo use python-3 (#555 )
* [DEMO] Reproduce numbers of distributed training in AMLC giant graph paper (#556 )
* update
* update
* update
* update num_hops
* fix bug
* update
* report numbers of distributed training in AMLC giant graph paper
* [DEMO] Remove duplicate code for sampling (#557 )
* update
* update
* re-use single-machine code
* update
* use relative path
* update
* update
* update
* add __init__.py
* add __init__.py
* import sys, os
* fix typo
* update
* [Perf] Improve performance of graph store. (#554 )
* fix.
* use inplace.
* move to shared memory graph store.
* fix.
* add more unit tests.
* fix.
* fix test.
* fix test.
* disable test.
* fix.
* [BUGIFX] fix a bug in edge_ids (#560 )
* add test.
* fix compute.
* fix test.
* turn on test.
* fix a bug.
* add test.
* fix.
* disable test.
* [DEMO] Add Pytorch demo for distributed sampler (#562 )
* update
* update
* update
* add sender
* update
* remove duplicate cpde
* [Test] Add gtest to project (#547 )
* add gtest module
* add gtest
* fix
* Update CMakeLists.txt
* Update README.md
* [Perf] lazily create msg_index. (#563 )
* lazily create msg_index.
* update test.
* [BUGFIX] fix bugs for running GCN on giant graphs. (#561 )
* load mxnet csr.
* enable load large csr.
* fix
* fix.
* fix int overflow.
* fix test.
* [BugFix] Fix error when bfs_level = 0 in Entity Classification with RGCN (#559 )
* [DEMO] Update demo of distributed sampler (#564 )
* update
* update
* update demo
* add network cpp test (#565 )
* Add unittest for C++ RPC (#566 )
* [CI] Fix CI for cpp test (#570 )
* fix CI for cpp test
* update port number
* [Docker] update docker image (#575 )
* update docker image
* specify lint version
* rm torch import from unified tests
* [Kernel][Scheduler][MXNet] Scheduler for DGL kernels and MXNet backend support (#541 )
* [Model] add multiprocessing training with sampling. (#484 )
* reorganize sampling code.
* add multi-process training.
* speed up gcn_cv
* fix graphsage_cv.
* add new API in graph store.
* update barrier impl.
* support both local and distributed training.
* fix multiprocess train.
* fix.
* fix barrier.
* add script for loading data.
* multiprocessing sampling.
* accel training.
* replace pull with spmv for speedup.
* nodeflow copy from parent with context.
* enable GPU.
* fix a bug in graph store.
* enable multi-GPU training.
* fix lint.
* add comments.
* rename to run_store_server.py
* fix gcn_cv.
* fix a minor bug in sampler.
* handle error better in graph store.
* improve graphsage_cv for distributed mode.
* update README.
* fix.
* update.
* [Tutorial] add sampling tutorial. (#522 )
* add sampling tutorial.
* add readme
* update author list.
* fix indent in the code.
* rename the file.
* update tutorial.
* fix the last API.
* update image.
* [BUGFIX] fix the problems in the sampling tutorial. (#523 )
* add index.
* update.
* update tutorial.
* fix gpu utest
* cuda utest runnable
* temp disable test nodeflow; unified test for kernel
* cuda test kernel done
* edge softmax module
* WIP
* Fixing typo in JTNN after interface change (#536 )
* mxnet backend support
* improve reduce grad
* add max to unittest backend
* fix kernel unittest
* [BugFix] Fix getting src and dst id of ALL edges in NodeFlow.apply_block (#515 )
* lint
* lint
* win build
* [Bug Fix] Fix inplace op at backend (#546 )
* Fix inplace operation
* fix line seprator
* [Feature] Add batch and unbatch for immutable graph (#539 )
* Add batch and unbatch for immutable graph
* fix line seprator
* fix lintr
* remove unnecessary include
* fix code review
* [BUGFix] Improve multi-processing training (#526 )
* fix.
* add comment.
* remove.
* temp fix.
* initialize for shared memory.
* fix graphsage.
* fix gcn.
* add more unit tests.
* add more tests.
* avoid creating shared-memory exclusively.
* redefine remote initializer.
* improve initializer.
* fix unit test.
* fix lint.
* fix lint.
* initialize data in the graph store server properly.
* fix test.
* fix test.
* fix test.
* small fix.
* add comments.
* cleanup server.
* test graph store with a random port.
* print.
* print to stderr.
* test1
* test2
* remove comment.
* adjust the initializer signature.
* try
* fix
* fix
* fix
* fix
* fix
* try
* test
* test
* test
* try
* try
* try
* test
* fix
* try gen_target
* fix gen_target
* fix msvc var_args expand issue
* fix
* [API] update graph store API. (#549 )
* add init_ndata and init_edata in DGLGraph.
* adjust SharedMemoryGraph API.
* print warning.
* fix comment.
* update example
* fix.
* fix examples.
* add unit tests.
* add comments.
* [Refactor] Immutable graph index (#543 )
* WIP
* header
* WIP .cc
* WIP
* transpose
* wip
* immutable graph .h and .cc
* WIP: nodeflow.cc
* compile
* remove all tmp dl managed ctx; they caused refcount issue
* one simple test
* WIP: testing
* test_graph
* fix graph index
* fix bug in sampler; pass pytorch utest
* WIP on mxnet
* fix lint
* fix mxnet unittest w/ unfortunate workaround
* fix msvc
* fix lint
* SliceRows and test_nodeflow
* resolve reviews
* resolve reviews
* try fix win ci
* try fix win ci
* poke win ci again
* poke
* lazy multigraph flag; stackoverflow error
* revert node subgraph test
* lazy object
* try fix win build
* try fix win build
* poke ci
* fix build script
* fix compile
* add a todo
* fix reviews
* fix compile
* WIP
* WIP
* all demo use python-3 (#555 )
* ToImmutable and CopyTo
* [DEMO] Reproduce numbers of distributed training in AMLC giant graph paper (#556 )
* update
* update
* update
* update num_hops
* fix bug
* update
* report numbers of distributed training in AMLC giant graph paper
* [DEMO] Remove duplicate code for sampling (#557 )
* update
* update
* re-use single-machine code
* update
* use relative path
* update
* update
* update
* add __init__.py
* add __init__.py
* import sys, os
* fix typo
* update
* [Perf] Improve performance of graph store. (#554 )
* fix.
* use inplace.
* move to shared memory graph store.
* fix.
* add more unit tests.
* fix.
* fix test.
* fix test.
* disable test.
* fix.
* [BUGIFX] fix a bug in edge_ids (#560 )
* add test.
* fix compute.
* fix test.
* turn on test.
* fix a bug.
* add test.
* fix.
* disable test.
* DGLRetValue DGLContext conversion
* [DEMO] Add Pytorch demo for distributed sampler (#562 )
* update
* update
* update
* add sender
* update
* remove duplicate cpde
* [Test] Add gtest to project (#547 )
* add gtest module
* add gtest
* fix
* Update CMakeLists.txt
* Update README.md
* Add support to convert immutable graph to 32 bits
* [Perf] lazily create msg_index. (#563 )
* lazily create msg_index.
* update test.
* fix binary reduce following new minigun template
* enable both int64 and int32 kernels
* [BUGFIX] fix bugs for running GCN on giant graphs. (#561 )
* load mxnet csr.
* enable load large csr.
* fix
* fix.
* fix int overflow.
* fix test.
* new kernel interface done for CPU
* docstring
* rename & docstring
* copy reduce and backward
* [BugFix] Fix error when bfs_level = 0 in Entity Classification with RGCN (#559 )
* [DEMO] Update demo of distributed sampler (#564 )
* update
* update
* update demo
* adapt cuda kernels to the new interface
* add network cpp test (#565 )
* fix bug
* Add unittest for C++ RPC (#566 )
* [CI] Fix CI for cpp test (#570 )
* fix CI for cpp test
* update port number
* [Docker] update docker image (#575 )
* update docker image
* specify lint version
* rm torch import from unified tests
* remove pytorch-specific test_function
* fix unittest
* fix
* fix unittest backend bug in converting tensor to numpy array
* fix
* mxnet version
* [BUGFIX] fix for MXNet 1.5. (#552 )
* remove clone.
* turn on numpy compatible.
* Revert "remove clone."
This reverts commit 17bbf76ed72ff178df6b3f35addc428048672457.
* revert format changes
* fix mxnet api name
* revert mistakes in previous revert
* roll back CI to 20190523 build
* fix unittest
* disable test_shared_mem_store.py for now
* remove mxnet/test_specialization.py
* sync win64 test script
* fix lowercase
* missing backend in gpu unit test
* transpose to get forward graph
* pass update all
* add sanity check
* passing test_specialization.py
* fix and pass test_function
* fix check
* fix pytorch softmax
* mxnet kernels
* c++ lint
* pylint
* try
* win build
* fix
* win
* ci enable gpu build
* init submodule recursively
* backend docstring
* try
* test win dev
* doc string
* disable pytorch test_nn
* try to fix windows issue
* bug fixed, revert changes
* [Test] fix CI. (#586 )
* disable unit test in mxnet tutorial.
* retry socket connection.
* roll back to set_np_compat
* try to fix multi-processing test hangs when it fails.
* fix test.
* fix.
* doc string
* doc string and clean up
* missing field in ctypes
* fix node flow schedule and unit test
* rename
* pylint
* copy from parent default context
* fix unit test script
* fix
* demo bug in nodeflow gpu test
* [Kernel][Bugfix] fix nodeflow bug (#604 )
* fix nodeflow bug
* remove debug code
* add build gtest option
* fix cmake; fix graph index bug in spmv.py
* remove clone
* fix div rhs grad bug
* [Kernel] Support full builtin method, edge softmax and unit tests (#605 )
* add full builtin support
* unit test
* unit test backend
* edge softmax
* apply edge with builtin
* fix kernel unit test
* disable mxnet test_shared_mem_store
* gen builtin reduce
* enable mxnet gpu unittest
* revert some changes
* docstring
* add note for the hack
* [Kernel][Unittest][CI] Fix MXNet GPU CI (#607 )
* update docker image for MXNet GPU CI
* force all dgl graph input and output on CPU
* fix gpu unittest
* speedup compilation
* add some comments
* lint
* add more comments
* fix as requested
* add some comments
* comment
* lint
* lint
* update pylint
* fix as requested
* lint
* lint
* lint
* docstrings of python DGL kernel entries
* disable lint warnings on arguments in kernel.py
* fix docstring in scheduler
* fix some bug in unittest; try again
* Revert "Merge branch 'kernel' of github.com:zzhang-cn/dgl into kernel"
This reverts commit 1d2299e68b004182ea6130b088de1f1122b18a49, reversing
changes made to ddc97fbf1bec2b7815c0da7c74f7ecb2f428889b.
* Revert "fix some bug in unittest; try again"
This reverts commit ddc97fbf1bec2b7815c0da7c74f7ecb2f428889b.
* more comprehensive kernel test
* remove shape check in test_specialization
2019-06-06 15:47:55 -04:00
Quan (Andy) Gan