ef93518da3
[Refactor] Auto fix view.py. ( #4461 )
...
Co-authored-by: Ubuntu <ubuntu@ip-172-31-34-29.ap-northeast-1.compute.internal >
Co-authored-by: Minjie Wang <wmjlyjemaine@gmail.com >
2022-08-30 18:31:03 +08:00
701b4fccc2
[Sampling] New sampling pipeline plus asynchronous prefetching ( #3665 )
...
* initial update
* more
* more
* multi-gpu example
* cluster gcn, finalize homogeneous
* more explanation
* fix
* bunch of fixes
* fix
* RGAT example and more fixes
* shadow-gnn sampler and some changes in unit test
* fix
* wth
* more fixes
* remove shadow+node/edge dataloader tests for possible ux changes
* lints
* add legacy dataloading import just in case
* fix
* update pylint for f-strings
* fix
* lint
* lint
* lint again
* cherry-picking commit fa9f494
* oops
* fix
* add sample_neighbors in dist_graph
* fix
* lint
* fix
* fix
* fix
* fix tutorial
* fix
* fix
* fix
* fix warning
* remove debug
* add get_foo_storage apis
* lint
2022-01-30 16:13:00 +08:00
1686106390
change __repr__ ( #2696 )
...
Co-authored-by: Minjie Wang <wmjlyjemaine@gmail.com >
2021-02-25 00:21:00 +08:00
c6890c231a
[Performance] In HeteroNodeView, build arange on target device, instead of on CPU and copying it ( #2266 )
...
* Build arange on target device
* Utilize arange device in viewpy:HeteroNodeView.__call__
* Work around uint64 error in TF to_dlpack
* Restore else clause
Co-authored-by: Jinjing Zhou <VoVAllen@users.noreply.github.com >
Co-authored-by: Da Zheng <zhengda1936@gmail.com >
2020-11-02 14:03:26 -08:00
444becf00a
[Misc] Move many deprecated codes to the deprecate folder ( #1893 )
...
* some file movements
* move some codes to deprecated
* more deprecation
* lint
* remove useless test
2020-07-30 18:17:33 +08:00
44089c8b4d
[Refactor][Graph] Merge DGLGraph and DGLHeteroGraph ( #1862 )
...
* Merge
* [Graph][CUDA] Graph on GPU and many refactoring (#1791 )
* change edge_ids behavior and C++ impl
* fix unittests; remove utils.Index in edge_id
* pass mx and th tests
* pass tf test
* add aten::Scatter_
* Add nonzero; impl CSRGetDataAndIndices/CSRSliceMatrix
* CSRGetData and CSRGetDataAndIndices passed tests
* CSRSliceMatrix basic tests
* fix bug in empty slice
* CUDA CSRHasDuplicate
* has_node; has_edge_between
* predecessors, successors
* deprecate send/recv; fix send_and_recv
* deprecate send/recv; fix send_and_recv
* in_edges; out_edges; all_edges; apply_edges
* in deg/out deg
* subgraph/edge_subgraph
* adj
* in_subgraph/out_subgraph
* sample neighbors
* set/get_n/e_repr
* wip: working on refactoring all idtypes
* pass ndata/edata tests on gpu
* fix
* stash
* workaround nonzero issue
* stash
* nx conversion
* test_hetero_basics except update routines
* test_update_routines
* test_hetero_basics for pytorch
* more fixes
* WIP: flatten graph
* wip: flatten
* test_flatten
* test_to_device
* fix bug in to_homo
* fix bug in CSRSliceMatrix
* pass subgraph test
* fix send_and_recv
* fix filter
* test_heterograph
* passed all pytorch tests
* fix mx unittest
* fix pytorch test_nn
* fix all unittests for PyTorch
* passed all mxnet tests
* lint
* fix tf nn test
* pass all tf tests
* lint
* lint
* change deprecation
* try fix compile
* lint
* update METIDS
* fix utest
* fix
* fix utests
* try debug
* revert
* small fix
* fix utests
* upd
* upd
* upd
* fix
* upd
* upd
* upd
* upd
* upd
* trigger
* +1s
* [kernel] Use heterograph index instead of unitgraph index (#1813 )
* upd
* upd
* upd
* fix
* upd
* upd
* upd
* upd
* upd
* trigger
* +1s
* [Graph] Mutation for Heterograph (#1818 )
* mutation add_nodes and add_edges
* Add support for remove_edges, remove_nodes, add_selfloop, remove_selfloop
* Fix
Co-authored-by: Ubuntu <ubuntu@ip-172-31-51-214.ec2.internal >
* upd
* upd
* upd
* fix
* [Transfom] Mutable transform (#1833 )
* add nodesy
* All three
* Fix
* lint
* Add some test case
* Fix
* Fix
* Fix
* Fix
* Fix
* Fix
* fix
* triger
* Fix
* fix
Co-authored-by: Ubuntu <ubuntu@ip-172-31-51-214.ec2.internal >
* [Graph] Migrate Batch & Readout module to heterograph (#1836 )
* dgl.batch
* unbatch
* fix to device
* reduce readout; segment reduce
* change batch_num_nodes|edges to function
* reduce readout/ softmax
* broadcast
* topk
* fix
* fix tf and mx
* fix some ci
* fix batch but unbatch differently
* new checkk
* upd
* upd
* upd
* idtype behavior; code reorg
* idtype behavior; code reorg
* wip: test_basics
* pass test_basics
* WIP: from nx/ to nx
* missing files
* upd
* pass test_basics:test_nx_conversion
* Fix test
* Fix inplace update
* WIP: fixing tests
* upd
* pass test_transform cpu
* pass gpu test_transform
* pass test_batched_graph
* GPU graph auto cast to int32
* missing file
* stash
* WIP: rgcn-hetero
* Fix two datasety
* upd
* weird
* Fix capsuley
* fuck you
* fuck matthias
* Fix dgmg
* fix bug in block degrees; pass rgcn-hetero
* rgcn
* gat and diffpool fix
also fix ppi and tu dataset
* Tree LSTM
* pointcloud
* rrn; wip: sgc
* resolve conflicts
* upd
* sgc and reddit dataset
* upd
* Fix deepwalk, gindt and gcn
* fix datasets and sign
* optimization
* optimization
* upd
* upd
* Fix GIN
* fix bug in add_nodes add_edges; tagcn
* adaptive sampling and gcmc
* upd
* upd
* fix geometric
* fix
* metapath2vec
* fix agnn
* fix pickling problem of block
* fix utests
* miss file
* linegraph
* upd
* upd
* upd
* graphsage
* stgcn_wave
* fix hgt
* on unittests
* Fix transformer
* Fix HAN
* passed pytorch unittests
* lint
* fix
* Fix cluster gcn
* cluster-gcn is ready
* on fixing block related codes
* 2nd order derivative
* Revert "2nd order derivative"
This reverts commit 523bf6c249bee61b51b1ad1babf42aad4167f206.
* passed torch utests again
* fix all mxnet unittests
* delete some useless tests
* pass all tf cpu tests
* disable
* disable distributed unittest
* fix
* fix
* lint
* fix
* fix
* fix script
* fix tutorial
* fix apply edges bug
* fix 2 basics
* fix tutorial
Co-authored-by: yzh119 <expye@outlook.com >
Co-authored-by: xiang song(charlie.song) <classicxsong@gmail.com >
Co-authored-by: Ubuntu <ubuntu@ip-172-31-51-214.ec2.internal >
Co-authored-by: Ubuntu <ubuntu@ip-172-31-7-42.us-west-2.compute.internal >
Co-authored-by: Ubuntu <ubuntu@ip-172-31-1-5.us-west-2.compute.internal >
Co-authored-by: Ubuntu <ubuntu@ip-172-31-68-185.ec2.internal >
2020-07-28 14:30:41 +08:00
b742c559fe
[Feature]heterograph.edata and heterograph.ndata support multiple ntype and etype ( #1673 )
...
* g.edata and g.ndata support multiple ntype and etype
* Add test case
* support g.srcdata and g.dstdata
* Fix test
* lint
* Fix
* Fix some comments
* lint
Co-authored-by: Ubuntu <ubuntu@ip-172-31-51-214.ec2.internal >
Co-authored-by: Mufei Li <mufeili1996@gmail.com >
2020-06-26 21:11:22 +08:00
dc8ca88e58
[Refactor] Explicit dtype for HeteroGraph ( #1467 )
...
* 111
* 111
* lint
* lint
* lint
* lint
* fix
* lint
* try
* fix
* lint
* lint
* test
* fix
* ttt
* test
* fix
* fix
* fix
* mxnet
* 111
* fix 64bits computation
* pylint
* roll back
* fix
* lint
* fix hetero_from_relations
* remove index_dtype in to_homo and to_hetero
* fix
* fix
* fix
* fix
* remove default
* fix
* lint
* fix
* fix error message
* fix error
* lint
* macro dispatch
* try
* lint
* remove nbits
* error message
* fix
* fix
* lint
* lint
* lint
* fix
* lint
* fix
* fix random walk
* lint
* lint
* fix
* fix
* fix
* lint
* fix
* lint
Co-authored-by: Minjie Wang <wmjlyjemaine@gmail.com >
2020-05-08 14:26:28 +08:00
6111ea4665
[Model] RGCN mini-batch training; Better bipartite graph support ( #1337 )
...
* change the model to use node embedding only
* minibatch training
* add readme
* small fix
* backward-compatible
* backward compatible
* modify to_block; rgcn changed
* fix
* fix transform
* fix bug in unittest script
* docstring
* fix lint
* add tests
* address comments; fix offline eval
* gitignore
2020-03-16 18:58:06 +08:00
d30a69bf27
[Backend] TF backend ( #978 )
...
* tf
* add builtin support
* fiix
* pytest
* fix
* fix
* fix some bugs
* fix selecting
* fix todo
* fix test
* fix test fail in tf
* fix
* fix
* fix gather row
* fix gather row
* log backend
* fix gather row
* fix gather row
* fix for pytorch
* fix
* fix
* fix
* fix
* fix
* fix tests
* fix
* fix
* fix
* fix
* fix
* fix
* fix convert
* fix
* fix
* fix
* fix inplace
* add alignment setting
* add debug option
* Revert "add alignment setting"
This reverts commit ec63fb3506ea84fff7d447a1fbdfd1d5d1fb6110.
* tf ci
* fix lint
* fix lint
* add tfdlpack
* fix type
* add env
* fix backend
* fix
* fix tests
* remove one_hot
* remove comment
* remove comment
* fix
* use pip to install all
* fix test
* fix base
* fix
* fix
* add skip
* upgrade cmake
* change version
* change ci
* fix
* fix
* fix
* fix
* fix seg fault
* fix
* fix python version
* fix
* try fix
* fix
* fix
* tf takes longer time in ci
* change py version
* fix
* fix
* fix oom
* change kg env
* change kg env
* 啊啊啊啊啊啊啊啊啊啊啊啊啊啊啊啊啊啊啊啊啊啊啊啊啊啊啊啊啊啊啊啊啊啊啊啊啊啊
* 我再也不搞各种乱七八糟环境了……
* use pytest
* Chang image
2019-12-20 15:56:51 +08:00
9b4d60799a
[Hetero] New syntax ( #824 )
...
* WIP. remove graph arg in NodeBatch and EdgeBatch
* refactor: use graph adapter for scheduler
* WIP: recv
* draft impl
* stuck at bipartite
* bipartite->unitgraph; support dsttype == srctype
* pass test_query
* pass test_query
* pass test_view
* test apply
* pass udf message passing tests
* pass quan's test using builtins
* WIP: wildcard slicing
* new construct methods
* broken
* good
* add stack cross reducer
* fix bug; fix mx
* fix bug in csrmm2 when the CSR is not square
* lint
* removed FlattenedHeteroGraph class
* WIP
* prop nodes, prop edges, filter nodes/edges
* add DGLGraph tests to heterograph. Fix several bugs
* finish nx<->hetero graph conversion
* create bipartite from nx
* more spec on hetero/homo conversion
* silly fixes
* check node and edge types
* repr
* to api
* adj APIs
* inc
* fix some lints and bugs
* fix some lints
* hetero/homo conversion
* fix flatten test
* more spec in hetero_from_homo and test
* flatten using concat names
* WIP: creators
* rewrite hetero_from_homo in a more efficient way
* remove useless variables
* fix lint
* subgraphs and typed subgraphs
* lint & removed heterosubgraph class
* lint x2
* disable heterograph mutation test
* docstring update
* add edge id for nx graph test
* fix mx unittests
* fix bug
* try fix
* fix unittest when cross_reducer is stack
* fix ci
* fix nx bipartite bug; docstring
* fix scipy creation bug
* lint
* fix bug when converting heterograph from homograph
* fix bug in hetero_from_homo about ntype order
* trailing white
* docstring fixes for add_foo and data views
* docstring for relation slice
* to_hetero and to_homo with feature support
* lint
* lint
* DGLGraph compatibility
* incidence matrix & docstring fixes
* example string fixes
* feature in hetero_from_relations
* deduplication of edge types in to_hetero
* fix lint
* fix
2019-09-17 15:41:57 -04:00
5f2f100b80
[Feature] convert np.ndarray to backend tensor when setting ndata/edata( #850 )
2019-09-11 14:37:45 +08:00
52d4535b61
[Hetero][RFC] Heterogeneous graph Python interfaces & Message Passing ( #752 )
...
* moving heterograph index to another file
* node view
* python interfaces
* heterograph init
* bug fixes
* docstring for readonly
* more docstring
* unit tests & lint
* oops
* oops x2
* removed node/edge addition
* addressed comments
* lint
* rw on frames with one node/edge type
* homograph with underlying heterograph demo
* view is not necessary
* bugfix
* replace
* scheduler, builtins not working yet
* moving bipartite.h to header
* moving back bipartite to bipartite.h
* oops
* asbits and copyto for bipartite
* tested update_all and send_and_recv
* lightweight node & edge type retrieval
* oops
* sorry
* removing obsolete code
* oops
* lint
* various bug fixes & more tests
* UDF tests
* multiple type number_of_nodes and number_of_edges
* docstring fixes
* more tests
* going for dict in initialization
* lint
* updated api as per discussions
* lint
* bug
* bugfix
* moving back bipartite impl to cc
* note on views
* fix
2019-08-23 15:45:37 -04:00
f370e628cd
[Feature] add NodeFlow API ( #361 )
...
* sample layer subgraphs.
* fix.
* fix.
* add layered subgraph.
* fix lint.
* fix.
* fix tutorial.
* fix.
* remove copy_to_parent.
* add num_layers
* move sampling code to sampler.cc
* fix.
* move subgraph construction out.
* Revert "move subgraph construction out."
This reverts commit 24b3d13b0d8ed5f91847ea75a7674ee8f7d45cff.
* change to NodeFlow.
* use NodeFlow in Python.
* use NodeFlowIndex.
* add node_mapping and edge_mapping.
* remove unnecessary code in SSE tutorial.
* Revert "remove unnecessary code in SSE tutorial."
This reverts commit 093f0413d5fa2e63ca5f80c46c80a126a9fb720c.
* fix tutorial.
* move to node_flow.
* update gcn cv updater.
* import NodeFlow.
* update.
* add demo code for vanilla control variate sampler.
* update.
* update.
* add neighbor sampling.
* return flow offsets.
* update node_flow.
* add test.
* fix sampler.
* fix graph index.
* fix a bug in sampler.
* fix map_to_layer_nid and map_to_flow_eid.
* fix apply_flow.
* remove model code.
* implement flow_compute.
* fix a bug.
* reverse the csr physically.
* add mini-batch test.
* add mini batch test.
* update flow_compute.
* add prop_flows
* run on specific nodes.
* test copy
* fix a bug in creating frame in NodeFlow.
* add init gcn_cv_updater.
* fix a minor bug.
* fix gcn_cv_updater.
* fix a bug.
* fix a bug in NodeFlow.
* use new h in gcn_cv_updater.
* add layer_in_degree and layer_out_degree.
* fix gcn_cv_updater for gpu.
* temp fix in NodeFlow for diff context.
* allow enabling/disabling copy back.
* add with-updater option.
* fix a bug in computing degree.
* add with-cv option.
* rename and add comments.
* fix lint complain.
* fix lint.
* avoid assert.
* remove assert.
* fix.
* fix.
* fix.
* fix.
* fix the methods in NodeFlow.
* fix lint.
* update SSE.
* remove gcn_cv_updater.
* correct comments for the schedulers.
* update comment.
* add map_to_nodeflow_nid
* address comment.
* remove duplicated test.
* fix int.
* fix comments.
* fix lint
* fix.
* replace subgraph with NodeFlow.
* move view.
* address comments.
* fix lint.
* fix lint.
* remove static_cast.
* fix docstring.
* fix comments.
* break SampleSubgraph.
* move neighbor sampling to sampler.cc
* fix comments.
* rename.
* split neighbor_list.
* address comments.
* fix.
* remove TODO.
2019-02-19 15:49:28 -08:00
4bd4d6e348
[Lint] Pylint ( #330 )
...
* fix lint for graph_index.py
* pylint for base.py
* pylint for batched_graph.py
* pylint for frame.py; simplify and fix bugs in frame when index is slice type
* pylint for graph.py
* pylint for immutable_graph_index.py
* pylint for init.py
* pylint for rest files in root package
* pylint for _ffi package
* pylint for function package
* pylint for runtime package
* pylint for runtime.ir package
* add pylint to ci
* fix mx tests
* fix lint errors
* fix ci
* fix as requested
* fix lint
2019-01-01 15:15:41 -05:00
274e1082f5
[Doc] API doc string for many components ( #245 )
...
* builtin function docstring
* init docstring
* view docstring
* add init to index and fix
* node /edge feature
* Example -> Examples
* fix func hyperlink
* traversal
* fix
* from/to_networkx docstring
* minor
* fix duplicate label
* comment about tensor framework
* from scipy sparse matrix
* fix format errors
2018-12-04 17:52:00 -05:00
b0c76d48be
[Bug] fix __slots__ in view.py ( #230 )
2018-12-03 13:28:22 -05:00
7241a9c008
[Backend] backend interface ( #109 )
...
* backend interface
* small fix
* more comments to the data type dict
* WIP
* convert_to and narrow
* WIP
* pytorch and numpy backend; WIP on mxnet backend
* mxnet backend
* narrow
* Fix all usages
* fix for mx
* fix for mx
* fix mx
* fix mx
* fix mx
* fix mx
* fix mx
* fix mx
* fix mx
* revert jenkins
* add sparse_matrix api
* sparse matrix api
* some fixme
* Fix as requested
2018-11-04 21:42:39 -05:00
1a2b306f55
[Bug] fix bug in nodes() that does not return int64 tensor ( #116 )
2018-11-03 00:00:29 -04:00
68ec624782
[API][Doc] API change & basic tutorials ( #113 )
...
* Add SH tutorials
* setup sphinx-gallery; work on graph tutorial
* draft dglgraph tutorial
* update readme to include document url
* rm obsolete file
* Draft the message passing tutorial
* Capsule code (#102 )
* add capsule example
* clean code
* better naming
* better naming
* [GCN]tutorial scaffold
* fix capsule example code
* remove previous capsule example code
* graph struc edit
* modified: 2_graph.py
* update doc of capsule
* update capsule docs
* update capsule docs
* add msg passing prime
* GCN-GAT tutorial Section 1 and 2
* comment for API improvement
* section 3
* Tutorial API change (#115 )
* change the API as discusses; toy example
* enable the new set/get syntax
* fixed pytorch utest
* fixed gcn example
* fixed gat example
* fixed mx utests
* fix mx utest
* delete apply edges; add utest for update_edges
* small change on toy example
* fix utest
* fix out in degrees bug
* update pagerank example and add it to CI
* add delitem for dataview
* make edges() return form that is compatible with send/update_edges etc
* fix index bug when the given data is one-int-tensor
* fix doc
2018-11-02 17:19:14 -04:00
Hongzhi (Steve), Chen