文件历史

114 次代码提交

作者 SHA1 备注 提交日期
Minjie Wang ca2a7e1ca1 [Refactor] Nodeflow, sampling, CAPI (#430)
* enable cython

* add helper function and data structure for void_p vector return

* move sampler from graph index to contrib.sampling

* WIP

* WIP

* refactor layer sampling

* pass tests

* fix lint

* fix graphsage

* remove comments

* pickle test

* fix comments

* update dev guide for cython build
2019-03-05 14:07:22 -05:00
Lingfan Yu d3c24cc25b [BugFix] Fix bug in RGCN data processing and use index_select to improve speed (#429)
* use index_select instead of __getitem__

* fix bug in dataset processing

* fix edge_type shape bug

* comments
2019-03-04 10:52:21 -05:00
Da Zheng bea07b41b3 [Sampler] fix the API of neighbor sampler. (#407)
* don't return aux_info.

* fix sampler test.

* fix sse.

* fix.

* add comment.
2019-02-28 13:45:21 -08:00
Ziyue Huang 7e30382e4f [Model][MXNet] neighbor sampling & skip connection & control variate & graphsage (#322)
* neighbor sampling draft

* val/test acc

* control variate draft

* control variate

* update

* fix new_history

* maintain aggregated history while updating new history

* preprocess the first layer, change push to pull

* update

* fix subg_degree

* nodeflow

* clear

* readme

* doc and unittest for self loop

* address comments

* rename

* update

* fix

* Update node_flow.py

* Update node_flow.py
2019-02-28 13:29:51 -08:00
Minjie Wang 565f0c88fc [WIP] [NN] Refactor NN package (#406)
* refactor graph conv

* docs & tests

* fix lint

* fix lint

* fix lint

* fix lint script

* fix lint

* Update

* Style fix

* Fix style

* Fix style

* Fix gpu case

* Fix for gpu case

* Hotfix edgesoftmax docs

* Handle repeated features

* Add docstring

* Set default arguments

* Remove dropout from nn.conv

* Fix

* add util fn for renaming

* revert gcn_spmv.py

* mx folder

* fix wierd bug

* fix mx

* fix lint
2019-02-25 18:41:21 -05:00
hbsun2113 8c750170e8 [Model][Pytorch] GraphSAGE (#403)
* simple implemention of GraphSAGE

* update the abstract method and `torch.nn` modules are more utilized
2019-02-22 15:48:53 -05:00
Tianyi cdbeb17f2d [Model] Simplifying Graph Convolutional Networks. (#405)
* [Model] Simplifying Graph Convolutional Networks.

* - improve code stype (use nn.Linear)
- use `bias` option
- update hyperparameter and corresponding performance
2019-02-22 15:17:26 +08:00
Da Zheng f370e628cd [Feature] add NodeFlow API (#361)
* sample layer subgraphs.

* fix.

* fix.

* add layered subgraph.

* fix lint.

* fix.

* fix tutorial.

* fix.

* remove copy_to_parent.

* add num_layers

* move sampling code to sampler.cc

* fix.

* move subgraph construction out.

* Revert "move subgraph construction out."

This reverts commit 24b3d13b0d8ed5f91847ea75a7674ee8f7d45cff.

* change to NodeFlow.

* use NodeFlow in Python.

* use NodeFlowIndex.

* add node_mapping and edge_mapping.

* remove unnecessary code in SSE tutorial.

* Revert "remove unnecessary code in SSE tutorial."

This reverts commit 093f0413d5fa2e63ca5f80c46c80a126a9fb720c.

* fix tutorial.

* move to node_flow.

* update gcn cv updater.

* import NodeFlow.

* update.

* add demo code for vanilla control variate sampler.

* update.

* update.

* add neighbor sampling.

* return flow offsets.

* update node_flow.

* add test.

* fix sampler.

* fix graph index.

* fix a bug in sampler.

* fix map_to_layer_nid and map_to_flow_eid.

* fix apply_flow.

* remove model code.

* implement flow_compute.

* fix a bug.

* reverse the csr physically.

* add mini-batch test.

* add mini batch test.

* update flow_compute.

* add prop_flows

* run on specific nodes.

* test copy

* fix a bug in creating frame in NodeFlow.

* add init gcn_cv_updater.

* fix a minor bug.

* fix gcn_cv_updater.

* fix a bug.

* fix a bug in NodeFlow.

* use new h in gcn_cv_updater.

* add layer_in_degree and layer_out_degree.

* fix gcn_cv_updater for gpu.

* temp fix in NodeFlow for diff context.

* allow enabling/disabling copy back.

* add with-updater option.

* fix a bug in computing degree.

* add with-cv option.

* rename and add comments.

* fix lint complain.

* fix lint.

* avoid assert.

* remove assert.

* fix.

* fix.

* fix.

* fix.

* fix the methods in NodeFlow.

* fix lint.

* update SSE.

* remove gcn_cv_updater.

* correct comments for the schedulers.

* update comment.

* add map_to_nodeflow_nid

* address comment.

* remove duplicated test.

* fix int.

* fix comments.

* fix lint

* fix.

* replace subgraph with NodeFlow.

* move view.

* address comments.

* fix lint.

* fix lint.

* remove static_cast.

* fix docstring.

* fix comments.

* break SampleSubgraph.

* move neighbor sampling to sampler.cc

* fix comments.

* rename.

* split neighbor_list.

* address comments.

* fix.

* remove TODO.
2019-02-19 15:49:28 -08:00
Hao Zhang 788d8dd4ad [Model]PPI dataloader and inductive learning script. (#395)
* Create ppi.py

* Create train_ppi.py

* Update train_ppi.py

* Update train_ppi.py

* Create gat.py

* Update train.py

* Update train_ppi.py

* Update ppi.py

* Update train_ppi.py

* Update ppi.py

* Update train_ppi.py

* Update train_ppi.py

* Update ppi.py

* Update train_ppi.py

* update docs and readme
2019-02-17 16:41:30 -05:00
Zihao Ye 1ea0bcf486 [Model] fix link & beam search (#394) 2019-02-17 13:32:36 -05:00
Zihao Ye ae1806f651 [Bugfix] RGCN tutorial (#388)
* fix rgcn tutorial

* small fix

* upd
2019-02-15 11:14:56 +08:00
Minjie Wang 91b7382378 [Model] update gat (#390)
* update gat: add minus max for softmax

* small fix
2019-02-13 14:53:41 -05:00
Giuseppe Futia 6c3dba867a [Tutorial] Update prerequisites of README (#380)
* Update prerequisites of README

* dependencies for pytorch models

* dependencies for mxnet models

* minor
2019-02-11 22:58:17 -05:00
Lingfan Yu 29dd22e666 [Model] Support Multi-GPU for Transformer model (#356)
* multi-process version of transformer

* lots of fix

* fix bugs and accum gradients for multiple batches

* many fixes

* minor

* upd

* set torch device

* fix bugs

* fix and minor

* comments and clean up

* uncomment viz code
2019-02-11 20:17:45 -05:00
Da Zheng 9cd0df7dde [Doc] Update README in MXNet GCN. (#373)
* update readme.

* Revert "update readme."

This reverts commit cd5ea512059adadfcb22a615a2c42bba12f334a8.

* update.
2019-02-02 21:59:07 -08:00
Quan (Andy) Gan 12d706300c [Hotfix] fixing zero shaped tensor problems for PyTorch 1.0.0 in JTNN example (#371) 2019-01-31 21:07:09 -05:00
Minjie Wang ddc2faa547 [Bugfix] Fix gat residual bug (#355)
* fix gat residual bug

* fix the residual addition; output heads; add some shape notations;

* minor

* fix the output head average

* add requests package in requirement
2019-01-12 08:37:01 -05:00
Minjie Wang efae0f97d8 [Model] Improve GAT models (#348)
* two better GAT implementations

* update numbers

* use version switch for spmm

* add missing dropout and output heads
2019-01-11 02:02:06 -05:00
brett koonce 707334ce85 minor spelling tweaks (#349)
* minor spelling tweaks

* Update CONTRIBUTORS.md
2019-01-10 12:02:31 -05:00
Sheng Zha 1e50cd2eda [Model][MXNet] MXNet Tree LSTM example (#279)
* TreeLSTM MXNet example

* hybridize

* add glove download

* usability

* Update README.md
2018-12-27 10:57:23 +08:00
Hao Zhang 896dc50e70 [Model] fix bugs in pygat and mxgat. (#323)
* mxgat

* pygat

* Update gat_batch.py

* add train

* Update gat_batch.py

* Update gat.py

* Update gat_batch.py
2018-12-23 20:45:25 -05:00
Hao Zhang 632d598c77 [Doc] Add readme to mxnet gat (#300)
* readme

* Update and rename README to README.md

* Update README.md

* Update README.md

* Update README.md

* Update README.md

* Update README.md

* Update README.md

* Update README.md

* Update README.md
2018-12-17 04:36:26 -08:00
Da Zheng f8811c7d3c [BUGFIX] fix some minor problems in GAT (#308)
* fix gat.

* fix context.
2018-12-16 22:20:27 -08:00
Da Zheng dba36c87af Fix some minor problems in SSE (#309)
* fix SSE.

* fix.

* fix.
2018-12-16 21:21:35 -08:00
Minjie Wang f35ac5443e [Graph][Model] Cache adj & inc; MX GCN (#307)
* add cache to adj and incmat

* Fix bug in cached adj/inc

* mx gcn spmv runnable; acc debugging...

* fix bug in mx gcn that loss is not correctly calculated

* fix mx utest

* fix as requested

* use raw parameter tensors rather than dense layer

* fix dropout

* Add numbers in readme
2018-12-16 22:51:01 -05:00
Ziyue Huang cffa4034f5 [Model] fix GCN (#305)
* mxnet gcn spmv

* update readme

* fix gcn

* pytorch gcn

* update readme
2018-12-16 12:44:41 -05:00
Zihao Ye 9f32554296 [Model]Transformer (#186)
* change the signature of node/edge filter

* upd filter

* Support multi-dimension node feature in SPMV

* push transformer

* remove some experimental settings

* stable version

* hotfix

* upd tutorial

* upd README

* merge

* remove redundency

* remove tqdm

* several changes

* Refactor

* Refactor

* tutorial train

* fixed a bug

* fixed perf issue

* upd

* change dir

* move un-related to contrib

* tutuorial code

* remove redundency

* upd

* upd

* upd

* upd

* improve viz

* universal done

* halt norm

* fixed a bug

* add draw graph

* fixed several bugs

* remove dependency on core

* upd format of README

* trigger

* trigger

* upd viz

* trigger

* add transformer tutorial

* fix tutorial

* fix readme

* small fix on tutorials

* url fix in readme

* fixed func link

* upd
2018-12-07 15:22:46 +08:00
Minjie Wang 3564fdc5f1 [Bugfix][Model] fix treelstm model (#274)
* fix bug after moving batcher out of dgl.data

* disable mx utest
2018-12-06 23:52:50 -05:00
Mufei Li ddf96ff9e7 [Doc] Fix DGMG part in README (#270)
* Fix DGMG epoch time

* Fix README for DGMG

* update
2018-12-06 10:54:07 -05:00
Da Zheng 1bbc885b40 move batcher to examples. (#269)
* move pytorch code to examples.

* fix.

* fix tutorial
2018-12-06 06:45:27 -08:00
Gan Quan ac660f45ef [Doc] Readme (#265)
* [Doc] updated readme

* contribution guide change

* small edits

* add perf #

* Update README.md

* Update README.md

* add others...

* rewrite scalability

* model & code links

* some note for treelstm

* rewrite scalability
2018-12-06 00:31:04 -05:00
Lingfan Yu f4a9a455f5 [Doc] Fix hyperlink in tutorial of tutorals (#260)
* fix all code tutorial links and typos in texts

* sse readme format

* fix

* sse paper link

* gat readme

* fix
2018-12-05 15:04:27 -05:00
Minjie Wang e557ed89ff [Doc][Model] example folder doc and model summary (#259)
* update example readme

* mx example readme

* add results in readme

* mx rgcn readme
2018-12-05 14:35:14 -05:00
Yizhi Liu 2c5b48ab60 [Model][MXNet] RGCN Entity Classification (#246)
* entity classify work for examples

* add loop_msg

* remove wrong assert

* remove one reshape

* add readme

* add MRR

* remove mrr from entity task
2018-12-05 10:27:59 -08:00
Da Zheng 7c7cc7e0c2 [sampler] Adjust the sampler API for the future extension. (#243)
* return seed ids.

* fix tests.

* implement.
2018-12-05 10:05:10 -08:00
Lingfan Yu 378c264561 [Model] Fix GCN Normalization (#249)
* WIP

* lr -> 0.01

* new cora dataset

* normalization code

* minor format change

* normalization factor for deg bucket
2018-12-05 12:32:10 -05:00
Minjie Wang 21255b6528 [Bugfix] tolist and dependencies in dgl.data (#239)
* change Index.tolist -> Index.tonumpy; fix bug in traversal; remove dependencies in data

* fix import

* fix __all__ and some docstring
2018-12-05 12:20:59 -05:00
Da Zheng a5a35d1f7a [Sampler] improve random shuffle performance in sampler (#228)
* fix.

* make it generic.

* add the API.

* fix.

* remove mxnet.
2018-12-04 09:24:32 -08:00
Da Zheng 78269cedfd [Doc] Update GCN README.md (#224)
* update readme.

* update readme
2018-12-04 12:07:05 -05:00
Da Zheng 2c170a8c17 [Graph][Bugfix] Fix the API of map_to_subgraph_nid (#226)
* correct vid mapping API.

* fix sse.
2018-12-03 17:16:35 -05:00
Lingfan Yu b98dc92c59 [Model] Relational GCN (#55)
* data preprocessing for rgcn

* edge subgraph

* WIP: RGCN

* use edge feature in spmv

* fix bugs

* match AIFB accuracy

* match mutag accuracy

* avoid materializing in featureless case

* remove untouched nodes and relabel nodes

* fix python list concatenate overhead

* sparsely store edge types

* refactor entity classify code for clean link prediction implementation

* further refactor code

* refactoring

* rgcn block decompose layers

* link predict dataset

* link predict model and eval code

* dropout, self-loop, regularization, etc, plus bug fixes

* update to new api

* dataset update

* bugs, WIP, need to impl early stopping and filtered metrics

* instruction to run, and minor

* group conv and early stop

* clean slow code

* some code comments

* use new api in model code

* change data preprocessing

* entity classify model

* WIP

* move dgl graph out of model

* hot fix for extract zip

* fix link predict model

* use latest dgl apis

* still have memory issue...

* bug fix and move inference to cpu

* move rgcn data processing to contrib

* th.allclose -> U.allclose

* minor change in readme

* fix memory issue in entity classify

* fix and testing code for link predict

* fix entity classify

* clean up

* fix comments

* revert erroneous git merge changes

* code clean up and more comments

* minor

* dependent package version
2018-12-03 13:01:27 -05:00
yifeim 6f4898a128 [Model][MXNet] gcn normalization and compare with mlp baselines (#196)
* clean up pr-188 and resubmit

* address Da comments
2018-12-02 19:17:37 -08:00
Da Zheng 57b07fce92 [Model] Accelerate SSE (#172)
* lazy eval edge ids.

* parallelize node id lookup.

* fix a bug.

* use mxnet for index.

* use update_all in the subgraph training.

* sample neighbors.

* Revert "parallelize node id lookup."

This reverts commit e661f69bb06cb5a7c246f0e106f245e27800e220.

* update README.

* cache subgraphs.

* support all degrees.

* cache adj in CPU.

* fix a bug in sse.

* print.

* raise error on mutable graphs.

* measure train time per epoch.

* fix a bug in graph_index.

* remove readonly in DGLSubGraph.

* cache subgraph properly.

* accelerate getting adjacency.

* split infer.

* lazy eval edges.

* specify inference mode.

* update for new sampler.

* use new mxnet sampling api.

* fix indent.

* remove profiling code.

* remove mxnet from sampler.

* return a lambda function for graph edges.

* add docs for immutable subgraph.

* Revert "return a lambda function for graph edges."

This reverts commit 0de5d7f100e230c518a3fb8976a6227f474d09ee.

* get parent_eid.
2018-12-02 12:43:25 -05:00
Gan Quan ac932c665b [Model] Junction Tree VAE update (#157)
* cherry picking optimization from jtnn

* adding official code.  TODO: fix DGLMolTree

* updating to current api.  vae test still failing

* reverting to list stacking

* reverting to list stacking

* cleaning x flags (stupid windows)

* cleaning x flags (stupid windows)

* adding stats

* optimization

* updating dgl stats

* update again

* more optimization

* looks like computation is faster

* removing profiling code

* cleaning obsolete code

* remove comparison warning

* readme update

* official implementation got a lot faster

* minor fixes

* unbatch by slicing frames

* working around unbatch

* reduce pack

* oops

* support frame read/write with slices

* reverting back to readout as unbatch-by-slicing slows down backward

* reverting to unbatch by splitting; slicing is unfriendly to backward

* replacing lru cache with static object factory

* cherry picking optimization from jtnn

* unbatch by slicing frames

* reduce pack

* oops

* support frame read/write with slices

* reverting to unbatch by splitting; slicing is unfriendly to backward

* replacing lru cache with static object factory

* replacing Scheme object with namedtuple

* forgot the find edges interface

* subclassing namedtuple

* updating to the latest api spec

* bugfix

* bfs with edges

* dfs toy test case

* clean up

* style fix

* bugfix

* update to latest api; include traversal

* replacing with readout

* simplify decoder

* oops

* cleanup

* reducing number of sets

* more speed up

* profile results

* random fixes

* fixing tvmarray handling incontiguous dlpack input

* fancier dataloader

* fix a potential context mismatch

* todo: support pickling or using scipy in multiprocessing load

* pickling support

* resorting to suggested way of pickling

* custom attribute pickling check

* working around a weird pytorch pickling bug

* including partial frame case

* enabling multiprocessing dataloader

* pickling everything now

* really works

* oops

* updated profiling results

* cleanup

* fix as requested

* cleaning random blank lines

* removing profiler outputs

* starting decoding

* testing, WIP

* tree decoding

* graph decoding, WIP

* graph decoding works

* oops

* fixing legacy apis

* trimming number of candidate structures

* sampling cleanups

* removing comparison test

* updated description
2018-12-02 03:32:01 -05:00
Zihao Ye c80dc5e012 [model] Tree-LSTM update & hotfix(dropbox link) (#202)
* change the signature of node/edge filter

* upd filter

* Support multi-dimension node feature in SPMV

* stable version

* hotfix

* upd tutorial

* upd README
2018-11-30 19:39:49 -05:00
VoVAllen e17c41c0da [Model][Tutorial] Fix capsule memory leak (#185)
* fix memory leak & Remove unnecessary initializer

* change confused name

* fix name

* Move func outside loop

* fix name inconsistency
2018-11-29 09:40:21 -05:00
Mufei Li a0d0b1ea00 [Model] Fix + batched DGMG (#175)
* DGMG with batch size 1

* Fix

* Adjustment

* Fix

* Fix

* Fix

* Fix

* Fix has_node and __contains__

* Batched implementation for DGMG

* Remove redundant dependency

* Adjustment

* Fix

* Add comments
2018-11-29 00:13:30 +08:00
HQ 5cda368d79 [Model] SBM hotfix (#137)
* [Model]SBM hotfix

* [Model] remove backend in data
2018-11-27 11:58:03 -05:00
yifeim 02eb463ab1 report accuracy and fix training mask (#181) 2018-11-27 15:15:57 +08:00
Mufei Li 3e8b63ecd3 [Model] DGMG Training with Batch Size 1 (#161)
* DGMG with batch size 1

* Fix

* Adjustment

* Fix

* Fix

* Fix

* Fix
2018-11-22 10:29:25 -05:00