e751ff01c7
fix reddit self loop ( #2330 )
2020-11-27 03:20:07 +00:00
63284c08bb
[Example] fix print info ( #2305 )
2020-11-27 03:17:12 +00:00
ad6b215bbd
[Doc and User Guide] Minor Fix ( #2206 )
...
* [Distributed Example] Check args.num_servers with DGL_NUM_SERVER (#2203 )
* update
* update
* update
* Fix doc and user guide
* Update heterograph.py
Co-authored-by: Chao Ma <mctt90@gmail.com >
Co-authored-by: Ubuntu <ubuntu@ip-172-31-13-9.us-west-2.compute.internal >
2020-09-17 02:59:55 +08:00
c53bf77452
[Distributed Example] Add --close_profiler option to train_dist.py ( #2199 )
...
* update
* update
2020-09-15 14:37:28 +08:00
0ced22c237
fix ( #2142 )
...
Co-authored-by: Ubuntu <ubuntu@ip-172-31-10-127.us-west-2.compute.internal >
Co-authored-by: Chao Ma <mctt90@gmail.com >
2020-09-15 14:19:16 +08:00
1b2658b926
update ( #2192 )
2020-09-14 15:35:39 +08:00
1aa25cb618
update ( #2191 )
2020-09-14 15:13:39 +08:00
55f3e92631
[Fix] use DistDataLoader instead of Pytorch’s DataLoader. ( #2182 )
...
Co-authored-by: hzliuchw <hzliuchw@corp.netease.com >
Co-authored-by: xiang song(charlie.song) <classicxsong@gmail.com >
2020-09-12 20:08:39 +08:00
7e7376eb4a
[Hotfix] Fix unsupervised graphsage ( #2143 )
...
* hotfix
* Hotfix
Co-authored-by: Ubuntu <ubuntu@ip-172-31-87-240.ec2.internal >
2020-09-03 11:11:15 +08:00
e8273a8510
update README.md ( #2138 )
2020-09-02 15:42:28 +08:00
1e3fcc7c53
update comments ( #2132 )
...
Co-authored-by: Ubuntu <ubuntu@ip-172-31-51-214.ec2.internal >
2020-08-31 13:23:43 +08:00
9eaace9216
rename create_format_ to create_formats_ ( #2126 )
2020-08-29 22:49:27 +08:00
4327d7125d
[Distributed] Check num_workers and num_samplers ( #2108 )
...
* check num_workers
* update
* update
* update
* update
* update
* update
2020-08-27 12:42:25 +08:00
283b2cfb96
[Distributed] Fix issues of GraphSage to support running on GPU ( #2084 )
...
* fix issues on GPU
* update
* update
* update
* update
* update
* update
* update
* update
* update
Co-authored-by: Ma <manchao@38f9d3587685.ant.amazon.com >
2020-08-25 13:20:46 +08:00
edfbee2ca8
[Feature] Make sample_neighbors copy features on demand ( #2042 )
...
* fix
* fix
* lint
* fix
* test
* fix
* fix
2020-08-18 22:25:19 +08:00
eb9c067b08
[Distributed] Copy training scripts in copy_partitions.py ( #2010 )
...
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
2020-08-13 12:20:39 +08:00
98c1117d00
update ( #2007 )
2020-08-12 16:07:15 +08:00
f5d8fa8476
[Distributed] Fix all arguments to the format of xx_xxx ( #2005 )
...
* update
* update
2020-08-12 14:45:30 +08:00
d1cf5c383e
[Distributed] adjust various APIs. ( #1993 )
...
* rename get_data_size.
* remove g from DistTensor.
* remove g from DistEmbedding.
* clean up API of graph partition book.
* fix DistGraph
* fix lint.
* collect all part policies.
* fix.
* fix.
* support distributed sampler.
* remove partition.py
2020-08-11 20:22:00 -07:00
4efa332044
[Distributed] Move server start code to initialize. ( #2002 )
...
* move server start code to initialize.
* fix.
* fix lint.
* fix examples.
* add more checks.
2020-08-11 16:58:18 -07:00
f5eb80d221
[Feature] Edge DataLoader for edge classification & link prediction ( #1828 )
...
* clean commit
* oops forgot the most important files
* use einsum
* copy feature from frontier to block
* Revert "copy feature from frontier to block"
This reverts commit 5224ec963eb6a3ef1b6ab74d8ecbd44e4e42f285.
* temp fix
* unit test
* fix
* revert jtnn
* lint
* fix win64
* docstring fixes and doc indexing
* revert einsum in sparse bidecoder
* fix some examples
* lint
* fix due to some tediousness in remove_edges
* addresses comments
* fix
* more jtnn fixes
* fix
2020-08-11 18:00:58 +08:00
d340ea3aa8
[Distributed] Remove server_count from ip_config.txt ( #1985 )
...
* remove server_count from ip_config.txt
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* lint
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* Update dist_context.py
* fix lint.
* make it work for multiple spaces.
* update ip_config.txt.
* fix examples.
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* udpate
* update
* update
* update
* update
* update
Co-authored-by: Da Zheng <zhengda1936@gmail.com >
Co-authored-by: Ubuntu <ubuntu@ip-172-31-19-1.us-west-2.compute.internal >
2020-08-11 17:41:48 +08:00
a089b91fdf
Remove stale partition code and fix #1949 ( #1984 )
...
* remove unused code
* fix litn
* fix
2020-08-11 10:51:07 +08:00
ee30b2aadd
[Distributed] Fix standalone ( #1974 )
...
* fix tests.
* fix.
* remove a test.
* make code work in the standalone mode.
* fix example.
* more fix.
* make DistDataloader work with num_workers=0
* fix DistDataloader tests.
* fix.
* fix lint.
* fix cleanup.
* fix test
* remove unnecessary code.
* remove tests.
* fix.
* fix.
* fix.
* fix example
* fix.
* fix.
* fix launch script.
Co-authored-by: Jinjing Zhou <VoVAllen@users.noreply.github.com >
Co-authored-by: Ubuntu <ubuntu@ip-172-31-19-1.us-west-2.compute.internal >
2020-08-10 15:49:28 -07:00
4b8eaf205b
[Distributed] move feature copy to samplers in distributed GraphSage. ( #1975 )
...
* fix example.
* move feature copy to sampler.
Co-authored-by: Ubuntu <ubuntu@ip-172-31-19-1.us-west-2.compute.internal >
2020-08-08 09:19:09 -07:00
d34cbf3180
Update train_sampling_unsupervised.py ( #1973 )
2020-08-08 17:21:15 +08:00
264d96cdf5
[bugfix] Fix a bunch of examples to be compatible with dgl 0.5 ( #1957 )
...
* upd
* upd
* upd
* upd
* upd
* upd
* fix pinsage also
* upd
* upd
* upd
Co-authored-by: Ubuntu <ubuntu@ip-172-31-29-3.us-east-2.compute.internal >
Co-authored-by: Quan Gan <coin2028@hotmail.com >
Co-authored-by: Jinjing Zhou <VoVAllen@users.noreply.github.com >
2020-08-08 01:31:23 +08:00
ba110e50e6
[Bug] Fix VRGCN with new dataset ( #1955 )
2020-08-06 17:54:24 +08:00
cebf3364e2
fix ( #1950 )
2020-08-06 16:27:28 +08:00
4f499c7ffb
[Distributed] DistDataloader ( #1901 )
...
* 111
* 111
* fix
* 111
* fix
* 11
* fix
* lint
* Update __init__.py
* lint
* fix
* lint
* fix
* fix
* fix
* fix
* fix
* try fix
* try fix
* fix
* Revert "fix"
This reverts commit a0b954fd4e99b7df92b53db8334dcb583d6e1551.
* fixes.
* fix.
* fix test.
* fix exit.
* fix.
* fix
* fix
* lint
* lint
* lint
* fix
* Update .gitignore
* 111
* fix
* 111
* 111
* fff
* 1111
* 111
* 1325315
* ffff
* f???
* fff
* 1111
* 111
* fix
* 111
* asda
* 1111
* 11
* 123
* 啊啊啊啊啊啊啊啊啊啊啊啊啊啊啊啊
* spawn
* 1231231
* up
* 111
* fix
* fix
* Revert "fix"
This reverts commit 7373f95312fdcaa36d2fc330bf242339e89c045d.
* fix
* fix
* 1111
* fix
* fix tests
* start kvclient as early as possible.
* lint
* fix test
* lint
* 1111
* fix
* fix
* 111
* fix
* fix
* 1
* fix
* fix
* lint
* fix
* lint
* lint
* remove quit
* fix
* lint
* fix
* fix several
* lint
* fix minor
* fix
* lint
Co-authored-by: Da Zheng <zhengda1936@gmail.com >
Co-authored-by: xiang song(charlie.song) <classicxsong@gmail.com >
2020-08-05 17:43:17 +08:00
929c99ed96
[Model] Rewrite GraphSAGE example ( #1938 )
2020-08-05 16:45:17 +08:00
1232961e07
Fix timing ( #1930 )
...
Co-authored-by: Ubuntu <ubuntu@ip-172-31-51-214.ec2.internal >
2020-08-04 23:41:10 +08:00
ca5a13fe49
[hotfix] Replace request_format and related APIs with create_format_ ( #1924 )
...
* upd
* upd
* upd
* upd
2020-08-04 00:05:40 +08:00
2c141229d5
[Dataset] RedditDataset ( #1914 )
...
* PPIDataset
* Revert "PPIDataset"
This reverts commit 264bd0c960cfa698a7bb946dad132bf52c2d0c8a.
* RedditDataset
* Update reddit.py
Co-authored-by: xiang song(charlie.song) <classicxsong@gmail.com >
2020-08-03 23:49:22 +08:00
a4c931a9bf
[Distributed] Support multiple servers ( #1886 )
...
* client init graph on the backup servers.
* fix.
* test multi-server.
* fix anonymous dist tensors.
* check #parts.
* fix init_data
* add multi-server multi-client tests.
* update tests in kvstore.
* fix.
* verify the loaded partition.
* fix a bug.
* fix lint.
* fix.
* fix example.
* fix rpc.
* fix pull/push handler for backup kvstore
* fix example readme.
* change ip.
* update docstring.
Co-authored-by: Ubuntu <ubuntu@ip-172-31-19-1.us-west-2.compute.internal >
2020-08-02 19:50:34 -07:00
56bbf9cb6d
[Distributed][Example] Distributed training for unsupervised graphsage ( #1853 )
...
* Standalone can run
* fix
* Add save
* Fix
* Fix
* Fix
* Fix
* debug
* test
* test
* Fix
* Fix
* log
* Fix
* fix
* Profile
* auto sync grad
* update
* add test for unsupervised dist training
* upd
* Fix lr
* Fix update
* sync
* fix
* Revert "fix"
This reverts commit d5caa7398b36125f6d6e2c742a95c6ff4298c9e9.
* Fix
* unsupervised
* Fix
* remove debug
* Add test case for dist_graph find_edges()
* Fix
* skip tensorflow test for find_edges
* Update readme
* remove some test
* upd
* Update partition_graph.py
Co-authored-by: Ubuntu <ubuntu@ip-172-31-68-185.ec2.internal >
Co-authored-by: Ubuntu <ubuntu@ip-172-31-24-210.ec2.internal >
Co-authored-by: Da Zheng <zhengda1936@gmail.com >
2020-08-01 12:24:55 -07:00
4be4b13424
[Distributed] add copy_partitions.py ( #1866 )
...
* fix bugs.
* eval on both vaidation and testing.
* add script.
* update.
* update launch.
* make train_dist.py independent.
* update readme.
* update readme.
* update readme.
* update readme.
* generate undirected graph.
* rename conf_file to part_config
* use rsync
* make train_dist independent.
Co-authored-by: Ubuntu <ubuntu@ip-172-31-19-1.us-west-2.compute.internal >
Co-authored-by: Ubuntu <ubuntu@ip-172-31-19-115.us-west-2.compute.internal >
Co-authored-by: xiang song(charlie.song) <classicxsong@gmail.com >
2020-07-31 11:11:56 -07:00
15411d932c
[Example] Fix some example after graph refactor. ( #1884 )
...
* Update cluster GCN README
We do not need to build metis right now.
We can use builtin metis.
* Fix gcmc mxnet
* Fix graphwriter
Co-authored-by: Ubuntu <ubuntu@ip-172-31-68-185.ec2.internal >
2020-07-29 22:07:47 +08:00
44089c8b4d
[Refactor][Graph] Merge DGLGraph and DGLHeteroGraph ( #1862 )
...
* Merge
* [Graph][CUDA] Graph on GPU and many refactoring (#1791 )
* change edge_ids behavior and C++ impl
* fix unittests; remove utils.Index in edge_id
* pass mx and th tests
* pass tf test
* add aten::Scatter_
* Add nonzero; impl CSRGetDataAndIndices/CSRSliceMatrix
* CSRGetData and CSRGetDataAndIndices passed tests
* CSRSliceMatrix basic tests
* fix bug in empty slice
* CUDA CSRHasDuplicate
* has_node; has_edge_between
* predecessors, successors
* deprecate send/recv; fix send_and_recv
* deprecate send/recv; fix send_and_recv
* in_edges; out_edges; all_edges; apply_edges
* in deg/out deg
* subgraph/edge_subgraph
* adj
* in_subgraph/out_subgraph
* sample neighbors
* set/get_n/e_repr
* wip: working on refactoring all idtypes
* pass ndata/edata tests on gpu
* fix
* stash
* workaround nonzero issue
* stash
* nx conversion
* test_hetero_basics except update routines
* test_update_routines
* test_hetero_basics for pytorch
* more fixes
* WIP: flatten graph
* wip: flatten
* test_flatten
* test_to_device
* fix bug in to_homo
* fix bug in CSRSliceMatrix
* pass subgraph test
* fix send_and_recv
* fix filter
* test_heterograph
* passed all pytorch tests
* fix mx unittest
* fix pytorch test_nn
* fix all unittests for PyTorch
* passed all mxnet tests
* lint
* fix tf nn test
* pass all tf tests
* lint
* lint
* change deprecation
* try fix compile
* lint
* update METIDS
* fix utest
* fix
* fix utests
* try debug
* revert
* small fix
* fix utests
* upd
* upd
* upd
* fix
* upd
* upd
* upd
* upd
* upd
* trigger
* +1s
* [kernel] Use heterograph index instead of unitgraph index (#1813 )
* upd
* upd
* upd
* fix
* upd
* upd
* upd
* upd
* upd
* trigger
* +1s
* [Graph] Mutation for Heterograph (#1818 )
* mutation add_nodes and add_edges
* Add support for remove_edges, remove_nodes, add_selfloop, remove_selfloop
* Fix
Co-authored-by: Ubuntu <ubuntu@ip-172-31-51-214.ec2.internal >
* upd
* upd
* upd
* fix
* [Transfom] Mutable transform (#1833 )
* add nodesy
* All three
* Fix
* lint
* Add some test case
* Fix
* Fix
* Fix
* Fix
* Fix
* Fix
* fix
* triger
* Fix
* fix
Co-authored-by: Ubuntu <ubuntu@ip-172-31-51-214.ec2.internal >
* [Graph] Migrate Batch & Readout module to heterograph (#1836 )
* dgl.batch
* unbatch
* fix to device
* reduce readout; segment reduce
* change batch_num_nodes|edges to function
* reduce readout/ softmax
* broadcast
* topk
* fix
* fix tf and mx
* fix some ci
* fix batch but unbatch differently
* new checkk
* upd
* upd
* upd
* idtype behavior; code reorg
* idtype behavior; code reorg
* wip: test_basics
* pass test_basics
* WIP: from nx/ to nx
* missing files
* upd
* pass test_basics:test_nx_conversion
* Fix test
* Fix inplace update
* WIP: fixing tests
* upd
* pass test_transform cpu
* pass gpu test_transform
* pass test_batched_graph
* GPU graph auto cast to int32
* missing file
* stash
* WIP: rgcn-hetero
* Fix two datasety
* upd
* weird
* Fix capsuley
* fuck you
* fuck matthias
* Fix dgmg
* fix bug in block degrees; pass rgcn-hetero
* rgcn
* gat and diffpool fix
also fix ppi and tu dataset
* Tree LSTM
* pointcloud
* rrn; wip: sgc
* resolve conflicts
* upd
* sgc and reddit dataset
* upd
* Fix deepwalk, gindt and gcn
* fix datasets and sign
* optimization
* optimization
* upd
* upd
* Fix GIN
* fix bug in add_nodes add_edges; tagcn
* adaptive sampling and gcmc
* upd
* upd
* fix geometric
* fix
* metapath2vec
* fix agnn
* fix pickling problem of block
* fix utests
* miss file
* linegraph
* upd
* upd
* upd
* graphsage
* stgcn_wave
* fix hgt
* on unittests
* Fix transformer
* Fix HAN
* passed pytorch unittests
* lint
* fix
* Fix cluster gcn
* cluster-gcn is ready
* on fixing block related codes
* 2nd order derivative
* Revert "2nd order derivative"
This reverts commit 523bf6c249bee61b51b1ad1babf42aad4167f206.
* passed torch utests again
* fix all mxnet unittests
* delete some useless tests
* pass all tf cpu tests
* disable
* disable distributed unittest
* fix
* fix
* lint
* fix
* fix
* fix script
* fix tutorial
* fix apply edges bug
* fix 2 basics
* fix tutorial
Co-authored-by: yzh119 <expye@outlook.com >
Co-authored-by: xiang song(charlie.song) <classicxsong@gmail.com >
Co-authored-by: Ubuntu <ubuntu@ip-172-31-51-214.ec2.internal >
Co-authored-by: Ubuntu <ubuntu@ip-172-31-7-42.us-west-2.compute.internal >
Co-authored-by: Ubuntu <ubuntu@ip-172-31-1-5.us-west-2.compute.internal >
Co-authored-by: Ubuntu <ubuntu@ip-172-31-68-185.ec2.internal >
2020-07-28 14:30:41 +08:00
bcb988bdea
[Distributed] Small fix on launch script ( #1867 )
...
* update
* update
* update
* update
2020-07-27 13:44:14 +08:00
ec2e24be6d
[Feature] Slice dstnode features in NN modules ( #1838 )
...
* slice dstdata from srcdata within nn module
* a bunch of fixes
* add comment
* fix gcmc layer
* repr for blocks
* fix
* fix context
* fix
* do not copy internal columns
* docstring
2020-07-25 21:57:49 +08:00
562871e76b
[Distributed] add distributed evaluation. ( #1810 )
...
* add eval.
* extend DistTensor.
* fix.
* add barrier.
* add more print.
* add more checks in kvstore.
* fix lint.
* get all neighbors for eval.
* reorganize.
* fix.
* fix.
* fix.
* fix test.
* add reuse_if_exist.
* add test for reuse_if_exist.
* fix lint.
* fix bugs.
* fix.
* print errors of tcp socket.
* support delete tensors.
* fix lint.
* fix
* fix example
Co-authored-by: Ubuntu <ubuntu@ip-172-31-19-1.us-west-2.compute.internal >
2020-07-22 00:40:14 -07:00
5c92f6c218
[RPC] Rpc exit with explicit invocation ( #1825 )
...
* exit client
* update
* update
* update
* update
* update
* update
* update
* update test
* update
* update
* update
* update
* update
* update
* update
* update
* update
2020-07-20 14:56:26 +08:00
20734637f0
[Distributed] Fix partition ( #1821 )
...
* fix partition and print timing.
* fix lint.
Co-authored-by: Ubuntu <ubuntu@ip-172-31-19-1.us-west-2.compute.internal >
2020-07-17 16:03:37 -07:00
df3683a234
fix ( #1817 )
2020-07-17 17:46:20 +08:00
ca9d3216d0
[Distributed] Distributed launching script ( #1772 )
...
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* fix launch script.
Co-authored-by: Da Zheng <zhengda1936@gmail.com >
2020-07-16 10:20:57 -07:00
cda0abf75a
[Distributed] add the standalone mode in DistGraph ( #1800 )
...
* add standalone mode
* add comments.
* add tests for sampling.
* fix.
* make the code to run the standalone mode
* fix
* fix
* fix readme.
* fix.
* fix test
Co-authored-by: Chao Ma <mctt90@gmail.com >
2020-07-14 23:46:25 -07:00
a1472bcff6
[Distributed] Run distributed graph server inside DGL ( #1801 )
...
* run dist server in dgl.
* fix bugs.
* fix example.
* check environment variables and fix lint.
* fix lint
2020-07-14 07:41:44 -07:00
4ddd477f35
[Model] GraphSAGE inductive example ( #1741 )
...
* graphsage inductive example
* fix
2020-07-03 11:32:06 +08:00
168a88e570
[Sampling] NodeDataLoader for node classification ( #1635 )
...
* neighbor sampler data loader first commit
* more commit
* nodedataloader
* fix
* update RGCN example
* update OGB
* fixes
* fix minibatch RGCN crashing with self loop
* reverting gatconv test code
* fix
* change to new solution that doesn't require tf dataloader
* fix
* lint
* fix
* fixes
* change doc
* fix docstring
* docstring fixes
* return seeds and input nodes from data loader
* fixes
* fix test
* fix windows build problem
* add pytorch wrapper
* fixes
* add pytorch wrapper
* add unit test
* add -1 support to sample_neighbors & fix docstrings
* docstring fix
* lint
* add minibatch rgcn evaluations
Co-authored-by: xiang song(charlie.song) <classicxsong@gmail.com >
Co-authored-by: Tong He <hetong007@gmail.com >
2020-07-02 16:31:05 +08:00
Quan (Andy) Gan