5e34ca8bb5
[Feature] Lazy copy ndata, edata to device ( #1986 )
...
* Lazy to device
* remove print
* lint
* Fix
* Fix
* Fix
* Fix
* Fix
* Fix
* Fix
* lint
* Fix
* Revert "Fix"
This reverts commit 615c9b8f80f5f6ee2ab43c849a22f0083deedf3b.
* Add test for frame lazy update
* disable tensorflow
* upd
Co-authored-by: Ubuntu <ubuntu@ip-172-31-51-214.ec2.internal >
Co-authored-by: Minjie Wang <wmjlyjemaine@gmail.com >
2020-08-12 13:04:47 +08:00
d1cf5c383e
[Distributed] adjust various APIs. ( #1993 )
...
* rename get_data_size.
* remove g from DistTensor.
* remove g from DistEmbedding.
* clean up API of graph partition book.
* fix DistGraph
* fix lint.
* collect all part policies.
* fix.
* fix.
* support distributed sampler.
* remove partition.py
2020-08-11 20:22:00 -07:00
4efa332044
[Distributed] Move server start code to initialize. ( #2002 )
...
* move server start code to initialize.
* fix.
* fix lint.
* fix examples.
* add more checks.
2020-08-11 16:58:18 -07:00
0f56575938
[feature] Allow copy_e + udf reduce function ( #1996 )
...
* up
* pylint
2020-08-11 18:47:40 +08:00
f5eb80d221
[Feature] Edge DataLoader for edge classification & link prediction ( #1828 )
...
* clean commit
* oops forgot the most important files
* use einsum
* copy feature from frontier to block
* Revert "copy feature from frontier to block"
This reverts commit 5224ec963eb6a3ef1b6ab74d8ecbd44e4e42f285.
* temp fix
* unit test
* fix
* revert jtnn
* lint
* fix win64
* docstring fixes and doc indexing
* revert einsum in sparse bidecoder
* fix some examples
* lint
* fix due to some tediousness in remove_edges
* addresses comments
* fix
* more jtnn fixes
* fix
2020-08-11 18:00:58 +08:00
d340ea3aa8
[Distributed] Remove server_count from ip_config.txt ( #1985 )
...
* remove server_count from ip_config.txt
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* lint
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* Update dist_context.py
* fix lint.
* make it work for multiple spaces.
* update ip_config.txt.
* fix examples.
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* udpate
* update
* update
* update
* update
* update
Co-authored-by: Da Zheng <zhengda1936@gmail.com >
Co-authored-by: Ubuntu <ubuntu@ip-172-31-19-1.us-west-2.compute.internal >
2020-08-11 17:41:48 +08:00
71f4230a8b
[Fix] OpenMP compatibility issues ( #1992 )
...
* fix OpenMP compatibility issues
* typo
Co-authored-by: Jinjing Zhou <VoVAllen@users.noreply.github.com >
2020-08-11 14:26:34 +08:00
a089b91fdf
Remove stale partition code and fix #1949 ( #1984 )
...
* remove unused code
* fix litn
* fix
2020-08-11 10:51:07 +08:00
ee30b2aadd
[Distributed] Fix standalone ( #1974 )
...
* fix tests.
* fix.
* remove a test.
* make code work in the standalone mode.
* fix example.
* more fix.
* make DistDataloader work with num_workers=0
* fix DistDataloader tests.
* fix.
* fix lint.
* fix cleanup.
* fix test
* remove unnecessary code.
* remove tests.
* fix.
* fix.
* fix.
* fix example
* fix.
* fix.
* fix launch script.
Co-authored-by: Jinjing Zhou <VoVAllen@users.noreply.github.com >
Co-authored-by: Ubuntu <ubuntu@ip-172-31-19-1.us-west-2.compute.internal >
2020-08-10 15:49:28 -07:00
c2cd6eb22e
[Doc] Reorg doc ( #1989 )
2020-08-10 23:19:03 +08:00
e4b4fcffc2
hotfix ( #1987 )
...
Co-authored-by: Ubuntu <ubuntu@ip-172-31-51-214.ec2.internal >
2020-08-10 22:06:25 +08:00
729ff2ef38
Fix the performance issue of graph partitioning in new DGLGraph ( #1934 )
...
* fix perf.
* fix.
* accelerate metis.
* fix lint.
* use gklib.
* fix perf.
* fix.
* update metis.
* update launch script
* handle synchronized API.
* fix.
* fix example.
* fix dataloader.
* temp fix.
* temp fix omp.
* distinguish roles.
* initialize iterator of DistDataloader correctly.
* check the correctness of launch script.
* move feature copy to sampler.
* measure mem/network copy time.
* remove
* Revert "measure mem/network copy time."
This reverts commit 86cefdc14b7815fcf5aad6496af912dba48e4aa6.
* fix.
* fix
* fix.
* fix cmake.
* disable metis in windows.
* disable metis tests in windows.
* remove test for multigraph.
* fix test.
* fix.
* fix cmake.
* fix.
* revert.
Co-authored-by: Ubuntu <ubuntu@ip-172-31-19-115.us-west-2.compute.internal >
Co-authored-by: Ubuntu <ubuntu@ip-172-31-19-1.us-west-2.compute.internal >
2020-08-09 18:33:05 -07:00
4ef01dbb05
[Example] Rgcn support ogbn-mag dataset. ( #1812 )
...
* rgcn support ogbn-mag dataset
* upd
* multi-gpu val and test
* Fix
* fix
* Add support for ogbn-mag
* Fix
* Fix
* Fix
* Fix
* Add layer_norm
* update
* Fix merge
* Clean some code
* update Readme
* upd
Co-authored-by: Ubuntu <ubuntu@ip-172-31-68-185.ec2.internal >
Co-authored-by: Ubuntu <ubuntu@ip-172-31-87-240.ec2.internal >
Co-authored-by: Ubuntu <ubuntu@ip-172-31-51-214.ec2.internal >
2020-08-09 15:56:15 +08:00
e75157738b
hotfix ( #1980 )
...
Co-authored-by: Ubuntu <ubuntu@ip-172-31-87-240.ec2.internal >
2020-08-09 11:25:13 +08:00
b9ef70e5ac
[Distributed] Set the number of threads correctly to speed up ( #1976 )
...
* temp fix omp.
* set server threads.
* add CAPI to set up OMP threads.
* fix.
* fix.
* update namesapce.
* set cpi properly.
* allow to config num worker threads.
* set #threads.
* fix.
2020-08-08 19:30:53 -07:00
f7ce48bcd4
[NN] Fix error message of GatedGraphConv ( #1964 )
...
Co-authored-by: Zihao Ye <expye@outlook.com >
2020-08-08 23:01:07 +08:00
5454471fc8
[Distributed] Add roles ( #1971 )
...
* distinguish roles.
* add comments.
* fix lint.
* move roles to server_state.
* fix text.
* fix tests.
* fix tests.
* Revert "fix tests."
This reverts commit 5baa136b872a4550d4e612bfb1dfe363d7814adf.
2020-08-08 01:41:51 -07:00
2823c61f37
[Distributed] Fix synchronized APIs in kvstore ( #1948 )
...
* handle synchronized API.
* fix.
* fix.
* fix.
Co-authored-by: Chao Ma <mctt90@gmail.com >
2020-08-07 19:01:52 -07:00
bab32d5ba1
[Distributed] Fix dataloader ( #1970 )
...
* fix dataloader.
* initialize iterator of DistDataloader correctly.
* update test.
2020-08-07 18:09:21 -07:00
264d96cdf5
[bugfix] Fix a bunch of examples to be compatible with dgl 0.5 ( #1957 )
...
* upd
* upd
* upd
* upd
* upd
* upd
* fix pinsage also
* upd
* upd
* upd
Co-authored-by: Ubuntu <ubuntu@ip-172-31-29-3.us-east-2.compute.internal >
Co-authored-by: Quan Gan <coin2028@hotmail.com >
Co-authored-by: Jinjing Zhou <VoVAllen@users.noreply.github.com >
2020-08-08 01:31:23 +08:00
18bfec24cf
[hotfix] Refactor edge softmax module ( #1967 )
...
* upd
* upd
* upd
* upd
* upd
* upd
* upd
* upd
2020-08-07 23:50:12 +08:00
22167f7203
[Refactor] Enable new kernel in all message passing APIs ( #1953 )
...
* WIP: frame refactor
* new frame
* simple update_all builtin
* move all subgraph routines into the same file
* sddmm & spmm schedule; node & edge udf
* degree bucketing
* some tricky 0deg corner cases
* bug in frame append
* merge test_hetero_basics and test_basics
* some code rearange
* fix test_heterograph
* add mean spmm
* enable all builtin combinations
* pass gpu test
* pass pytorch tests
* wip
* fix some pt debugging codes
* fix bug in mxnet backward
* pass all mxnet utests
* passed tf tests
* docstring
* lint
* lint
* fix broadcasting bugs
* add warning and clamp for mean reducer
* add test for zero-degree mean
* address comments
* lint
* small fix
2020-08-07 15:40:25 +08:00
5d5436ba18
[Dataset] RedditDataset change data.train_mask to numpy array ( #1961 )
...
* PPIDataset
* Revert "PPIDataset"
This reverts commit 264bd0c960cfa698a7bb946dad132bf52c2d0c8a.
* Update reddit.py
Co-authored-by: xiang song(charlie.song) <classicxsong@gmail.com >
2020-08-07 15:22:13 +08:00
35c9473ba5
[HotFix] Fix add_reverse_edges ( #1960 )
...
* Hot fix
* more test
Co-authored-by: Ubuntu <ubuntu@ip-172-31-51-214.ec2.internal >
2020-08-07 13:07:06 +08:00
78651016f4
[Hot fix][Dataset] knowledge graph dataset statistics output ( #1952 )
...
* Hot fix
* Fix
Co-authored-by: Ubuntu <ubuntu@ip-172-31-51-214.ec2.internal >
2020-08-06 20:20:20 +08:00
13ea9ddb06
[Doc] Fix some format issues in dataset api doc ( #1951 )
...
* PPIDataset
* Revert "PPIDataset"
This reverts commit 264bd0c960cfa698a7bb946dad132bf52c2d0c8a.
* update doc
Co-authored-by: Jinjing Zhou <VoVAllen@users.noreply.github.com >
2020-08-06 16:51:46 +08:00
967ecb8064
[Dataset] Fix the docstring format for dgl.data section ( #1941 )
...
* PPIDataset
* Revert "PPIDataset"
This reverts commit 264bd0c960cfa698a7bb946dad132bf52c2d0c8a.
* update data rst
* update data doc and docstring
* API doc rst for dataset
* docstring
* update api doc
* add url format
* update docstring
* update citation graph
* update knowledge graph
* update gc datasets
* fix index
* Rst fix (#3 )
* Fix syntax
* syntax
* update docstring
* update doc (#4 )
* final update
* fix rdflib
* fix rdf
Co-authored-by: HuXiangkun <huxk_hit@qq.com >
Co-authored-by: Ubuntu <ubuntu@ip-172-31-51-214.ec2.internal >
Co-authored-by: xiang song(charlie.song) <classicxsong@gmail.com >
2020-08-06 14:47:49 +08:00
f9bde91fbd
[hotfix] Remove dead code ( #1942 )
...
* Remove dead code
* Fix
Co-authored-by: Ubuntu <ubuntu@ip-172-31-51-214.ec2.internal >
2020-08-05 23:16:46 +08:00
4f499c7ffb
[Distributed] DistDataloader ( #1901 )
...
* 111
* 111
* fix
* 111
* fix
* 11
* fix
* lint
* Update __init__.py
* lint
* fix
* lint
* fix
* fix
* fix
* fix
* fix
* try fix
* try fix
* fix
* Revert "fix"
This reverts commit a0b954fd4e99b7df92b53db8334dcb583d6e1551.
* fixes.
* fix.
* fix test.
* fix exit.
* fix.
* fix
* fix
* lint
* lint
* lint
* fix
* Update .gitignore
* 111
* fix
* 111
* 111
* fff
* 1111
* 111
* 1325315
* ffff
* f???
* fff
* 1111
* 111
* fix
* 111
* asda
* 1111
* 11
* 123
* 啊啊啊啊啊啊啊啊啊啊啊啊啊啊啊啊
* spawn
* 1231231
* up
* 111
* fix
* fix
* Revert "fix"
This reverts commit 7373f95312fdcaa36d2fc330bf242339e89c045d.
* fix
* fix
* 1111
* fix
* fix tests
* start kvclient as early as possible.
* lint
* fix test
* lint
* 1111
* fix
* fix
* 111
* fix
* fix
* 1
* fix
* fix
* lint
* fix
* lint
* lint
* remove quit
* fix
* lint
* fix
* fix several
* lint
* fix minor
* fix
* lint
Co-authored-by: Da Zheng <zhengda1936@gmail.com >
Co-authored-by: xiang song(charlie.song) <classicxsong@gmail.com >
2020-08-05 17:43:17 +08:00
c801a164ee
[hotfix] Allow broadcastable expand in the backward phase of gspmm ( #1939 )
...
* upd
* upd
* upd
* upd
* upd
* trigger
* simplify unittest
* patch-sp
Co-authored-by: Jinjing Zhou <VoVAllen@users.noreply.github.com >
2020-08-05 17:02:25 +08:00
879e4ae5f2
[Transform] Add add_reverse_edges ( #1936 )
...
* Add add_reverse_edges and is_simple_graph
Update to_bidirected
* remove is_simple_graph
* Fix lint
* to bidirected only support cpu
* support copy ndata
* upd
Co-authored-by: Ubuntu <ubuntu@ip-172-31-51-214.ec2.internal >
2020-08-05 15:09:55 +08:00
823eb5be1b
[Doc] dgl.sampling docstring fixes ( #1928 )
2020-08-04 17:12:46 +08:00
451ed6d836
[Dataset] SBMMixtureDataset ( #1920 )
...
* PPIDataset
* Revert "PPIDataset"
This reverts commit 264bd0c960cfa698a7bb946dad132bf52c2d0c8a.
* SBMMixture dataset
* Update sbm.py
* fix example
* Update sbm.py
* Revert "Update sbm.py"
This reverts commit 066db5c89bd5e159981ae7cad1bfb883ea5db71d.
* Update sbm.py
Co-authored-by: xiang song(charlie.song) <classicxsong@gmail.com >
2020-08-04 15:06:53 +08:00
d2ccd218cf
[hotfix] Allow creating graph from edges with restrict formats excluding coo. ( #1926 )
...
* upd
* upd
* upd
* upd
2020-08-04 00:33:36 +08:00
2c141229d5
[Dataset] RedditDataset ( #1914 )
...
* PPIDataset
* Revert "PPIDataset"
This reverts commit 264bd0c960cfa698a7bb946dad132bf52c2d0c8a.
* RedditDataset
* Update reddit.py
Co-authored-by: xiang song(charlie.song) <classicxsong@gmail.com >
2020-08-03 23:49:22 +08:00
37aa99c510
[Dataset] GNNBenchmarkDataset ( #1912 )
...
* PPIDataset
* Revert "PPIDataset"
This reverts commit 264bd0c960cfa698a7bb946dad132bf52c2d0c8a.
* gnn benchmark dataset
* Update gnn_benckmark.py
Co-authored-by: xiang song(charlie.song) <classicxsong@gmail.com >
2020-08-03 23:28:58 +08:00
56339b34bf
[Fix] Update ogb examples according to new API. ( #1922 )
...
* upd
* upd
Co-authored-by: Ubuntu <ubuntu@ip-172-31-29-3.us-east-2.compute.internal >
2020-08-03 23:08:50 +08:00
001d793711
[Dataset] SSTDataset ( #1918 )
...
* PPIDataset
* Revert "PPIDataset"
This reverts commit 264bd0c960cfa698a7bb946dad132bf52c2d0c8a.
* SSTDataset
* Update tree.py
2020-08-03 19:15:28 +08:00
73b9c6f18c
[Dataset] GDELTDataset ( #1911 )
...
* PPIDataset
* Revert "PPIDataset"
This reverts commit 264bd0c960cfa698a7bb946dad132bf52c2d0c8a.
* gdelt dataset
* Update gdelt.py
Co-authored-by: xiang song(charlie.song) <classicxsong@gmail.com >
2020-08-03 17:43:50 +08:00
06ea03d0f8
[Dataset] ICEWS18Dataset ( #1913 )
...
* PPIDataset
* Revert "PPIDataset"
This reverts commit 264bd0c960cfa698a7bb946dad132bf52c2d0c8a.
* ICEWS18Dataset
Co-authored-by: xiang song(charlie.song) <classicxsong@gmail.com >
2020-08-03 17:07:02 +08:00
b5be4f4bbf
[Dataset] Update dataset hash with deterministic function ( #1919 )
...
* update hash with deterministic function
* update docstring
* add test on determination
2020-08-03 16:17:00 +08:00
39ed096630
[Dataset] Builtin LegacyTUDataset and TUDataset ( #1891 )
...
* add LegacyTUDataset and TUDataset
* update docstrings and url
* update docstrings
* add hash to fix save/load
* update docstring and use hash
Co-authored-by: xiang song(charlie.song) <classicxsong@gmail.com >
2020-08-03 14:40:36 +08:00
65e9644e54
[Bugfix] Fix _deprecate not found error for now ( #1916 )
2020-08-03 12:59:23 +08:00
22485e58d3
[Dataset] BitcoinOTCDataset ( #1910 )
...
* PPIDataset
* Revert "PPIDataset"
This reverts commit 264bd0c960cfa698a7bb946dad132bf52c2d0c8a.
* bitcoinotc dataset
* Update bitcoinotc.py
2020-08-03 12:15:04 +08:00
d22f96feb4
[Dataset] QM7bDataset ( #1915 )
...
* PPIDataset
* Revert "PPIDataset"
This reverts commit 264bd0c960cfa698a7bb946dad132bf52c2d0c8a.
* QM7bDataset
* Update qm7b.py
Co-authored-by: xiang song(charlie.song) <classicxsong@gmail.com >
2020-08-03 11:58:31 +08:00
a4c931a9bf
[Distributed] Support multiple servers ( #1886 )
...
* client init graph on the backup servers.
* fix.
* test multi-server.
* fix anonymous dist tensors.
* check #parts.
* fix init_data
* add multi-server multi-client tests.
* update tests in kvstore.
* fix.
* verify the loaded partition.
* fix a bug.
* fix lint.
* fix.
* fix example.
* fix rpc.
* fix pull/push handler for backup kvstore
* fix example readme.
* change ip.
* update docstring.
Co-authored-by: Ubuntu <ubuntu@ip-172-31-19-1.us-west-2.compute.internal >
2020-08-02 19:50:34 -07:00
9bcce7bead
[Dataset] PPIDataset ( #1906 )
...
* PPIDataset
* Revert "PPIDataset"
This reverts commit 264bd0c960cfa698a7bb946dad132bf52c2d0c8a.
* Revert "Revert "PPIDataset""
This reverts commit 6938a4cbe3ac6e38d3e0188b5699e5c952a6102e.
* update doc string
Co-authored-by: xiang song(charlie.song) <classicxsong@gmail.com >
2020-08-03 00:30:01 +08:00
743c38401c
[Dataset] KarateClubDataset ( #1897 )
...
* karateclub dataset
* PPIDataset
* Revert "PPIDataset"
This reverts commit 264bd0c960cfa698a7bb946dad132bf52c2d0c8a.
* Update karate.py
* doc string
Co-authored-by: xiang song(charlie.song) <classicxsong@gmail.com >
2020-08-02 22:39:11 +08:00
cb2c4ec17b
Fix ( #1909 )
...
Co-authored-by: Ubuntu <ubuntu@ip-172-31-51-214.ec2.internal >
2020-08-02 14:53:21 +08:00
56bbf9cb6d
[Distributed][Example] Distributed training for unsupervised graphsage ( #1853 )
...
* Standalone can run
* fix
* Add save
* Fix
* Fix
* Fix
* Fix
* debug
* test
* test
* Fix
* Fix
* log
* Fix
* fix
* Profile
* auto sync grad
* update
* add test for unsupervised dist training
* upd
* Fix lr
* Fix update
* sync
* fix
* Revert "fix"
This reverts commit d5caa7398b36125f6d6e2c742a95c6ff4298c9e9.
* Fix
* unsupervised
* Fix
* remove debug
* Add test case for dist_graph find_edges()
* Fix
* skip tensorflow test for find_edges
* Update readme
* remove some test
* upd
* Update partition_graph.py
Co-authored-by: Ubuntu <ubuntu@ip-172-31-68-185.ec2.internal >
Co-authored-by: Ubuntu <ubuntu@ip-172-31-24-210.ec2.internal >
Co-authored-by: Da Zheng <zhengda1936@gmail.com >
2020-08-01 12:24:55 -07:00
xiang song(charlie.song)