f8d6bf8e07
[Test] Fix regression ram info ( #2964 )
...
* fix regression ram info
* fix
2021-06-02 16:14:05 +08:00
caa6d6072c
[Feature] Replacing thread_wrapped_func with minimal mp.Process wrapper ( #2905 )
...
* standardizing thread_wrapped_func
* lints
* Update __init__.py
2021-05-14 11:34:49 +08:00
5de4edd1fa
[Regression] Add replace_branch.py ( #2884 )
...
* fix
* fix
* debug
* fix
* fix
* fix
* fix
* ci
* fix
* fix
* remove duplicate instruction
* need this file in the main branch
* add nightly
* Delete nightly.jenkins
2021-05-12 17:19:35 +08:00
a38bf346db
[CI] Remove duplicate instruction by bot ( #2880 )
...
* fix
* fix
* debug
* fix
* fix
* fix
* fix
* ci
* fix
* fix
* remove duplicate instruction
2021-04-28 19:21:35 +08:00
302125efd4
[Test] Add comment trigger for regression test ( #2827 )
...
* add
* fix
* f
* 111
* print
* fix
* ci
* f
* fix regex
* fix
* t
* fix
* add
* test
* fix
* fix
* fff
* fix
* 1113
* v2
* 222
* ttt2
* f2
* ff
* 11
* 121
* try
* add
* 222
* asd
* t2
* fix
* install dependency
* ff
* 图
* fix
* fix
* fix
* fix
* escape
* fix
* add url
* fix branches
* add url
* fix
* fix
* fix
* to csv
* update link
* fix
* fix
* fix
2021-04-15 16:10:29 +08:00
704ec68576
[Benchmark] Fix benchmark tests and add script to generate excel result ( #2681 )
...
* add script
* 21
* log
* fix regression tests
* add iter time
* fix
* Revert "fix"
This reverts commit 9b4587ad61dfeb82dcce6d1de188809f62947663.
* fix
* fix
* add
* add ogb instruction
* add cu11 dockerfile
* fix
* fix
* more iter apply_edge
* add iteration time
Co-authored-by: Minjie Wang <wmjlyjemaine@gmail.com >
2021-02-24 19:41:49 +08:00
22ccf4365a
[Test] Tweak end2end benchmarks to be more reasonable ( #2643 )
...
* change timeout to reasonable ranges
* rgcn ns
* fix all ns speed tests
Co-authored-by: Jinjing Zhou <VoVAllen@users.noreply.github.com >
2021-02-09 11:08:55 +08:00
0aca566000
[Regression] Fix regression tests ( #2639 )
...
* add bench jenkins
* instance type
* fix
* fix
* fix
* 111
* test
* 111
* 111
* fix
* test
* run
* fix
* fix
* fix
* fix
* fix
* publish results
* 111
* regression
* launch ec2 script
* fix
* add
* run on master
* change
* rrr
* run gpu
* fix
* fix
* try fix
* fix
* ff
* fix
* fix
* fix
* refactor
* fix
* fix
* update
* fix
* fix
* fix
* fix
* remove import torchtext
* add shm size
* update
* fix
* fix
* fix
* fix
* fix this!!!!
* 111
* fix
* remove verbose
* fix
* fix
* fix
* fix
* fix
* fix
* fix
* fix
* update readme
* fix
* fix
* fix
* change asv default to head
* commit sage and rgcn
* fix
* update
* add benchmarks
* add
* fix
* update
* remove RandomState
* tmp remove
* new batch
* fix
* fix
* fix
* address comment
* fix warning
* fix
* fix
* fix
* fix
* add multiupdate all
* address comment
* fix
* add benchmarks
* add
* fix timing
* fix
* push
* add -v
* [Example] NGCF (#2564 )
* ngcf
* ngcf
* update
Co-authored-by: zhjwy9343 <6593865@qq.com >
* Revert "[Example] NGCF (#2564 )" (#2611 )
This reverts commit a75e04f408c719289f478ca129784e05655d8def.
* fix
* change task
* fix
* fix
* fix2
* enable tensoradapter when benchmark
* minor fix
* trigger ci
* fix
* fix
* fix
* fix
* fix
* fix
* lint
* fix
Co-authored-by: Minjie Wang <wmjlyjemaine@gmail.com >
Co-authored-by: KounianhuaDu <51199171+KounianhuaDu@users.noreply.github.com >
Co-authored-by: zhjwy9343 <6593865@qq.com >
2021-02-08 17:01:35 +08:00
469088ea52
[Test] Add benchmarks for end-to-end training w/ UDF message passing ( #2609 )
...
* model acc test
* add model speed test
* [Example] NGCF (#2564 )
* ngcf
* ngcf
* update
Co-authored-by: zhjwy9343 <6593865@qq.com >
* Revert "[Example] NGCF (#2564 )" (#2611 )
This reverts commit d88a9b1b2c52becb8cc7faebceca6e52c763de19.
* use timer
Co-authored-by: KounianhuaDu <51199171+KounianhuaDu@users.noreply.github.com >
Co-authored-by: zhjwy9343 <6593865@qq.com >
Co-authored-by: Jinjing Zhou <VoVAllen@users.noreply.github.com >
Co-authored-by: Zihao Ye <expye@outlook.com >
2021-02-04 14:40:00 +08:00
d460efee3e
[Test] More regression tests ( #2591 )
...
* add bench jenkins
* instance type
* fix
* fix
* fix
* 111
* test
* 111
* 111
* fix
* test
* run
* fix
* fix
* fix
* fix
* fix
* publish results
* 111
* regression
* launch ec2 script
* fix
* add
* run on master
* change
* rrr
* run gpu
* fix
* fix
* try fix
* fix
* ff
* fix
* fix
* fix
* refactor
* fix
* fix
* update
* fix
* fix
* fix
* fix
* remove import torchtext
* add shm size
* update
* fix
* fix
* fix
* fix
* fix this!!!!
* 111
* fix
* remove verbose
* fix
* fix
* fix
* fix
* fix
* fix
* fix
* fix
* update readme
* fix
* fix
* fix
* change asv default to head
* commit sage and rgcn
* fix
* update
* add benchmarks
* add
* fix
* update
* remove RandomState
* tmp remove
* new batch
* fix
* fix
* fix
* address comment
* fix warning
* fix
* fix
* fix
* fix
* add multiupdate all
* address comment
* fix
* add benchmarks
* add
* fix timing
* fix
* push
* add -v
* [Example] NGCF (#2564 )
* ngcf
* ngcf
* update
Co-authored-by: zhjwy9343 <6593865@qq.com >
* Revert "[Example] NGCF (#2564 )" (#2611 )
This reverts commit a75e04f408c719289f478ca129784e05655d8def.
* fix
* change task
* fix
* fix
* fix2
* enable tensoradapter when benchmark
* minor fix
* trigger ci
* fix
* fix
Co-authored-by: Minjie Wang <wmjlyjemaine@gmail.com >
Co-authored-by: KounianhuaDu <51199171+KounianhuaDu@users.noreply.github.com >
Co-authored-by: zhjwy9343 <6593865@qq.com >
2021-02-03 19:10:07 +08:00
6ce2dc3415
[Test] Regression Test for update_all and apply_edges ( #2568 )
...
* add bench jenkins
* instance type
* fix
* fix
* fix
* 111
* test
* 111
* 111
* fix
* test
* run
* fix
* fix
* fix
* fix
* fix
* publish results
* 111
* regression
* launch ec2 script
* fix
* add
* run on master
* change
* rrr
* run gpu
* fix
* fix
* try fix
* fix
* ff
* fix
* fix
* fix
* refactor
* fix
* fix
* update
* fix
* fix
* fix
* fix
* remove import torchtext
* add shm size
* update
* fix
* fix
* fix
* fix
* fix this!!!!
* 111
* fix
* remove verbose
* fix
* fix
* fix
* fix
* fix
* fix
* fix
* fix
* update readme
* fix
* fix
* fix
* change asv default to head
* commit sage and rgcn
* fix
* update
* add benchmarks
* add
* fix
* update
* remove RandomState
* tmp remove
* new batch
* fix
* fix
* fix
* address comment
* fix warning
* fix
* fix
* fix
* fix
* add multiupdate all
* address comment
* fix
Co-authored-by: Minjie Wang <wmjlyjemaine@gmail.com >
2021-01-28 15:50:05 +08:00
362f72cbe9
[Test] Performance benchmarks for DGL kernels ( #2582 )
...
* add initial kernel benchmarks
* finished kernel benchmarks
* add desc
2021-01-27 21:29:48 +08:00
0c156573a3
[Test] API benchmarks ( #2542 )
...
* add bench jenkins
* instance type
* fix
* fix
* fix
* 111
* test
* 111
* 111
* fix
* test
* run
* fix
* fix
* fix
* fix
* fix
* publish results
* 111
* regression
* launch ec2 script
* fix
* add
* run on master
* change
* rrr
* run gpu
* fix
* fix
* try fix
* fix
* ff
* fix
* fix
* fix
* refactor
* fix
* fix
* update
* fix
* fix
* fix
* fix
* remove import torchtext
* add shm size
* update
* fix
* fix
* fix
* fix
* fix this!!!!
* 111
* fix
* remove verbose
* fix
* fix
* fix
* fix
* fix
* fix
* fix
* fix
* update readme
* fix
* fix
* fix
* change asv default to head
* commit sage and rgcn
* fix
* update
* add benchmarks
* add
* fix
* update
* remove RandomState
* tmp remove
* new batch
* fix
* fix
* fix
* address comment
* fix warning
* fix
Co-authored-by: Minjie Wang <wmjlyjemaine@gmail.com >
2021-01-20 20:02:54 +08:00
c29daaef56
Add API benchmarks ( #2522 )
...
* add bench jenkins
* instance type
* fix
* fix
* fix
* 111
* test
* 111
* 111
* fix
* test
* run
* fix
* fix
* fix
* fix
* fix
* publish results
* 111
* regression
* launch ec2 script
* fix
* add
* run on master
* change
* rrr
* run gpu
* fix
* fix
* try fix
* fix
* ff
* fix
* fix
* fix
* refactor
* fix
* fix
* update
* fix
* fix
* fix
* fix
* remove import torchtext
* add shm size
* update
* fix
* fix
* fix
* fix
* fix this!!!!
* 111
* fix
* remove verbose
* fix
* fix
* fix
* fix
* fix
* fix
* fix
* fix
* update readme
* fix
* fix
* fix
* change asv default to head
* commit sage and rgcn
* fix
* update
* add benchmarks
* add
* fix
* update
* remove RandomState
* tmp remove
Co-authored-by: Minjie Wang <wmjlyjemaine@gmail.com >
2021-01-14 15:53:28 +08:00
5d4995e6e8
Update README.md ( #2510 )
...
fix typo
Co-authored-by: Quan (Andy) Gan <coin2028@hotmail.com >
2021-01-12 13:14:10 +08:00
71283997ce
Integrate Regression Test with Jenkins ( #2448 )
...
* add bench jenkins
* instance type
* fix
* fix
* fix
* 111
* test
* 111
* 111
* fix
* test
* run
* fix
* fix
* fix
* fix
* fix
* publish results
* 111
* regression
* launch ec2 script
* fix
* add
* run on master
* change
* rrr
* run gpu
* fix
* fix
* try fix
* fix
* ff
* fix
* fix
* fix
* refactor
* fix
* fix
* update
* fix
* fix
* fix
* fix
* remove import torchtext
* add shm size
* update
* fix
* fix
* fix
* fix
* fix this!!!!
* 111
* fix
* remove verbose
* fix
* fix
* fix
* fix
* fix
* fix
* fix
* fix
* update readme
* fix
* fix
* fix
* change asv default to head
* commit sage and rgcn
* fix
* update
2021-01-11 16:01:51 +08:00
16169f3a9d
[Test] Regression speed test for rgcn with neighbor sampling ( #2461 )
...
* Add sage neighbor sample test for reddit
* Add ogbn-products dataset
* upd
* upd
* Add ogbn-mag
* rgcn heterogeneous performance test
* upd
* update
* upd
* upd
* use dgl dataloader
* upd
* Update with new collator
Co-authored-by: Ubuntu <ubuntu@ip-172-31-59-204.ec2.internal >
2021-01-10 00:03:45 +08:00
63327acfea
[Test] Pinsage speed regression test ( #2467 )
...
* Add sage neighbor sample test for reddit
* Add ogbn-products dataset
* upd
* upd
* use symbolic other than copy data for ogb datasets
* upd
* upd
* Add graphsage unsupervised neighbor sampler
* update unsupervised
* Add pinsage
* Add pinsage speed
* upd
Co-authored-by: Ubuntu <ubuntu@ip-172-31-59-204.ec2.internal >
2021-01-05 00:14:35 +08:00
d3c1645550
[Performance][Test] New low memory implementation for RGCN and related regression tests ( #2468 )
...
* WIP
* finish lowmem impl; benchmarking
* wip
* wip
* fix benchmarks
* fix bug in searchsorted
* update readme
* update
* lint and ogb dependency
* add flags to to_homogeneous
* fix docstring
* address comments
2021-01-04 22:23:59 +08:00
a3d86376d9
[Test] Regression speed test for GAT neighbor sampler ( #2462 )
...
* Add gat neighbor sampler speed
* upd
Co-authored-by: Ubuntu <ubuntu@ip-172-31-59-204.ec2.internal >
2021-01-03 22:16:44 +08:00
1ac70abbc9
[Test] Update unsupervised regression speed test ( #2460 )
...
* Add sage neighbor sample test for reddit
* Add ogbn-products dataset
* upd
* upd
* use symbolic other than copy data for ogb datasets
* upd
* upd
* Add graphsage unsupervised neighbor sampler
* update unsupervised
* upd
* upd
Co-authored-by: Ubuntu <ubuntu@ip-172-31-59-204.ec2.internal >
Co-authored-by: Minjie Wang <wmjlyjemaine@gmail.com >
2020-12-29 00:35:36 +08:00
5d8330ccad
[Test] Add model speed and accuracy tests for RGCN ( #2458 )
...
* add rgcn acc bench
* fix issue of multiple parametrize
* model acc/speed test: RGCN
* fix dep problem in docker run
* add docstring
2020-12-28 10:20:50 +08:00
f8b3ebcecc
[Regression Test] Add sage neighbor sample test for reddit ( #2449 )
...
* Add sage neighbor sample test for reddit
* Add ogbn-products dataset
* upd
* upd
* use symbolic other than copy data for ogb datasets
* upd
* upd
* Add graphsage unsupervised neighbor sampler
Co-authored-by: Ubuntu <ubuntu@ip-172-31-59-204.ec2.internal >
Co-authored-by: Minjie Wang <wmjlyjemaine@gmail.com >
2020-12-27 11:00:18 +08:00
6634b984f4
[Test] Basic regression test setup. ( #2415 )
...
* add machine name
* update scripts
* update script
* test commit
* change run.sh
* model acc bench for gcn and sage
* get basic pipeline setup for local benchmarking
* try to bridge pytest with asv
* fix deps
* move asv to other folders
* move dir
* update script
* new setup
* delete useless file
* delete outputs
* remove dependency on pytest
* update script
* test commit
* stuck by torch version in dgl-ci-gpu
* update readme
* update asv conf
* missing files
* remove the old regression folder
* api bench
* add batch api bench
Co-authored-by: Jinjing Zhou <VoVAllen@users.noreply.github.com >
2020-12-15 14:35:15 +08:00
Jinjing Zhou