8ab27b0581
[DistGB] enable replacement sampling with GraphBolt API ( #7202 )
2024-03-08 14:02:48 +08:00
3fd6a5d081
[DistDGL] Fixing warning in test_new_kvstore. ( #7180 )
2024-03-07 15:46:04 +08:00
a6505e86a4
[DistGB] revert toindex() but refine tests ( #7197 )
2024-03-06 09:56:40 +08:00
d8d87243c8
[DistGB] restrict NID/EID as int64_t ( #7177 )
2024-02-29 16:03:34 +08:00
ebf505ee92
[DistGB] update top level API about use_graphbolt ( #7169 )
2024-02-28 15:20:37 +08:00
d1bea9e87f
[DistGB] format dtype when converting partition to GraphBolt format ( #7150 )
2024-02-28 09:24:39 +08:00
045beeba14
[DistGB] remove toindex() as torch tensor is always be expected ( #7146 )
2024-02-26 14:04:35 +08:00
63541c88f1
[DistGB] enable int32 id ranges in IdMap ( #7144 )
2024-02-26 10:28:59 +08:00
b0080d5bac
[DistGB] add graphbolt flag into top level API ( #7122 )
2024-02-22 09:26:45 +08:00
8e6cbd621f
[DistGB] sample with graphbolt on heterograph via DistNodeDataLoader ( #7112 )
2024-02-09 15:51:39 +08:00
6735a3ae3d
[DistGB] enable sample etype neighbors on heterograph ( #7095 )
2024-02-09 10:09:16 +08:00
3ebdee7768
[DistGB] sample with graphbolt on homograph via DistNodeDataLoader ( #7108 )
2024-02-09 09:58:32 +08:00
763bd39ff5
[DistGB] sample with graphbolt on homograph via DistDataLoader ( #7098 )
2024-02-08 10:37:01 +08:00
ee8b7b39ce
[DistGB] enable GB sampling on heterograph ( #7087 )
2024-02-06 11:22:38 +08:00
4ee0a8bddb
[DistGB] return global eids from GB sampling on homograph ( #7085 )
2024-02-05 13:22:44 +08:00
f3af2a9fd4
[DistGB] return eids together with etype_ids in sampling ( #7084 )
2024-02-05 09:48:20 +08:00
6459a688ae
[DistGB] enable GB sampling on homograph ( #7061 )
2024-02-04 10:39:44 +08:00
571340dac6
[DistGB] update partition_graph to support graphbolt ( #7053 )
2024-02-01 11:37:43 +08:00
df6b3250f4
[DistGB] enable DistGraph to load graphbolt partitions ( #7048 )
2024-02-01 09:39:50 +08:00
366fb02fbd
[DistGB] enable to load GB partitions ( #7029 )
2024-01-26 12:38:25 +08:00
0bfe34d96b
[DistGB] refine convertion from dgl to graphbolt ( #7007 )
2024-01-25 14:55:25 +08:00
1a8e0c00a9
[GraphBolt] remove GraphMeta and update API accordingly ( #6709 )
2023-12-12 14:49:50 +08:00
c213444268
[GraphBolt] use torch.load/save instead of load/save_fused_xxx() ( #6707 )
2023-12-07 17:17:31 +08:00
3cdc37ccd7
[GraphBolt] add ntype/etype_to_id into graph and save/load() ( #6687 )
2023-12-05 15:56:10 +08:00
19c6491b66
[DistGB] recover dist unit tests while skip unstable ones ( #6582 )
2023-11-21 16:44:10 +08:00
91fe0c9069
[GraphBolt] Refactor CSCSamplingGraph and update the corresponding method. ( #6515 )
2023-11-04 03:09:14 +08:00
0d9b6bfd5a
[TensorpipeDeprecation] remove long live server support from DistDGL ( #5931 )
2023-07-03 09:26:27 +08:00
9c5250829f
[Misc] remove unnecessary print() from test_partition.py
2023-06-15 13:55:42 +08:00
1e886cb9cf
[DistDGL] sort node/edge_map to obtain expected id ranges ( #5872 )
2023-06-15 13:53:53 +08:00
0f3223310d
[DistDGL] remove tensorpipe from python APIs ( #5848 )
2023-06-09 16:35:51 +08:00
00972deecf
[GraphBolt] convert dgl partition to CSCSamplingGraph ( #5736 )
2023-05-29 16:49:39 +08:00
fbb26ee5f6
[Dist] fix crash issue if empty test set ( #5653 )
2023-05-11 17:21:31 +08:00
5b409bf7f5
Rename_test ( #5487 )
...
Co-authored-by: Ubuntu <ubuntu@ip-172-31-28-63.ap-northeast-1.compute.internal >
2023-03-24 18:44:24 +08:00
f0759a96ee
[Misc] Auto-reformat test/. ( #5324 )
...
* auto-format-test
* more
* remove
---------
Co-authored-by: Ubuntu <ubuntu@ip-172-31-28-63.ap-northeast-1.compute.internal >
2023-02-19 22:50:37 +08:00
56ffb650fe
[API Deprecation]Deprecate contrib module ( #5114 )
2023-01-06 20:16:01 +08:00
3a2a5031e9
[API Deprecation]Deprecate candidates in dgl.distributed ( #5116 )
2023-01-06 16:17:44 +08:00
f40db9b743
[Dist][Test] Add exit_code asserts in some distributed tests ( #5053 )
...
Signed-off-by: Serge Panev <spanev@nvidia.com >
Signed-off-by: Serge Panev <spanev@nvidia.com >
2022-12-21 09:03:13 +08:00
611393021a
[API Deprecation] Remove candidates in DGLGraph ( #4946 )
2022-12-01 16:41:53 +08:00
cd3fa03035
[Dist] init node/edge data store for Node/EdgeDataView in appropriate place ( #4906 )
...
* [Dist] instantiate NodeDataView in lazy mode
* fix test failure
* init node/edge data store at the very beginning
* fix test failures
* refine comment
* add more tests
2022-11-21 09:52:36 +08:00
6e1cc7dac2
[Dist] fix is_node check according to policy ( #4911 )
...
* [Dist] fix is_node check according to policy
* add more tests
2022-11-17 09:27:50 +08:00
5f0b61b858
[Dist] enable access DistGraph.edges via canonical etype ( #4814 )
...
* [Dist] enable access DistGraph.edges via canonical etype
* refine code
* refine test
* refine code
2022-11-07 21:35:41 +08:00
ed8e9c4440
[Dist] deprecate etype and always use canonical etype for partition and load ( #4777 )
...
* [Dist] deprecate etype and always use canonical etype for partition and load
* enable canonical etypes in dist part pipeline
* resolve rebase conflicts
* fix lint
* fix test failure
* throw exception if outdated part config is loaded
* refine
* refine
* revert unnecessary change
* fix typo
2022-11-04 10:08:18 +08:00
2caa6bd02d
[Dist] Enable save and load for Distributed Optimizer ( #4752 )
...
* add save/load for distributed optimizer
Co-authored-by: Ubuntu <ubuntu@ip-172-31-16-19.ap-northeast-1.compute.internal >
2022-11-01 14:30:16 +08:00
2bca4759c1
[Sampling] Enable sampling with edge masks in sample_etype_neighbors ( #4749 )
...
* sample neighbors with masks
* oops
* refactor again
* remove
* remove debug code
* rename macro
* address comments
* more stuff
* remove
* fix
* try fix unit test
* oops
* fix test
* oops
* change name
* rename a lot of stuff
* oops
* ugh
* misc fixes
* lint
* address a lot of comments
* lint
* lint
* fix
* that was silly
* fix
* fix
* fix
* oops
2022-10-29 15:49:44 +08:00
1990e797e1
[Dist] Reduce startup overhead: sort etypes and save in specified formats ( #4735 )
...
* [Dist] reduce startup overhead: enable to save in specified formats
* [Dist] reduce startup overhead: sort partitions when generating
* sort csc/csr only whenmultiple etypes
* refine
2022-10-26 19:07:10 +08:00
b13092172d
[Dist] Reduce peak memory in DistDGL ( #4687 )
...
* [Dist] Reduce peak memory in DistDGL: avoid validation, release memory once loaded
* remove orig_id from ndata/edata for partition_graph()
* delete orig_id from ndata/edata in dist part pipeline
* reduce dtype size and format before saving graphs
* fix lint
* ETYPE requires to be int32/64 for CSRSortByTag
* fix test failure
* refine
2022-10-17 13:35:55 +08:00
408eba2479
Multiple dist dl sampler ( #4704 )
...
* [Dist] enable iterate multiple dist dataloaders simultaneously
* format file
* add support for any number of dataloaders
* fix lint
* refine code
2022-10-12 15:51:45 +08:00
89a4cc4db2
[Misc] Black auto fix. ( #4694 )
...
Co-authored-by: Steve <ubuntu@ip-172-31-34-29.ap-northeast-1.compute.internal >
2022-10-11 00:12:30 +08:00
5bf17547f7
[DistTensor] add bitwise or function ( #4638 )
...
* first commit
* add test
* fixes
* ah this is how you skip setup
* fix
* ugh
* address comments
* i like black
2022-09-30 19:38:37 +08:00
39987bc599
[Feature] enable graph partition book support canonical etypes ( #4343 )
...
* [Feature] enable graph partition book support canonical etypes
* fix lint
* fix lint
* add todo
* refine according to review comments
* fix lint
* refine naming
* revert PartitionPolicy __init__
* refine docstring
* fix doc string
2022-08-16 11:52:02 +08:00
Rhett Ying