dmlc--dgl
75ffc31f76
* add doc. * update DistGraph. * add DistTensor. * update DistEmbedding. * add partition.py * add sampling. * fix. * add graph partition book and create a base class. * fix test. * add rst. * update doc rst. * update. * fix. * fix docs * update distributed tensor and embeddings. * add checks. * update DistGraph. * update initialization. * fix graph partition book. * update graph partition book. * update partition. * update partition. * fix. * add example code. * update DistGraph * Update python/dgl/distributed/dist_context.py Co-authored-by: Quan (Andy) Gan <coin2028@hotmail.com> * Update python/dgl/distributed/dist_context.py Co-authored-by: Quan (Andy) Gan <coin2028@hotmail.com> * Update python/dgl/distributed/dist_dataloader.py Co-authored-by: Quan (Andy) Gan <coin2028@hotmail.com> * Update python/dgl/distributed/dist_dataloader.py Co-authored-by: Quan (Andy) Gan <coin2028@hotmail.com> * Update python/dgl/distributed/dist_dataloader.py Co-authored-by: Quan (Andy) Gan <coin2028@hotmail.com> * update initialize. * update dataloader. * update distgraph. * update DistGraph. * update DistTensor. * update. * more updates. * fix lint. * add num_nodes and num_edges Co-authored-by: Chao Ma <mctt90@gmail.com> Co-authored-by: Quan (Andy) Gan <coin2028@hotmail.com> Co-authored-by: xiang song(charlie.song) <classicxsong@gmail.com>
31 行
1.0 KiB
Python
31 行
1.0 KiB
Python
"""DGL distributed module contains classes and functions to support
|
|
distributed graph neural network training and inference in a cluster of
|
|
machines.
|
|
|
|
This includes a few submodules:
|
|
|
|
* distributed data structures including distributed graph, distributed tensor
|
|
and distributed embeddings.
|
|
* distributed sampling.
|
|
* distributed workload split at runtime.
|
|
* graph partition.
|
|
|
|
"""
|
|
import os
|
|
import sys
|
|
|
|
from .dist_graph import DistGraphServer, DistGraph, node_split, edge_split
|
|
from .dist_tensor import DistTensor
|
|
from .partition import partition_graph, load_partition, load_partition_book
|
|
from .graph_partition_book import GraphPartitionBook, PartitionPolicy
|
|
from .sparse_emb import SparseAdagrad, DistEmbedding
|
|
|
|
from .rpc import *
|
|
from .rpc_server import start_server
|
|
from .rpc_client import connect_to_server
|
|
from .dist_context import initialize, exit_client
|
|
from .kvstore import KVServer, KVClient
|
|
from .server_state import ServerState
|
|
from .dist_dataloader import DistDataLoader
|
|
from .graph_services import sample_neighbors, in_subgraph, find_edges
|