dmlc--dgl
0a56d65223
* upd
* fig edgebatch edges
* add test
* trigger
* Update README.md for pytorch PinSage example.
Add noting that the PinSage model example under
example/pytorch/recommendation only work with Python 3.6+
as its dataset loader depends on stanfordnlp package
which work only with Python 3.6+.
* Provid a frame agnostic API to test nn modules on both CPU and CUDA side.
1. make dgl.nn.xxx frame agnostic
2. make test.backend include dgl.nn modules
3. modify test_edge_softmax of test/mxnet/test_nn.py and
test/pytorch/test_nn.py work on both CPU and GPU
* Fix style
* Delete unused code
* Make agnostic test only related to tests/backend
1. clear all agnostic related code in dgl.nn
2. make test_graph_conv agnostic to cpu/gpu
* Fix code style
* fix
* doc
* Make all test code under tests.mxnet/pytorch.test_nn.py
work on both CPU and GPU.
* Fix syntex
* Remove rand
* Start implementing masked-mm kernel.
Add base control flow code.
* Add masked dot declare
* Update func/variable name
* Skeleton compile OK
* Update Implement. Unify BinaryDot with BinaryReduce
* New Impl of x_dot_x, reuse binary reduce template
* Compile OK.
TODO:
1. make sure x_add_x, x_sub_x, x_mul_x, x_div_x work
2. let x_dot_x work
3. make sure backward of x_add_x, x_sub_x, x_mul_x, x_div_x work
4. let x_dot_x backward work
* Fix code style
* Now we can pass the tests/compute/test_kernel.py for add/sub/mul/div forward and backward
* Fix mxnet test code
* Add u_dot_v, u_dot_e, v_dot_e unitest.
* Update doc
* Now also support v_dot_u, e_dot_u, e_dot_v
* Add unroll for some loop
* Add some Opt for cuda backward of dot builtin.
Backward is still slow for dot
* Apply UnravelRavel opt for broadcast backward
* update docstring
158 行
3.7 KiB
Python
158 行
3.7 KiB
Python
"""This file defines the unified tensor framework interface required by DGL
|
|
unit testing, other than the ones used in the framework itself.
|
|
"""
|
|
|
|
###############################################################################
|
|
# Tensor, data type and context interfaces
|
|
|
|
def cuda():
|
|
"""Context object for CUDA."""
|
|
pass
|
|
|
|
def is_cuda_available():
|
|
"""Check whether CUDA is available."""
|
|
pass
|
|
|
|
###############################################################################
|
|
# Tensor functions on feature data
|
|
# --------------------------------
|
|
# These functions are performance critical, so it's better to have efficient
|
|
# implementation in each framework.
|
|
|
|
def array_equal(a, b):
|
|
"""Check whether the two tensors are *exactly* equal."""
|
|
pass
|
|
|
|
def allclose(a, b, rtol=1e-4, atol=1e-4):
|
|
"""Check whether the two tensors are numerically close to each other."""
|
|
pass
|
|
|
|
def randn(shape):
|
|
"""Generate a tensor with elements from standard normal distribution."""
|
|
pass
|
|
|
|
def attach_grad(x):
|
|
"""Flag the tensor *in-place* to have its gradient computed in backward
|
|
pass.
|
|
|
|
If the flag is already set, reset the gradient buffer as well.
|
|
"""
|
|
pass
|
|
|
|
def backward(x, head_gradient=None):
|
|
"""Invoke backward computation with an optional head gradient.
|
|
|
|
Returns nothing."""
|
|
pass
|
|
|
|
def grad(x):
|
|
"""Fetches the gradient from the tensor after backward computation."""
|
|
pass
|
|
|
|
def is_no_grad(x):
|
|
"""Check whether a tensor has its gradient computed."""
|
|
pass
|
|
|
|
def full(shape, fill_value, dtype, ctx):
|
|
pass
|
|
|
|
def narrow_row_set(x, start, stop, new):
|
|
"""Set a slice of the given tensor to a new value."""
|
|
pass
|
|
|
|
def sparse_to_numpy(x):
|
|
"""Convert a sparse tensor to a numpy array."""
|
|
pass
|
|
|
|
def clone(x):
|
|
pass
|
|
|
|
def reduce_sum(x):
|
|
"""Sums all the elements into a single scalar."""
|
|
pass
|
|
|
|
def softmax(x, dim):
|
|
"""Softmax Operation on Tensors"""
|
|
pass
|
|
|
|
def spmm(x, y):
|
|
"""Sparse dense matrix multiply"""
|
|
pass
|
|
|
|
def add(a, b):
|
|
"""Compute a + b"""
|
|
pass
|
|
|
|
def sub(a, b):
|
|
"""Compute a - b"""
|
|
pass
|
|
|
|
def mul(a, b):
|
|
"""Compute a * b"""
|
|
pass
|
|
|
|
def div(a, b):
|
|
"""Compute a / b"""
|
|
pass
|
|
|
|
def sum(x, dim):
|
|
"""Computes the sum of array elements over given axes"""
|
|
pass
|
|
|
|
def max(x, dim):
|
|
"""Computes the max of array elements over given axes"""
|
|
pass
|
|
|
|
def min(x, dim):
|
|
"""Computes the min of array elements over given axes"""
|
|
pass
|
|
|
|
def prod(x, dim):
|
|
"""Computes the prod of array elements over given axes"""
|
|
pass
|
|
|
|
def matmul(a, b):
|
|
"""Compute Matrix Multiplication between a and b"""
|
|
pass
|
|
|
|
def dot(a, b):
|
|
"""Compute Dot between a and b"""
|
|
pass
|
|
|
|
###############################################################################
|
|
# Tensor functions used *only* on index tensor
|
|
# ----------------
|
|
# These operators are light-weighted, so it is acceptable to fallback to
|
|
# numpy operators if currently missing in the framework. Ideally in the future,
|
|
# DGL should contain all the operations on index, so this set of operators
|
|
# should be gradually removed.
|
|
|
|
###############################################################################
|
|
# Other interfaces
|
|
# ----------------
|
|
# These are not related to tensors. Some of them are temporary workarounds that
|
|
# should be included in DGL in the future.
|
|
|
|
class record_grad(object):
|
|
"""Context manager that records the gradients"""
|
|
def __init__(self):
|
|
pass
|
|
|
|
def __enter__(self):
|
|
pass
|
|
|
|
def __exit__(self, exc_type, exc_value, exc_traceback):
|
|
pass
|
|
|
|
|
|
class no_grad(object):
|
|
"""Context manager that explicitly disables gradient computation"""
|
|
def __init__(self):
|
|
pass
|
|
|
|
def __enter__(self):
|
|
pass
|
|
|
|
def __exit__(self, exc_type, exc_value, exc_traceback):
|
|
pass
|