* Regolden graphsage example to guide others
* update golden
* update
* Update example and propagate to original folder
* Update to remove ^M (windows DOS) character
* update
* Merge file changes and update README
* Minor comment update
Co-authored-by: Minjie Wang <wmjlyjemaine@gmail.com>
Co-authored-by: Mufei Li <mufeili1996@gmail.com>
* * Workaround for graph data saving/loading compatibility problem in Column class. There may be more places in DGL with the same issue, due to using Python serialization, instead of a more cohesive, comprehensive strategy. This is just a local fix.
* Add checking for non-empty states
* Add unit test
* Handle the case of columns without storage
Co-authored-by: ndickson <ndickson@nvidia.com>
Co-authored-by: Xin Yao <xiny@nvidia.com>
* code changes for bug fixes identified during mag_lsc dataset
1. Changed from call torch.Tensor() to torch.from_numpy() to address memory corruption issues when creating large tensors. Tricky thing is this works correctly for small tensors.
2. Changed dgl.graph() function call to include 'num_nodes" argument to specifically mention all the nodes in a graph partition.
* Update convert_partition.py
Moving the changes to the function "create_metadata_json" function to the "multiple-file-format" support, where this change is more appropriate. Since multiple machine testing was done with these code changes.
* Addressing review comments.
Removed space as suggested at the end of the line
* Update nccl communicator for when NCCL is missing
* Use static_cast
* Add doc string
* Fix whitespace
* Resrtict unit test to GPU runs
Co-authored-by: Xin Yao <xiny@nvidia.com>
* * Added missing specializations for `__half` of `DLDataTypeTraits`, `IndexSelect`, `Full`, `Scatter_`, `CSRGetData`, `CSRMM`, `CSRSum`, `IndexSelectCPUFromGPU`
* Fixed casting issue in `_LinearSearchKernel` that was preventing it from supporting `__half`
* Added `#if`'d out specializations of `CSRGEMM`, `CSRGEAM`, and `Xgeam`, which would require functions that aren't currently provided by cublas
* * Added more specific error messages for unimplemented FP16 specializations of Xgeam, CSRGEMM, and CSRGEAM
* * Added missing instantiation of DLDataTypeTraits<__half>::dtype
* * Fixed linter error
* Added clearer comment explaining why the cast to long long is necessary
* * Worked around a compile error in some particular setup, where __half can't be constructed on the host side
* * Fixed linter formatting errors
* * Changes to comments as recommended
* * Made recommended changes to logging errors in FP16 specializations
* Also changed the existing Xgeam function for unsupported data types from LOG(INFO) to LOG(FATAL)
* [Dist] enable USE_EPOLL in default
* fix build issue on windows
* fix build issue on windows
* fix build issue on windows
* fix build issue on windows
* fix build issue on windows
* fix build issue
* Add uva by default to embedding
* More updates
* Update optimizer
* Add new uva functions
* Expose new pinned memory function
* Add unit tests
* Update formatting
* Fix unit test
* Handle auto UVA case when training is on CPU
* Allow per-embedding decisions for whether to use UVA
* Address spares_optim.py comments
* Remove unused templates
* Update unit test
* Use dgl allocate memory for pinning
* allow automatically unpin
* workaround for d2h copy with a different dtype
* fix linting
* update error message
* update copyright
Co-authored-by: Xin Yao <xiny@nvidia.com>
Co-authored-by: Minjie Wang <wmjlyjemaine@gmail.com>
* Remove all torchtext legacy-related APIs
* Remove unused BagOfWordsPretrained class, and fix some typos
Co-authored-by: Mufei Li <mufeili1996@gmail.com>
* Explicitly unpin tensoradapter allocated arrays
* Undo unrelated change
* Add unit test
* update unit test
* add pinned_by_dgl flag to NDArray::Container
* use dgl.ndarray for holding the pinning status
* update multi-gpu uva inference
* reinterpret cast NDArray::Container* to DLTensor* in MoveAsDLTensor
* update unpin column and examples
* add unit test for unpin column
Co-authored-by: Dominique LaSalle <dlasalle@nvidia.com>
Co-authored-by: nv-dlasalle <63612878+nv-dlasalle@users.noreply.github.com>
* Fix a cub compile error for CUDA 11.5
* Fix comparison of integer expressions of different signedness in coo_sort.cu file
* Fix comparison of integer expressions of different signedness in cuda_compact_graph.cu file
* Remove never referenced variable in spmm.cu
* Fix comparison of integer expressions of different signedness in rowwise_pick.h file
* Fix comparison of integer expressions of different signedness in choice.cc file
* Remove never referenced variable col_data in spat_op_impl_coo.cc
* Remove never referenced variable allowed in global_uniform.cc
* Fix comparison of integer expressions of different signedness in graph.cc
* Fix comparison of integer expressions of different signedness in graph_apis.cc
* Fix the un-used ctx variable in ndarray_partition.cc file for cpu only build
* Fix comparison of integer expressions of different signedness in libra_partition.cc
* Fix comparison of integer expressions of different signedness in graph_op.cc
Co-authored-by: Triston Cao <tristonc@nvidia.com>
Co-authored-by: Quan (Andy) Gan <coin2028@hotmail.com>
* fix unstable sort
* add torch version check
* reformat
* split too long comments
* Update dataloader.py
Co-authored-by: Quan (Andy) Gan <coin2028@hotmail.com>
* * Added functions from dgl.transforms.functional that were missing from the list for documentation in dgl.rst
* * Sorted transform ops list in dgl.rst in alphabetical order
Co-authored-by: Xin Yao <xiny@nvidia.com>
* Fix fail to create_shared_mem_array in ddp spawn train #4110
Fix fail to create_shared_mem_array in ddp spawn train #4110
* [Bugfix] Fix fail to create_shared_mem_array in ddp spawn train #4110
[Bugfix] Fix fail to create_shared_mem_array in ddp spawn train #4110
Replace random.seed() to random_ = random.Random()
* Update pytorch.py
Co-authored-by: Quan (Andy) Gan <coin2028@hotmail.com>
* add argument reorder=False for citation_graph
* add description of the argument reorder
* add reordered/un_reordered save_path
* add version number postfix
Co-authored-by: Mufei Li <mufeili1996@gmail.com>
* Wrap all CUDA runtime API/CUB calls with macro
* remove the usage of explicit cudaMalloc in favor of AllocWorkspace
* fix typo
Co-authored-by: Israt Nisa <neesha295@gmail.com>
Chang Liu