dmlc--dgl
Hongzhi (Steve), Chen
23d09057e3
* [Misc] Black auto fix. * sort Co-authored-by: Steve <ubuntu@ip-172-31-34-29.ap-northeast-1.compute.internal>
10 行
183 B
Python
10 行
183 B
Python
import torch
|
|
|
|
|
|
def swish(x):
|
|
"""
|
|
Swish activation function,
|
|
from Ramachandran, Zopf, Le 2017. "Searching for Activation Functions"
|
|
"""
|
|
return x * torch.sigmoid(x)
|