SiLU(Sigmoid Linear Unit)

Summary

GELU 다음 나온 activation function
$\text{SiLU}=x\sigma (x)$