GELU
Apply the Gaussian error linear unit, element-wise.
class GELU : Module— python/vkml/nn.py:319
A stateless wrapper: forward calls gelu and nothing else. It exists so the activation can sit inside a Sequential. See gelu for the numerical behaviour, which is where the substance is.
Forward¶
forward¶
def forwardself, x: V.Tensor -> V.Tensor— python/vkml/nn.py:320
See also gelu, Sequential