1.2 KiB
1.2 KiB
HSwish
@sphinxdirective
Versioned name: HSwish-4
Category: Activation function
Short description: HSwish takes one input tensor and produces output tensor where the hard version of swish function is applied to the tensor elementwise.
Detailed description: For each element from the input tensor calculates corresponding element in the output tensor with the following formula:
.. math::
HSwish(x) = x \cdot \frac{min(max(x + 3,\ 0),\ 6)}{6}
The HSwish operation is introduced in the following article <https://arxiv.org/pdf/1905.02244.pdf>__.
Attributes: operation has no attributes.
Inputs:
- 1: Multidimensional input tensor of type T. Required.
Outputs:
- 1: The resulting tensor of the same shape and type as input tensor.
Types
- T: arbitrary supported floating-point type.
Example
.. code-block:: cpp
<layer ... type="HSwish"> 256 56 256 56
@endsphinxdirective