Piotr Szmelczynski
0c373ba79b
* remove relu_backprop * Update ReLU spec * change inputs and outputs subsections of ReLU spec * Update Mathematical Formulation subsection * Update Category of ReLU in spec * Update Short description of ReLU in spec
47 lines
1.2 KiB
Markdown
47 lines
1.2 KiB
Markdown
## ReLU <a name="ReLU"></a> {#openvino_docs_ops_activation_ReLU_1}
|
|
|
|
**Versioned name**: *ReLU-1*
|
|
|
|
**Category**: *Activation function*
|
|
|
|
**Short description**: ReLU element-wise activation function. ([Reference](http://caffe.berkeleyvision.org/tutorial/layers/relu.html))
|
|
|
|
**Detailed description**: [Reference](https://github.com/Kulbear/deep-learning-nano-foundation/wiki/ReLU-and-Softmax-Activation-Functions#rectified-linear-units)
|
|
|
|
**Attributes**: *ReLU* operation has no attributes.
|
|
|
|
**Mathematical Formulation**
|
|
|
|
For each element from the input tensor calculates corresponding
|
|
element in the output tensor with the following formula:
|
|
\f[
|
|
Y_{i}^{( l )} = max(0, Y_{i}^{( l - 1 )})
|
|
\f]
|
|
|
|
**Inputs**:
|
|
|
|
* **1**: Multidimensional input tensor *x* of any supported numeric type. Required.
|
|
|
|
**Outputs**:
|
|
|
|
* **1**: Result of ReLU function applied to the input tensor *x*. Tensor with shape and type matching the input tensor. Required.
|
|
|
|
**Example**
|
|
|
|
```xml
|
|
<layer ... type="ReLU">
|
|
<input>
|
|
<port id="0">
|
|
<dim>256</dim>
|
|
<dim>56</dim>
|
|
</port>
|
|
</input>
|
|
<output>
|
|
<port id="1">
|
|
<dim>256</dim>
|
|
<dim>56</dim>
|
|
</port>
|
|
</output>
|
|
</layer>
|
|
|
|
``` |