2020-07-20 17:36:08 +03:00
|
|
|
|
## Elu<a name="Elu"></a> {#openvino_docs_ops_activation_Elu_1}
|
2020-06-19 14:39:57 +03:00
|
|
|
|
|
|
|
|
|
|
**Versioned name**: *Elu-1*
|
|
|
|
|
|
|
|
|
|
|
|
**Category**: *Activation function*
|
|
|
|
|
|
|
|
|
|
|
|
**Short description**: Exponential linear unit element-wise activation function.
|
|
|
|
|
|
|
|
|
|
|
|
**Detailed Description**
|
|
|
|
|
|
|
2021-03-31 17:41:46 +02:00
|
|
|
|
*Elu* operation is introduced in this [article](https://arxiv.org/abs/1511.07289v3).
|
|
|
|
|
|
It performs element-wise activation function on a given input tensor, based on the following mathematical formula:
|
|
|
|
|
|
|
2020-06-19 14:39:57 +03:00
|
|
|
|
\f[
|
2021-03-31 17:41:46 +02:00
|
|
|
|
Elu(x) = \left\{\begin{array}{r}
|
|
|
|
|
|
x \qquad \mbox{if } x > 0 \\
|
|
|
|
|
|
\alpha(e^{x} - 1) \quad \mbox{if } x \leq 0
|
2020-06-19 14:39:57 +03:00
|
|
|
|
\end{array}\right.
|
|
|
|
|
|
\f]
|
|
|
|
|
|
|
2021-03-31 17:41:46 +02:00
|
|
|
|
where α corresponds to *alpha* attribute.
|
|
|
|
|
|
|
2021-07-02 12:51:00 +02:00
|
|
|
|
*Elu* is equivalent to *ReLU* operation when *alpha* is equal to zero.
|
2021-03-31 17:41:46 +02:00
|
|
|
|
|
2020-06-19 14:39:57 +03:00
|
|
|
|
**Attributes**
|
|
|
|
|
|
|
|
|
|
|
|
* *alpha*
|
|
|
|
|
|
|
|
|
|
|
|
* **Description**: scale for the negative factor
|
2021-03-31 17:41:46 +02:00
|
|
|
|
* **Range of values**: non-negative arbitrary floating-point number
|
|
|
|
|
|
* **Type**: `float`
|
2020-06-19 14:39:57 +03:00
|
|
|
|
* **Required**: *yes*
|
|
|
|
|
|
|
|
|
|
|
|
**Inputs**:
|
|
|
|
|
|
|
2021-07-15 09:17:23 +02:00
|
|
|
|
* **1**: A tensor of type *T* and arbitrary shape. **Required.**
|
2020-06-19 14:39:57 +03:00
|
|
|
|
|
|
|
|
|
|
**Outputs**:
|
|
|
|
|
|
|
2021-07-02 12:51:00 +02:00
|
|
|
|
* **1**: The result of element-wise *Elu* function applied to the input tensor. A tensor of type *T* and the same shape as input tensor.
|
2021-03-31 17:41:46 +02:00
|
|
|
|
|
|
|
|
|
|
**Types**
|
|
|
|
|
|
|
|
|
|
|
|
* *T*: arbitrary supported floating-point type.
|
|
|
|
|
|
|
|
|
|
|
|
**Example**
|
|
|
|
|
|
|
|
|
|
|
|
```xml
|
|
|
|
|
|
<layer ... type="Elu">
|
|
|
|
|
|
<data alpha="1.0"/>
|
|
|
|
|
|
<input>
|
|
|
|
|
|
<port id="0">
|
|
|
|
|
|
<dim>1</dim>
|
|
|
|
|
|
<dim>128</dim>
|
|
|
|
|
|
</port>
|
|
|
|
|
|
</input>
|
|
|
|
|
|
<output>
|
|
|
|
|
|
<port id="1">
|
|
|
|
|
|
<dim>1</dim>
|
|
|
|
|
|
<dim>128</dim>
|
|
|
|
|
|
</port>
|
|
|
|
|
|
</output>
|
|
|
|
|
|
</layer>
|
|
|
|
|
|
```
|