diff --git a/docs/doxygen/ie_docs.xml b/docs/doxygen/ie_docs.xml index 1049d4d3283..a6f5dd3250c 100644 --- a/docs/doxygen/ie_docs.xml +++ b/docs/doxygen/ie_docs.xml @@ -234,7 +234,7 @@ limitations under the License. - + diff --git a/docs/ops/activation/Selu_1.md b/docs/ops/activation/Selu_1.md new file mode 100644 index 00000000000..0af534b8f56 --- /dev/null +++ b/docs/ops/activation/Selu_1.md @@ -0,0 +1,71 @@ +## Selu {#openvino_docs_ops_activation_Selu_1} + +**Versioned name**: *Selu-1* + +**Category**: *Activation function* + +**Short description**: *Selu* is a scaled exponential linear unit element-wise activation function. + +**Detailed Description** + +*Selu* operation is introduced in this [article](https://arxiv.org/abs/1706.02515), as activation function for self-normalizing neural networks (SNNs). + +*Selu* performs element-wise activation function on a given input tensor `data`, based on the following mathematical formula: + +\f[ +Selu(x) = \lambda \left\{\begin{array}{r} + x \quad \mbox{if } x > 0 \\ + \alpha(e^{x} - 1) \quad \mbox{if } x \le 0 +\end{array}\right. +\f] + +where α and λ correspond to inputs `alpha` and `lambda` respectively. + +Another mathematical representation that may be found in other references: + +\f[ +Selu(x) = \lambda\cdot\big(\max(0, x) + \min(0, \alpha(e^{x}-1))\big) +\f] + +**Attributes**: *Selu* operation has no attributes. + +**Inputs** + +* **1**: `data`. A tensor of type `T` and arbitrary shape. **Required.** + +* **2**: `alpha`. 1D tensor with one element of type `T`. **Required.** + +* **3**: `lambda`. 1D tensor with one element of type `T`. **Required.** + +**Outputs** + +* **1**: The result of element-wise *Selu* function applied to `data` input tensor. A tensor of type `T` and the same shape as `data` input tensor. + +**Types** + +* *T*: arbitrary supported floating-point type. + +**Example** + +```xml + + + + 256 + 56 + + + 1 + + + 1 + + + + + 256 + 56 + + + +``` diff --git a/docs/ops/arithmetic/Selu_1.md b/docs/ops/arithmetic/Selu_1.md deleted file mode 100644 index 8d69d13fbf2..00000000000 --- a/docs/ops/arithmetic/Selu_1.md +++ /dev/null @@ -1,65 +0,0 @@ -## Selu {#openvino_docs_ops_arithmetic_Selu_1} - -**Versioned name**: *Selu-1* - -**Category**: Arithmetic unary operation - -**Short description**: *Selu* calculates the SELU activation function (https://arxiv.org/abs/1706.02515) element-wise with given tensor. - -**Detailed Description** - -For each element from the input tensor calculates corresponding -element in the output tensor with the following formula: -\f[ -selu(x) = \lambda \left\{\begin{array}{ll} - \alpha(e^{x} - 1) \quad \mbox{if } x \le 0 \\ - x \quad \mbox{if } x > 0 -\end{array}\right. -\f] - -**Attributes**: - - No attributes available. - -**Inputs** - -* **1**: An tensor of type T. **Required.** - -* **2**: `alpha` 1D tensor with one element of type T. **Required.** - -* **3**: `lambda` 1D tensor with one element of type T. **Required.** - -**Outputs** - -* **1**: The result of element-wise operation. A tensor of type T. - -**Types** - -* *T*: any supported floating point type. - -**Examples** - -*Example 1* - -```xml - - - - 256 - 56 - - - 1 - - - 1 - - - - - 256 - 56 - - - -``` \ No newline at end of file diff --git a/docs/ops/opset1.md b/docs/ops/opset1.md index 73da245d2dc..eec109ad9c3 100644 --- a/docs/ops/opset1.md +++ b/docs/ops/opset1.md @@ -93,7 +93,7 @@ declared in `namespace opset1`. * [Result](infrastructure/Result_1.md) * [ReverseSequence](movement/ReverseSequence_1.md) * [Select](condition/Select_1.md) -* [Selu](arithmetic/Selu_1.md) +* [Selu](activation/Selu_1.md) * [ShapeOf](shape/ShapeOf_1.md) * [Sigmoid](activation/Sigmoid_1.md) * [Sign](arithmetic/Sign_1.md) diff --git a/docs/ops/opset2.md b/docs/ops/opset2.md index bfee6cee9c4..67c51385a78 100644 --- a/docs/ops/opset2.md +++ b/docs/ops/opset2.md @@ -98,7 +98,7 @@ declared in `namespace opset2`. * [ReverseSequence](movement/ReverseSequence_1.md) * [ROIPooling](detection/ROIPooling_1.md) * [Select](condition/Select_1.md) -* [Selu](arithmetic/Selu_1.md) +* [Selu](activation/Selu_1.md) * [ShapeOf](shape/ShapeOf_1.md) * [Sigmoid](activation/Sigmoid_1.md) * [Sign](arithmetic/Sign_1.md) diff --git a/docs/ops/opset3.md b/docs/ops/opset3.md index e36d4be27c5..52af67efc0f 100644 --- a/docs/ops/opset3.md +++ b/docs/ops/opset3.md @@ -113,7 +113,7 @@ declared in `namespace opset3`. * [ScatterElementsUpdate](movement/ScatterElementsUpdate_3.md) * [ScatterUpdate](movement/ScatterUpdate_3.md) * [Select](condition/Select_1.md) -* [Selu](arithmetic/Selu_1.md) +* [Selu](activation/Selu_1.md) * [ShapeOf](shape/ShapeOf_3.md) * [ShuffleChannels](movement/ShuffleChannels_1.md) * [Sigmoid](activation/Sigmoid_1.md) diff --git a/docs/ops/opset4.md b/docs/ops/opset4.md index 709319f0640..71607453ee9 100644 --- a/docs/ops/opset4.md +++ b/docs/ops/opset4.md @@ -121,7 +121,7 @@ declared in `namespace opset4`. * [ScatterNDUpdate](movement/ScatterNDUpdate_3.md) * [ScatterUpdate](movement/ScatterUpdate_3.md) * [Select](condition/Select_1.md) -* [Selu](arithmetic/Selu_1.md) +* [Selu](activation/Selu_1.md) * [ShapeOf](shape/ShapeOf_3.md) * [ShuffleChannels](movement/ShuffleChannels_1.md) * [Sigmoid](activation/Sigmoid_1.md) diff --git a/docs/ops/opset5.md b/docs/ops/opset5.md index 7db25f894d5..6c79caca19b 100644 --- a/docs/ops/opset5.md +++ b/docs/ops/opset5.md @@ -129,7 +129,7 @@ declared in `namespace opset5`. * [ScatterNDUpdate](movement/ScatterNDUpdate_3.md) * [ScatterUpdate](movement/ScatterUpdate_3.md) * [Select](condition/Select_1.md) -* [Selu](arithmetic/Selu_1.md) +* [Selu](activation/Selu_1.md) * [ShapeOf](shape/ShapeOf_3.md) * [ShuffleChannels](movement/ShuffleChannels_1.md) * [Sigmoid](activation/Sigmoid_1.md) diff --git a/docs/ops/opset6.md b/docs/ops/opset6.md index dbe17d46861..92deb4a6fbe 100644 --- a/docs/ops/opset6.md +++ b/docs/ops/opset6.md @@ -135,7 +135,7 @@ declared in `namespace opset6`. * [ScatterNDUpdate](movement/ScatterNDUpdate_3.md) * [ScatterUpdate](movement/ScatterUpdate_3.md) * [Select](condition/Select_1.md) -* [Selu](arithmetic/Selu_1.md) +* [Selu](activation/Selu_1.md) * [ShapeOf](shape/ShapeOf_3.md) * [ShuffleChannels](movement/ShuffleChannels_1.md) * [Sigmoid](activation/Sigmoid_1.md) diff --git a/docs/ops/opset7.md b/docs/ops/opset7.md index 242b1e029cf..c04b90e81a0 100644 --- a/docs/ops/opset7.md +++ b/docs/ops/opset7.md @@ -138,7 +138,7 @@ declared in `namespace opset7`. * [ScatterNDUpdate](movement/ScatterNDUpdate_3.md) * [ScatterUpdate](movement/ScatterUpdate_3.md) * [Select](condition/Select_1.md) -* [Selu](arithmetic/Selu_1.md) +* [Selu](activation/Selu_1.md) * [ShapeOf](shape/ShapeOf_3.md) * [ShuffleChannels](movement/ShuffleChannels_1.md) * [Sigmoid](activation/Sigmoid_1.md)